Login Register

Reduced Data Processing Time by 40%

January 10, 2023 omkarnathvaranasi
Client: American Express
Tools Used: SQL, Data Warehouse, Jira
Description

Eliminated hundreds of legacy stored procedures in Amex's collections data pipeline.

The Challenge

As Amex was going through an enterprise datawarehouse migration, the legacy stored procedures that fetched data into the Collections platform were old and outdated and we needed to rearchitect

What I Did

Reverse-engineered business logic, partnered with QA and Data Engineering, and replaced over 60% of procedures with reusable views and parameterized queries.

The Impact

Data refactoring is not glamorous — but it unlocks speed, safety, and sanity

What I Learned

Cut nightly processing time by 40%. Reduced maintenance time by ~8 hours/month for data team.

Added on April 20, 2025 at 04:04