Data Migration ETL using SSIS

Collaborated on an asynchronous ETL application (Extract Transform Load) to routinely migrate financial transactions for a government entity handling statewide financial data

Features:

  • Orchestrated multiple SSIS packages to asynchronously migrate ~1M financial and transactional records daily
  • Indexed relevant columns and followed best practices in table normalization to optimize query performance
  • Configured Change-Data-Capture (CDC) to monitor data changes and replace existing triggers impacting performance
  • Created user functions and staging tables to accommodate time zone differences in UTC and to track changes
  • Collaborated with Database Administrators to implement High Availability and Disaster Recovery (HADR) redundancy