Case studies from across industries, domains and Bitwise solutions
Automate ETL from DataStage to Microsoft SSIS
Case Study Summary
Bitwise helped a large, US Insurance company successfully migrate their Data Integration (ETL) platform from DataStage to Microsoft SSIS. The first and primary step in this migration was to complete the inventory analysis, and then scope the exact ETL jobs to be migrated. The approach included a collaborative effort with client teams and the STIMA utility (an automated assessment tool put together by Bitwise), which helped in laying the foundation for the ETL Converter by analyzing the items below:
- Complexity definition of each ETL job
- Identification of common features across all the ETL jobs
The Bitwise ETL Converter is customized based on the information captured that makes the automation highly cost-effective in terms of reducing the overall development efforts. The converter is additionally bundled with Data Validation automation that enormously reduces the turn-around time to productionalize the new solution.
The Client
A NASDAQ listed, $6 Billion company, providing affordable Insurance products across United States since 1925 with more than 5 million customer base.
The Challenge
The client had to move their entire data integration platform from IBM DataStage to Microsoft SSIS, covering the following aspects:
- Development of the SSIS ETLs after analyzing the original DataStage jobs
- Unit testing, which involved the extensive field level comparison of DataStage outputs against those generated by newly developed SSIS ETLs
- System integration and performance testing
- Deployment to stage environment followed by production environment
All of the above aspects had to be covered for about 700 Datastage jobs spread across 22 subject areas within the fixed timeline of 4 months to avoid Datastage license renewal. The jobs were of varied complexity with 42% jobs in the Medium-to-Complex category.