CompilerWorks is now part of Google Cloud

Cloud Data Warehouse Accelerating Data Engineering and Cloud Transformation at ABN AMRO Bank

ABN AMRO Bank N.V. is the third-largest bank in the Netherlands. Headquartered in Amsterdam, it provides financial services to more than a quarter of the Dutch population. The bank employs 19,000 people and has over $465.8 billion in assets. 

In 2019, ABM AMRO began an IT digital transformation and modernization project to grow the number of teams working in the cloud. The project included migrating a 90TB on-premise appliance-based Teradata enterprise data warehouse (EDW) to Microsoft Azure.

The data warehouse migration from Teradata EDW to Azure Data Factory’s (ADF) platform as a service (PaaS) architecture promised to optimize costs. It was also a hedge against a looming 2021 end-of-support deadline for the Teradata appliance. 

Regulatory Constraints Delay Migration Deadline

The bank identified 62 end-user groups using the Teradata EDW and asked them to re-engineer their workloads on Azure as part of the data platform modernization project. Unfortunately, many of the workloads were over ten years old and involved critical business logic with little, if any, documentation. 

The prospect of rewriting complex code from scratch was daunting. A significant number of the workloads were risk models used by the bank to satisfy data governance regulations such as Basel III/IV, ECB, DCB, AFM, and GDPR. 

Any changes to the highly regulated business logic would require regulators to re-validate the models: a time-consuming process that would delay the cloud transformation project. 

CompilerWorks Slashes Time to Re-Engineer Business Logic

ABM AMRO turned to CompilerWorks for help. Using a combination of CompilerWorks Lineage and Transpiler solutions, the bank’s DevOps teams extracted the business logic used by risk models and recreated the workloads on Azure’s cloud data warehouse. 

An on-screen comparison of the Teradata and Azure datasets demonstrated to regulators that both platforms were using the same business logic, eliminating the need to re-validate the models.

Using CompilerWorks Lineage and Transpiler solutions enabled the bank to condense four years’ development work into one year. Through an automated migration, critical workloads were successfully moved to Azure on schedule, reducing EDW’s total cost of ownership (TCO) by more than 10 million euros ($12 million) per year.

In addition to financial benefits, CompilerWorks brought clarity to ABM AMRO’s re-engineering efforts. IT teams and end-user groups acquired a much deeper understanding of the business logic used in their risk models. Retiring their Teradata EDW on schedule enabled the bank to adopt a modern cloud-based data architecture years earlier than would otherwise have been possible.

Decentralized Data Models and Improved Compliance

For the future, ABN AMRO anticipates providing end-user groups from across the enterprise access to data through a self-service data marketplace. The marketplace will include information such as data quality, ownership, and lineage over time letting data consumers prove internal and external compliance at any point.

The bank also has plans to use CompilerWorks Transpiler to support future cloud database migrations. Transpiler will let users compare translated code in different SQL dialects and perform risk assessments before migrating to a new platform.

ABM AMRO Bank key outcomes:

  • Migrate workflows from Informatica PowerCenter to Azure Data Factory pipeline
  • Slash migration time and enable user groups to meet target completion dates 
  • Enable nearly $12 million per year in IT CAPEX/OPEX savings 
  • Provide upstream and downstream automated lineage transparency 
  • Achieve one-to-one transpilation from Teradata SQL to Azure SQL 
  • Simplify data architecture by identifying unused data and resources 
  • Bring clarity to business logic, streamlining regulatory compliance through automation
  • Save time, reduce cost, and hedge risk for large-scale data pipeline migrations

Find out more about how ABN AMRO Bank uses CompilerWorks Lineage and Transpiler solutions to accelerate cloud transformation, reduce costs, and maintain regulatory compliance. Read the full customer success story here.