Worldpay, global leader in financial services technology, invested millions of dollars building applications to help business leaders better understand and leverage the massive amount of data the company was processing. However, the initial adoption rates for these applications fell short of expectations. Word got out that the resulting reports weren’t entirely accurate, and this understandably curbed adoption.
The organization’s QA leaders were given the challenge of “fixing this problem” by transforming the end-to-end data testing process—just as they had recently transformed the organization’s end-to-end application testing process. Based on that experience, they recognized that they not only needed to introduce new technology for test automation, but also transform people and processes to ensure that the new approach was well-adopted, scalable, and sustainable.
The QA leaders designed and drove an initiative to automate testing across all layers of the BI flow– Ingestion, transformation, data mart, and reporting. After evaluating the available tools, they selected Tricentis Tosca, and designed a rapid rollout with minimal disruption to the many “in-flight” projects they were responsible for testing.
In just a few months, they were up and running with end-to-end regression testing that automatically tests data as it flows through the various ingestion and transformation layers—including data validation, data profiling, and checking data accuracy, integrity, and completeness. This was accomplished by the QA team creating a core set of reusable, scalable tests …without wrestling with SQL or scripting. Using this automated test suite, billions of rows are automatically reconciled, even with constantly changing sources. Not surprisingly, this high degree of automation has dramatically increased their testing scope while slashing testing time and costs.
“A few months after our new BI/data warehouse testing approach launched, people finally started trusting the applications. They’re highly used now, and they have become a vital tool in making critical business decisions.” — Head of Enterprise Quality Assurance Team