DiGrazia’s test automation philosophy is based on the typical test automation pyramid. “Years ago, Tricentis came up with a nice charter about the pyramid that I use all the time because it shows where you want to make the heavy investment on your API level and unit testing and then make sure that you can get the right amount of UI testing that’s going to provide that return on investment. That’s how we’ve been able to operate fast for all of our test automation.”
Wolters Kluwer uses an open-source framework that integrates with an in-house tool and BlazeMeter for performance. For testing, the organization used everything from manual spreadsheets to Word documents to tools such as Jama. It needed a test management solution to keep all the testing sources unified and centralized and to start adding more test automation.
Wolters Kluwer selected qTest for its test management solution to maintain visibility and control across a diverse test automation toolset. The team uses qTest to orchestrate automated testing and to standardize, centralize, and scale testing best practices across the enterprise.
With this unified approach, the team has achieved 100% automation at the UI and API levels for its core platform applications. For many others, their automation rates range from 30% to 60%, with a focus on repeatability to maximize their ROI.
“We focus automation on some of those highly matrixed and repeatable types of regression tests. That ensures we can free humans up for finding the negative test cases, and then we can get through our test cycles more quickly without having this massive regression burden,” said DiGrazia.
“qTest is where we drive all our testing metrics from in terms of test execution, test development, and percent of automated tests. We leverage the qTest APIs to feed all that data into an internally home-grown tool married with Jira. We have a full picture of tests run and what the quality is on the other side,” said DiGrazia.
Wolters Kluwer has invested in training to instill consistency across its divisions, but DiGrazia said, “There is no way that we could scale if we didn’t have some of the tools like qTest.”