Future-Proofing Testing for Continuously Accelerating Release Cycles
Tricentis supports a number of large enterprises in the financial industry, including one of Europe’s largest insurance providers in Europe. This Swiss-based organization provides insurance solutions and other banking and financial services to its core markets in Switzerland, Germany, Belgium and Luxembourg. Recognizing the changing business landscape and customer expectations around them, our customer recently rolled out a transformative strategy that will take the company from that of a traditional insurance provider to one that delivers a suite of innovative digital services.
As our customer looks to maintain market share and avoid disruption, one vital component of their digital transformation is ensuring that their software is consistently of a high quality, and that it meets or, ideally, exceeds users’ expectations. In order to achieve this, this organization’s testing teams knew that a modern approach to test automation would be required. As they evaluated which tooling would best fit their needs, they looked for a solution that would not only be easy to use, and effective at meeting their current rate of deployment, but one that would also scale to the increased release velocities on the horizon.
Tricentis Tosca was ultimately selected and has given the company a strategic, “future-proof” enabler for delivering high-quality software within continuously accelerating release cycles.
Traditional Automation Proves Insufficient—Again
Before discovering Tricentis, our customer had traditional automation technologies and practices in place to accelerate the execution of their functional regression testing. But as they looked to accelerate the delivery of the software their customers depended on most, commonly-found shortcomings of legacy automation solutions came to light. “It was costing us more time and money to keep our test scripts in line with each new release candidate,” said the company’s Quality Assurance leader.
Test automation has been a critical component of enterprise systems for years, but as enterprises are required to introduce changes to their applications more frequently, many traditional automation tools create what’s known as the “maintenance trap.” Test cases are able to be executed automatically but require extensive manual scripting efforts in order to be maintained. These manual efforts prevent end-to-end testing within modern-day release cycles, often result in flaky, brittle tests, and require testers to have extensive coding skills, or taking developers off of writing new code to aid test efforts.
“We knew that we needed to increase our defect detection rates within our regression tests in order to keep those defects out of production,” said the QA leader. “It was clear that continuing to rely on our developers and technical resources to manually script test cases would only continue to result in insufficient scalability of both quality and speed.”
The Search for a “Future-proof” Test Automation Solution
The company conducted a formal RFP with several testing vendors and required that they prove their solution’s ability to fully support one of their most complex applications.
“It was really important that the solution we went with didn’t just support our current needs, but that it would be “future-proof.” Meaning, our chosen solution would provide the same ease-of-use and maintainability when we’re releasing three times as fast as we are today. Tricentis Tosca was the clear choice for us and continues to contribute to meeting the company’s organization-wide business goals.”
As the cloud’s #1 Continuous Testing platform, Tricentis Tosca provides a model-based, scriptless approach to test automation that eliminates the need for coding expertise. By lowering the barrier to entry, test automation is simplified, allowing any tester or business user to quickly and easily create and execute tests, and share valuable feedback to the business. “What Tricentis Tosca has provided for us is ‘automated validation’ on top of valuable human interaction, says our customer. “By automating the repetitive tasks that dull the skills and contributions of our testers, those teams can focus on what they’re best at—really intelligent work that contributes so much to our products.”
Today’s Successes and Tomorrow’s Goals
Our customer soon realized a number of benefits commonly found shortly after adopting Tricentis Tosca. One of their biggest needs was to quickly reduce constraints around maintenance. Eliminating these constraints not only dramatically reduced their maintenance overhead costs, code coverage saw an equally impressive improvement. With a previous regression test suite of 117 test cases, the company leveraged Tricentis Tosca’s Test Case Design to increase the scope of their suite to more than 1,000 new test cases. Furthermore, this 9x larger test suite is able to be run on a weekly basis, where it previously ran only once a month.
Today, our customer’s automation team looks each week at the defects found by manual tests to evaluate whether they could’ve been found through automation—given that automated tests are now so easy to create and maintain. In order to reach true Continuous Testing, our customer is working toward fully-automated regression testing after every deployment. To make this possible, the company is currently setting up distributed execution so an even greater number of tests can be run in parallel alongside those which run on their local machines.
“We’ve made significant improvements in so many of our initiatives; it’s hard to choose any one percentage to best represent what we’ve achieved with Tricentis Tosca,” says our customer. “What I’m really looking to do now is to make sure the rest of our organization is aware of many of the new contributions our testers are making, so they get the appreciation they fully deserve.”