reduction in regression testing time
reduction in test cases
As one of the world’s largest online retailers, the company is a Fortune 100 mainstay and in the top five of the largest and most dominant technology companies in the United States. Besides e-commerce, its business interests include cloud computing, digital streaming, and artificial intelligence, plus over 40 subsidiaries including a supermarket and a home automation system.
During the pandemic, the online retailer saw its profits more than triple as consumers shifted their spending from physical stores to online shopping and at-home delivery. To meet this demand, the online retailer rapidly expanded its real estate footprint, including fulfillment centers, warehouses, office spaces, and transportation centers.
The online retailer’s accounting division oversees the hundreds of corporate leases for all its properties. To manage its extensive facilities operations, the accounting team uses IBM TRIRIGA, a web-based application designed for integrated workplace management systems (IWMS). The application uses data and AI to help organizations with space planning, service requests, room bookings, and other property needs.
The usage of IBM TRIRIGA – along with the number of customizations that needed to be developed – had increased due to the growing number of properties, and the online retailer needed a more efficient way to ensure the application’s reliability as it scaled. But even though the online retailer had been using IBM TRIRIGA for over ten years, minimal testing was conducted on the application during that time. If testing was done, it was manual, which led to bottlenecks and slower release cycles.
It is critical to test IBM TRIRIGA because the application is heavily customized and integrated with other core business systems, and there is a high possibility that each release may contain bugs that could severely impact the business. For example, every corporate lease contains Payment Line Items (PLIs). These are the fine details of the payments that must be made towards a lease for the lease’s lifetime. Suppose any of the calculations that generate these PLIs are off by a single decimal place. Missing this error could result in a significant over/under payment – like a $3 million payment on a $300,000 lease.
A new head of IT realized there had to be a better way to test IBM TRIRIGA and did an online search for test automation tools. The executive looked at other tools, such as UFT and PeopleSoft, before discovering Tricentis Tosca. Tosca was selected because of its codeless, AI-powered approach to end-to-end testing.
The IBM TRIRIGA application immediately presented challenges for automation because of the way it is built, and because the online retailer had heavily customized it.
IBM TRIRIGA does not allow multiple users to access the application simultaneously. This rule severely impacts testing time since it makes it impossible for manual testers to run several test cases in parallel. Tricentis Tosca resolved this problem by automating the user creation process with no limits on the number of users.
The online retailer leveraged these Tricentis Tosca features to automate testing:
The online retailer now has a comprehensive automated testing process in place for IBM TRIRIGA. It is able to release higher quality customizations, smoothly run its facilities operations, and significantly reduce the risks to the business. By automating testing of IBM TRIRIGA, the online retailer has now:
Manual testing of IBM TRIRIGA used to take a team of four people six months to complete. Using Tricentis Tosca, total test cycle time has been dramatically reduced to only 3.5 hours. By leveraging Tricentis’ risk-based testing approach, which focuses on maximizing test coverage while reducing the number of test cases, the online retailer reduced its total number of test cases from ~300 to 96.
A Test Manager of the online retailer’s FinTech team said, “The TRIRIGA automation that we have achieved with Tosca is invaluable. We are now able to fix bugs, run full regression, and release the fix all in a day. A process that would previously take us months.”