MN is one of the largest pension administrators of and asset managers for Dutch pension funds, with more than 175 billion euros under management. Every aspect of their day-to-day is calculated to benefit the greater good of the people they serve to “enjoy a good pension in a better world.”
Focused on future-proof solutions, MN takes the evolution of the technology that supports its efforts very seriously. To facilitate the mechanics of supporting its customers, the IT department is responsible for maintaining and improving close to 70 tailor-made applications. These applications are critical to providing up-to-date information to customers on the balance of their pension plans, as well as facilitating payouts.
After evaluating the efficiencies of releases on critical internal systems, the team recognized there was room for improvement.
Testing had been limited to predominantly manual efforts for each of the applications as well as for end-to-end testing. Testing was often performed after the completion of development, which created a bottleneck with the limited time available to complete comprehensive testing for both the application and adjacent systems. Peter Van Dongen, head of the MN Testing Center of Excellence, said, “We needed more testing, but we didn’t have time for it.”
Progress on testing was often difficult to share and report to development and leadership, who were responsible for making the “go/no-go” decision for each release. This was especially true for communicating results of tests run on the integration of systems, where teams would share the responsibility of testing. The inability to create greater and more efficient end-to-end testing drove the decision to consider what options were available.
MN turned to their longstanding partner Sogeti to help them navigate the test tooling strategy moving forward, especially as it related to test automation.
After a market evaluation, MN decided to move forward with Tricentis Tosca for test automation. In addition to its low-code automation that would be easy for manual testers to quickly adapt to, leadership was intrigued by the success of other organizations who had taken up similar automation initiatives leveraging Tosca.
The team quickly undertook efforts to upskill the manual testing team and were automating systems within a few months. A business decision was made to focus efforts on newer systems being built on OutSystems to replace many of the legacy systems that would be sunset. Test automation is now leveraged for regression, integration, and end-to-end testing on all new applications.
End-to-end test automation serves as a quality gate for each release. Reports built in PowerBI are easily shared with leadership after nightly executions for faster feedback loops. This process is enabled entirely through Tosca with the help of the email module. This enables more informed decisions on when to release for the highest quality.
Service virtualization and test data management was the next step in MN’s test automation journey. Previous tools proved to be user unfriendly for the team. Testers struggled to adopt the existing solution, which hindered their ability to complete full end-to-end testing when systems were offline.