How Australia Maintains Innovation through Optimized Test Automation

Reduction in regression testing time
Overall testing costs saved
Environments (Dev, UAT, SIT) now tested in parallel

Digital Transformation Initiative Requires Faster Delivery Cycles

The New South Wales (NSW) Government’s Department of Finance, Services, and Innovation (DFSI) supports a large number of programs around sustainable government, public works, procurement, IT, and other shared services. And, as the driving force behind all technology enhancements within the NSW government, the DFSI recently embarked on a digital transformation journey around their extensive implementation of Salesforce.

The department’s Salesforce implementation spanned over 5 projects, including Sales Cloud, Services Cloud, Visualforce, and partner applications. With only a small team of manual testers responsible for testing software depended on by 8,000 NSW end-users, the DFSI recognized the need for an innovative test automation solution. Delivering high-quality solution within short timeframes was key, as was an initiative to better support continuous delivery.

Key Business Challenges

Salesforce development and deployment at DFSI was predominantly focused on the introduction of new features, but extensive manual regression testing that spanned from end-to-end resulted in bottlenecks and constraints to agility and innovation. These constraints are common around complex integrations of packaged applications, and include:

  • Regression testing that took up to 75% of their total testing time
  • Deployments made with untested functionality
  • High risk of unknown defects in production due to low code coverage
  • High costs of manual testing with low quality ROI

The Tricentis Solution:
Optimized Test Automation for Packed Applications

Risk coverage optimization in test suites

DFSI implemented a risk-based approach to test data combinations used within all their Salesforce projects. Tricentis Tosca’s Test Case Design helps create an optimized set of test cases that allows for prioritization based on each case’s value to the business. This optimized data set was used to run automated regression tests.

Model-based Test Automation

Once risk coverage optimization was completed, model-based test automation was implemented with templates and instances. Previously unknown production defects were uncovered during sample dry runs. Tricentis Tosca goes beyond legacy, script-based automation solutions by supporting the speed and quality of agile methodologies, DevOps, and digital transformation initiatives.

BAU testing customizations

To accommodate DFSI’s email checks and pdf document validation requirements, we extended native Tosca functionality. This was accomplished by building custom email and pdf engines that abstract code and provide a model-based test automation GUI for even higher automation ratios.

DFSI Bar Graph