How Telia is modernizing performance testing with Tricentis NeoLoad
Hear from Telia, one of Sweden’s largest telecommunications companies, how they use Neoload for their performance testing.
The SAP environment and applications form the technology hub for many organizations. Out of the world’s 500 largest companies, 94 percent are SAP customers. The typical enterprise portfolio includes 2,000 to 3,000 applications in production—and an average transaction touches 83 different technologies.
This complex, dynamic IT landscape presents significant challenges for QA teams. In joint research conducted by ASUG and Tricentis in August 2020, we found that:
The good news is that there are technologies and methodologies that can minimize the risk of maintaining, upgrading, or migrating your SAP implementation. Here are the steps to taking control of your SAP QA processes.
This article will describe how you can accelerate your SAP QA processes by using the right strategies and tools provided in the Continuous Testing Framework and with SAP Activate.
SAP Activate is a development methodology designed to help you implement your SAP solutions. Within this set of practices, RISE with SAP can help you get up and running with cloud SAP solutions.
As you use RISE with SAP, you will want testing and quality assurance to be an efficient part of your efforts. To that end, we have overlayed the capabilities of the Continuous Testing Framework (CTF) with the RISE with SAP methodology to help you bring testing tools into your delivery process as early as possible.
The evolution of the process starts when you use technical solutions to help you orchestrate QA efficiently, so that you will be fully aware of the changes and the impact they will have.
New technologies can help you speed up QA towards more agile testing, enabling greater innovation, faster time to market, higher quality, and lower costs. In the process, you will also:
In a typical software delivery cycle, teams start with designing and developing before performing impact analysis, continuous test automation, and load testing. But according to ASUG and Tricentis’ research, 49 percent of organizations say the QA phase slows down SAP releases and 45 percent report that the business requirements and planning phase causes a similar drag. To eliminate these common delays, it’s important to determine exactly what to test.
This can be either done manually or with the help of new technical solutions which can be seamlessly integrated into your SAP quality assurance or delivery pipeline. No matter which type of project you’re running, identifying your business risks early in the process is crucial. By making use of modern technology, you will decrease manual analysis efforts significantly and deliver business value.
This applies to each of the following types of projects:
One of the biggest benefits technical solutions can deliver in your projects is to help you detect all changes with every check-in. You can detect all changes to your SAP landscape automatically, whether they are ABAP, security, contract, or code changes. Doing so enables you to shift testing left and increase transparency throughout the software delivery lifecycle, which helps you shorten lead times, decrease effort, and generate business value as quickly as possible.
By analyzing your SAP instances automatically to identify changes, you will immediately benefit from:
Furthermore, by combining advanced technologies you will elevate your SAP QA practice. You can improve your delivery process at every stage by deeply integrating the following capabilities into your delivery pipeline:
Modern technology can also help teams integrate the output of all their activities so that they can collect the data they need to make data-driven decisions about quality. The various QA activities throughout the SAP landscape generate vast amounts of data. Within this data are insights that can help you:
Conduct analysis to determine exactly what to test, including:
Assess the release readiness of an application and the overall health of your quality assurance processes in terms of:
Gauge the impact of your QA processes and measure the business value they create in terms of:
Based on this information, you can begin to determine whether a release candidate has an acceptable level of risk—and whether SAP updates will undermine business continuity.
Implementing the right technology and analyzing the right data are essential steps in evolving your SAP QA practice. But it’s also critical to execute these strategies as efficiently as possible. The best way to do that will depend on your organizational structure. Some organizations maintain a classic hierarchy, while others have adopted a matrix approach. Still others have devised unique organizational models.
This doesn’t mean that differently structured organizations need to take vastly different approaches to QA. One of the biggest advantages of CTF is that it’s designed to work in virtually any organizational structure. Companies can easily implement CTF for SAP Activate for RISE—SAP’s methodology for deploying, adopting, and extending new capabilities. The implementation will take place in several key phases.
The first discovery assessment should begin during application design and configuration. It is never too early to start thinking about quality assurance. One objective is to create an innovation strategy and a high-level roadmap to enable business and IT objectives. The priority for your QA in this phase is to outline the test strategy & scope and enable the sap business technology platform.
During the Discover phase, your team will contribute and define the guardrails by designing the high-level test architecture for continuous testing, test management, data management, and the overall testing strategy to be in line with SAPs application design and configuration during this phase. You can also calibrate your strategy to incorporate AI, automation, and cloud technologies.
During the Prepare phase, the Enterprise Enablement Team—a team of highly skilled QA experts—takes a leadership role in terms of strategy and operational tasks. The team will provide the initial planning and preparation for the testing stream by enabling on test management, QA tools.
In detail, the Enterprise Enablement Team will focus on tasks such as:
In the Explore phase, the bulk of strategic and tactical responsibility shifts to the Program Test Architect who will develop detailed plans to cover all aspects of the implementation. The Program Test Architect will also make key decisions about the amount and type of test data needed, reporting capabilities, unified analytics, and other key elements of test planning.
The Program Test Architect may also:
The Realize phase consists of test preparation and test execution – preparing scenarios, cases, data and the actual tests by utilizing automation and integrated analysis and reporting. These activities happen within teams, across teams, or at a highly integrated end-to-end level. For any organization that wants to increase speed and quality without exploding costs at the Realize phase, automation at all levels is a must.
Teams should now use all the tools, methodology, and platform at their disposal to execute their testing strategies. Automation Specialists and Analysts will execute all the plans made for QA, impact analysis, automated testing, and analysis and reporting.
How can incorporating CTF into your SAP testing cycle lead to better results? Consider the impact from the very beginning of a delivery when a developer is writing code. This activity can often be a black box in the sense that team members have no visibility into changes and tests..
This is where teams can leverage smart impact analysis to reduce their manual efforts and identify dead code and technical debts. With this information, developer can focus on writing code and running automated ABAP tests. Teams that do this continuously and integrate it into the delivery pipeline can massively increase quality and transparency and streamline efforts.
Here’s what happens at each level of testing:
Any organization that’s serious about optimizing their SAP quality assurance for faster, higher quality deliveries should focus on:
The Continuous Testing Framework is designed to help organizations accomplish all three of these goals and is complementary to SAP Activate for RISE. It incorporates the latest testing technologies, encourages the integration of data from all testing systems, and shifts testing left so that all later stages of testing will be as efficient as possible.