|Characteristics||Functional Description||Features and Benefits|
|Test Script Design||Create realistic test scripts.|
Design tests quickly, including complex ones.
|For performance engineers: To create complex test scripts that simulate the diversity of real-world use cases.|
For developers: To quickly generate API tests with code.
|Technical Support||Support a variety of Web protocols – HTTP, Java, etc.; older protocols such as SAP GUI and Oracle Forms.||Provide extended protocol support so testers can test all their current applications.|
Simulate complex protocol behaviours to create realistic tests.
Provide early support for emerging protocols.
|Mobile Testing||Simulate mobile users.||Mobile behaviors are different from those of desktop. They must be isolated and simulated realistically – considering the specifics of mobile network conditions and different devices.|
|On-premise/Cloud Load Infrastructure||Generate on-premise and cloud loads – or a combination.||An on-premise testing tool that is easy to install, but requires investing in your loading infrastructure|
The cloud is more suitable for generating extreme load tests (those with thousands of VUs). It can create loads outside firewalls to simulate realistic conditions
Depending on the application being tested, it might be appropriate to adopt a combination of VUs using on-premise and cloud infrastructure.
|Load Infrastructure Management||Manage/reserve load infrastructure.||In large organizations, it can be challenging to manage load infrastructure|
Enable teams to collaborate and share test resources (such as load generators and VU licenses).
|Tool Scalability||Scale to thousands or even millions of VUs.||Not all load testing tools can scale to accommodate significant tests with thousands or even millions of VUs|
Generate millions of VUs – either on-premise or in the Cloud
Synchronize tens or many hundreds of controllers to ensure that load generators are synchronized
Create test reports and analyses that aggregate this data for multiple controllers and load generators.
|Load Testing Analysis||Analyze tested applications and identify bottlenecks||Must have its own monitoring capability or at least be capable of importing monitoring data for analysis|
Must be able to provide actionable decision-making information to identify and help resolve bottlenecks
|Integration with CI Pipeline||Integrate with Continuous Integration servers to automate performance testing||Does it provide standard integration with the most popular CI/CD servers?|
Does it offer an API that enables integration with third parties?
Does it permit code-based testing for the integration of performance testing into a fully automated process?
Does it provide an automated success/failure SLA result, so that the test result can be fully automated?
|Integration with Other Testing Tools||Integrate with other functional testing devices (e.g., Selenium)||Through integration with other tools the device lets you reuse existing, functional test scripts for load testing – speeding up the design phase.|
Use “browser-based” performance indicators for the end-user experience
|Collaboration||Enable different teams to collaborate on performance testing process and results analysis||Must let you share test resources (scripts, results, etc.) as well as the test infrastructure itself, including load generators and VU licenses.|
Must support teams working together.
|Security||Ensure the security of the data being created (user logins and personal info, etc.).||Must encrypt the data it handles.|
Must be completely secure, with absoutely no backdoors that could compromsie the safety of the data.
|Technical Support||Support its customers in a variety of situations (different protocols and custom applications, etc.).||Testers must be able to customise protocols based on VUs to create realistic tests|
Integrate performance testing into CI/CD pipelines to enable automation
Must provide testers with best practice guidance.