Your transformation toolkit

Advance your enterprise testing strategy with our transformation toolkit.

Learn more

Product updates

Make smarter decisions with Tricentis Analytics: A Q&A with Product Manager Callie McConnell

Tricentis Analytics is now available for qTest On-Premise customers and will be released to qTest cloud customers later this year.  

With the Tricentis July release, we’ve extended availability of Tricentis Analytics, our portfolio-level reporting tool, to qTest On-Premise customers. Now, customers using any combination of solutions in the Tricentis Continuous Testing Platform (Tosca, qTest and Flood) can centrally analyze test progress and results across testing efforts. The update enables organizations to get a birds-eye view of test progress across manual steps, functional and API automation and performance testing — as well as drill down into the specifics of each.

Following this release, I sat down for a Q&A with Tricentis Product Manager Callie McConnell to get more details around the genesis of Tricentis Analytics and what customers can expect in the future. 

What was the catalyst to build Tricentis Analytics? 

We’ve been on a journey to bring together portfolio level analytics reporting and analytics to the Tricentis Continuous Testing Platform. Every customer we talk with wants to visualize and elevate their testing activities to tell a story how they bring value to the business. Our conversations with customers revealed some common scenarios that we’re addressing with our reporting solutions.

  1. Mixed Applications Under Test: Testing spans both modern apps built for web and mobile, as well as enterprise business applications that span SAP, Oracle, and more.
  2. Multiple Automation Tools: Teams want to use the test automation tools that work for them. Whether you are using Tricentis Tosca, Selenium, Appium or a mixed bag of custom frameworks — teams must be able to use, and report on, what works for their situation.
  3. Diversified Processes: Believe it or not, most enterprise groups do not all follow the same agile process. Some operate well within a scaled agile framework using Jira Software, while others use a hybrid approach to ensure governance and compliance.

All these factors lead to a struggle with reporting at a portfolio level.

Tricentis Analytics is the solution for bringing all these results into unified, actionable views for pipeline analysis. Ultimately, we are delivering a reporting solution to provide users with access to their data, and allowing them to analyze and create opportunities to make smarter business decisions.

Tricentis Analytics - Release Views
What customer feedback have you gotten so far?

Customers have provided positive feedback thus far; in particular, Verizon and others love the customization abilities that Tricentis Analytics provides. Our reporting engine allows these customers to manipulate the data in new ways, helping them find nuggets of test information to run their business more successfully, streamline processes, and bring the value of testing to the forefront of technology organizations.

“Now we can empower teams with self-service dashboards and drill down into our test data to get the information we need quickly. This allows us to have focused conversations with all stakeholders at any time.”

William Haug , End-to-End Test Automation Architect | Verizon
Tricentis Analytics - Test Automation
Can you explain more about what custom reporting means with Tricentis Analytics?

Most reporting solutions are too basic, or make it incredibly difficult to create custom reports. So when it comes to custom reporting, we made sure that both user experience and performance were top of mind. Although this seems like it would be a given, we learned that it is critical for custom reports to load fast. Time is critical and reports must perform.

Other considerations that we wanted to add for custom reporting include:

  • Calculate Your Own KPIs: With Tricentis Analytics you can create your own custom, complex calculations through formulas to build out team KPIs.
  • Customize Colors of Charts: Colors can help convey status, urgency, or allow at-a-glance identification of different variables when looking at data, so we don’t limit the color combinations.
  • Allow Sorting on X and Y Axis: Being able to view your data from the first release to the last release allows you to find trends and track quality improvements across each release. 
  • Custom Labeling: Rename charts, add labels, add text boxes into your reports and provide summaries of a graph and tell stakeholders why they should care. 
  • Add Your Own Touch: It’s your testing data, so we wanted to allow customers to make the reports feel and look like they are linked with their company’s brand.
What’s Next for Tricentis Analytics?

Now that we have addressed our customers’ biggest needs, the next thing we will do is get smarter with reporting. We have lots of things in the backlog, and I want to share a few of them today.

A.I. Assistance

Through data mining, we have the ability to start injecting A.I. assistance. For example, we can have Tricentis Analytics give us recommendations around which tests to execute, or disqualify based of trends in automation. We’ll also be looking into how we can auto-assign test case failure reasons.

Sharing Reports

Share reports via email, upload to Confluence or SharePoint or quickly share via ChatOps channels through Slack. 

Time to Release Reports

These reports will be useful for the development team. Use them to find out if your dev teams are able to keep up with the number of issues being raised by testers and determine if you will release on time.