With the recent trend of organizations interested in moving from HPE UFT to Tricentis, we’ve had a lot of questions about what the migration process involves. We’ve outlined some technical details in a recent Fact Sheet and on-demand webinar, but we thought it would also be helpful to share a specific customer example.

Background: 15,000 HPE UFT Tests, 10 Week Regression Tests, Unknown Risk Coverage

A large European insurance company recently decided to migrate from HPE UFT to Tricentis Tosca enterprise wide, and started the rollout by focusing on their most critical application portfolio. After transitioning to agile, the development team started releasing software on 2-week agile sprints, but their existing testing process couldn’t keep pace. They previously built a regression test suite of approximately 15,000 HPE tests, but it took 10 weeks to execute. Exacerbating the issue, regression test execution usually triggered thousands of false positives that had to be reviewed and resolved before the release.

They wanted to integrate regression testing into their Continuous Integration process, but it wasn’t feasible to even complete execution—much less keep the test suite in sync with the rapidly-evolving application.

Migrating the HPE UFT Tests to Tricentis Tosca

There were two main phases to the HPE migration process: importing the legacy regression test cases and optimizing the resulting test suite. First, to jumpstart the transition from HPE to Tricentis, the team used the migration utility that Tricentis provides.   It took a total of 5 hours to import their existing 15,000 HPE UFT regression test cases. The automated process successfully migrated approximately 75% of their existing test assets (objects, keywords, and test data). The imported tests were reviewed and adjusted over the course of 4 weeks.

 

Optimizing the Test Suite for Efficiency and Risk Coverage

Once the initial test case migration was completed, the team moved on to the test suite optimization phase. After completing a quick risk assessment, they used Tricentis Tosca’s risk-based test case design to perform two main rounds of risk-based test optimization.

First, they focused on reducing test redundancy—eliminating tests that did not contribute to their overall risk coverage. They discovered that they could eliminate approximately 60% of their existing tests without impacting their level of risk coverage.

In the next round, they focused on increasing their risk coverage as efficiently as possible. The risk assessment revealed that their existing test suite wasn’t effectively covering their most critical business risks. Their initial test suite achieved 35% risk coverage—which is close to what most of our customers achieve by creating test cases intuitively. Using risk-based test case design, they identified an additional 2,000 tests that would increase their test coverage, then they built those tests in Tricentis Tosca’s business-readable interface. The complete test suite could execute in 8 hours—and risk-based analysis also helped them identify a core set of “smoke tests” that could achieve high risk coverage (over 50%) within 12 minutes.

In the end, the organization ended up reducing their test suite size by approximately 55% and reducing test execution time from 10 weeks to 8 hours using distributed execution—all while increasing risk coverage to 82%.

Continued Integration with HPE ALM

Although the organization wanted to migrate their HPE tests, they decided to continue using HPE ALM to manage requirements and reporting. Using Tricentis Tosca Connect, they enabled bidirectional synchronization of artifacts (requirements, test results, etc.) across these platforms. This way, testers can use their functional testing tool of choice without losing any connectivity to the legacy HPE functionality that’s still meeting their needs.

Mike Nemeth

Author Mike Nemeth

More posts by Mike Nemeth

Join the discussion 2 Comments

  • Rajnikant Singh says:

    Hi Mike,

    I work as Test Consultant is NZ, and work across different Automation Tools.

    I was looking at this post and have some questions ?
    1. Reducing test redundancy—eliminating 60% tests that did not contribute to their overall risk coverage.
    That could have done in the HP UFT only without importing first. So that makes 15,000 HPE UFT Tests to 6000 Test cases.

    2. Using risk-based test case design, I think this is related to going through critical business flows and requirements, Which could have been done using BPT
    framework in UFT/ALM itself.

    3. Will the migration tool convert VBScript to C# code if most of the code is written in Descriptive programming?

    4. How execution time got drastically reduced from 10 weeks to 8 hours?
    As both of them run on Front end Applications, and it takes about same time for execution on front end? Was Front end automation changed to API
    automation?

    5. What would be cost benefits to client after migration from UFT to ALM in terms of licenses.

    Thanks and Regards,
    RJ

  • Mike Nemeth says:

    Hi Rajnikant,

    To your questions:

    1: That could have done in the HP UFT only without importing first. So that makes 15,000 HPE UFT Tests to 6000 Test cases.
    MN: In one project, we imported the TC of HP UFT and linked them to the requirements. After that we found out that we had a lot of redundancy in the the TC and some parts of requirements that we did not cover. After doing a test case design with the customer, we reduced the test cases by 60 %.

    2: Using risk-based test case design, I think this is related to going through critical business flows and requirements
    MN: We have strong test case design possibility to get to a high-risk coverage of a test case portfolio. Look at our resources page under https://www.tricentis.com/resources/ in the section “risk-based-testing”.

    3: Will the migration tool convert VBScript to C# code if most of the code is written in Descriptive programming?
    MN: We support basic capabilities in migrating script code. Because it is open source, you can extend the capabilities for your own.

    4: How execution time got drastically reduced from 10 weeks to 8 hours?
    MN: We reduced the portfolio up to 60 % and we set up distributed execution (executing the test cases parallel).

    5. What would be cost benefits to client after migration from UFT to ALM in terms of licenses.
    MN: This is not easy to answer without knowing more about the customer situation (technologies, users…). Nevertheless, our service department can calculate an ROI if you want…

    Thx,
    Regards,
    Mike

Leave a Reply

Tricentis Logo White Version
X