JFrog

JFrog scales UI functional testing with Tricentis Testim to “release fast or die!”

Company overview

JFrog has impacted the tech scene by working to enable continuous updates through what it calls Liquid Software. They are a major factor in enterprise DevOps initiatives helping organizations bridge software development and deployment. With over 5,500 customers, quality and performance are of utmost importance.

We spoke about using Tricentis Testim with Eli Givoni, QA and Release Manager, at JFrog.

  • Arrow Icon
    Industry: Technology
  • Arrow Icon
    Organization size: 1,300 employees
  • Arrow Icon
    Location: United States
  • Arrow IconProducts:

The hypergrowth challenge

In 2016, JFrog was growing fast — very fast.

It believed in quality from the start, building unit and integration testing into the development process. It also recognized the need for functional and end-to-end testing for regression and to validate end-user flows as the JFrog platform expanded, adding new features and revamping the UI experience. Each change meant new tests had to be created and existing tests required updates.

 

“We are always focused on innovation – either releasing a new product or innovating an existing product. That means we need to create a lot of new UI functional tests on an ongoing basis.” — Eli Givoni, QA and Release Manager, JFrog

In order to support the fast scale and growth of its development team and products, JFrog decided to look at test automation solutions that could enable fast authoring, improve test stability, and fit its DevOps workflow.

UI testing solution required to launch new unified platform

JFrog discovered Tricentis Testim and decided to do a proof of concept. Eli explained their POC process. “I assigned one of our QA automation engineers to create a suite to test the administration function of the JFrog Artifactory product. He was given five days to get up to speed and complete the task. He was done in two days. This appeared to be a solid ROI.”

JFrog was on the verge of launching a new unified platform that changed the UI of all of its products in one major release.

“Creating test coverage while things are in development can be risky. With Testim, we had a big push to create final UI tests. In two weeks, we created over 150 new tests in Testim, to enable the successful launch of the unified platform.” — Eli Givoni, QA and Release Manager, JFrog

Results

  • Faster test creation. “An experienced QA automation engineer could write one or two tests per day in code. They can easily do six or seven per day in Testim.”
  • Easy to use. “You don’t need to be an expert in Testim to write tests.”
  • Easy fit into DevOps processes. “We easily integrated Testim into our workflows.”
  • Strong support. “The support team at Testim has been a joy to work with — both responsive and helpful.”