1. HomeArrow Icon
  2. Case StudiesArrow Icon
  3. Marvell streamlines testing and reporting for DevOpsArrow Icon

Marvell Technology Group

Marvell streamlines testing and reporting for DevOps

Company overview

Marvell Technology Group Ltd. provides data infrastructure technology that keeps the world running. They move, store, process, and secure the world’s data with semiconductor solutions designed for their customers’ current needs and future ambitions. Everything they do revolves around 4 key principles: reliable results, superior performance, nimble dexterity, and rigorous execution.

Releasing exceptional-quality software faster is a key part of advancing these goals. That’s why Marvell made testing transformation a key element of their recently-launched DevOps initiative. Specifically, they recognized that maximizing the benefits of DevOps would require an enterprise-grade test management solution with asset sharing, approval processes, integration into the DevOps pipeline, and real-time reporting on test results and quality trends. Their existing process of using Excel files to plan tests and track test results, manually coordinating test execution, then manually compiling reports upon stakeholder request was not fast, efficient, or scalable enough for their new DevOps process.

  • Arrow Icon
    Industry: Technology, Manufacturing
  • Arrow Icon
    Organization size: 5,000+ employees
  • Arrow Icon
    Location: United States
  • Arrow IconProducts:

Challenges

  • Thousands of tests to run on hundreds of devices for many parallel projects
  • Tests were created and stored in individual Excel files
  • Test results were manually transferred into Excel files
  • Reports were manually compiled by reviewing Excel files, consuming an hour per report per day
  • TestLink test management tool was acquired, but was not “enterprise grade” and did not provide the required Jenkins integration
  • Multiple TCM tools across different teams ( HP QC, Excel, TestLink, SpiraTest…) that were not agile enough for the new DevOps process
  • Different automation frameworks and integration tools were used across multiple business units
  • Each business unit was expected to provide standardized reporting on key quality metrics—no matter what test automation tool was being used
  • Opportunities to reduce testing time, effort, and cost could free resources for innovation

Solution

After exploring several solutions, Marvell’s SSD Firmware team selected Tricentis qTest. Instead of adding tests to individual Excel files on individual testers’ systems, all tests are created and visible within a central repository and correlated to requirements in Jira, their requirements management system. This enables team members to see if any reusable assets already exist before creating new assets from scratch. Approvals can be tracked and reviewed at a glance. qTest-Jenkins integration enables automated test execution within the DevOps pipeline, with results reported back to qTest and Jira. Test results and Marvell’s key quality metrics (e.g., failure rate from version to version) are visualized in custom dashboards, giving stakeholders instant insight into test status and release readiness.

Marvell’s qTest adoption rapidly expanded across additional business units after seeing how the solution increased the efficiency of test planning and sharing, standardized test execution in the DevOps pipeline, and simplified reporting.

  • Custom dashboards provide on-demand access to key metrics and trends for stakeholder review and process improvement
  • Reporting is standardized across different automation frameworks and integration tools
  • Test automation (unit, API, etc.) is integrated into the DevOps pipeline with Jenkins and Gerrit
  • Real-time integration with Jira provides requirements traceability
  • Over 300 users were onboarded in several “waves’ of adoption
  • Teams modernized test management by migrating from tools like Excel, HP QC, and TestLink
  • Reports that took an hour to create are now generated automatically
  • Templates streamline test planning and management, reducing rework and increasing speed