How Telia is modernizing performance testing with Tricentis NeoLoad
Hear from Telia, one of Sweden’s largest telecommunications companies, how they use Neoload for their performance testing.
By Sean Michael Kelly, Vice President, User Experience
At user experience meet-ups, I’m often asked, “How does design or research get a seat at the table?” At LGBTQ in tech meet-ups, I’m often asked, “How do those that identify as LGBTQ get a seat at the table?” I’d wager that most, if not all, people from traditionally underrepresented groups in tech ask the same question.
This is a ridiculous question. It’s ridiculous because nobody should need to ask it in the first place. Tech leaders have a moral and business obligation to ensure that everyone knows exactly how they can be included.
Everyone with a good idea should be given the respect to have that idea thoughtfully and authentically considered. Everyone, regardless of demographic, should be able to freely contribute and lend their expertise to the conversation when decisions are made. It isn’t just the morally right thing to do; it makes good business sense.
To accomplish this within Research & Development at Tricentis, we use a framework called “R&D Thinks.” Participation in “R&D Thinks” is not limited to the R&D department. We also invite solution architects, support engineers, marketing content strategists, product marketing managers, and others to participate. And they do!
Making a truly inclusive environment goes far beyond a multi-cultural photo on a website or a one-and-done training seminar. It involves changing the way we do business to make inclusivity part of our company DNA. One way to achieve that is with a framework that focuses on bringing forth the best ideas and critiquing them – all while being as inclusive and as equitable as possible in the most transparent way possible.
Our newly unveiled R&D streamlined decision governance framework aims to do just that.
Here’s how our Chief Product Officer, Dr. Grigori Melnik, explains the goals for the framework:
“As an organization grows from a couple dozen to hundreds and then thousands of team members, it’s important to have an idea framework that captures and disseminates not just the decisions (about ideas, scopes, technical or UX designs, business models, user journeys, internal improvements – anything, actually) but also the rationale for those decisions, tradeoffs analysis, and other considerations.
It drives alignment and helps the team (including future hires) quickly gain a better understanding of those decisions. More importantly, it preserves the context and the rationale behind these decisions when we might need to analyze their consequences and/or revisit them in the future.”
When we set out to create and implement this framework, we had several requirements related to making sure that as many people felt comfortable participating as possible. Everyone in the organization must…
We named our framework “R&D Thinks” to reflect that:
The R&D Thinks framework has been live for a little over three months now and we’ve achieved what we set out to do: bring more people into the decision-making framework so that we see a marked increase in the quality and quantity of great ideas.
It has been amazing to see the most junior employees change the direction of certain initiatives. Our Chief Product Officer has changed course based on the input of someone who has been with the company for less than three months. Team members have challenged their boss’s assumptions and made our initiatives better as a result. A program manager has weighed in on something very technical, and an engineer has changed the course of a visual design direction on a prototype based on their keen sense of aesthetics. It is amazing to see ideas being judged by their merits and rationale, not by the person who creates them.
We wanted to keep the process simple to make it as easy to use as possible. Here are the steps:
In this step, people conduct research, look at market trends, and confer with their colleagues or customers. Because this is an explicit part of the process, everyone in the organization expects to field questions from other people. This helps to reduce the barrier people have in reaching out to others.
Using a pre-defined template, the person with the idea fleshes it out, including a crisp statement about the benefit and the rationale for decisions made in the idea. Usually, this is only about two to three pages and has the benefit of helping the author to clarify their thinking.
Research has shown that capturing an idea in writing leads to deeper critical thinking and increased understanding. In essence, it helps to clarify your thoughts. Writing down ideas gives the idea’s originator a bit more distance from the merits of the idea. Focusing on the originator of the idea leads to more bias.
The idea is then tracked in our requirements management system (Jira), which is visible to everyone at Tricentis. If someone sees an idea and they want to add themself as a reviewer and approver, they can. They don’t need to ask their boss for permission, and they don’t have to ask the idea originator either. Everybody’s input is welcomed.
In this step, the intended project team member and additional reviewers weigh in on the idea. They asynchronously leave comments directly inside the document. This allows for more participation from people in different time zones.
We try to resolve comments asynchronously and we aim to approve asynchronously as well. If we can’t come to a resolution, we use a standing meeting to resolve any outstanding issues instead, though we can usually achieve a consensus. However, in the rare cases that we can’t, our CPO makes the final call on which way to go on a particular issue. Interestingly, it doesn’t always break the way that the most senior-ranking person would like. Ultimately, it all comes down to our CPO’s assessment of how well a given solution aligns with our strategic objectives.
Approved ideas are then prioritized based on how much impact we anticipate they will have. Interestingly, by this stage, the originator of the idea is largely forgotten since the idea has thoroughly been vetted and critiqued by many people. By the time an idea goes through review and approval, it really has become a shared idea.
Diversity and inclusion have become so commonplace in the parlance of corporate speak that it almost loses its meaning. It’s used as a marketing tool instead of a way of doing business. At Tricentis, we value diversity and inclusion so much that we upend existing processes and traditional ways of doing business in order to ensure more people are included and engaged in the decision-making process, from automated testing processes to quality control.
We hire very talented people for their expertise. It only stands to reason that we give their talent a platform to shine. The R&D Thinks framework does just that.