It’s impossible to avoid UX testing when creating a digital product.
Any specialist who wants to know if what he’s doing is valued by his end users should care whether the result of their time and effort is respected.
Sometimes people are really surprised when we tell them they’re not supposed to use some method of UX research because it’s bad for their project. This happens often enough that we decided to talk about it in more detail.
Some people are ashamed to admit that they test their products on the down-low. Others just don’t bother calling it anything, and still, they still test their products on the down-low.
If you want to be a better UX researcher, you should read this article. It’s a compilation of twenty one UX research methods.
You needn’t feel nervous if you want to start a side business. You can just get started by simply learning how to do some of the things, such as managing your time or improving your skills in your area of interest.
These all have distinct characteristics, but they don’t need to be used in the same way. Each has a purpose. Choose the one that suits your taste and your purpose, but first, let’s take a look at what differentiates them.
Differences in the Methodologies
Qualitative / Quantitative.
The researchers will be able to collect some data, which may or may not prove useful, about the impact of your social media presence.
Analytics data and results of surveys are examples of information that is collected, either through human observation or through machine observation, that’s used to improve a company’s or individual’s understanding of the
This type of research is called qualitative. Qualitative research often allows for only a limited range of answers, but often can uncover valuable information.
These are subjective interpretations. Some may prefer convenient interpretations, others may prefer ones that are more complex and nuanced, but they are all still interpretations.
This is a logical relationship to the number of participants in the study.
With more data there are more opportunities for analysis. With the right analysis, the average becomes much less meaningful.
Qualitative research is very useful when there are small sample sizes and lots of data that require analysis.
In a qualitative analysis it is always necessary to know why someone chose a particular course of action, instead of counting how many.
Behavioral / Attitudinal.
Behavioral research tends to focus on what users do, while attitudinal research looks at what users think about the product or service. Together, these two methods provide a more complete picture of user needs and preferences.
Context of Product Use. Following are the ways that establish the degree of the product’s involvement in the research. The study can be conducted in the following way:
- in conjunction with the natural use of the product
- in conjunction with a pre-created scenario (script) for using the product
- without the product’s involvement in the study
- with mixed use of the product, or a combination of the above mentioned methods
Phases of Product development. The three phases of a product’s development cycle are strategy, execution and assessment. As part of the market research process, each type of study will have a slightly different focus.
We’ll start with the methods that are used early on and conclude with the methods that are used at the end of the product’s development cycle.
UX Research Methods
1. Concept Testing
2. Card Sorting
3. Focus Groups
4. Ethnographic Field Studies
5. Participatory Design
6. Tree Testing
7. Desirability studies
8. Usability-Lab Studies
9. Eyetracking
10. Diary/Camera Studies
11. Moderated Remote Usability Studies
12. Five second test
13. Unmoderated Remote Panel Studies
14. A/B testing
15. Usability benchmarking
16. Expert review
17. Clickstream analysis
18. Customer Feedback
19. Email surveys
20. True intent studies
21. Interviews
1. Concept Testing
Qualitative / Quantitative: Either/Both are possible
Behavioral / Attitudinal: Attitudinal
Context of Product Use: Mixed
Project Phase: Strategy
Overview
This method helps to identify the key qualities of the product that will allow you to determine if it matches the target audience.
It’s a pretty basic concept, and if you’re familiar with the idea of a MVP (minimum viable product), you’ll know what this method is all about.
It can be performed in either the one-on-one format or with a large audience.
In this method, the goal is to understand whether there’s even a need for the product in question.
When to use
The following research method is useful for verifying whether a given concept is viable before building a product around it.
2. Card Sorting
Qualitative / Quantitative: Either/Both are possible
Behavioral / Attitudinal: Attitudinal
Context of Product Use: Natural
Project Phase: Strategy
Overview
The method can be used to create a minimalist interface for your users to input their ideas for a new product. There is an outline of the product’s information architecture required. The users will get sets of cards that correspond to the data that is available on the site or in the application. The foundation for future interface screens were based on the logic of the users, who divided the cards into semantic groups. The group names are what the users are often required to come up with.
When to use
In the early stages of product design, card sorting can be used to identify any gaps or deficiencies that exist in the product or service. If you are using this software for a new project, it could help you to quickly find out if any information within your framework is out of date.
3. Focus Groups
Qualitative / Quantitative: Qualitative
Behavioral / Attitudinal: Attitudinal
Context of Product Use: Not used
Project Phase: Strategy, Execution
Overview
A group of people discuss their opinions on a future product. The person leading the discussion helps them keep their thoughts organized. The role of the moderator is to maintain the flow of opinions rather than directing them. If you want to find out if your audience likes your message, you can conduct a focus group, but don’t turn it into an interview.
When to use
Focus groups can help you better understand what users expect from the end result of the project. When using this approach, it’s essential to first determine the general concept.
4. Ethnographic Research Studies
Qualitative / Quantitative: Either/Both are possible
Behavioral / Attitudinal: Either/Both are possible
Context of Product Use: Natural
Project Phase: Strategy, Execution
Overview
Ethnographic research studies are done with the use of existing products on the market. It is similar to what you would like to create yourself. It is your goal to catch the user in their natural environment with this method. When your employees are using your system, you should try to observe them. The physical presence of a researcher is taken into account in ethnographic studies. Many of the studies are looking at how people use the product. They don’t pay much attention to how people interact with each other. If you want to study, use the observational research method. It’s a good fit for situations where you need to understand what’s happening in a specific time and place.
When to use
Market research can be used to determine what products are selling well, and whether there is a need for new products. This method will help you better understand user needs, which in turn will allow you to refine your product idea.
5. Participatory Design
Qualitative / Quantitative: Qualitative
Behavioral / Attitudinal: Attitudinal
Context of Product Use: Natural or Scripted
Project Phase: Strategy, Execution
Overview
Users meet to discuss their ideas after they have independently drafted the structure of the application on a piece of paper or a whiteboard. While you have to understand the product’s purpose, you should present it in a way that would make it more convenient for your customers. The materials used for the design are cards that represent functional elements, decorative materials and markers. The clients employees, managers, shareholders, etc. are the target audience for this software.
When to use
This is a method for product design that you can use instead of a brainstorming session.
With Scenarios you can create scenarios that can be used to uncover problems, or identify issues that could arise if a certain scenario is not handled properly.
6. Tree Testing
Qualitative / Quantitative: Quantitative
Behavioral / Attitudinal: Behavioral
Context of Product Use: Not used
Project Phase: Strategy, Execution
Overview
The study’s participants work with a text-only version of the site or application, the entire structure of which is presented as a tree Some people think that top level categories are unchanging. The sub-categories expand into even more sub-categories. Clicking on the provided tree diagram will lead to a link to a menu or site element which should only be accessible to participants. It’s important to find a balance between targeting the most competitive and least competitive words. The structure of “a/b/c/d” is an example of this.
When to use
Tree testing can be used to detect possible navigational difficulties, to better understand users’ logic, and to find potential problems.
7. Desirability Studies
Qualitative / Quantitative: Either/Both are possible
Behavioral / Attitudinal: Attitudinal
Context of Product Use: Natural, Scripted
Project Phase: Strategy, Execution
Overview
The design options are evaluated based on the set of quantitative and qualitative characteristics that were specified. They have the option to select one of the options. The cards are often used for convenience because of the characteristics provided in advance.
When to use
This research method is used when you want to find out what kinds of feelings the design evokes in users. Researching the market and competitors before launching your product can pay off big-time.
8. Usability-Lab Studies
Qualitative / Quantitative: Qualitative
Behavioral / Attitudinal: Behavioral
Context of Product Use: Scripted
Project Phase: Execution
Overview
People test the product to make sure it will help them achieve their goals. Users are given a scenario with an explanation of the actions and what their goals should be The researcher records the important details of different operations. In the article “UX-Research of Remote Banking Services: our experience, mistakes and discoveries” you can read more about how to carry out a research.
When to use
This method can be used to determine the validity of certain hypotheses. User experience research is the most common application of this method. Lab studies can be performed as early as the prototyping stage, which is when they are designed for use in proprietary applications that are not available to the majority of users.
9. Eyetracking
Qualitative / Quantitative: Either/Both are possible
Behavioral / Attitudinal: Behavioral
Context of Product Use: Natural or Scripted
Project Phase: Execution
Overview
An eye-tracker is a computer vision system that measures the fixation points of the user’s gaze when they work with a website or application. The eye tracker can be used to record the reflections from users’ eyes.
In this method, you’ll be asked to take part in an activity while we measure your eye movements and keystroke behavior while you work. A feature like this is a great way to make your website easier to use. If your navigation is too complex, it can be hard for visitors to understand. Video recordings of participants may be used as stimuli in eye-tracking studies that do not include scripted instructions.
When to use
The best time to perform this study is during the product’s development phase, when a usable product is already in place. The user can use it to improve the structure and navigation of their interface.
10. Diary / Camera Studies
Qualitative / Quantitative: Either/Both are possible
Behavioral / Attitudinal: Attitudinal
Context of Product Use: Natural
Project Phase: Execution
Overview
We want to learn more about the people who think about your product. The people who are most likely to purchase your product are the ones. To get a broad perspective, you need to take a look at the actions, events, and situations that preceded the thoughts in question. You can record information in a variety of ways, such as with a notebook, a mobile app, audio or video. Users will be instructed on how to take notes in the book, but will be asked to set up daily reminders.
When to use
When you’re trying to understand the user’s needs and determine the best strategy for your product, this research method is a great option. To improve a site, you need to know your users well and understand their habits.
11. Remote Usability Studies
Qualitative / Quantitative: More qualitative than quantitative
Behavioral / Attitudinal: Behavioral
Context of Product Use: Scripted
Project Phase: Execution, Assessment
Overview
A research study that replicates the results of an original research study carried out in the lab, but that uses methods and procedures that aren’t as rigorous as those conducted in the lab are moderated, when participants are asked to respond to comments and questions from a specialist. It is best to let go of responsibility when it is convenient. Everyone is allowed to contribute their ideas without fear of failure or criticism.
When to use
In the same way as real-life experiments, the studies were carried out. More real-life results can be obtained as participants are using the product in a more comfortable setting, andremote studies can allow you to invite a greater number of participants.
12. The Five Second Test
Qualitative / Quantitative: Qualitative
Behavioral / Attitudinal: Attitudinal
Context of Product Use: Not used
Project Phase: Execution, Assessment
Overview
The purpose of this test is to see how people respond to a product design. The study’s participants answered a series of questions after being shown a piece of a product for just 5 seconds. Questions such as what impression they developed about the brand, what the purpose of the shown page was, what they think the target audience is, what they feel about the experience, and other examples can be asked.
When to use
Whenever you need to make sure that the vision of the users is in line with the vision of the designers, you can use the five second test. If there is a noticeable discrepancy, it is better to take the time to correct it.
13. Unmoderated Remote Panel Studies
Qualitative / Quantitative: Either/Both are possible
Behavioral / Attitudinal: Either/Both are possible
Context of Product Use: Natural or Scripted
Project Phase: Execution, Assessment
Overview
A panel is a group of people who use a product independently and give feedback. In order to study this course successfully, you need to use video recording applications. Three people were interviewed for the case study. The interviews were held in person at my home. You save a lot of time by having just one action to choose, and you are able to try Pro: easy to analyze the results. The presence of an adverb is the most significant difference in the two questions.
When to use
This is a good method for studying products that have a long use cycle. This report can be used to analyze pending events, including notifications, and plan product updates.
14. A/B Testing
Qualitative / Quantitative: Quantitative
Behavioral / Attitudinal: Behavioral
Context of Product Use: Natural
Project Phase: Execution, Assessment
Overview
You should compare your applications and websites to make sure they are the same. You should make sure that the differences are what you want and that each version has its own unique features. A group of people are split into two different groups. You will need to answer all the questions in one of the two versions of the test. You can conclude that one option is better than the other based on statistical significance when the results have reached a certain level. A/B testing can be done by using specialized services, such as the use of websites and apps.
When to use
A/B testing can be used to improve the working version of a product, which is either at the last phases of development or after the product’s release. Critical interface elements, such as CTA buttons or navigation elements, can be fine-tuned with these studies.
15. Usability Benchmarking
Qualitative / Quantitative: Quantitative
Behavioral / Attitudinal: Behavioral
Context of Product Use: Scripted
Project Phase: Execution, Assessment
Overview
This is a research method used to assess the user experience of a website. The methodology is the same as the previous one, but the main difference is how the results are compared. It is used to compare the new version of your product with the older version of the product.
When to use
This is a must-read whenever there is a need to track or demonstrate the progress of the product. It is a common practice in software engineering to measure how well a new or different software solution works for its users when they switch between development cycles.
16. Expert Review
Qualitative / Quantitative: Qualitative
Behavioral / Attitudinal: Attitudinal
Context of Product Use: Natural or Scripted
Project Phase: Execution, Assessment
Overview
This product has been peer reviewed by an experienced UX specialist who documented their findings in a detailed report. Anyone who wants to improve their solution needs this document. Recommendations for the elimination of the problems as well as best practices for doing so are included in the report.
When to use
In order to see the product from a different point of view, this is a common technique. The untrained eye can’t see the little things that the untrained eye doesn’t notice. When the design team doesn’t have the expertise topolish the product, this research method is a good choice.
17. Clickstream Analysis
Qualitative / Quantitative: Quantitative
Behavioral / Attitudinal: Behavioral
Context of Product Use: Natural
Project Phase: Execution, Assessment
Overview
The method involves analyzing the data that tells what users click on to find what they are looking for. It is easy to conduct this type of research with the help of systems such as Yandex. You can identify any issues related to the navigation of a site or app by analyzing it. It’s not helpful to figure out their causes either. If you are using it in the wrong way or in the wrong place, it might be the reason that it isn’t working well.
When to use
If you want to check whether people are using your products in the way you intended, clickstream analysis is a good option. The final and intermediate versions of your product can be studied using this research method.
18. Customer Feedback
Qualitative / Quantitative: Either/Both are possible
Behavioral / Attitudinal: Attitudinal
Context of Product Use: Natural
Project Phase: Assessment
Overview
A product experience questionnaire is sent to a random sample of users. There are many methods to accomplish this, from web forms to pop-ups, to polls and email surveys. It is possible to use both closed and open-ended questions if you don’t overload your respondents.
When to use
The research method should be implemented after the user performs a meaningful action on a website or app, such as placing an order or requesting support. Sometimes it’s not necessary to start a survey immediately. The benefits of launching a survey right away may outweigh the potential difficulties.
19. Email Surveys
Qualitative / Quantitative: Either/Both are possible
Behavioral / Attitudinal: Attitudinal
Context of Product Use: Not used
Project Phase: Assessment
Overview
There are two main types of online feedback. User opinions and suggestions are collected by the first one without being triggered by any action taken by the website’s users. Survey results aren’t always indicative of an individual’s true feelings about a product They only look at his perception of it. It’s better to use this research method to find out what people think about a topic. The number of questions that exceed 10 is typically very small, so as not to scare away potential respondents.
When to use
Email surveys are used to help a new company evaluate its products.
20. True Intent Studies
Qualitative / Quantitative: Quantitative
Behavioral / Attitudinal: Either/Both are possible
Context of Product Use: Natural
Project Phase: Assessment
Overview
To understand the user experience of a website or app, researchers conduct a study by asking the users of that website or application a series of questions. Users are asked why they came after they enter the site. They have a chance to leave if their goal isn’t accomplished within a certain period of time. “Have you tried using this product before?” or “Did you find it easy to use?” are some of the questions that might be included in the survey. It is important not to overload the users with questions or the visitors will not be interested in filling it out.
When to use
When there are sufficient levels of traffic True Intent is most effective after a product has been launched. It is designed to find out if the developed product meets the needs of the users, and whether or not it is fulfilling its intended purpose.
21. Interviews
Qualitative / Quantitative: Qualitative
Behavioral / Attitudinal: Attitudinal
Context of Product Use: Not used
Project Phase: Assessment
Overview
Personal interviews are conducted with people who have used the product in the past. To determine the impact that the site or app has on its users is the goal of the research. A retrospective study is not intended to be a comprehensive picture of reality. It’s not possible to gather accurate numerical data.
When to use
Interviews are necessary to make the best decision when making a redesign or upgrade of an existing website. User testing is one of the best ways to find out how people feel about a product. User tests can be used to highlight primary technical weaknesses and suggest solutions.
Conclusion
There are a lot of methods that can be used to analyze and identify the reasons for users’ behavior and their perception of the product. If you know when to apply each approach, it will make a huge difference in the creation of a UX solution. This guide was helpful, that’s what I hope.