Focus groups can be defined as moderated group discussions that can be done in a more structured or unstructured fashion. In the first case, the moderator keeps a stricter agenda assuming a more directive posture, while in the second, the moderators let the discussion between the participants flow with more freedom.
But the distinct features of focus groups are the fact that they take place in a group setting (usually between 4 and 12 participants), rather than in a one-to-one setting, and that they are based on discussion, not in tasks and/or observations. These two aspects are the crucial points to have into consideration when evaluating the possibility of using, or not, this technique.
Here's when it becomes crucial to have some awareness about psychology and sociology in order to best evaluate when to use a technique or not.
One of the characteristics that defines us, as humans, is that we don’t have a clear notion of why we act the way we do. Also, we don't have a particularly good capacity to envision how we would act in hypothetic scenarios.
Discussions provide us unique insight into a person's feelings and emotions in a certain moment, and a good talk is the best window that we have to access people's perceptions and motivations, things that are almost impossible to unveil with such richness if you just observe their actions. But discussions are a very, very, poor indicator of how people act and how they move along in the world.
Another human characteristic is that we behave and communicate differently in group than we do in private. Instincts and behaviours such as an individual inclination to be more dominant or more submissive; our shared desire to be accepted; social, professional and other hierarchies existing between members of a group... all these factors play a huge role on the dynamic created in a group, influencing the course and results of a discussion.
I will not even try to go into how each of these factors can influence results, as that would be material for a dozen master theses (you can, however, have a glimpse of it in this article). The fact of which we should be conscious is that the input that we gather from a group discussion is radically different from the one we would gather from a one-to-one session.
Focus groups first came upon the '30s, in the USA, as a tool to evaluate audience response to war propaganda in the context of the World War II. This context is important to understand the focus group's potential and the goals for which it was designed to achieve.
Propaganda is, per se, something that takes place in a group setting, since it happens in the public realm, and the way an audience subject reacts to it is influenced by group factors, such as the ones that were mentioned above. Given that it is a best practice to test in an environment that best replicates the factors at play in real-life situations, it makes sense, in the context of propaganda, to use a technique that allows to incorporate all those variables.
Another fact about propaganda is that it’s not intended to convey specific accurate information, nor is it an interactive process. Propaganda is intended just to trigger an emotional response and it’s unidirectional. There are no users in propaganda, there is an audience. An audience passively receives the message and reacts to it, there is no interaction in the sense that the audience doesn’t need to perform actions in order to unroll the piece. In that sense, focus groups were conceived to collect information regarding the sentiment of the people in face of the presented piece of propaganda.
The technique was later largely used by the marketing field. Beyond assessing reaction to war propaganda, it was used to access consumers reaction to product advertise or to brand discourses and look & feel. This was a good fit, since classical marketing strategies rely on the same logic as propaganda (unidirectional, reactive, not interactive, emotional, and not accurate).
When the field of digital products started to develop, its professionals turned to the existing research and testing techniques on the well-established marketing field. Focus groups were among them, as well as many others, like personas (which we've already reviewed in a previous post).
But, in my opinion, both marketing and UX design for digital products have a few core differences that make focus groups have limited potential when applied to product design. In order to better understand those differences, we need to take a more in-depth look at what usability and user experience are.
User experience can be defined as the subjective experience that someone has while using a product, and usability as the quality of a product of generating the desired experience in the person using it. That’s basic knowledge, I know. But there is a key point that I want to put emphasis on. It’s the verb "to use”.
Digital products are inherently different from propaganda and advertisement in the sense that they imply that the users perform a set of tasks and actions on/with them with the purpose of achieving a goal. It’s not just about what the user feels when faced with a product. It’s also about how the user is able (or not) to operate it.
Going beyond superficial definitions of usability, we can identify the different dimensions that compose it:
Due to the discursive nature of focus groups, which are not action-oriented, and the fact that it’s a technique done in a group setting (when in most cases users will be interacting directly with the product individually), this technique is able to access only the last dimension of usability.
As Norman says, focus groups are a rather poor method for evaluating interface usability. Their role is not to access interaction styles but to discover what users want from the system.
Focus groups don’t provide useful data regarding the usefulness, efficiency, efficacy or learnability of a digital product or interface. As such, they should not be used in the validation of design deliveries that have a high focus on those aspects of the user experience.
Focus groups should not be used in Wireframes validation.
Focus groups should not be used in Graphic User Interface validation.
They will offer you extremely low-quality and counter-productive insights in those steps.
“Should that navbar be on top or on the left side?”
Focus groups will not answer that.
“Should that button be larger, or in colour XXXX, or…?”
Once again, Focus groups will not provide an answer here.
Focus Groups are, however, useful in validating design deliveries that concern the satisfaction dimension of usability, such as mood boards; especially if you are working in a product that has a highly collaborative or social aspect.
The technique can also be a somewhat useful tool to collect feedback in exploratory steps of the creative process. User interviews, or even better, context inquires, are my recommendation - since they eliminate the group factor and allow you to see users in action.
But if you don’t have enough time or budget for that, focus groups are better than nothing and can help you to have a better notion of user's needs. Just be sure that you have an expert doing the moderation, so you don’t fall into the trap that Jonathan Ive warns about:
“It’s unfair to ask people who don’t have a sense of the opportunities of tomorrow from the context of today to design"
You need to have a moderator that can see beyond the words, and see the user needs beyond the user requests.
So, wrapping it up... There is no inherently better or worse tool. There's nothing wrong with focus groups, but you shouldn’t be using only one tool of your toolbox for everything. And it’s not about using as many tools as there are either.
It’s all about knowing the strengths and weaknesses of each technique and, as such, when and how they can complement each other. That’s why a good product design process is crucial for guaranteeing that the project has the most efficient budget and time frame, and that the product has the best possible quality.
Found this article useful? You might like these ones too!
With 10 years of experience and a background in cognitive science. I’m passionate about inclusive design and calm technology.
People who read this post, also found these interesting:
.png)
