Angelfish team member carrying out participant validation by phone

How Do Qualitative Research Recruitment Agencies Verify Participants?

One of the questions we're hearing more and more from clients isn't about methodology, incentives or timings.

It's much simpler.

"How do you know your participants are actually who they say they are?"

It's a fair question.

Research fraud has become an increasing concern within the qualitative market research industry over the last few years.

As more qualitative research has moved online, researchers are encountering more cases of fraudulent participation, duplicate accounts and individuals misrepresenting themselves to qualify for studies. What was once a relatively contained issue has become a much more visible and pressing challenge.

After all, the quality of your insight is only ever as good as the people generating it. You can have an excellent discussion guide, an experienced moderator and clear research objectives, but if the wrong participants make it into the room, the findings become much harder to trust.

That's why participant quality has become one of the biggest talking points in qualitative research today. It's no longer simply a recruitment challenge. It's a data quality challenge.

A peer-reviewed paper published in Qualitative Health Research has identified fraudulent participation as an emerging issue within online qualitative studies, recommending stronger verification and validation processes to protect the integrity of research. This aligns with guidance from industry bodies such as the Market Research Society (MRS) and the Global Data Quality (GDQ) initiative, both of which emphasise robust participant verification as essential to maintaining trust and data quality in research.

For agencies and UX teams outsourcing recruitment, that naturally leads to another question.

What should a qualitative research recruitment agency actually be doing to make sure participants are genuine?

At Angelfish Fieldwork, we've been recruiting participants for qualitative research since 2011. Over that time, we've learnt that respondent quality isn't achieved through one clever piece of technology or one final check before fieldwork begins.

It's built into every stage of the recruitment process.

It starts long before someone joins a research project

People often assume participant validation begins once somebody has expressed an interest in taking part.

In reality, it starts much earlier.

The majority of our recruitment comes through Angelfish Opinions, our organically grown participant community and panel. Every member has actively chosen to join because they want to take part in research. They haven't been scraped from a third-party database or added simply to increase the size of our panel.

That distinction matters.

There's often a temptation in recruitment to talk about panel size, but we've never believed that bigger automatically means better. We'd rather maintain a community of genuine, engaged participants than chase headline numbers that look impressive but tell you very little about the quality of the people behind them.

Of course, not every project can be fulfilled through an existing community alone. Some studies require very specific audiences, so we also recruit through carefully targeted social media campaigns, specialist outreach and refer-a-friend recommendations.

Regardless of where someone comes from, however, they all go through the same validation process.

Because respondent quality shouldn't depend on how somebody first found you.

Looking after a community is an ongoing job

Joining our community isn't the end of the process.

In many ways, it's the beginning.

Respondent quality isn't something you check once and tick off a list. People's circumstances change. Profiles evolve. Engagement levels naturally fluctuate over time.

That's why our community management team is continually reviewing the health of our panel.

We monitor for duplicate or suspicious accounts, look into profiles that don’t seem to match what we’d expect from genuine UK-based participants, and keep an eye out for signs that somebody is no longer genuinely engaged with taking part in research.

Most of this work happens quietly in the background.

It isn't particularly glamorous.

But it's one of the reasons our clients can have confidence that the people they're speaking to are exactly who they say they are.

Research participant completing an online screener for a qualitative research study

How does Angelfish validate research participants?

Once someone has been identified as a potential fit for a live project, our two-stage validation process begins.

This is where recruitment moves beyond simply matching demographics against a brief.

It's where experience really matters.

Step one: the online screener

Every participant completes a project-specific screener designed around the client's research objectives.

Naturally, we're checking whether they meet the required criteria.

But we're looking for much more than that.

We're paying attention to how they answer.

Do their responses feel considered? Are they consistent throughout the questionnaire? Do their open-ended answers sound like somebody reflecting on their own experiences, or do they feel vague, rushed or overly rehearsed?

Good recruiters develop an instinct for these things over time.

Sometimes it's obvious.

More often, it's subtle.

A thoughtful screener doesn't automatically guarantee somebody will become a great research participant. Equally, a shorter answer isn't necessarily a warning sign.

The screener simply helps us decide who deserves a closer conversation.

Read next: Market Research Screener Tips

Step two: the validation phone call

For us, this is where respondent quality and rapport is really established.

Every shortlisted participant receives a validation phone call from a member of our recruitment team before being confirmed onto the project.

The practical side is important. We explain the project clearly, check availability, confirm they understand what's involved and answer any questions they may have.

But validation calls are about much more than confirming logistics. They're our opportunity to understand whether somebody is genuinely the right fit for the research and, just as importantly, to make sure they're comfortable and confident about taking part.

A phone call tells you things an online questionnaire never can.

Can this person comfortably talk about the topic in their own words?

Do they naturally expand on their experiences, or do they struggle once they move beyond the answers they've already written?

Does what they're telling us genuinely align with what they submitted in their screener?

Sometimes we uncover simple misunderstandings. Occasionally, people's circumstances have changed since they first applied. Every now and then, we spot inconsistencies that suggest somebody isn't quite the right fit after all.

We've also learnt to notice the quieter signals.

Participants who repeat their screener answers almost word for word without adding any extra context. People who describe themselves as passionate about a topic but have very little to say when asked about it. Or those who technically meet the criteria but don't seem comfortable holding a natural conversation.

None of these automatically mean somebody is unsuitable.

But they do prompt us to ask more questions.

It's not just about recruiting people who tick boxes; it's about recruiting people who can genuinely contribute once the discussion begins.

Why participant validation leads to better research

It's easy to think of validation as an administrative step. Something that happens before the "real" research begins.

In reality, it has a direct impact on the quality of the insight that follows.

Take a focus group, for example. If even one participant has exaggerated their experience to qualify for the study, it can change the dynamic of the entire discussion. They may struggle to contribute, rely on generalisations rather than personal experiences, or simply agree with everyone else because they don't have anything meaningful to add. A skilled moderator will always do their best to draw people out, but they shouldn't have to spend the first twenty minutes working out whether someone should have been recruited in the first place.

The same is true for depth interviews and UX research. Researchers need participants who can reflect on their behaviours, explain their decision-making and answer questions with confidence and authenticity. That's what leads to richer conversations, better observations and, ultimately, more robust insights.

That's why, for us, validation isn't about catching people out or trying to trip them up. It's about giving moderators, researchers and clients confidence that the people taking part are genuinely able to contribute. Because validation is carried out by our project team, rather than treated as a separate administrative exercise, they understand the brief in detail and can probe where needed to make sure the right people are taking part.

After all, qualitative research isn't simply about finding people who match a set of demographics.

It's about finding people with the right experiences, who are willing and able to talk about them openly.

In our article, Data Quality in Market Research: Lessons from the UK, we explore some of the wider factors that influence data quality and why every stage of the research process matters, from recruitment through to delivery.

Research recruiter reviewing participant screening responses before qualitative fieldwork

Professional standards support the process

While our day-to-day recruitment processes are what really underpin respondent quality, we also believe it's important to hold ourselves accountable to recognised industry standards.

Angelfish Fieldwork is a RAS-accredited fieldwork agency, an MRS Company Partner, and a signatory of the Global Data Quality (GDQ) Pledge. These standards reflect our commitment to doing things properly, but they don't replace the day-to-day judgement, conversations and decisions that underpin good recruitment.

Accreditations provide reassurance. Experience is what brings them to life.

Sometimes the most important thing we do is have an honest conversation

One thing we've learnt over the years is that quality recruitment isn't always about saying "yes".

Sometimes it's about saying, "Let's talk."

Perhaps the audience is far more niche than first expected. Maybe the recruitment criteria are unintentionally excluding the very people the research is trying to understand. Or perhaps the timescales simply don't reflect the reality of finding the right participants.

When that happens, we're honest about it.

We'll discuss the challenge, explain what's happening and work with the client to find the right solution. That could mean refining the screener, broadening the geography, adjusting quotas or extending the recruitment period.

What it won't mean is quietly lowering the standard of recruitment just to hit a target.

It can be tempting to think that filling every seat is the measure of success.

We don't see it that way.

A room full of participants who only partially fit the brief might look like a successful recruitment exercise on paper, but it rarely delivers successful research.

Sometimes the best outcome is a conversation that protects the integrity of the project before fieldwork even begins.

In our experience, clients appreciate that honesty. They'd much rather understand the reality of recruitment than receive a sample that doesn't genuinely answer their research objectives.

It's also one of the reasons many agencies choose to work with a specialist fieldwork partner. Recruitment isn't just about finding participants. It's about protecting the quality of the research from the very beginning. If you're weighing up whether to recruit internally or work with a specialist partner, our article Why Use a Fieldwork Agency? explores some of the practical advantages in more detail.

Real people. Better conversations. Stronger insight.

Respondent quality isn't created by a single check or one clever piece of technology.

It's the result of hundreds of small decisions made throughout the recruitment process, from carefully managing our participant community and reviewing screeners, to having meaningful validation calls and being honest with clients when recruitment presents genuine challenges.

That's the approach we've taken since Angelfish Fieldwork was founded in 2011, and it's one we continue to refine as qualitative research evolves.

Because when researchers have confidence in the people sitting in front of them, they're free to focus on what really matters: asking better questions, uncovering richer insights and helping organisations make more informed decisions.

If you're planning a qualitative research project and would like to discuss participant recruitment, feasibility or respondent quality, we'd love to help. Whether you're recruiting for focus groups, in-depth interviews, online communities or UX research, we'll work with you to find the right participants and give you confidence in the quality of every conversation.

Let's Talk

Related Articles