Recruiter conducting a telephone validation call with a research participant

How to Spot Participant Recruitment Issues Before Fieldwork

You've been handed an important brief. It's a big project. Stakeholders have flown in from across the country – maybe even across continents – to be there.

You get your participants into the room… and they're just… well… not right.

Some struggle to answer basic questions, others seem disengaged, and a few haven't even shown up.

It's a disaster. And the worst part? It was entirely avoidable.

Participant recruitment is integral to the research process. When it goes well, everything flows: the conversation is rich, the insights are meaningful, and your client leaves happy. But when it goes wrong, even the best research design in the world can't rescue you.

Poor recruitment doesn't just affect data quality – it affects insight quality, client confidence, and the integrity of the research itself.

The good news? Many participant recruitment issues can be spotted, and prevented before you ever get near fieldwork. In this article, we'll walk you through exactly what to look out for, and how to make sure you're working with a recruitment partner who gets it right first time.

Why Participant Recruitment Issues Matter

Recruitment is the foundation on which all qualitative market research is built. Get it right, and everything else has a chance to shine. Get it wrong, and no amount of brilliant moderation or insightful analysis can compensate.

The frustrating reality is that participant recruitment issues often only become visible once fieldwork has already begun – by which point, time and budget are committed. Replacing participants at the last minute is stressful, expensive, and sometimes simply not possible.

That's why understanding what good recruitment looks like is so valuable. Whether you're a seasoned researcher or newer to commissioning qualitative work, it pays to ask the right questions early.

Who Is Doing Your Recruitment?

The first question to ask is a simple but crucial one: who is actually doing your recruitment?

If you're working with a full-service research agency that's outsourcing the recruitment, find out who they've partnered with. It's completely reasonable to ask and any reputable agency will be happy to tell you.

When evaluating a recruiter, here's what to look for:

Are they a professional recruitment agency? There's a meaningful difference between an experienced fieldwork specialist and someone who happens to have a large social media following or access to a generic database.

Are they affiliated with recognised industry bodies? Membership of organisations like the MRS (Market Research Society) or AQR signals a commitment to professional standards and ethical practice.

What accreditations do they hold? Look out for the Recruiter Accreditation Scheme (RAS), which is the MRS's quality benchmark for recruitment professionals. Unlike training-only programmes, RAS involves formal assessment and time-limited accreditation, meaning RAS-accredited recruiters have demonstrated knowledge and competency in best-practice recruitment methods. The MRS also offers the Recruiter Training Programme (RTP) – a free, training-only option that issues a Certificate of Completion rather than full accreditation, and is a useful benchmark for newer or less experienced recruiters.

A word of caution on informal recruitment methods: it might seem straightforward to post a research opportunity in a Facebook group, but it's worth asking… who is actually clicking on those posts? Are they genuinely eligible participants, or have they been coached on how to answer the screener? The risk of mis-recruits is high, and the consequences for your research can be significant.

Investing in a professional, accredited recruitment agency may cost a little more up front. But it dramatically reduces risk, improves participant quality, and gives you the confidence to focus on the research itself, rather than firefighting in the field.

Participants recruited for market research focus group

How Are Participants Being Recruited?

Even when you're working with a professional agency, it's worth understanding their process. Not all recruitment methodologies are equal.

Social media can be a genuinely powerful recruitment tool – we use it ourselves at Angelfish. But the key word is used correctly. Reaching people through a well-targeted social campaign is one thing; making sure those people are truly right for your research is another.

A robust recruitment process should include, at a minimum:

1. A digital screening questionnaire to verify initial eligibility and interest. This should be carefully crafted to confirm the right criteria without signposting the 'correct' answers. Red herring questions are a useful tool here for filtering out professional or dishonest respondents.

2. A telephone validation call to confirm the screener responses, assess how articulate and engaged the participant is, and get a genuine sense of whether they'll contribute meaningfully to the research.

That second step – the human call – is where the real quality control happens. It's the part that can't be automated or skipped without consequence. An experienced recruiter can quickly identify inconsistencies, spot participants who seem uncertain about their own answers, and assess whether someone is genuinely going to add value in a group or interview setting.

(Psst – if you're looking for guidance on designing an effective screener, our blog on market research screeners has everything you need!)

Early Warning Signs of Participant Recruitment Issues

So what should you actually be looking out for? Whether you're overseeing the recruitment process yourself or reviewing participants sourced by a partner, here are some red flags that can indicate a deeper problem with participant quality.

Inconsistencies Between the Screener and the Validation Call

If a participant's answers on the online screener vary significantly to what they say during the follow-up call, that's a huge red flag. It can indicate that they guessed or were guided through the screener, rather than responding genuinely.

Suspiciously Polished Answers

A participant who can recall their longer screener responses almost word-for-word, or who gives answers that sound rehearsed rather than natural, may have been coached on how to qualify. Genuine participants don't speak like prepared scripts.

Reluctance or Inability to Take a Phone Call

If a participant is insisting on video-only communication and is resistant to a standard telephone validation call, it's worth pausing. This can sometimes indicate that they don't have a valid local phone number, which in turn may suggest they're not based where they claim to be.

Inability to Elaborate on Answers

A participant who can tick the right boxes on a screener but struggles to expand on their answers in conversation may lack the genuine knowledge or lived experience your research requires. Qualitative research depends on depth, not just demographic criteria.

These signals can be subtle in isolation. But when a recruiter knows what to look for, they're often very telling. It's one of the reasons that human validation remains so important.

A note on AI and LLM-generated responses: As large language models become more accessible, there's a growing risk that some participants – or those helping them 'qualify' – may use AI tools to craft screener responses that tick every box while reflecting nothing genuine. At Angelfish, we're increasingly alert to this. Structured telephone validation is one of the strongest defences we have against it: it's much harder to fake authentic, unprompted conversation than it is to generate a polished written answer.

What Is the Follow-Up and Participant Care Process?

Recruiting the right participants is only half the job. Getting them to actually show up engaged, prepared, and ready to contribute is the other half.

Show rates are one of the most telling indicators of recruitment quality. A high dropout rate, or participants who arrive disengaged and unprepared, often reflects a process that stopped at confirmation rather than continued through genuine care.

A strong recruitment partner will:

  • Respond quickly and professionally to participant queries throughout the process
  • Check in with participants at regular intervals, not just at the point of booking
  • Send timely reminders and confirmations as the session approaches
  • Address any concerns or questions participants have ahead of the day
  • Have a clear plan for managing dropouts and replacing participants where necessary

Participants who feel informed and valued are far more likely to show up, and contribute meaningfully when they do so. Good participant care isn't a nice-to-have; it's a material factor in research success.

When evaluating a recruitment agency, it's worth looking beyond their own testimonials. Independent review platforms like Trustpilot and Google Reviews can provide a useful, unfiltered sense of how both clients and participants experience their service.

How to Prevent Participant Recruitment Issues

The best time to prevent participant recruitment issues is before the project even begins. Here's what we'd recommend:

Work with accredited, experienced recruiters. Accreditations like the RAS exist for a reason. They signal that a recruiter has been assessed against professional standards and that they're committed to continuous improvement.

Ask about methodology and sourcing. Don't be shy about asking how participants will be found, what the validation process looks like, and how dropouts are managed. A reputable agency will welcome these questions.

Don't compromise on recruitment to save time or money. Cutting corners at the recruitment stage is a false economy. The cost of a poorly recruited group – in time, resources, and compromised insights – is almost always greater than the saving made.

Be honest about feasibility upfront. If your criteria are very narrow or your timeline is tight, raise it early. A good recruitment partner will be straight with you about what's realistic and help you adjust the brief if needed, rather than overpromising and underdelivering.

Prioritise quality over speed or cost. In qualitative market research especially, a smaller number of genuinely right participants will always produce better insights than a larger pool of approximate ones.

Getting Recruitment Right Every Time

Participant recruitment issues don't always announce themselves loudly. Sometimes they creep in quietly – through a screener that's too easy to game, a validation process that's been skimped on, or a recruiter who's more focused on filling numbers than finding the right people.

But they do leave traces. And if you know what to look for, you can often spot the warning signs before they become problems.

At Angelfish Fieldwork, quality recruitment isn't just something we talk about, it’s part of our every day. We're proud to be an MRS partner and RAS-accredited agency, and we're signed up to the GDQ Excellence Pledge. We believe in being honest about feasibility, thorough in our validation, and genuinely invested in the success of every project we work on.

If you've got an upcoming project and want to be confident that your participants are the real deal, we'd love to have a conversation.

Explore our participant recruitment services, or get in touch to chat about your next project. We're always happy to help.

Let's Talk

Related Reading

Related Articles