The realities ofparticipant panels

About this project

This piece is part of the ResearchOps community's ongoing volunteer project exploring the Participant Lifecycle. Based on community feedback, this series focuses on participant panels.

Panels are often seen as a cornerstone of scaling research because they promise to solve one of its biggest headaches: recruiting participants. But like most initiatives, they succeed less often than you might hope, and the path to making them look easy is long, winding, and not entirely within your control.

As diligent researchers, we started with desk research. Content on panels has exploded in recent years (see Kate Towsey's Research That Scales), and we figured a roundup of existing research would be a great start. While we found plenty of articles about panels, most of it stayed high level and almost all of it was written by vendors with a product to sell. We found few case studies and virtually no unbiased guidebooks on how to navigate the decisions teams actually face when building a panel.

To fill that gap, we interviewed 25 practitioners from the ResearchOps community who had set up a panel, managed one, or often both. This series draws on their experiences across a range of panels, including B2C, B2B, government, and non-profit or third sector.

This was supposed to be a how-to guide

We started with a simple goal: write a how-to guide for building and running a participant panel, grounded in the experiences of real researchers. A small convenience-sample survey surfaced consistent themes around the objectives, challenges, and success metrics of panels, and we planned follow-up conversations to add context, color, and detail.

But then we talked to people. As expected, many echoed the core themes from our survey and desk research. What we didn't expect was how much each researcher's context and constraints revealed a bouquet of experiences rather than a repeated linear path.

So this series won't give you a single playbook for building a panel. Instead, it shares the stories practitioners told us, in the hope they help you tackle your own mix of challenges and constraints.

What do we mean by panel?

Ask ten researchers to define a panel and you'll get ten answers, but most converge on something like this: "a set of potential respondents who have declared that they will cooperate for future research projects." That's useful to hold onto, because it names the one thing every version of a panel shares: access. Beyond that, size, audience, and management style all vary.

That variance is wide enough that "panel" can mean a plain spreadsheet you email twice a year, or something with screening, profiling, and dedicated tooling behind it. Both get called a panel, and both can be good.

General panel fundamentals

What isn't covered here

Four adjacent things get called panels, or get confused with them. This series leaves them alone.

There is no one way

The zone of success for a panel is defined by three forces: your participants, your organization, and the resources you can marshal to create and sustain the panel. To succeed, you need a way that works for all three.

Throughout this series you'll hear from researchers on how they navigated real-world constraints. Every quote and case study is a real conversation, not a composite. The point isn't that you should do exactly what any one of them did. Rather, we hope you use their stories to better define and navigate your own constraints.

How this series is organized

The articles roughly align with the phases our experts encountered. In practice, your experience may not line up one-for-one with the order laid out here. You may need to bounce back and forth as you have the necessary conversations and build support and buy-in.

Recruitment is the bottleneck

If you've spent any meaningful time doing research, you already know the feeling: a project lands, the brief is clear, and then you spend weeks in preparation alone. Finding people. Chasing responses. Coordinating calendars. Sending the same email for the fifth time.

Teams that have built participant panels describe a different experience entirely: one where the infrastructure is established before research needs emerge. But before building a panel, consider the factors below when deciding how to proceed.

Speed and efficiency

The numbers are hard to argue with. According to User Interviews, sourcing 50 B2B participants through ad-hoc recruitment can take roughly 47 times more labor hours than through an owned panel. Across the industry, community-based recruitment is cited as five times faster than ad hoc methods, with some teams receiving answers to UX questions within a single day.

The goal most practitioners describe is getting in front of users within a standard one-to-two-week sprint, something that's nearly impossible when sourcing from scratch.

Self-service and democratization

One of the less-discussed benefits of a functioning panel is what it unlocks for people who aren't researchers. Paired with other ReOps infrastructure like guardrails, templates, and guides, panels allow product managers and engineers to run their own studies without sitting on a research roadmap or waiting for UXR capacity.

Quality, depth, and longitudinal potential

Panels can improve more than speed. Recruiting from a known customer base means participants are already familiar with the product, company, or testing process, which reduces onboarding friction and improves the quality of the conversation.

That means when research calls for feedback from specific segments, such as those with more or less product familiarity or heavy use of a specific feature, she can connect with customers whose experiences and characteristics align with the needs of the study.

For teams doing longitudinal work, panels are often the only viable option. One ReOps lead at a bioscience organization manages a participant tracker of clinical specialists, a global population of roughly 200 to 300 people, using year-long consent and automated scheduling to protect a genuinely finite resource. Because their research depends on repeated engagement with the same population over time, maintaining a panel is less a convenience than a necessity.

The practices of panel management also lend themselves to small longitudinal cohorts. Rachel Wigen-Toccalino, Staff UXR Program Manager in healthcare, ran six-month engagements with cohorts of 8 to 10 people to track how user experience evolved as products were iterated. Built-in consent forms, processes for mass outreach, and tracking who has participated recently versus who hasn't let her cleanly refresh her group for each study.

Cost

DIY recruiting (versus a third-party panel) is often perceived as the budget-friendly choice. But ad hoc recruiting is rarely cheap once you account for labor. User Interviews breaks it down: a mid-career professional earning roughly $73 an hour, manually recruiting 20 B2B participants, costs an estimated $4,831 in labor alone. A panel reduces that to around $870 and saves 63 hours of work.

At scale, the gap widens. For teams recruiting 100 qualitative participants per month, panel-based approaches cost between $5,580 and $16,452 less than ad hoc methods. Beyond labor and time, panels eliminate the procurement drag that makes research irrelevant by the time it's complete. As Prama Ayalasomayajula, UX Researcher for a B2B CRM, noted, traditional vendor procurement can take 60 to 90 days, a timeline that doesn't serve anyone.

Diversity and hard-to-reach audiences

Ideally, panels give researchers deliberate control over whose voices they hear. Rather than relying on whoever responds to a generic recruitment post, panel managers can intentionally recruit underrepresented groups, target by behavior or geography, and avoid over-indexing on the loudest or most engaged voices. For niche professional audiences such as developers, C-suite executives, or clinical specialists, a pre-vetted panel can be especially valuable.

PII, compliance, and legal drivers

For many researchers, a panel isn't just operationally useful. It can also provide structure for managing consent and participant data responsibly. Spreadsheets become difficult to manage as requirements around opt-outs, consent records, deletion requests, and participant data grow more complex. In regulated industries, the risk of non-compliance is a direct cost.

In B2B environments, formal opt-in panels can also provide clearer processes for documenting consent and establishing how and when researchers are permitted to contact users.

When not to build a panel

Panels aren't the right answer for every organization. Several practitioners were direct about the conditions that make them a poor fit: no existing customer base, or research demand too low to justify the investment.

The failure mode most often described isn't a bad launch, it's a quiet fade: a panel that gets built, has a short run of success, then goes silent and loses members before it ever proves its sustained value.

When to choose which strategy

Build vs. buy

Standing up an in-house participant panel, or outsourcing recruitment. Where each path pays off, at a glance.

While the decision to build is a single moment, a good setup can assure the panel earns its keep for years. In the next piece, we'll walk through how to set up a panel built to last: the stakeholders to involve early, the tooling decisions to make, the recruitment criteria worth capturing on day one, and where to find your first participants.

A panel is a lifecycle, not a thing

A participant panel is easy to picture as a thing: a tool, a list, or a group of people who answer your surveys. It's more useful to picture it as a lifecycle. Where you are in that lifecycle determines what you should be working on right now.

We think of setup in four phases.

This article focuses on the third phase. It picks up where the previous article leaves off: you have approval, resources, and a mandate. Now it's time to set up the panel you were funded to create.

Stakeholders appear in both the advocacy and setup phases, which can make it seem like we're covering the same ground twice. We're not. Advocacy is about persuasion: convincing leadership that a panel is worth funding. Setup is about execution: coordinating with legal on consent and governance, with sales and customer success to protect client relationships, and with marketing to ensure your first recruitment campaign doesn't collide with a major launch.

No, advocacy doesn't end the moment the budget clears. You'll keep re-earning buy-in long after. But you have to start building somewhere. This is where.

Who to involve before you build anything

Setting up a participant panel is not a solo project. The practitioners who have done it well are consistent on this point: the biggest mistakes happen when someone tries to build in isolation and ends up asking for favors rather than collaborating on a shared resource.

Getting the right people involved early, and being clear about what you need from each, is as much a part of setup as choosing your tool or writing your first recruitment email. A RACI framework maps this cleanly.

Choosing your tooling: spreadsheet, existing CRM, or dedicated platform?

The tooling question is a balancing act. Invest too early and you risk buying capabilities you don't yet need. Invest too late and you'll spend valuable time managing logistics manually that even basic tooling could have automated. Your organizational context matters a lot: is there more time or money easily available? Is it easy or hard to get new vendors through procurement? Does leadership feel that having their own toolset signals importance internally? If you end up with a long-running panel, conditions will change, so monitor for the point where it's time to make the case for a different kind of system support.

The home-grown method

Many of the professionals we talked to have used a spreadsheet at some point. For some specialist populations, spreadsheets are sufficient altogether. One ReOps lead manages a panel of 200 to 300 clinical scientists on a spreadsheet. At that scale, with that population, a dedicated tool would add overhead without adding value. The spreadsheet is the panel.

Spreadsheet as proof of concept

The scrappy tool that gets you going can be the prototype that leads to better things. The most common pattern we heard was spreadsheet-as-proof-of-concept: starting lean to demonstrate the utility of an always-on panel before advocating for tooling investment.

There's generally a natural tipping point. Once you're managing more than a few hundred contacts, tracking who's been contacted, who's been paid, and who's been over-used becomes a job in itself.

Signs it's time to invest in dedicated tooling

Using the existing CRM

Not every organization jumps directly from spreadsheets to a dedicated platform. For teams that already have a customer database or CRM, the next logical step may be to leverage that infrastructure first. The CRM already contains customer profiles, contact histories, segmentation data, and communication workflows. It wasn't designed for research operations, but it can often support the early stages of panel management and bridge the gap between a spreadsheet and a dedicated platform.

Specialized panel management systems

For other teams, the risks and downsides of the spreadsheet convinced them to invest in tooling early. To understand if your context calls for specialized tooling, evaluate these upsides.

• Better coordination with your Sales or Marketing CRM. Spreadsheets don't talk to your CRM, which means you might inadvertently send a survey invite to a customer mid-contract-renewal.
• Tooling can enforce a cooldown period. With manual management, enthusiastic participants end up dominating your pool. Most panel systems have cooldowns to prevent over-engaging participants.
• Designed with compliance in mind. Right-to-be-forgotten requests and PII protection stay invisible until legal gets involved. Dedicated platforms make consent, deletion, and PII management easier to administer consistently.

Whether you choose a spreadsheet, an existing CRM, or a dedicated platform, the technology is ultimately a supporting decision. The bigger determinant of success is whether your panel contains the participants you'll need six months from now, not just the participants who are easiest to recruit today.

Build your panel success criteria

Before the first recruitment email goes out, you need a clear answer to a question most teams skip: who, exactly, is this panel for? Teams that skip this step build panels that work for the first few studies and quietly fail when a stakeholder needs a segment that was never recruited for.

Start with your research agenda

The most common mistake in panel planning is starting with whoever is easiest to reach and working backward to justify the composition. Consider a 12-month snapshot of the research you expect to run. Sketch enough of a picture to ask: what segments will we need to hear from, and how often? That question surfaces your panel's size and segment requirements faster than any tool selection or recruitment channel decision will.

A team running monthly pulse surveys needs a panel large enough to sustain repeated outreach without burning participants out. A team doing longitudinal qualitative work may only need eight to ten deeply engaged people.

Define your segments

One of the beauties of having your own panel is being able to talk to specific subsets of users based on your research needs. To do that, the panel needs relevant data to understand who is available. But keeping the initial sign-up form short means being selective about what you ask up front versus what you collect through profiling surveys over time. Our experts were opinionated on what to capture on day one.

What practitioners wish they'd tracked earlier

The most consistent regret across practitioners was what they hadn't captured about participants early on.

How big does my panel need to be?

We are often asked how large a panel needs to be to become successful, or even "worth it." What we learned is that panel size is better treated as a calculation than a target. A basic starting point:

This is a starting estimate. Your actual needs will vary based on how often participants can take part, how narrowly studies are targeted, and how much participant overlap exists between studies. Modelling panel size can get as elaborate as you want. But size isn't everything.

Manageability sets a real ceiling. A panel is only as useful as your ability to manage it. The right size is one your team can recruit, maintain, segment, communicate with, and learn from consistently.

Start recruiting

Once your team is bought in, your tooling selected, and the recruitment criteria identified, it's time to recruit your panelists. The advice from practitioners was consistent: cold outreach to unfamiliar audiences should be a last resort, not a starting point. Begin with the warm channels already available to you.

Start with warm channels

Across accounts, warm channels offered compelling examples of both speed and quality. One team using Slack and email received 70 percent of its responses within an hour. Others found that people recruited through warm channels provided richer feedback, in part because they were invested in improving tools they already used.

Avoid generic lists

An existing list isn't necessarily the right list. Avinash Mangar discovered this managing a WWE panel, where merchandise purchaser lists included parents and relatives buying gifts, not necessarily the engaged fans the research needed. "Reaching out through our engaged CRM base was much better." Availability is no substitute for relevance.

Consider niche communities

When standard channels fall short, consider where specialized populations already gather and how their qualifications can be verified.

Reach skeptical audiences in person

For audiences skeptical of research, such as fraud investigators, clinical specialists, and regulated professionals, personal credibility can matter more than another recruitment email. Jess Ivins, Senior UX Researcher in enterprise software, found that cold emails to customers produced "crickets."

Get creative for harder-to-find audiences

For hard-to-reach demographics, traditional channels may be tough. Joe Jordan, President of Elliam, Inc., described one company that built a panel of teenagers ages 14 to 17 whose parents had already provided standing consent, making it easier to recruit from that population for future studies.

The through-line is simple: recruit with the audience in mind. That might mean working through an account manager, recruiting at a conference booth, partnering with a community organization, or relying on peer referrals. For hard-to-reach populations, the best path may look very different from the broad outreach that works elsewhere.

Building a panel is relatively easy. Building one that remains useful and engaged over time is harder. There are too many contextual factors for any single formula to guarantee success. But practitioners pointed to a consistent set of principles: work iteratively, find your allies and sponsors, address objections early, and understand what your organization needs today while planning for what it needs tomorrow.

What to do after setup

Contacting that first wave of participants is a major milestone, but don't mistake it for the finish line.

The failure mode for panels is rarely a bad launch. It's the quiet fade: the panel that opens with fanfare, runs well for a quarter or two, then slowly goes silent as participants churn, profiles go stale, and the people who championed it move on. A panel isn't a project you finish. It's a resource you keep alive.

That's where the next phase begins. In part four, we look at what it takes to keep participants engaged, profiles current, and your panel valuable long after the initial excitement of launch has faded.

Getting a panel started isn't easy, so if you've successfully set one up, congratulations and respect are in order. But keeping it healthy over time is a different kind of challenge.

Panels aren't Twinkies or forever chemicals. They are subject to entropy, and they require energy to keep functioning. The enthusiasm and collaboration that fueled the launch can fade as the reality of ongoing maintenance sets in.

This article looks at how practitioners keep their panels healthy without losing momentum: keeping participants engaged without burning them out, handling participant data responsibly, improving representation, and managing the ongoing work sustainably.

Keep participants engaged

Sustaining engagement means treating the panel not as a static database but as an ongoing relationship that requires care and feeding. When participants feel their time is being wasted or their voices aren't being heard, they quickly disengage or stop responding.

Humanize the panel to build rapport

Rachel Wigen-Toccalino worked with a team in healthcare, where showing care for participants was paramount. Her team provided a high-touch onboarding experience with an orientation and a clear schedule of weekly communications.

Ted Kendall kept engagement high by putting a human face on the panel. His wife served as the dedicated face of the program, handling communications and signing off with her name. The connection grew strong enough that participants would email her to say they were going on vacation and couldn't take a survey.

More ways practitioners keep the relationship warm

Avoid participant burnout

Keeping panelists active is the lifeblood of a healthy panel. Practitioners described several ways to prevent burnout, from managing contact frequency to reducing the burden of individual studies.

Avoid consent drift with careful data handling

While burnout risks losing engagement over time, consent violations and poor data handling can put the panel itself at risk. Interviewees cautioned against consent drift, where changes, merges, or transfers between systems result in people being added to outreach they didn't consent to. Over time, that leads to poor data hygiene, accidental over-contacting, or outright violations.

Purge non-consenting users from data merges

Consent problems can emerge inadvertently when new data sources are connected. Jess Ivins experienced this when her data team synced its Snowflake database directly to the panel tool, RallyCRM. The integration risked pulling thousands of users into the panel without the required consent. Jess now purges non-consenting users from the platform to maintain panel integrity.

Keep consent updated by inheriting opt-out rules

Compliance isn't just about initial sign-up. It requires maintaining accurate consent and preference records over time, including when participants opt out or request deletion. Tanya Branitska suggests an automated opt-out inheritance workflow: "Set up an automated link between the panel and your native software to have that process automated."

Increase and maintain healthy representation

A panel that skews toward your easiest, most enthusiastic respondents will quietly tell you a distorted story. The people who respond most readily may not reflect the full range of people you need to hear from, and that imbalance grows over time. Practitioners pointed to two habits.

Treat multicultural audiences as distinct groups, not monoliths

Avinash Mangar emphasized recognizing differences within ethnic and regional populations rather than treating them as homogeneous. "You can't treat certain ethnic or regional groups like monoliths, expecting their behaviors and preferences to be the same." In international research, he also adapts language and localization to engage different audiences.

Oversample or continuously recruit underrepresented populations

The diversity you recruit for at launch doesn't stay put. Smaller segments become underrepresented as participants leave, while the people who remain change. A participant's role, life stage, or relationship with your product can shift enough that they no longer represent the segment you recruited them for.

Improve efficiency with automation

Operational efficiency is what turns panel management from a reactive administrative burden into a scalable resource. Practitioners focused on reducing time to recruit, automating repetitive tasks, and moving away from scattered, manual systems, using both built-in workflows and custom automations.

Measure success

Activity is easy to measure: sessions run, emails sent, participants recruited. But activity is not the same as success. A panel is successful when it solves the problem it was built to solve, and that problem is different from team to team. Before choosing a metric, go back to the reason you built the panel in the first place.

Were you trying to shorten time to recruitment? Improve the quality of your insights? Democratize who could run research? Reduce reliance on expensive external recruiters? A growing contact count can feel like progress even if half those contacts have gone cold. The right metric distinguishes a panel that is working from one that only looks busy.

Metrics can't tell you exactly what to do next, but they give you a place to start forming hypotheses and looking for the story underneath. Choose the one or two measures that map most directly to why your panel exists, then use them consistently.

When to shut down a panel

Even after employing the tactics above, panels can still fail due to supply, demand, organizational, or strategic factors. Knowing when the underlying conditions have changed is just as important as knowing how to keep a panel going.

The panel is never finished

Deciding whether to build or buy, making the case for the investment, setting the panel up, and keeping it alive are not four separate projects. They're parts of one continuous commitment to the people who help shape your product.

So if you're staring down the maintenance phase and feeling the momentum slip, that's not necessarily a sign you've failed. It's the normal physics of a panel. Panels are subject to entropy. Keeping one healthy is the price of having a standing bench of real users ready to answer your hardest questions when you need them.

Very few research assets pay off like that. Almost none of them run themselves.