How Do You Run a Beta That Produces Real Customers?
How Do You Run a Beta That Produces Real Customers?
Define what the beta is for, write down what you are and are not promising, pick a small number of the right testers, and set an end date. A beta without a stated scope and an end date is not a beta. It is a free tier you did not mean to launch.
The version that fails is familiar. A company opens a beta to everyone who signs up, collects a few hundred accounts, gets almost no usable feedback, and then cannot work out how to start charging the people who are already using it for free.
Here is the structure we would use, built around the four decisions that determine whether the beta converts.
What Is the Beta Actually For?
Pick one of three purposes and say it out loud. Validating that the product works under real conditions. Learning whether people will pay and how much. Or generating proof in the form of references and case studies. Those need different testers and different measures, and a beta chasing all three does none well.
A technical beta wants a small number of demanding users who will hit edge cases. A commercial beta wants buyers who match your ideal customer profile, because a tester who could never buy tells you nothing about willingness to pay. A proof beta wants recognisable names who will let you use theirs.
Write the purpose in one sentence at the top of the plan. Every later argument about who to admit and when to end resolves against that sentence, and without it those arguments never resolve at all.
How Is This Different From a Design Partner Program?
Design partners help you decide what to build. Beta testers tell you whether what you built works. Design partnership happens before the product exists and involves a handful of companies in a deep, mutual arrangement. A beta happens once there is something to use.
Running them as one thing is a common mistake, and it produces a group of people who feel like co-designers being asked to report bugs. We covered the earlier stage separately in our piece on design partner programs.
If your design partners want to continue into the beta, that is good, but they should be a labelled subgroup. Their feedback is not representative, because they helped choose the direction.
What Should You Promise, and What Should You Refuse to Promise?
Be explicit and slightly harsh about it. Google's service specific terms are a useful model for how a mature company frames this. They cover features "identified as 'Early Access,' 'Alpha,' 'Beta,' 'Preview,' 'Experimental,' or a similar designation", and state that those offerings "are provided 'as is' without any express or implied warranties or representations of any kind."
The operative clauses are the ones people skip. Google states that pre-GA offerings "may be changed, suspended or discontinued at any time without prior notice to Customer" and "are not covered by any SLA or Google indemnity", and that except where stated otherwise they "are not covered by TSS", its technical support service.
There is a data clause worth copying almost word for word. Google states that no data processing terms apply to pre-GA offerings and that "Customer should not use Pre-GA Offerings to process personal data or other data subject to legal or regulatory compliance requirements." If your beta touches customer data, say what protections do and do not apply before anyone uploads anything.
Does Limiting Liability Actually Matter at This Stage?
It matters more in beta than at general availability, because beta software is where things break. Google caps liability for pre-GA offerings at the lesser of the agreement's limit or "$25,000", which is a deliberate and specific number rather than a general disclaimer.
You do not need Google's scale to need this. A B2B beta running inside a customer's workflow can cause real losses, and the conversation about who carries that risk is much easier before the incident than after.
Keep the document short and readable. A one page beta agreement that a reasonable person will actually read is worth more than twelve pages nobody opens, and the parts that matter are scope, data, support, termination, and confidentiality.
How Many Testers Should You Admit?
Fewer than you want, and chosen rather than accepted. The number depends on the purpose: a technical beta needs enough load to surface concurrency problems, while a commercial beta needs maybe fifteen companies who genuinely match your profile.
Platform limits give a sense of the ceilings involved. Apple's TestFlight lets you "designate up to 100 members of your development team" as internal testers and "invite up to 10,000 external testers", with testers able to use builds "on up to 30 devices." Those are generous caps, and almost no B2B beta should approach them.
The constraint that actually binds is your own attention. Every tester you admit is someone whose feedback you have implicitly promised to read, and a beta where feedback disappears produces silence by week three. Admit the number of companies you can genuinely talk to every fortnight.
Who Should You Let In?
People who match the customer you are building for, even when more enthusiastic people are available. The single biggest distortion in beta feedback comes from admitting the wrong companies, because eager early adopters will use anything and tell you it is good.
Screen on fit rather than enthusiasm. Industry, company size, the workflow they would replace, and whether they have budget for this category. A tester with no budget is a user, not a prospective customer, and their feedback will steer you toward a product nobody buys.
Say no clearly and keep a waitlist. Declining people is uncomfortable and it is the mechanism that makes the whole programme work. We wrote about getting the target right in our piece on defining your ICP.
How Do You Get Feedback That Is Worth Anything?
Schedule it rather than inviting it. A feedback form produces a trickle of feature requests. A scheduled thirty minute call every two weeks with each beta company produces the things people will not write down, which is where the real problems are.
Ask about the last time they used it, not about the product in general. "Walk me through the last thing you did in it" produces specifics. "What do you think of the product" produces politeness. This one change improves beta feedback more than any tooling.
Instrument alongside the conversations. What people say and what they do diverge constantly, and a tester describing a feature as essential while never opening it is telling you something important. Both signals matter and neither is sufficient.
How Does the Beta End?
On a date announced at the start, with a defined transition. Every tester should know at admission when the beta ends, what happens to their data, and what the commercial terms will be. A beta that drifts past its end date turns into an entitlement.
Decide the pricing transition before you open, not at the end. Free for the beta then standard pricing is clean. A permanent discount for beta participants is defensible if it is stated upfront and has a limit. What is fatal is deciding in month five, because by then every conversation is a negotiation.
Give a real notice period and offer an export. People who tested your product for free and then found themselves locked out with a week's warning are not going to be references, and references were probably one of the reasons you ran the beta.
How Do You Convert Testers Into Customers?
Start the commercial conversation in the middle, not at the end. By the halfway point you should know which testers are using it seriously, and those are the conversations to have while the goodwill is highest and before the free period becomes the default expectation.
Ask for the reference commitment at the same time as the purchase, because that is the moment a customer is most willing and least likely to need internal approval twice. A logo, a quote, and a willingness to take a call is a reasonable ask alongside a first contract.
Expect that not everyone converts and treat that as information. If most of your carefully selected testers do not buy, the product or the price is wrong, and finding that out with fifteen companies is far cheaper than finding it out after launch.
What Should You Do Before You Open Signups?
Write four things down. The purpose in one sentence. The scope of what is and is not promised. The admission criteria. And the end date with the pricing transition. That document is the entire programme, and it takes an afternoon.
Then build the landing page and the intake form around those criteria, so the screening happens before anyone gets in rather than afterwards. Our piece on the product launch website checklist covers what that page needs.
If you are planning a beta and want help designing the programme or the pages around it, we are happy to work through it with you. Find us at phoenix.studio.
Want a site that performs like this?
Tell us about your project. We will come back with a clear next step, no pressure.
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Have a project like this?
Tell us where you want to go. We'll tell you how we'd get you there.