Suppose a new proposition performs best among people outside the audience the business meant to pursue. Should the team change the proposition, change the audience or reconsider what the test is telling it?
When a concept wins with an unexpected audience, the highest score doesn’t settle the matter: the result has to be read against what the product is for and what each audience is worth to the business.
What “wins” means
Imagine that a concept attracts stronger stated interest from existing category enthusiasts than from the less engaged customers it was meant to reach. It’s an illustration, not a result from one of our engagements.
The enthusiasm may be commercially useful. It may also reflect familiarity: people who understand the category can more easily imagine the benefit. A positive response doesn’t, by itself, show that this is the most valuable audience or that the proposition is wrong for everyone else.
Before changing direction, it matters how the comparison was made. A difference between audiences defined in advance means more than one found by searching many possible cuts of the data. A small gap may lack the evidence to support a change of plan. And a measure of appeal says something different from consideration, or from a choice made among realistic competitors.
Statistical uncertainty and commercial significance both belong in that interpretation. A small difference need not decide a large investment simply because it appears in a ranked chart.
The intended audience is a strategic choice
A target group may matter because of its size, value, needs, future potential or accessibility. Some of those considerations lie outside a concept test. Reaching the group may also be a deliberate ambition for a brand that currently attracts someone else.
If the intended audience responds weakly, the first question may be whether the benefit is relevant, credible and clear enough. The answer could lead to a better proposition for that audience. Alternatively, the new response may reveal a worthwhile opportunity the team had overlooked.
Neither move should be automatic. Following the strongest reaction can pull a portfolio toward the people it already serves well. Refusing to reconsider a target can discard evidence of a more promising opportunity.
Keep audience and proposition evidence connected
In our work for a home services company, marketing leadership had two decisions in front of it: which customers in the whole market to prioritize, and how to describe the company’s existing service proposition to them. We built and sized a segmentation of the market, then read a test of the proposition through the same segments, so the offer was judged by the customers the plan would put first. The segments went into use: the client’s media agency planned around the priority segment, and the company read its next proposition test through them.
The case illustrates the research design; the audience surprise above is hypothetical. It also shows a useful boundary. Interest in signing up was asked on condition of buying a new heating system, so we read it as conditional intent, which is different from an estimate of how many people would sign up today.
The distinction matters whenever a response depends on a future occasion. A customer can be a good fit for an offer without representing immediate demand. In a peer-reviewed paper on stated intentions, Sun and Morwitz note that intentions “change over time and may not accurately predict actual purchases.”
Make the choice explicit
The next discussion connects the result to the business’s options: what would have to change for the proposition to work for the intended group, what it would take to serve the more receptive group well, and which other offers, including the business’s own, each audience would weigh it against.
Sometimes the right move is further development. Sometimes it is a different audience or a different role for the concept. Sometimes the result is too uncertain to support a change in strategy.
Research is most useful when it makes those alternatives clearer. A surprising response deserves attention. Its value comes from what it helps the team understand about the opportunity, rather than the satisfaction of picking a winner.