L35: Advertising Testing Process

Good morning, everyone. Welcome to Lecture 35 of MGA-304. Last class we covered measuring advertising effectiveness — the tools, metrics, and challenges involved in knowing whether advertising is working. Today we examine the Advertising Testing Process — the systematic procedures through which advertising is evaluated before and during its production, to maximise the probability of effectiveness. [0–10 min: Introduction] Think about this. A major national television commercial for a brand like Surf Excel can cost Rs. 1 to 3 crore to produce and Rs. 30 to 50 crore to air across India for a full campaign season. That is 30 to 50 crore rupees riding on a piece of creative work that may or may not resonate with its target audience. Given those stakes, it is surprising how often brands and agencies skip or rush the testing process. But the brands that consistently produce effective advertising — HUL, Procter and Gamble, Cadbury — invest heavily in testing throughout the creative development process. Testing is not about replacing creative judgment with consumer committees — that is a recipe for safe, mediocre, consensus-driven advertising. Testing is about reducing uncertainty, identifying where a promising idea is not yet communicating clearly, and catching catastrophic failures before they are expensive. There is a big difference between those two things. [10–40 min: Core Content] The advertising testing process maps onto three stages of the creative development lifecycle: before creative development begins (strategic research), during development (developmental testing), and after development is complete but before major media investment (pre-testing or copy testing). After the campaign runs, there is of course post-testing — which we covered in Lecture 34. Stage one: Strategic Research and Exploratory Testing. Before the creative brief is written, research is conducted to understand the consumer deeply — their attitudes toward the brand, their pain points, their aspirations, the language they use to describe the product category. This phase uses qualitative research: focus groups, in-depth interviews, ethnographic observation. The output is the consumer insight that becomes the foundation of the creative brief. In India, this exploratory research is particularly important because of cultural diversity. An insight that is valid for an upper-middle-class urban Delhi consumer may not translate to a semi-urban Maharashtra consumer. Large brands commission research across multiple markets and socio-economic groups to ensure the brief is grounded in a genuine universal or appropriately segmented insight. Stage two: Concept Testing. Once the creative team has developed rough concepts — before any production investment — these concepts are tested with target consumers. At this stage, the advertising exists only as rough 'animatics' (storyboards photographed and put to rough audio) or simple written descriptions of the concept. Concept testing asks: Do consumers understand the concept? Does it communicate the intended message? Does it generate interest and positive associations? Does it feel right for the brand? Concept testing is typically conducted in focus groups of 6 to 10 participants from the target audience. The moderator presents the concept and explores reactions through guided discussion. Because concept testing is qualitative, it is interpretive — the analyst must distinguish between genuine creative weaknesses and consumers' natural resistance to the unfamiliar. Many genuinely breakthrough advertising ideas — Fevicol's humorous bus commercial, for example, or Cadbury's cricket field girl — might have tested poorly in initial concept groups because they were so unexpected. Consumers asked about something they have never seen before often default to confusion or caution. The skill is in interpreting which negative reactions represent communication failures versus which represent creative freshness. Stage three: Rough Testing or Animatic Testing. The preferred concept is developed further into a rough execution — an animatic for television, a rough layout for print. At this stage, more investment has been made but still far less than a full production. The testing at this stage moves toward more diagnostic, quantitative assessment. Key measures at rough testing include: Overall Reaction — liking and interest ratings on a scale. Communication — what is the main message taken away? Brand Association — is the brand correctly identified and positively associated with the message? Motivation — does the advertisement make the consumer more or less likely to consider purchasing? Distinctiveness — is the advertisement distinctive from others in the category? The rough testing phase also identifies specific executional problems: a scene that is confusing, a visual that is distracting, a piece of copy that is ambiguous. These issues can be fixed in production at relatively low cost. Identifying them after the television commercial has been fully produced is vastly more expensive. Stage four: Finished Film or Final Execution Testing. After the advertisement is produced — but ideally before it goes to air on a large scale — some brands conduct one final round of quantitative testing using the finished execution. This is called a 'finished commercial test' or 'copy test.' The finished commercial is shown to a statistically valid sample of target consumers in a controlled research setting. Standard measures include: recall of the advertisement, recall of the brand, communication of the key message, brand linkage, purchase intent, and emotional engagement. Several specialist research agencies offer proprietary finished commercial testing systems in India and globally. Kantar's LINK test and Ipsos's ECHO are the most widely used globally. These systems have norm databases built from thousands of tested commercials, allowing a brand to benchmark their new advertisement against category and general norms. If a Cadbury commercial scores in the top quartile on emotional engagement and in the top decile on purchase intent, that is a strong signal of effectiveness. The critical issue in copy testing is whether the test measures the right things. Early copy testing systems over-indexed on recall — they scored advertisements on how well they were remembered after a single forced exposure. But as we learned from the ELM, emotional advertisements that work through the peripheral route and build brand associations over time may score poorly on single-exposure recall while being highly effective brand builders in the real world. The Cadbury 'Real Taste of Life' campaign famously scored poorly in early copy testing because it was not a recall-generating, information-heavy advertisement — it was a mood-creating, emotion-generating piece of cinema. Yet it became one of India's most successful brand campaigns. Modern copy testing systems have evolved to measure emotional engagement — through both self-report scales and biometrics — alongside rational communication metrics. This gives a more complete picture of how the advertisement will function in the real world. Let me also discuss the concept of Norms and Benchmarks in copy testing. A 'norm' is the average score for a measure across all advertisements tested in a category or across all categories. If the average recall norm for a chocolate confectionery advertisement in India is 40%, and your new Cadbury commercial achieves 55% recall, you are significantly above norm — a positive signal. If it achieves 25% recall, you are significantly below norm and need to investigate why. Norms allow relative benchmarking but they also create a conservative bias — advertisers naturally gravitate toward advertising that scores safely above norms, which tends to be conventional, familiar, category-typical advertising rather than breakthrough creative that challenges expectations. The best research systems and the best clients use norms as a floor, not a ceiling. [40–55 min: Activity and Discussion] Activity. You are a market researcher presenting concept test results to the marketing team of a Goa-based natural coconut oil brand. Two concepts were tested with 40 female consumers aged 25-40 in Bengaluru and Mumbai. Concept A: 'The Purity Story.' A visual of a grandmother and granddaughter in a traditional Goa home, the grandmother applying coconut oil to her hair. The message: 'Pure as it has always been.' Testing result: 80% found it warm and trustworthy, 75% correctly identified the brand message as 'natural and pure.' Purchase intent improved by 15 points. Concept B: 'The Modern Choice.' A visual of a confident young professional woman using the oil in a modern kitchen. The message: 'The smart woman's choice for healthy hair and skin.' Testing result: 65% found it interesting and modern. Only 50% correctly identified the brand message. Purchase intent improved by 8 points. Based on these results, which concept would you recommend to proceed to production, and what modifications if any would you suggest? Discussion: Concept A performed better on message clarity, emotional resonance, and purchase intent. But Concept B has a more modern positioning that might better differentiate in a cluttered category. The recommendation: proceed with Concept A's proven emotional foundation but explore whether the visual casting can include both traditional and modern elements to avoid the risk of being perceived as old-fashioned. The message clarity of Concept A is its greatest strength and should be preserved. Discussion question: Some advertising leaders — particularly in creative boutique agencies — argue that consumer testing systematically kills the most innovative advertising ideas. They say that consumers cannot evaluate what they have never seen before, and testing in advance produces regression to the mean — safe, average work. What is your view on the appropriate role of testing in creative development? The balanced answer: testing at the concept stage with qualitative methods is valuable for identifying communication failures. Testing finished creative with quantitative methods provides a useful benchmark. But testing should inform, not dictate. The decision to produce a radically fresh creative approach requires judgment, courage, and strategic conviction that no test can substitute for. [55–60 min: Summary and Assignment] Today we examined the four-stage advertising testing process: strategic exploratory research, concept testing, rough testing, and finished commercial testing. We discussed copy testing systems — Kantar LINK, Ipsos ECHO — and the role of norms. We examined the inherent tension between testing rigour and creative boldness. We applied the framework to a Goa brand case. Assignment: Describe how you would design a concept testing study for two alternative creative concepts for a new Amul cheese product targeting urban working professionals. Specify: the research method, the sample (who would you interview and how many), the key measures, and how you would use the results to make a decision. One page. Next class — Lecture 36 — we examine Pre-testing and Post-testing Methods in detail — the specific research instruments, their advantages, and limitations. See you then.