Beyond the Vanity Metric: How Virgin Voyages and PebblePost Are Redefining Incrementality in Modern Marketing

By the ADWEEK Content Studio
In partnership with PebblePost

Main Facts

In the modern media ecosystem, launching a new advertising channel has never been simpler, yet proving that the investment actually drives incremental business growth remains a formidable hurdle. This persistent gap between execution and attribution is driving brands away from surface-level performance metrics and toward a deeper focus on true incrementality.

At an exclusive ADWEEK House Advertising HQ fireside chat co-hosted with PebblePost, industry leaders gathered to dissect how brands can build the confidence needed to test, measure, and scale emerging channels. The panel featured Alison Weissbrot, executive editor at ADWEEK; Melissa Racklin, senior vice president of growth at PebblePost; and Nathan Quinn, senior manager of lifecycle marketing at Virgin Voyages.

The core takeaways from their discussion highlight a shift in modern advertising strategy:

• The Trust Deficit: Marketers increasingly struggle to prove ROI to internal stakeholders, making rigorous measurement tools a mandatory prerequisite for campaign scaling.
• The Shared Source of Truth: Successful cross-channel strategies—spanning programmatic direct mail and performance Connected TV (CTV)—require verified, first-party household purchase data.
• True Partnership: Active vendor relationships are no longer defined solely by campaign execution, but by mutual accountability, real-time optimization, and the courage to advise clients against spending when efficiency dips.
• Actionable Insights: True marketing tests must be capable of changing business decisions rather than merely validating vanity metrics.

Chronology of a Disruption: From Niche Testing to Omnichannel Scale

To understand how modern brands navigate the complexities of measurement, it is necessary to examine the evolution of the partnership between Virgin Voyages and PebblePost.

Phase 1: Grounding Disruption in Customer Intent

When Virgin Voyages entered the fiercely competitive cruise industry, it did so with a mandate to disrupt conventional travel norms. However, as Nathan Quinn pointed out during the discussion, corporate disruption does not mean reckless experimentation.

• The Philosophy: The brand leaned heavily into the broader Virgin ethos—asking what consumers genuinely want out of a vacation experience.
• The Risk Mitigation: By anchoring disruptive creative concepts in hard customer desires, Virgin Voyages transformed high-stakes marketing initiatives into lower-risk, highly targeted endeavors.

Phase 2: Expanding the Channel Mix

As the cruise line sought to scale its acquisition efforts, it initiated a strategic partnership with PebblePost.

• Initial Deployment: The collaboration began with programmatic direct mail, a medium that bridges the digital and physical worlds by delivering relevant offers directly to consumers’ mailboxes based on digital intent signals.
• Channel Diversification: Building upon early successes, the relationship naturally expanded into performance Connected TV (CTV), allowing Virgin Voyages to capture household attention on the living room screen with the same rigorous tracking applied to direct mail.

Phase 3: Real-Time Optimization and Strategic Restraint

Rather than operating under a "set-it-and-forget-it" model, the teams established a rigorous operational cadence characterized by weekly meetings, deep-dive data reviews, and mid-campaign adjustments.

• The Turning Point: A defining moment in the partnership occurred when Virgin Voyages had allocated budget available for deployment, but PebblePost’s analytics revealed a plateau in campaign efficiency.
• The Recommendation: Instead of pushing to exhaust the budget, PebblePost advised Quinn to hold the funds, roll them over, or deploy them elsewhere. This act of strategic restraint cemented a foundation of deep, long-term trust between the brands.

Supporting Data and Methodologies: The Mechanics of Incrementality

In performance marketing, the term "incrementality" is frequently thrown around, but its actual execution requires sophisticated data architecture and scientific discipline. During the ADWEEK House fireside chat, Melissa Racklin elaborated on the core components required to establish a reliable baseline of measurement.

1. Verified First-Party Data Assets

PebblePost distinguishes itself in the crowded martech space by anchoring its platform in verified purchase data across households.

• The Data Loop: By connecting online intent data with offline, real-world purchasing behavior, the platform provides brands with a closed-loop measurement system.
• Internal Alignment: For Nathan Quinn, having access to this verifiable data is essential when defending marketing budgets to Virgin Voyages’ internal paid media, data science, and analytics teams. It provides the analytical cover necessary to take calculated messaging risks.

2. The Power of Holdout Groups

True incrementality cannot be calculated without rigorous experimental design. Racklin emphasized the critical role of holdout groups—subsets of the target audience that are intentionally withheld from seeing an ad campaign.

• Measuring Lift: By comparing the conversion behavior of the exposed group against the unexposed holdout group, marketers can isolate the exact financial impact of the advertising campaign.
• Defending Decisions: This methodology eliminates the noise of organic conversions (users who would have purchased anyway), giving internal finance and analytics departments absolute confidence in the reported ROI.

3. Shared Measurement Frameworks

When two organizations operate on different definitions of success, friction is inevitable. PebblePost and Virgin Voyages bypass this by aligning on a shared measurement methodology from day one.

• Holistic Visibility: By evaluating metrics collectively while campaigns are live in the market, both teams can diagnose performance dips and execute pivots before budgets are wasted.

Official Perspectives and Insights

The dialogue between Weissbrot, Racklin, and Quinn shed light on the shifting psychological contract between modern brands and their media partners. Below are key perspectives shared during the fireside chat.

On Trust and Radical Candor

Melissa Racklin underscored that technology alone cannot drive successful marketing outcomes; human partnership and transparency are paramount.

"We have to operate as trusted advisors, and we have to be really candid with one another and challenge one another. We’re not waiting until the campaign is over," Racklin explained.

This philosophy was put to the test when PebblePost actively advised Virgin Voyages not to spend available capital due to softening efficiencies. Nathan Quinn welcomed this level of candor, noting that it fundamentally reframed the vendor-client dynamic.

"I’d rather you come to me and tell me that something doesn’t make sense for your brand or for what you’re doing and your product than try and pigeonhole it in and make it fit," Quinn stated.

On the True Definition of a Successful Test

Too often, marketing teams fall into the trap of celebrating vanity metrics—impressions, clicks, and view-through rates—that look impressive on a slide deck but fail to move the bottom line. Racklin offered a definitive litmus test for organizational experimentation:

"We really believe that a test is valuable when it changes a decision. It’s not just about performance. It’s not just the vanity metrics. It’s really about: Did that ad change behavior, can you prove that, and do you have confidence in it?"

On the Imperative of Scalability

For a brand scaling rapidly across multiple touchpoints, isolated marketing victories are insufficient. Campaigns must be capable of translating across the entire ecosystem. Quinn outlined his strategic criteria for evaluating new tactics:

"If I can’t scale it across multiple channels, I can’t find a way to move it outside of its own bucket, then it becomes a lot less appealing."

Implications for the Future of Marketing

The insights surfaced during the ADWEEK House fireside chat point toward several broader shifts in the advertising and media landscape.

The Death of the "Vanity Metric" Era

As corporate boards and CFOs demand deeper accountability for marketing expenditures, the era of relying on top-line impressions and non-validated attribution models is drawing to a close. Brands that fail to adopt incrementality-based measurement frameworks will likely find themselves struggling to secure internal budget increases.

The Evolution of Vendor Relationships

The collaborative dynamic demonstrated by Virgin Voyages and PebblePost signals a new expectation for agency and technology partnerships. Modern brands no longer want "yes-men" vendors who look to exhaust budgets at all costs. Instead, they demand strategic partners who act as fiduciaries of their ad spend—willing to advocate for restraint, transparency, and long-term brand health over short-term revenue extraction.

Omnichannel Synergies Require Unified Data

As consumers fluidly move between physical mailboxes, streaming television, email, and social media, marketing channels can no longer exist in silos. The future belongs to brands that can harness unified, first-party data assets to orchestrate consistent, measurable messaging across every screen and touchpoint.

In summary, the partnership between Virgin Voyages and PebblePost serves as a masterclass in modern marketing execution. By pairing disruptive creative vision with rigorous incrementality testing, transparent vendor collaboration, and a relentless focus on data-driven decision-making, brands can successfully navigate uncertainty and unlock sustainable, scalable growth.