Chapter 26
The New Media Scorecard
One of the most fascinating aspects of socialized media is its ability to track and measure almost anything that matters to your business—as it unfolds. With the right tools, we can peel back the layers between the digital and real worlds to reveal actions and outcomes.
Whether you realize it or not, you are already making progress. To ease us into this complex and diverse discussion, I've peppered the materials needed to build a framework for relevant business metrics throughout this book.
In the Social CRM chapter (Chapter 23), we learned how to measure customer value and influence. Earlier in the book we examined the processes associated with identifying and establishing authority. We also reviewed methods for discovering communities of influence and capturing relevant activity so as to institute a measurable Conversation Index. We also learned how to define experiences, establish desired click paths, and track and measure activity and outcomes. Each step forms a foundation of metrics that serve as benchmarks moving forward—focused specifically on the programs and goals as implemented at program and brand levels. After all, while the need to measure initiatives is pervasive, we have no basis for comparison without benchmarks.
There are several schools of thought when it comes to measuring the effectiveness of new media. In this chapter, we explore the tools and methodologies that translate activity into tangible value for your business and its management infrastructure.
Our first step, however, is to understand who within the organization is already measuring Web activity and immediately become part of the process. The Web team or data analyst(s) typically maintain control of valuable online performance information, usually sourced from Web analytic tools such as Omniture or Google Analytics. Those on the e-commerce team are already examining how, when, and where customers are making purchases online. Advertising and marketing are familiar with click conversions and impression on digital ads and other programs. Much of what each of these teams do is aligned with your work. Working together, your roles will adapt to more effectively translate social data into business value. This analysis will affect and shape current and future campaigns.
THE DISPARITY BETWEEN SOCIAL MEDIA ADOPTION AND MEASUREMENT
While the allure of new media is hypnotizing, bewitching us to leap before looking or fire before aiming, its value is truly revealed in the behavior and ensuing analysis that stems from engagement.
We now have the ability to incite change directly and indirectly and track the resulting actions and responses as they travel from community to community and person to person, transcending the boundaries between the digital and real worlds.
Engaging without analysis is akin to driving aimlessly, without direction or purpose.
Measurement is the key to relevance and future successes.
Here are just a few ways that change agents are measuring the return on investment (ROI) of social media:1
- Best Buy measures the ROI of its internal “Blue Shirts Nation” community in terms of lower turnover rates.
- The National Association of Manufacturers measures the ROI of its blog in terms of greater access to the halls of Capitol Hill.
- Dell measures the success of its IdeaStorm community both in terms of lower support costs and in the number of new ideas generated.
- SeaWorld reached out to roller coaster enthusiasts with its social media program and measured its ROI in terms of lower outreach costs as well as tickets sold.
ROA: RETURN ON ACRONYMS
One of the most commonly asked questions in new media marketing is often voiced by someone who is usually unqualified to appreciate the response.
You know the question. We hear it all the time.
“What's the ROI of this?”
While many think it, the initial answer is usually suppressed: “I dunno, what's the ROI of anything we do? What's the ROI of customer service? What's the ROI of PR? What's the ROI of branding? What's the return on human resources? While we're at it … what's the ROI of research?”
I'm only partially kidding.
What if we asked the question this way: “How can we measure ROI if the I stands for ignorance?”
As I always say, ignorance is bliss until it's not.
The truth is that we need to have answers. The good news is that the answers are available. If we don't know them, we must seek them. We just need to know what to look for and where.
In traditional businesses, return on investment is calculated by dividing net profits after taxes by total assets.2 For example, if you invested $50,000 and the investment was worth $75,000 after two years, your annual return on investment would be 25 percent. To get that result, you divide the $25,000 gain by your $50,000 investment, and then divide the 50 percent gain by 2.
In new media, ROI can work similarly, but the acronym is also morphing to make way for new metrics, including:
- Return on participation, return on engagement, or return on involvement: The review of activities, patterns, reactions, and results associated with direct interaction or through social objects.
- Return on experience: The analysis of the effects of experience through design aesthetics, engagement, and words.
- Return on influence: The study of the impact of influence as it reverberates across communities and resulting behavior.
While experts play with the I in ROI or x in ROx to reflect other measurement scenarios, to truly garner insight and value from the gauging of our activities, we must first define the R, or return. Defining the R allows us to analyze behavior and activity as it applies to the business. Return on investment is a bona fide analysis related to business finances. Its value is indisputable—even in the seemingly elusive world of social media.
This is done initially by asking a handful of simple questions to surface the return we seek:
- What are we measuring and why?
- What does success look like?
- How will we know when we get there?
- Are there incremental milestones worth noting?
- Who else within the organization benefits from our work and how would they measure meaningful results?
Observing the literal translation of the I as investment, we must also factor in the corporate assets that power any and all business initiatives:
- Intellectual capital
- Resources
- Finances
- Campaign costs
As inexpensive as social media is considered to be in comparison to traditional programs, there are always fixed costs associated with any activity.
In June 2008, I published an early formula for calculating the I in ROI based on the research results from the Conversation Prism and Index studies.3
THE ESSENTIAL GUIDE TO SOCIAL MEDIA: RESOURCES—PERSONNEL AND BUDGETS
Activities to Meter
- The average frequency of relevant conversations
- Identify the more active hubs and communities
- The context of the conversations to better determine the time and variety of resources required
Resource Assessment Formula
Number of average relevant conversations per day per community.
Multiplied by the quantity of relevant communities.
Multiplied by 20 (average minutes required to research and respond and also monitor for additional responses), variable plus or minus, and depending on the case, usually plus.
Divided by 60 (minutes).
Equals the amount of time required and, in turn, the resources and associated costs required depending on internal labor (salaries or hourly rates), external consulting fees, plus the cost of equipment and other necessary resources.
THE SOCIAL BAROMETER
Over the years, I have established the criterion to measure my work as it specifically relates to the companies and the business units each customized initiative was designed to benefit. Along the way, I have also maintained a spectator perspective, as I've documented the evolution of the interactive media landscape. Much of this is so new and exciting that businesses are diving in out of perceived urgency without investing resources in acquiring or embracing existing techniques for evaluating participatory programs.
However, there are best practices tied to soft and explicit metrics that we can implement to justify and judge our work. Depending on the level of sophistication and also primary focus and purpose of your business, the combination of these calculations will vary in importance.
As we assess the methodologies, formulas, and criteria required for creating a system for measurement, we must identify the attributes that are important to the organization as well as those that will receive buy-in at the departmental and executive level.
Don Bartholomew, a social media research and measurement consultant, observed that communications professionals, for example, often confuse outputs with outtakes or outcomes—basically confusing exposure with action.
He proposed a metrics taxonomy to help us truly understand our mission for measurement:4
Exposure: To what degree have we created exposure to content and message?
Engagement: Who, how, and where are people interacting or engaging with our content?
Influence: The degree to which exposure and engagement have influenced perceptions and attitudes.
Action: As a result of the effort, what actions, if any, has the target taken?
Bartholomew also defined three zones of measurement: websites on the left side (measured by Web analytics), social networks in the center (measured by content and behavior analysis) and offline on the right side (captured by audience research).
From the left, companies or brands control, own, or manage websites—corporate sites, Facebook pages, Twitter accounts, LinkedIn pages, and blogs, by way of example—and create content to lure consumers toward engagement. This zone is measured primarily by Web analytics. In the middle are the actual social networks and conversations between individuals. We are interested in this zone in data sets that cannot be gathered solely using Web analytics packages. How often is the brand being mentioned in conversation? What is the sentiment of the comments? How often is the brand being recommended and by whom? Content and behavior analysis, including tracking technologies, are the primary measurement tools in this zone. The third zone represents all the real-world, offline transactions that may be of interest. Did someone visit the store or attend an event? Did he buy a product? Did he recommend the brand or product to a friend over coffee?
START WITH THE RESULTS, THEN WORK BACKWARD: DEFINING GOALS AND OBJECTIVES
We can't measure what we do not recognize as value. We cannot measure success if we don't know what success looks like. It is for these very reasons that we must first establish our day-to-day programs and incremental campaigns around the end result—as shaped by the research work performed in the listening and observation stages of the Conversation Prism.
This is important, as I'm often asked to reveal a formula or template that reveals the secret to measurement. The metrics are as diverse as the roles of the social consumer. Charting growth among the three Fs (friends, fans, and followers), views, or traffic to a blog or website or likes, comments, and retweets are representative of entry-level metrics. Growth here is not a reflection of key performance indicators, (KPIs), ROI, or any other measurement acronym, for that matter. Define the outcome and work backward from there. For example, in customer service, one of the key metrics for social media is the noticeable reduction in trouble tickets and inbound calls and email around common subjects. Sales organizations, of course, track leads, foot traffic (if applicable), sales, and referrals. Brand managers use the Conversation Index as a way of documenting progress showing growth in share of voice and share of conversation, an increase in positive sentiment, and boost in advocacy. Marketers focus on conversion ratios and the rate individuals clicked through to the next stage of the campaign.
Clicks to action, including the experience and the click path, must get tied to measurable outcomes.
K. D. Paine (Katie Delahaye Paine) is recognized as “the queen of measurement.” She observed that the importance value of social media is what happens because of it. She therefore suggests that we actually consider dropping media from social media when it comes to measuring its effects.5
While I partially agree, K. D. recognizes that the metrics required for measuring the effectiveness of social media are new and different from anything currently used in marketing: “We need to be working closely with the data geeks and the market research folks and measure the things that happen faster and better because of social networking.”
K. D. outlined a change in business habits and efficiency as a foundation for metrics:
- Process improvement
- Time to market
- Number of new product ideas
- Number of suggestions
- Length of time it takes to find a solution to a problem
- Efficiency with which a product is launched
- Level of social capital
- Churn rates among your customers or employees or both
- Cost of recruitment
Therefore, establishing objectives and tying activity back to the results we desire require both planning and calculation.
To help, K. D. Paine created an immensely helpful measurement program checklist (edited to reflect the lessons shared in this book).6
Measurement Program Checklist by K. D. Paine
Step 1: What Are Your Objectives?
1. What are your organization's key goals for this year?
2. What are your department's key goals for this year?
3. What do you hope to accomplish with your measurement report?
- Get budget approved
- Increase budget
- Increase head count
- Get more internal support
- Get more external support
- Justify my existence
- Get a raise
- Get promoted
Step 2: What Audiences Are You Targeting?
List all that apply, not just the following common ones. (If in doubt, put all the executives and marketing people in your organization in a room and ask them.)
- Media
- Prospects
- Customers
- Partners
- Employees
- Governments
- NGOs
- Communities
- Investors
- Thought leaders
- International community
- Other
How does a good relationship with your various target audiences benefit your organization?
1. Increases sales
2. Increases attendance
3. Increases donations
4. Increases likelihood of desirable legislation passing
5. Increases preference
6. Increases awareness
7. Improves employee retention
8. Improves employee loyalty
9. Improves customer retention
10. Improves customer loyalty
11. Improves likelihood of purchase
12. Attracts new customers
13. Attracts new prospects (lead generation)
14. Attracts new or potential donors
15. Increases amount of purchase
16. Increases frequency of purchase
17. Boosts stock price
18. Increases profitability
19. Reduces turnover
20. Decreases time to market
21. Decreases number of complaints
22. Decreases absenteeism
Step 3: Set Priorities
Prioritize your audiences with this exercise: You have a total of 100 points to allocate. Award those points to the audiences that you have identified in order of their importance to your organization, based on your answers to questions in Step 2.
Step 4: Determine a Benchmark
Who or what keeps your boss or client up at night? In other words, what are the competitive threats or perceived competitive threats to your organization? Select from the following list to determine what you will be comparing your results to.
- Competitor(s) or peer companies
- Industry benchmarks
- Yourself over time
- Last year's results
- Last quarter's sales or Web or commerce metrics
Step 5: Select the Right Measurement Tool
If your objectives (see Step 1) include “increase awareness,” improve products or service, “attitude change,” or “education,” you will need to conduct an online audit in social media to determine the current state of affairs and establish a benchmark.
If you are seeking to measure sales and leads, you should be tracking website traffic and conferring with the sales team to document numbers, referring sources, and existing hurdles.
- Sentiment
- Share of voice versus the competition
- Share of discussion versus the competition
- Audience reached
- Important trust agents and tastemakers
Pat LaPointe at Marketing Measurement Today developed a framework for approaching social measurement in response to one of the most common questions he faced: “How should I measure the value of all the social marketing things we're doing, like Twitter, Linked-in, Facebook, and so forth?”
LaPointe's answer was as commonsensical as it was poignant, “Why are you doing them in the first place? If you can't answer that, you're wasting your time and the company's money.”7
Social Measurement Framework by Pat LaPointe
1. Fill in the blanks: “Adding or swapping in social media initiatives will affect _______________ by _______________ extent over _______________ time frame. And when that happens, the added value for the business will be $_______________, which will give me an ROI of _______________. This forms your hypotheses about what you might achieve, and why the rest of the business should care.
2. Identify all the assumptions implicit in your hypotheses and flex each assumption up or down by 50 percent to 100 percent to see under which circumstances your assumptions become unprofitable.
3. Identify the most sensitive assumption variables—those that tend to dramatically change the hypothesized payback by the greatest degree based on small changes in the assumption. These are your key uncertainties.
4. Enhance your understanding of the sensitive assumptions through small-scale experiments constructed across broad ranges of the sensitive variables. Plan your experiments in ways you can safely fail, but mostly in ways to help you understand clearly what it would take to succeed—even if that turns out to be unprofitable upon further analysis. That way, you will at least know what won't work, and change your hypotheses in Step 1 accordingly.
5. Repeat Steps 1 through 4 until you have a model that seems to work.
6. In the process, the drivers of program success will become very obvious. Those become your key metrics to monitor.
The frameworks proposed by K. D. Paine and Pat LaPointe represent methodical approaches to help us assess performance as compared to expectations with tangible business performance metrics.
AUTHORITY: THE ABILITY TO GALVANIZE ACTION AND QUANTIFY IT
Revisiting influence as I define it (the ability to inspire desired and measurable action), the world of metrics essentially opens up new opportunities well beyond traditional analytics. Measuring traffic, views, and referring sources requires purpose, a front end in which we can engage, define, and capture measurable activity, monitor, assess, and adapt. It is important to focus on performance and establish our key performance indicators in advance, which will allow us to track the progress and execution of our programs.
In social media, performance data is typically organized as follows (whether intentionally or unintentionally):
- Volume
- Engagement
- Action
Remember, no matter how many formulas you review or trends you observe, for metrics to be accurate and meaningful, they have to apply to your world. Therefore any combination of volume, engagement, and action can define success and failure, which ultimately determines your level of authority and influence.
Volume
Volume is symbolic of brand presence, the frequency with which it appears, its amplification, and its reach across the Web. It represents the extent to which your brand appears and resonates online, as defined by the communities, conversations, and people behind the surrounding activity.
To better understand how to recognize and quantify volume, we must define the characteristics and associated attributes with defining individual value:
- Dialogue: The quantity of discussions transpiring in the front and back channels, taking the shape of questions, answers, suggestions, and general interaction around the brand, as documented by networks and the Social Web as a whole.
- Themes and memes: Trends, topics, and discussion threads related to the brand, without direct influence from the brand.
- SEO and SMO: Linkbacks and links to the brand site, page, or a branded social object with value symbolized in the form of page rank, relevance, and authority.
- Sentiment: The perception of the state of the brand at any moment in time—the process of attempting to shift sentiment in the conversion section is the difference between volume and action.
- Customer satisfaction: The state of customer fulfillment and gratification (see details in Chapter 23).
- Audience: The size of individual communities, networks, and social graphs, measured independently as well as in the aggregate.
Engagement
One of the most compelling aspects of interactive media is represented in the moniker that I just used: interactive media. It's indicative of two-way exchanges and it's measurable as such. I describe engagement as the time spent with the brand, either individually, in a community environment, or through direct interaction. Engagement metrics are captured through the impact garnered from conversations with brand representatives, time spent viewing or taking action around social objects, as well as browsing, viewing, and interfacing with branded online content.
Engagement can include:
- Conversations: Direct exchanges tied to the brand, represented through comments, blog posts, tweets, and retweets, wall posts, and shares—as eConsultancy says, “An engaged customer is a highly valuable one.”8
- Time: The duration spent viewing or interacting with the brand, a social object, or content, from widgets to pages to profiles to conversations.
- Social graph and relationships: The size and shape of a social network tied to a person or a brand, measured by quality and quantity.
- Fans and followers: The number of individuals subscribed to receive the updates in social networks and communities.
- Interaction: The level in which people contribute information, social objects, and other content to brand hosted communities and networks.
- Registrations: Individuals who proactively register or subscribe to information, content, offers, and so forth.
- Curation: The process of publicly sharing favorite content through social bookmarks, retweets, reposts, favorites, and likes (which are all discoverable and calculable).
- Traffic: The cumulative activity directly at or around a site, page, profile, or social object.
- Views: Less about Web pages or more specifically tied to the viewing of specific social objects, such as videos, images, and widgets.
- Shares: The act of sharing content and objects across the Social Web.
- Immersion: The depth of interaction or engagement with online content, applications, conversations, or social objects.
- Impressions: The potential reach of the engagement or social object as determined by connections and traffic.
Conversion
Action is profound in both its value to the bottom line and in its ability to convey discernible statistics. The ability to capture and measure action, if tied to calculated social programs, and meaningful business metrics is among the most salient forms of assessing return on investment as a true performance equation. Whereas volume and engagement capture the state of brand perception and presence, action reveals the activities that directly contribute to business health and profitability. This is why social media programs should feature carefully designed calls to action combined with the ability to capture and analyze the data on the back end—in real time.
Quantifiable data points and key performance indicators and measurable tactics can include:
- Conversions: The process of transforming individuals from one state to something of greater value, such as prospects and visitors into customers, or customers into advocates.
- Click-throughs: Crossing the chasm between social presences and objects to branded sites and microsites rife with calls to action—transcending from the virtual into real-world customers and users.
- Offers: Social media is expected to be a tremendous catalyst for individualized deals, discounts, exclusive offers, specials for products, services, and also local transactions. Airlines are measuring the response for special fares they offer in social networks; local businesses are documenting responses tied to specialized programs designed to lure prospects and transform them into customers; these efforts link to sales as a metric.
- Ratings: Customer review sites are repositories for brand experiences and sentiment. Without Astroturfing these sites, customers can be encouraged and directed to share positive thoughts.
- Increased sales: If @delloutlet can attribute approximately $3 million directly to its Twitter stream, Blendtec can recognize a 500 percent increase in sales, and other brands can realize increased revenue through its engagement specifically in the Social Web, integrating social programs and barometers designed to trigger and capture sales is within your grasp.
- Data capture or registrations: Growing lists of targeted pros-pects and customers is ideal for increasing relationships as well as direct communications channels—the number of individuals who share information either goes up or down on the basis of your activity.
- Conversations or share of voice: As discussed previously, conversations and share of voice are identifiable and measurable, providing a lens and revealing the state of presence and sentiment as a solitary number or in comparison to competition at any point in time, over time.
- Sentiment conversion: While sentiment is a reflection of volume and state, the act of shifting sentiment is a strategy and tactic that is both identifiable and measurable.
- Customer/acquisition/retention/referrals/loyalty: Customer in- teraction and recognition improves satisfaction, loyalty, and future revenue—assessing the cost of customer acquisition and retention using other forms of marketing and service programs and media compared to the costs associated with your social programs. As a metric, Zappos.com (a wholly owned subsidiary of Amazon.com) reports that 75 percent of its annual $1 billion in sales are from repeat customers.9
- Lead generation: The number of new prospects acquired through specific new media initiatives compared to other programs and dedicated performance.
- Feedback and change: Capturing thoughts and feedback through online voting and survey initiatives can be measured in change and interaction—the value of a brilliant idea is priceless.
- Visitors and traffic: Whether we're pointing people to a particular place or steering activity and responses based on our interaction, traffic is measurable and indicative of interest and movement.
- Downloads: The number of people who get something in exchange for something, for example, a downloaded widget, custom wallpaper, a white paper, coupon upon completion of registration, following, becoming a fan, and so forth.
- New markets: The establishment of new markets and channels based on engagement in nicheworks.
- Participation or membership: Capturing affinity is instantaneous in its results and value, designing programs around membership drives (such as a fan page, group, and so on) reveals the growth rate of a community (dialogue and interaction also become factors).
- Cost savings or avoidance: What did the company save by applying feedback and insight gleaned from the Social Web, solicited through either feedback or direct interaction.
THE CS OF MEASURING ACTION THROUGH COST
Yes, more Cs! For those in the online marketing and advertising world, this section will be remedial. However, since social methodologies and programs are transforming many disciplines within the business, we are creating hybrids of professionals who now need to become a jack of all trades as well as a master of some.
The Cs in this case refer to cost, which can represent the I in ROI, as it serves as a benchmark for measuring the true price associated with activity—taking the form of monetary and resource assets. Their meaning and value in the era of interactive media is often debated, but using the law of “it depends,” any one or combination of these Cs can help you measure what specifically matters to your business.
Cost per impression (CPM): The cost of acquiring eyeballs through impressions. Payment is often triggered by mutually agreeing upon activities such as a click-through, registration, sale, and so on. The CPM deal is calculated by multiplying the CPM rate by the number of CPM units. For example, one million impressions at $10 CPM equals a total price of $10,000. The amount paid per impression is calculated by dividing the CPM by 1,000—for example, $10 CPM/1,000 impressions = $.01 per impression.10
Cost per click (CPC): The cost or cost-equivalent paid per click-through or a campaign in which payment is based on impressions, not clicks. For example, impressions are sold for $10 CPM with a click-through rate (CTR) of 2 percent. One thousand impressions × 2 percent CTR = 20 click-throughs. $10 CPM/20 click-throughs = $.50 per click.11
Click-through rate (CTR): The analysis of activity that sends a viewer from one place to a place of designation. It is the average number of click-throughs per hundred ad impressions, usually expressed as a percentage. The CTR measures the percentage of people who clicked through a media asset to arrive at a destination site. It is used as a measure of immediate response, but not to show the overall response.
Click to Action (CTA): The introduction of an outcome into the equation and the conversion ratios associated with impression to click-through. Many professionals track CTA in real time to improve imagery, messages, and venues to experiment and improve conversion ratios.
Social media is encouraging metrics that identify real business value, resulting in less interest in click-through rates and more interest in conversion and CTA rates. Active and high click-through rates don't necessarily guarantee good conversion rates, with the two rates often sharing an inverse relationship.12 But with desirable and beneficial outcomes, everything improves.
Eric Von Coelln, who evaluates the numbers behind social media marketing and gaming, assessed the click-through rates after tweets to benchmark engagement. Von Coelln analyzed tweets that contained links from powerhouse brands, including @Zappos, @JetBlue, @SouthwestAir, and @ZyngaPoker. His study found that 1 to 3 percent of active followers actually click through to view the content.13 Hence, CTR in this case didn't necessarily amount to much more than a benchmark number, but if we explored the activity that transpired after the click-through, we could assess conversion rates or, as you see next, the ability to recognize the effects of social actions.
Cost per action (CPA): A model in which payment is based solely on qualifying actions such as sales or registrations. The actions defined in a CPA agreement are tied to conversion, with sales and registrations representing the most common transactions. The CPA model resides at the opposite end of the C spectrum from CPM, with the CPC somewhere in the middle.14 Affiliate marketing, for example, is one of the most-often-referred-to performance-based models, in which merchants and advertisers determine what actions they choose to reward and how much they are willing to pay for that activity.
Cost per engagement (CPE): CPE is a performance-based metric that assumes advertising impressions are free. Advertisers and marketers pay only on the basis of user engagement, wherein a prospect interacts with the content. Examples include polling, games, rollovers, tours, downloads, and so forth.
Another form of CPE is analyzing the fixed costs associated with existing resources such as employees, contractors, and services. We can measure time associated with an activity designed to produce results or drive action. Knowing the cost of time spent to yield an outcome gives us the ability to capture and assess engagement over time as it relates to specific goals.
THE ENGAGEMENT PHASE
Social media is equalizing. As such, the social objects and engagement strategies that are introduced through online communities provide much more value than exposure and branding.
In one such case, David Berkowitz, senior director of emerging media and innovation at 360i, proposed CPSA,15 a new pricing model for social media that factors the cost per social action. CPSA is connected to distinct social qualities that lead to either new relationships (such as through viral referrals or acquiring new followers and fans) or deepening existing relationships (such as through likes, comments, responses, and ratings). Berkowitz proposed that the primary benefit of CPSA is that it offers marketers a program where they know that they are paying specifically for social and relationship-oriented programs.
Engagement value and presence differ from network to network and from community to community. For example, the rate at which people are exposed to and thus interact with an object or person in Twitter is different from the rate in Facebook, which is different from YouTube or blogs. Embedding calculated and productive action within any existing framework allows you to capture a cost per social action, not as a standard industry metric, but as a form of tailored measurement within predefined and understood paradigms. That activity can be measured within each network regardless of the C program mentioned previously, as well as in the free programs we pursue through direct engagement—responding, interacting, sharing content, introducing objects, and so on.
Procter & Gamble became one of the first companies to launch a results-based online ad model that rewards publishers for consumer engagement.16 P&G, which owns brands such as Gillette, Pampers, and Pantene, will offer financial incentives for publishers when its campaigns receive greater engagement, beyond ad or content views, sign-ups, game play, and so on. The move essentially forces publishers to assume a proactive role in embracing accountability and also inspiring creativity to effectively partner with brands to cultivate meaningful interactions with audiences.
In response to P&G's announcement, Jack Wallington, program manager at the Internet Advertising Bureau (IAB), seemed to support P&G, but added a note of caution: “It's not the way the whole market is heading, but looking at more than traffic is a good thing. But even with CPE and other statistics, people are missing a trick in terms of branding power. Even if users don't click through, they could still be engaged. I hope P&G takes that into consideration.”17
Jerry Lloyd-Williams, digital strategy director at U.K.-based media agency Mediacom, believes that CPE requires accountability, making the media buy a more collaborative experience. Mediacom, for example, worked with Volkswagen and Times Online to create a CPE campaign, “A Life More Streamlined,” for the Volkswagen Passat. The Times Online was compensated each time a person watched a video, listened to a podcast, or downloaded material.18
The data, of course, changes from network to network, but it is this information that must be uncovered through industry research or through direct consumer analysis to create an internal benchmark for your activity.
Charlene Li, founder of the Altimeter Group and former social analyst at Forrester Research, conducted a social engagement review in conjunction with Wetpaint of the 100 most valuable brands, as identified by BusinessWeek/Interact.19 The ENGAGEMENTdb 2009 Report observed the engagement programs as well as their performances.20
The team critiqued the brands on the extent (breadth) of engagement across the Social Web as well as level of engagement (depth), such as whether they reply to comments made on blog posts or respond to consumers on Twitter, and so forth. Each brand was given a numerical score.
The top 10 ENGAGEMENTdb brands with their scores in 2009 were:
1. Starbucks (127)
2. Dell (123)
3. eBay (115)
4. Google (105)
5. Microsoft (103)
6. Thomson Reuters (101)
7. Nike (100)
8. Amazon (88)
9. SAP (86)
10. Tie: Yahoo! and Intel (85)
As we're enthralled in the exploration of engagement metrics such as CPE, social actions, or engagement, the ENGAGEMENTdb report did find a correlation between engagement and financial performance.
But even more interesting is that we also looked at the financial performance of the brands, grouping the companies with the greatest depth and breadth into a group called Social Media Mavens. These mavens on average grew 18 percent in revenues over the last 12 months, compared to the least engaged companies that, on average, saw a decline of 6 percent in revenue during the same period. The same holds true for two other financial metrics, gross margin and net profit.
The metrics we establish are derivative of the mission, purpose, and presence we embody throughout the organization and are truly measured by how our intentions are conveyed through the champions and advocates we empower. This sentiment and philosophy is echoed in Li's introduction of the ENGAGEMENTdb report:21
The study also looks at the engagement best practices of four companies: Starbucks, Dell, SAP, and Toyota. Some of the key findings include:
Emphasize quality, not just quantity.
Engagement is more than just setting up a blog and letting viewers post comments; it's more than just having a Facebook profile and having others write on your wall. Don't just check the box; engage with your customer audience.
To scale engagement, make social media part of everyone's job.
The best practice interviews have a common theme—social media is no longer the responsibility of a few people in the organization. Instead, it's important for everyone across the organization to engage with customers in the channels that make sense—a few minutes each day spent by every employee adds up to a wealth of customer touch points.
Doing it all may not be for you—but you must do something.
Start you must, or risk falling far behind other brands, not only in your industry, but across your customers’ general online experience.
Find your sweet spot.
Engagement can't be skin-deep, nor is it a campaign that can be turned on and off. True engagement means full engagement in the channels in which you choose to invest. Thus, choose carefully and advocate strongly to acquire the resources and support you will need to succeed.
We're learning that social media engagement is tied to all outbound forms of marketing, service, communications, branding, and relationship management. It's less about talking at people and more about collaboration and movement, which offer more value and quality to people on both sides of the equation and thus ensures measurable impact.
SHARE OF VOICE AND SHARE OF CONVERSATION
Establishing share of voice and share of conversation tied to sentiment is also a metric of brand health, now and over time and establish share of voice now and over time is to use the techniques shared in the chapter discussing the Conversation Prism and Conversation Index.
It recognizes the state of awareness and reputation to not only measure, but also to inspire rapid evolution.
By listening to the conversations on the Social Web, we can capture the following data using a period of time (a particular month, for example):
1. Number of conversations related to brand or product within all relevant networks (blogs, Twitter, Facebook, and so on).
a. Categorize conversations by networks of relevance
b. Sorted by business unit (marketing, service, product, communications, and so on)
2. Sentiment (positive, neutral, negative).
3. Repeat this process for key competitors.
4. Compare findings by first searching conversations related to the greater market. For example, if we're searching for Lexus against BMW and Mercedes, each of the car manufacturers would represent the share of voice. If we ran a more sweeping search for luxury sedans and then searched the place of each manufacturer within the dialogue, we could establish share of conversation.
This data should be captured in the form of a matrix or report so that we can refer to it every month.
To determine share of voice and the state of sentiment, we simply capture the total number of conversations and organize it as such:
Share of voice: Total conversations in the Social Web compared to brand or competitor share:
- Your brand represents X percent
- Competitor A = X percent
- Competitor B = X percent
- Competitor C = X percent
- Competitor D = X percent
- Total = 100 percent
Sentiment score:
- Total positive, neutral, or negative conversations divided by total number of conversations, including positive, neutral, and negative for a particular span of time (example: 12,000 positive conversations divided by 25,000 total number of conversations = 48 percent).
- Compare results to competitors for each state of sentiment.
COMPARATIVE DATA ANALYSIS
In almost every form of measurement, the need for comparative data is prevalent. At the campaign and brand level, a snapshot of time and activity is necessary to serve as a benchmark related to the state of brand-specific activity as well as that of the competition. Whether it's the Conversation Index, the social influence score, or existing data that reveals sentiment, traffic, and activity volume, sales, action, competitive intelligence, and so forth, we must first establish a benchmark for every program by which to compare future socialization of resources and objects.
For example, how much are you paying now to acquire customers and prospects or market share using other marketing channels and using the preceding metrics?
Everything we discuss and review serves as the base to compare our work and results to internal initiatives and in direct comparison to the efforts of our competitors. Thus, we learn and adapt to create more engaging programs that are measurable and versatile. By defining what it is we need to grow or where we need to reach, we can determine what it is we need to measure, which dictates the social programs we employ and how we ultimately engage.
In the end, the best thing to measure is the estimated activity you plan on capturing. Give them something to talk about. Give them a reason to connect. Monitor, document, and measure everything that happens as a result.
NOTES
1. K. D. Paine, “Establishing the ROI of Social Media,” KDPaine's Meas-urement Standard (May 2008), www.themeasurementstandard.com/issues/5–1–08/painelet5–1–08.asp.
2. “Return on Investment,” The Free Dictionary, http://financial-dictionary.thefreedictionary.com/Return+on+investment.
3. Brian Solis, “The Essential Guide to Social Media: A Free eBook,” PR 2.0 (June 9, 2008), www.briansolis.com/2008/06/essential-guide-to-social-media-free/.
4. “Public Relations Measurement 2010: Five Things to Forget & Five Things to Learn,” MetricsMan (July 29, 2009), http://metricsman.wordpress.com/2009/07/29/public-relations-measurement-2010-five-things-to-forget-five-things-to-learn/.
5. K. D. Paine, “What's Important about Social Media Is What Happens Because of It,” KDPaine's Measurement Standard (July 2009), www.themeasurementstandard.com/issues/7–1–09/painelet7–1–09.asp.
6. K. D. Paine, “The All-Purpose, One-Size-Fits-All Public Relations Meas-urement Program Checklist,” The Measurement Standard Blog Edition (March 11, 2009), http://kdpaine.blogs.com/themeasurementstandard/2009/03/the-allpurpose-onesizefitsall-public-relations-measurement-program-checklist.html.
7. Pat LaPointe, “Twittering Away Time and Money,” Marketing Meas-urement Today (July 24, 2009), http://marketingmeasurementtoday.blogspot.com/2009/07/twittering-away-time-and-money.html.
8. Chris Lake, “10 Ways to Measure Social Media Success,” eConsultancy (March 5, 2009), http://econsultancy.com/blog/3407–10-ways-to-measure-social-media-success.
9. Chris Lake, “Q&A with Zappos CEO Tony Hsieh,” eConsultancy (November 27, 2008), http://econsultancy.com/blog/2955-q-a-with-zappos-ceo-tony-hsieh.
10. “CPM,” Marketing Terms, www.marketingterms.com/dictionary/cpm/.
11. “Cost-per-Click,” Marketing Terms, www.marketingterms.com/dictionary/cost_per_click/.
12. “Click-Through Rate,” Marketing Terms, www.marketingterms.com/dictionary/clickthrough_rate/.
13. Eric von Coelln, “After the Tweet: Exploring Twitter Click-Through Rate Benchmarking to Measure Engagement,” Voncoelln.com (June 3, 2009), www.voncoelln.com/eric/2009/06/03/after-the-tweet-exploring-twitter-click-through-rate-benchmarking-to-measure-engagement/.
14. “Cost-per-Action,” Marketing Terms, www. marketingterms.com/dictionary/cost_per_action/.
15. David Berkowitz, “CPSA: The New Pricing Model For Social Media?” Social Media Insider (August 4, 2009), www.mediapost.com/publications/?fa=Articles.showArticle&art_aid=111081.
16. Suzanne Bearne, “Cover Story: P&G to Pay Publishers Based on Online Engagement,” New Media Age (September 17, 2009), www.nma.co.uk/news/pg-to-pay-publishers-based-on-online-engagement/3004452.article#.
17. “P&G to Pay Publishers Based on Online Engagement,” Mad.co.uk (September 16, 2009), www.mad.co.uk/Main/News/Articlex/038fc4206a70425095eae37466f7ef37/PG-to-pay-publishers-based-on-online-engagement.html.
18. Suzanne Bearne, “Cover Story: P&G to Pay Publishers Based on Online Engagement,” New Media Age (September 17, 2009), www.nma.co.uk/news/pg-to-pay-publishers-based-on-online-engagement/3004452.article#.
19. “The 100 Top Brands,” BusinessWeek, http://images.businessweek.com/ss/08/09/0918_best_brands/index.htm.
20. ENGAGEMENTdb 2009 Report, www.engagementdb.com/Report.
21. Charlene Li, “New Study: Deep Brand Engagement Correlates with Financial Performance,” The Altimeter (July 20, 2009), www.altimetergroup.com/2009/07/engagementdb.html.