Why Has Analytics Missed the Mark?
Chapter Overview
Why has analytics missed the mark? This chapter first explores the main reasons responsible for the lackluster performance of marketing analytics and then introduces three prevailing analytics maturity models that not only will help organizations to recognize their analytic maturity state but also provide macrolevel solutions to achieving analytic successes.
This chapter is organized as follows:
Why Has Analytics Not Yet Lived Up to the Promise?
Analytics is the scientific process of transforming data into insight for making better decisions. Since Professor Tom Davenport published his breakthrough book—Competing on Analytics: The New Science of Winning, more leaders see analytics as a new wave of competitive advantage. The application of analytics is becoming commonly accepted in marketing.
Investments in analytics have been increasing steadily. The 2018 chief marketing officer (CMO) Survey conducted by Duke University’s Fuqua School of Business reports that the percentage of marketing budgets companies plan to allocate to analytics over the next three years will increase from 5.8 percent to 17.3 percent, a whopping 198 percent increase.1
However, in the same CMO Survey, top marketers also report that the effect of analytics on companywide performance remains modest, with an average performance score of 4.1 on a seven-point scale, where 1 = not at all effective and 7 = highly effective. It is bothersome that the analytics performance impact had shown little increase over the last five years when it was rated 3.8 on the same scale.2
A 2015 Forbes Insights Report indicates that only 22 percent of marketers have data-driven initiatives achieving significant results. According to ITSMA and Vision Edge Marketing, 74 percent of marketers can’t measure or report how their efforts impact their business.3 These numbers are startling, considering the importance and prevalence of analytics in marketing success and proving return on investment (ROI).
So, why has analytics missed the mark? Below are eight of the most common reasons:
Data make or break a business because that data fuel marketing analytics. Commonly seen issues with data are as follows:
Technology and IT Support Issues
Some commonly seen problems include but are not limited to:
Poor Investment Decisions
Poor investment decisions waste your limited marketing dollars, which is one of, if not, the biggest reasons why your analytics ROI was unsatisfying.
Lack of Analytics Marketers
To compete on analytics, companies desperately need to bring the left-side and the right-side brains together. The convergence of marketing and analytics, which was once nice to have, is now becoming a new trend and business-critical. Analytics marketers are individuals who know analytics and can also speak the language of business. They translate business requirements into terms that analytics and technologists can understand. Conversely, they can also use plain English to show business the value of data, justify investments in analytics, and translate insights gleaned from data into easy-to-understand stories for better decision making. Analytical marketers are critical to improving the competitive advantages of the company. The more analytics marketers a company has, the more likely the company is to adopt an analytically oriented culture and use analytics to make better decisions than the competition. Many companies do not have qualified analytics marketers; they are not yet ready for the era of insight-driven marketing.
Lack of Executive Support
Like any other projects, support from executives is critical to the success of analytics. Organizations need analytical leaders to set and clarify strategic objectives and ensure appropriate project funding. Analytical leaders help secure resources, provide project governance, create high-level organizational buy-in from all stakeholders, manage risks, and make critical decisions. Leading analytically oriented companies often have a couple of senior executives sponsor analytics initiatives; they raise the awareness and analytics IQ within the organization and create and maintain a culture of excellence.
Scarcity of Analytics Professionals and Skills
The shortage of analytics skills means several things:
Company Silos
The company silos present when certain departments or sectors do not wish to share knowledge and information with others in the same company. This lack of information flow results in departmental isolation and territorialism. Company silos can lead to negative customer experience, inefficiency, and duplicate work, and may also contribute to the demise of productive data-driven company culture.
Not Using the Right Metrics and Key Performance Indicators
Metrics are quantifiable measures that are used to monitor and evaluate financial performance, reveal the truth about performance, and provide an actionable way to achieve overall business strategies and goals. Key performance indicators (KPIs) are a subset of metrics that provide a simple, insightful snapshot of a company’s overall performance, as well as reliable, real-time information for effective decision making. Continuously tracking the trends of KPIs for an extended period will help highlight any issues that might otherwise go unnoticed and discover hidden opportunities for further growing your business. However, in reality, quite a few companies make decisions without using the right metrics, thus resulting in low ROI of marketing initiatives. For instance, recently, quite a few multichannel retailers repositioned print catalogs as a branding tool to raise brand awareness and drive traffic to other channels. Did all these retailers make the decision based on KPIs such as customer lifetime value and incremental margin? Probably not. A couple of them I knew made that move simply because other retailers did so.
So, how to fix these problems and improve the ROI of your investments in marketing analytics? The first step, of course, is to identify the gap between you and those analytically competitive firms. Below I’d like to introduce you to four analytics maturity models that will help you not only recognize where you are at on the analytics maturity curve but also get you on the right path toward analytical success.
Davenport’s Five-Stage Analytics Maturity Model
In 2007, Thomas H. Davenport and Jeanne G. Harris published their famous Five Stages of Analytics Maturity Model that classifies organizations into five maturity stages based on five success factors: data, enterprise, leadership, targets, and analysts.
Davenport describes five stages of analytics maturity as follows:
Currently, most organizations are sitting at stage two or three in Davenport’s model. According to a recent study by Gartner, almost 90 percent of organizations have low BI and analytics maturity.5
Davenport’s DELTA Model
In their 2010 book, Analytics at Work: Smarter Decisions, Better Results, Tom Davenport, Jeanne Harris, and Bob Morison introduced the DELTA model. If the Five Stages of Analytics Maturity Model is the industry standard framework for assessing analytics maturity, the DELTA model is the compass for achieving analytics success. As Davenport explains, the DELTA model has five attributes (later, two new elements Technology and Analytical Techniques were added, thus becoming the DELTA Plus model):
The Gartner Continuum Model
In addition to Davenport’s analytics maturity model, two other analytic maturity models are worth your attention—the Gartner Analytic Continuum Model and Wayne Eckerson’s Analytical Maturity Model.
The Gartner Continuum model was developed based on the difficulty and sophistication of analytics. In Gartner’s model, analytics was divided into four stages: descriptive analytics, diagnostic analytics, predictive analytics, and prescriptive analytics.
Wayne Eckerson’s Analytics Maturity Model
While Gartner’s analytics maturity model focuses more on the technical side, Wayne Eckerson tries to combine Davenport and Gartner and provide a comprehensive and holistic approach to achieving analytic maturity. In his book Secrets of Analytical Leaders, Mr. Eckerson introduces an analytics maturity model that helps organizations assess their analytic capabilities and also provides a clear path to analytics maturity. Mr. Eckerson’s model has four axes:
Like Davenport, Wayne Eckerson also drafted a roadmap to analytics success. He developed a very comprehensive analytical framework that highlights the major steps required to run a successful analytical program. Wayne argued that to succeed with analytics, organizations must have the right architecture and data, the right process, the right organization, right people, and the right culture. He cautioned that the ideal path for companies to achieving analytics success was to go from “Flying Blind” straightly up to “Analytic Competitor.” Any other paths would be either too risky or too expensive.
Both Davenport’s and Eckerson’s analytic maturity models are great tools to help organizations recognize their current state on the analytics maturity curve. Not only do these models reveal the critical elements required for the success of analytics, but also plot clear directions for marketers to transform their organizations from analytically impaired to analytical competitors.
Paul Mauschbaugh, Group CIO—Services, Distribution, and Digital at Caterpillar Inc. testified to the accuracy of Davenport’s maturity model. In the article Why Analytics Maturity Matters,6 Paul shared his success story about how he had followed the maturation process and drove analytics into the business at Caterpillar. Paul said he first introduced predictive modeling to the company, but it was not widely accepted by the business side. What he found out was that businesspeople didn’t trust the credibility of the data. Therefore, Paul realized that the first hill to conquer was gaining accountability for the quality of the data within the business community. Paul points out that gaining accountability for the process discipline and thus, the data that are output from that process is a leadership challenge. Establishing KPIs for each line of business and automating the reporting of data against those KPIs is one effective way to drive such accountability. Paul also shared his learning from his amazing journey to analytics maturity at Caterpillar:
Challenges and Opportunities Facing Small- to Medium-Sized Firms
While these analytics maturity models worked great for Caterpillar, marketers at small- to medium-sized firms are worried that the distance between them and their larger competitors are widening. The reasons for such concern are apparent: First, small organizations do not have the best database, high-quality data, analytic talent, and the analytical tools required to perform analytics work. Second, the biggest problem is money. Small- to medium-sized companies typically have a small budget for improving data and technology, recruiting, and training the best analytics talent. And third, neither Davenport nor Wayne has provided a detailed how-to guide to achieving analytics success for small- and medium-sized organizations. Their models are more a compass than a detailed roadmap.
While it is true that lacking money certainly is a considerable constraint that prevents them from taking advantage of what analytics has to offer, the best-kept secret is that small- to medium-sized firms will benefit more from analytics than their larger competitors. Analytics is an equalizer that democratizes the competitive advantages between large and small organizations. Small- to medium-sized companies have some advantages that their larger competitors do not have. First of all, they usually have fewer business units and organizational layers, which help analytical leaders speed up the decision-making process and gain quicker consensus from different stakeholders, although leaders still have to juggle analytics initiatives with corporate politics. Second, compared to large firms, small- and medium-sized companies are quick and agile, enabling faster implementations of analytics initiatives and faster reactions to risks and learning. Last but not the least, analytics in smaller organizations is more a people and analytics IQ problem than a data and technology issue. Money certainly is an obstacle, but it is not as big a deal as you would expect because there are always workarounds if you are creative enough.
The ALADA Model—Five Pillars of Analytics Success for Small- to Medium-Sized Firms
In general, Davenport’s DELTA model and Wayne’s IQ model can be adapted and utilized by businesses of any size. However, these models were developed mainly for large organizations; therefore, adjustments are necessary when applying them to small- to medium-sized companies. Inspired by Davenport’s DELTA model and based on my successful experience in using data-driven strategies to improve marketing for small- to medium-sized organizations, I developed the ALADA Model—a pragmatic and practical roadmap specially designed for small- to medium-sized companies to achieve analytics success.
The ALADA model has five key success pillars:
Difference Between the ALADA model and Other Analytics Maturity Models
Many large organizations started their marketing analytics journey with a focus on data and analysts. Often, the first thing they did was to conquer data accountability and technology upgrades. But for small- to medium-sized companies, while data and technologies are certainly very important, too, the effectiveness and ROI of analytics are largely determined by three types of analytics people—Analytics Marketers, Analytical Leaders, and Analytics Scientists. Together, they determine the analytics IQ and analytics maturity of an organization.
The First Pillar: Analytics Marketers
In most organizations, many dialogues between marketing and analytics take place every day. Most of them, however, are initiated by the marketing side requesting the analytics team to complete specific assignments such as testing product offers or reporting the result of a recently completed direct mail promotion, and so on. In other words, these conversations are centered more at the tactical level rather than the strategic level.
On the marketing side, while marketing does understand that analytics can supply them with significant new decision-making firepower, still, some marketers don’t enjoy talking to analytics because they don’t quite understand the language of analytics. Also, because few marketers have received essential training in statistics and analytics, they might not realize that their internal analytics partners can solve many tough problems if they reach out to their analytical team.
On the analytics side, most analysts are strong in math and coding but don’t have much marketing knowledge and real-world business experience. Due to lack of marketing education and business acumen, some analytics work is not conducted in the context of business. Therefore, the findings and insights while seemingly statistically sound are not actionable, or one insight would cause another or more questions.
Another big challenge for analysts is that most of them are not fluent in business language. Marketers feel that analysts speak a language of their own, not the language of business. According to a 2017 KPMG study, many executives say that they don’t trust their own analytics. It is a shame.
This is when the analytics marketers kick in to help. I borrowed the idea of analytics marketers from Mr. Eckerson. He first defined them as “purple people,” being neither “blue” business leaders or “red” technology leaders but a balanced blend of the two. Because the term “purple people” often demands a further explanation, I came up with a more descriptive name: analytics marketers—individuals who know analytics and also can speak the language of business.
What Does an Analytics Marketer Do?
Analytics marketers are conduits between analytics, IT, and marketing executive decision makers. They translate business requirements into terms that analytics and technologists can understand. Conversely, they also use plain English to show business the value of data and how to exploit it through analytics. Analytics marketers translate insights gleaned from data into actionable recommendations and ultimately into the impact at scale in an organization.
In their role, analytics marketers add value through performing the following tasks within an organization:
A small-sized business needs at least one to two analytics marketers, whereas a medium-sized company will need more. Analytics marketers can be people at any level, but ideally, they are middle- to upper-level managers such as vice president (VP) marketing, VP analytics, marketing managers/directors, analytics managers/directors, or analytics scientists.
The Second Pillar: Leadership
Like any other initiative, support from executives is critical to the success of analytics projects. Davenport considered leadership the deciding DELTA factor. “If we had to choose a single factor to determine how analytical an organization will be, it would be leadership. If leaders get behind analytical initiatives, they are much more likely to bear fruit.”7
Mr. Eckerson also concurred: “The biggest factor that determines analytical success does not involve technology; rather, it involves leadership.”
Broadly speaking, analytics marketers are analytical leaders. However, in the ALADA model, the analytical leader specifically refers to the top executives who sponsor analytics initiatives.
What Does an Analytical Leader Do?
A successful analytical leader does not have to know a lot about analytics. But he or she must recognize that data are critical corporate assets and analytics is the new science of winning. Marketing executive Steve Larkin has helped many retailers to turn around their businesses. I had the pleasure of working with Steve for many years, first at Zales, then Golfsmith, and most recently Charles & Colvard. He always starts his turnaround strategies with fixing the bad customer data and creating a centralized database accessible to both online and offline teams. The improved and consolidated database will lay a good foundation upon which an integrated omnichannel marketing strategy can be implemented. Steve cautions, “It is a needed and often misunderstood and mismanaged topic. Determining and prioritizing the most critically impactful and actionable data is key.”
Essentially, an analytical leader needs to do at least these five things below to ensure successful outcomes of analytics programs:
Bernie Sensale was my boss when we both worked for Zale Corp almost 20 years ago. Shortly after Bernie became the chief marketing officer of Zale Corp, he quickly identified several major analytics issues with the marketing department:
In the next 12 months, I witnessed how Bernie magically transformed an analytically blind organization into an analytical company. What Bernie did was:
Considering Bernie did all these things before Davenport published his breakthrough book Competing on Analytics, even up to date, I am still amazed and very impressed by his textbook-like strategic move.
Matt Corey is the CMO of PGA Tour Superstores. I worked for him during my days at Golfsmith. Matt is a brilliant and charismatic marketing executive. His way to improve marketing results is to hire smart people who have a can-do attitude. Matt’s ability to find so many competent marketers is enviable. Matt understands the importance of marketing analytics. He encouraged the team to embrace advanced analytics and statistical modeling to improve the performance of marketing initiatives. He promoted marketing analytics among senior executives and gained support from IT and merchants. In 2012, SAS voted Golfsmith the best analytics company in the small- to medium-sized company sector.
Those good analytical executives all have similar traits: They are willing to invest in the best people, they take calculated risks and have the courage to challenge the status quo, and they have the ability to gaze into the future.
The Third Pillar: Analytics Scientists
Here an analytics scientist is not an average data scientist or statistician, but one who has:
Most average analytics professionals have analytical intelligence but are typically weak in creative intelligence, probably even weaker in practical intelligence. A true analytics scientist has a combination of good data knowledge, fluency in programming languages like SAS, R, or Python, mathematical and statistical knowledge, an insatiable curiosity, business acumen, and the ability to creatively solve real-world problems.
The best value an analytics scientist brings to the table is that he or she spearheads new ways to transform current practices. He or she can come up with creative and innovative solutions to solving problems with a very limited budget and technical constraints.
For instance, Golfsmith couldn’t afford to buy a campaign management system, which generally would easily demand a cost up to a quarter-million a year for licensing, training, and a business analyst using the system. So how to solve this issue? Our solution turned out to be quite simple. We worked with the IT team to add a campaign data mart in the database. Then we put the Base SAS on the top of the Oracle database and created an in-house campaign management system that worked far more efficiently than any campaign management system currently available in the market. The invention literally saved Golfsmith more than $250K a year and every year.
The Fourth Pillar: Data and Technologies
Compared to their larger competitors, small- to medium-sized companies typically do not have a centralized data platform that is accessible to all stakeholders. However, being small also has several advantages. First, you can improve the quality of the data with a modest budget. Second, without having to rely on IT support solely, the analytics team can step in and use analytical tools such as SAS, R, or Python to stitch data from disparate databases and create a temp centralized customer database, which can be used by many teams. And third, if you are creative enough, small- to medium-sized companies can create many in-house analytical applications such as the campaign management system that will work equally well as those big-name tools and will save a huge amount of money for the organization. That is why I always say that it is totally possible that small- to medium-sized organizations can achieve the same or even greater significant analytics success with just a fraction of the costs of their large competitors.
The Fifth Pillar: Analytically Oriented Culture
It is difficult to give a concise definition of what an analytically oriented culture is. Basically, an analytically oriented company has the following traits:
In a nutshell, the secrets to achieving analytics success are that you must recruit and retain the right analytics people, get the data and technologies right, and create an analytically oriented culture within the organization.
Conclusion
The disappointing results of analytics initiatives were typically caused by one of or a combination of several issues relating to data, technologies, leadership, analytics people, organization structures, process, and corporate cultures. To achieve success with analytics, firms need to take advantage of Davenport’s Five Stages of Analytics Maturity Model to recognize their analytic maturity state and then follow Davenport’s DELTA model and Wayne’s analytical framework to improve their analytics capabilities. Sometimes, a fundamental shift in organizational structure, skills, and culture is required.
Small- to medium-sized companies approach marketing the same way as large companies do. They have unique advantages and disadvantages when it comes to analytics. Complementing Davenport’s DELTA model and Wayne’s analytical framework that is more suitable for large organizations, Mu’s ALADA analytics maturity model was specially developed for small- to medium-sized companies to break through the budget and technical constraints and transform their organizations into analytical competitors as well.
Analytics leaders should also be aware that while these analytics maturity models have revealed the secrets to improving analytics’ capabilities, they are more a compass than a detailed roadmap. Therefore, in real life, innovations in analytics at more granular levels are encouraged and required.
In the rest of the book, we will explore how to leverage marketing analytics to improve ROIs for a variety of marketing channels and how to use the right metrics and KPIs to measure the effectiveness of marketing programs so that marketers can maximize the ROI of their marketing dollars.
1 CMOSurvey.org. February 2018. “The CMO Survey.” https://cmosurvey.org/wp-content/uploads/sites/15/2018/02/The_CMO_Survey-Highights_and_Insights_Report-Feb-2018.pdf
2 CMOSurvey.org. February 2018. “The CMO Survey.” https://cmosurvey.org/wp-content/uploads/sites/15/2018/02/The_CMO_Survey-Highights_and_Insights_Report-Feb-2018.pdf
3 Simpson, J.E. 2017. “Tracking Your Marketing Efforts: Why It’s Important and How to Start.” Forbes.com, October 16, 2017, https://forbes.com/sites/forbesagencycouncil/2017/10/06/tracking-your-marketing-efforts-why-its-important-and-how-to-start/#1e88ba9d31e8
4 Davenport, T.H., and J.G. Harris. 2007. “Five Stages of Analytic Competition.” Computerworld, September 17, 2007, https://computerworld.com/article/2553020/five-stages-of-analytic-competition.html
5 Gartner Press Release. 2018. “Gartner Data Shows 87 Percent of Organizations Have Low BI and Analytics Maturity.” December 6, https://gartner.com/en/newsroom/press-releases/2018-12-06-gartner-data-shows-87-percent-of-organizations-have-low-bi-and-analytics-maturity
6 Mauschbaugh, P. “Why Analytics maturity Matters.” Thoughtspot.com, https://thoughtspot.com/fact-and-dimension/why-analytics-maturity-matters
7 Davenport, T.H., J.G. Harris, and R. Morison. 2010. Analytics at Work: Smarter Decisions, Better Results. Harvard Business School Publishing.
18.222.148.124