PR Measurement Doesn’t Lie: It Just Doesn’t Always Tell the Whole Truth

by / Newsroom Ink on 04/30/2011

by Ed Lallo/Newsroom Ink

In a recent  PRSA seminar on measurement led by Shonali Burke, ABC, attendees were informed that there are two kinds of measurement; bad measurement and good measurement. In reality, careful study of best practices shows that measurement numbers are never intended to tell the whole story – only a specific part over a specified period of time.

What is underlying difference between bad and good measurement?

Bad measurement only tracks impression; it uses the AVE (Advertising Value Equivalent) standard to evaluate the cost of PR coverage obtained; and the measurement is inconsistent.

On the other hand, good measurement tracks only the important information; has a defined standardized base and is performed consistently; it connects collected information to the goals of the business; and tracks outputs, outtakes and outcomes (information that is retained and can be utilized by the intended audience.)

Measurement professionals are moving clients away from the old dollar for dollar AVE measurement standard, to the new standard of Key Performance Indicators (KPI) – which can be easily modified to specified targets.

KPI’s help an organization define and measure progress toward goals set by the organization, once it has analyzed its mission, identified all its stakeholders, and defined its goals.

What are these key performance indicators? Based on quantifiable measurements, agreed to beforehand, they reflect the critical success factors of an organization. These indicators are not standardized, but differ depending on the organization. They are aligned to the key messages of the CEO, executive committee and the brand’s goals.

Like good brand journalism, good measurement must answer the six basic questions: the ‘Who”, “What”, “When’, “Where”, “Why” and “How”.

  • • The “Who” includes the target audiences of media, customers, business partners, employees, governmental agencies and stakeholders.
  • • The “What” is about exposure, brand awareness, brand positioning, market-share and customer education. It also includes: outputs such as speaking engagement and messaging; outtakes that include messaging, understanding and perception the target audience takes away from the campaign; and outcomes that are quantifiable changes in attitude, opinion and behavior occurring as end result of the campaign.
  • • The “When” sets a defined timeframe to compare results to past performances, as well as competitors.
  • • The “Where” is the media channels that are used for the outreach; such as social media tools Facebook and Twitter.
  • • The “Why” is more existential.  A working definition might be – “for every PR action there is equal audience reaction”.  The “why” is used in determining the effectiveness of a campaign.
  • • The “How” are the measurement tools such a website data from Google Analytics and Alexa; phone polling; online polling; surveys; focus groups; media analytics; and phone lines.

The measurement process is all about questions. Questions answered, and those left unanswered. In the end, good measurement must provide answers to the collected data – good or bad. It must also be able to connect the objectives with results, and show how they relate to the strategy of the brand.

PR agencies allocate between five to ten percent of a clients budget toward measurement costs. In the real world of shrinking corporate PR budgets, measurement has become more of a luxury than a standard.

Yet effective measurement monitoring of a campaigns influence, quality, engagement and quantity of response; can be performed effectively even on a limited budget. Measurement tools such as Twitter Search, Google Analytics, Survey Monkey and Alexa; are all cost effective tools to find information on whether the tactics and strategy of your story is reaching the intended audience. For companies with a limited measurement budget, options include Csion and Radian 6.

No matter how a campaigned is measured, one fact remains – the numbers don’t always tell the whole story.

The PRSA measurement seminar included an example of the measurement of an Oklahoma City jeweler’s campaign over a six-year period from 2004 to 2010.

The store effectively moved from ad-based customer outreach to a social media outreach, using Facebook and Twitter. It reduced ad costs, while at the same time increasing store foot traffic and revenues. In every aspect the numbers showed that they did everything right, and the campaign was a huge success.

However, what the numbers didn’t show may leave lingering questions.

The economy of Oklahoma City, where the jeweler was located, revolves around oil and gas. At a time the rest of the country was mired in a recession, OKC was barely affected. What if the jeweler did not embrace social media, and instead continued with heavy ad spending – would the numbers still indicate the same increase, or perhaps even more? What if this jeweler was located in Detroit where the economy had crumbled – would the social media campaign numbers remain the same? The answers are “of course not”.

Measurement numbers will always lie to some extent, because it is impossible to enter every factor into a measurement equation.   This is not to say measurement should not be done, on the contrary, it should be done often…but always taken with a small pinch of salt.

The use of an online newsroom as the “landing page” for social media gives you accurate monthly measurement at a cost-effective price. Content on the newsroom does not fade out of sight within hours, if not minutes, like Twitter and Facebook.  It gives accurate tracking numbers daily, weekly, and monthly.   The newsroom is searchable, and most importantly gives a permanent home for readers to learn, share and become involved with your brand.

Perhaps the most important tool measurement professionals fail to utilize is the same tool journalists use every day while conducting interviews and writing stories – the “gut feeling”.

Is a campaign reaching the intended audience, with the desired outcome? If it is being talked about around the water cooler, over drinks at a bar or on social media; then you are doing something right. If not, then it might be time to start over because – “in your gut, you know it’s just nuts.”


Tags: , , , , , , , , , , , ,

Top