Internet trends: marketing research & predictions

On Google’s new forecasting capabilities and their importance to Market Research

September 7th, 2009 by

Google’s power lies in knowledge. The knowledge of what people search for.
Google shares some of this knowledge as it updates their tool – Google
Insights for Search
.
With a posteriori examination of historical trends – it suggests a basic
model for predicting the next search trends
.
We can now improve the understanding of consumer behavior in variety of
markets and geographical locations.

How does that work?

On many search trends queries, conducted on the Google insight for Search
website, you receive along with the historical data, a 12 month forecast. For good example search for  “iPhone“.

What’s behind Google’s forecasting model?

Google has characterized the predictability of a trends’ series based on its
historical performance. To do so they compared the discrepancy of forecasted trends, applied at some point in the past, to the trends’ actual performance. When the discrepancy between the forecasted trends and the actual trends is smaller than a predefined threshold, Google denotes the trends query as predictable.

Google’s research observations:

– Over half of the most popular Google search queries were found predictable in 12 month ahead forecast, with a mean absolute prediction error of approximately 12% on average. That means that nearly half of the most popular queries are not predictable.

– High predictable categories: Health (74%), Food & Drink (67%) and
Travel (65%).

– Low predictable categories: Entertainment (35%) and Social Networks &
Online Communities (27%).

– To earn more predictable indications – best to search for trends of
aggregated queries (“all categories” option): 88% of the aggregated category
is predictable with a mean absolute prediction error of less than 6% on
average. The larger the aggregation set is, the smaller would be the
variability of the aggregated time series

– There is a clear association between the existence of seasonality
patterns and higher predictability, as well as an association between high
levels of outliers and lower predictability.

GOOGLE_ PREDICTIONS_SEARCH_CATEGORIES

For the above summary results of the 10 categories, the correlation between
the Predictability and the Seasonality Ratio is r= 0.80 while the Deviation Ratio has a (negative) correlation of r= -0.94 with the Predictability.

While TrendsSpotting is working on a new research on US Recession Trends
(you are welcome to contact us for more information) – we have
observed such trends, where seasonality seems high and predictability can
be inferred. Take the trend search for “gift” as a good example for the seasonality effect:

gifts_ search_volume

In many of the consumer industries we have followed, the recession has
definitely distracted seasonality and made forecasting abilities more difficult: Refer to the search for “flight” for example.

flight_ search_volume

Whats missing in Google Insights for Search?

1. As I have pointed out some  years ago – Google Trends Search gives you
relative search volume only (relative to the total number of searches done
on Google over time). It doesn’t represent absolute search volume numbers.
2. While Google does calculate forecast parameters – how about releasing
the data on seasonality and deviation for the specific search?

A Market Research perspective:

I welcome Google for sharing more trends search capabilities.
I personally met a few of the Google Trends team and highly appreciate their work.

Web search trends are very important for the understanding of consumer behavior. In the many years I have worked as a market researcher, I have always preferred direct methods to analyze consumer behavior.
Compare that to surveys – those can tell you mostly about intentions (far future), about previous actions (depending on good memory skills that respondents  don’t have..), and perceptions (but not in a natural manner where one freely chooses to express her/his feelings). Surveys can indeed provide some indications and estimations for behaviors but they lack the means to reflect consumers’ real behavior.
In the last years, web metrics as search trends, blog citations
tools, and social media monitoring tools have captured my full attention. As a Social Psychologist – I find them to be valuable tools in examining people’s natural behavior. TrendsSpotting (company and blog) is all about making sense of it all.

Post to Twitter Tweet This Post Post to Plurk Plurk This Post Post to Yahoo Buzz Buzz This Post Post to Delicious Delicious Post to Digg Digg This Post Post to Ping.fm Ping This Post Post to Reddit Reddit Post to StumbleUpon Stumble This Post

4 Responses

  1. Roger Says:

    This is a fascinating article.

    I expect that this approach will be useful for some applications and not for others. It is not surprising that searches for “gift” are strongly seasonal. The challenge is to apply this observation into actionable market strategy.

    What do you do with the information? Traditional market research can direct you toward or away from a particular message or tactic. Will search data be able to do the same?

  2. Sara Says:

    Great article, finding hot subject for my blog is a challenge and trends a really helpful. I also use http://www.newsonrails.com to get 100 Google’s hot trends, since Google publishes only 40.

  3. betfair winning Says:

    Dazzling article . Will definitely copy it to my blog.Thanks.

  4. Money Man Says:

    5 star article brilliant. I am new to blogging and you used a langauge I can understand

Leave a Comment

Please note: Comment moderation is enabled and may delay your comment. There is no need to resubmit your comment.

Real Time Web Analytics