9 Common Issues with Data That Make Your Ad Testing Worthless
August 20, 2012
At a recent meeting between Google and one of my clients, we were presented with a staggering statistic: conversion rate increased as our average position increased in the account. Based on this data we had a simple course to chart to climb all the way to the top of the entire Internet: bid higher. When in doubt, just keep bidding. It’ll make all the difference in your ad testing.
It was shocking to see, presented as it was in one of Google’s sleek and no frills Power Point decks. Not only did click through rate increase, conversion rate increased as well. While the conversation continued on all about me, I stared at the screen and felt my mind melting inside my skull. All we have to do is bid up? Just keep bidding higher? Is this what ad testing was? Was everything that Gerald B. Watson ever told me a lie?
After another couple of seconds of mouth-agape world questioning, I realized what was happening. Our branded keywords were the only ones consistently in average position 1-2. I waited politely for a pause in the presentation to ask if, in fact, this set of statistics included branded keywords. After an awkward pause, the very nice gentleman from Google conceded that yes, this data included branded terms. Branded keywords will almost always have a higher CTR and conversion rate than their non-branded counterparts, and if I had followed Google’s simple advice to bid higher on everything it could have meant a disastrous month for me and my client.
It’s important not to silo your data, but it’s also important not to treat all data the same. There’s a reason people talk about wheat/chaff and cream rising to the top and Oreos being milk’s favorite cookie. Some campaigns/positions/targeting methods are just better. You can’t lump data from one in with another; that’ll wreck everything.
The first step is having a high degree of awareness about your accounts so you know what changes have been made recently. From there, identify which of these variables is most important to performance and filter your data accordingly. Don’t make the same mistake that Google did – actively seek out ways to make your test results can be as good as they can be. These are all different factors that can shed light on performance if you use them wisely.
1. Average Position
Higher click through rate in a higher average position is almost a given, so don’t let your new aggressive bidding strategy fool you into thinking your ads are now somehow groundbreaking. You’re just like people using Fast Passes at an amusement park – cutting in front of the line cause you’re willing to spend more money.
2. Types of Campaigns
We talked about this at the opening of the article. Different types of campaigns can have wildly different results, so don’t let bad performance in one combine with great performance in another to make middling data. Create meaningful aggregations to provide insights.
When I’m trying to get an overview of ad text I find it useful to break my ads into campaign types:
(And if you want to get even more specific, competitors campaigns should probably be broken out from non-branded search.) People have been breaking performance out by network for a long time, but it’s similarly important to break out campaign groups within those networks. Don’t let Branded campaigns skew the true performance of your ads.
Education accounts will take off when people are thinking about school. Cruise lines may have a great run when the weather’s particularly terrible. Oreo cookies may take off when an industry-specific blog with dozens of readers mentions them in a post. Be aware of when your high and low points are so you can adjust your testing results accordingly.
4. Quality of Deal Offered
At times your company/client may be offering a great deal that almost sells itself. “Buy one, get one free” will get clicks like crazy. “Half off shipping on orders over $10,000” won’t be as enticing. Despite the wording of your ad, the quality of the offer itself could cloud your results. Experimenting with different headlines during times of a bad promotion may lead you to exclude something that could work really well under better circumstances.
5. Ad Extensions
You may have extensions on some campaigns but not others. You may have different wording on your sitelinks depending on the campaign and the targets. Don’t let these small differences be the reason one ad looks like a star performer. Be aware of the bells and whistles you’re running.
This one is almost as given as segmenting by network. Know the relative performance across the devices you’re targeting so poor performance in one, or really strong performance in another, doesn’t give you the wrong idea about an ad.
7. Time of Day
This one applies particularly if your campaign is limited by budget. If your settings are still on accelerated even though you’re consistently running out of budget, early morning users might have a different reaction to your ads. The first step would be to check your settings (as running accelerated in a limited campaign is a bad idea), and then after that get to know how people respond to your ads depending on when it is.
8. Search Partners
This one could surprise you. Search partner sites (and the users thereon) can have wildly different intents than the main search results page. If you have campaigns that skew heavily toward search partners, be aware of them and filter your results accordingly.
9. Sample Size
This one’s basic. The last one is also the most important one. Don’t act unless you have enough data to be reasonably sure of what to do after your ad testing.
With all of these qualifiers it can start to feel paralyzing. You may think you know what works but then want to check it against yet another segment. This isn’t a post saying that you should check all of these in every case. It’s just a reminder that there are things worth considering. That meeting with Google could have been a turning point in the account. If would have been a wrong turn, so it was good that different angles were considered.
At a certain point you just have to pick a winner and move forward.
How To Analyze Time-Of-Day Performance For Luxury Products
The importance of ad schedules varies across industries, services, and products. For e-commerce companies that sell luxury goods, ad schedules are more crucial.
One Week Left to Save 25% at Hero Conf London!
You still have time to join us for Hero Conf London, 24-26 October at etc.venues St Paul's at 25% off the conference price. But time is running out.
4 Common Questions Prospects Ask Me During The Sales Process
There’s always new, hot topics and questions we get asked by prospects to see what our company’s take is, and how we go about implementing from a services perspective. Read what our most common questions are.
A bi-weekly newsletter packed full of resources and strategies that will help make you a better PPC expert.
Hanapin Marketing | The PPC Agency of Experts Behind PPC Hero
Mobile Price Extensions Rolling Out In AdWords
It looks like "Christmas in July" has come to Google. Recently announced price extensions are designed to help mobile marketers qualify clicks and inform prospective consumers.
[New Whitepaper!] 4 Ways To Survive PPC Campaigns for the Healthcare Market...
This whitepaper will highlight four examples of how thinking at the corners can help boost your PPC performance in the healthcare industry.
Create Visually Appealing Reports With Google Data Studio
When we talk about what tasks tend to eat up a significant chunk of time, reporting is surely mentioned. You may want to explore another option - Google Data Studio.
Liveblogging 2016 DoubleClick Announcements
Today is the day we learn more about the latest DoubleClick updates. Follow along live as we share DoubleClick's announcements as well as our opinions.
The 2016 Top 25 Most Influential PPC Experts
After a month of voting, rigorous research and data analysis, we are excited to announce the wildly anticipated list of the Top 25 Most Influential PPC Experts for 2016.
[New Webinar with AdEspresso!] 4 Effective Strategies for Facebook Lead Gen...
In this new webinar, AdEspresso and Hanapin experts discuss four effective strategies to use Facebook Lead Gen Ads for your business.
PPC Hero Launches New Site!
We're excited to announce the launch of a brand new PPC Hero! We've redesigned the site to be more search friendly with a better navigation system and more opportunity to find the right resources quicker.
How To Get More Out Of Excel Solver
Excel Solver is a fantastic tool, but most examples only cover simple marketing use cases. We’ll cover the next steps of enhancing your models and how to automate the process.
Where You Should Focus Your Facebook Brand Awareness Efforts
Learn the basic metrics to focus on when you want to build awareness on Facebook.
Google To Release New Shopping And Travel Features
Several upcoming changes to Google Shopping and travel-related ads can be expected in the near future. Read to find out more.