Keyword Best Practices: the Seven Habits of Highly Successful Search Engine Marketing

When I first wrote about the seven habits of effective SEM, my primary motivation was to point out that keyword selection was not the end all, be all of SEM. I have seen too many people waste too much of their day trying to come up with that killer ‘long tail’ keyword, instead of spending their time more wisely on other equally important aspects of SEM. Indeed, I sometimes wonder whether keyword selection still deserves to be a top seven SEM technique, since the search engines continue to ramp up their broad matching technology (see, for example, Google’s recent “advanced broad match” announcement and Yahoo’s new terms and conditions which allow them to optimize your accounts for you), making it more and more difficult to find keywords where your competitors are not.

In the end, I concluded that keywords are indeed still important, just not as important as they once were. So here are my best practices for keywords:

1. Create Basic Keywords. Synonyms, action prefixes and suffixes, runons and misspellings, plurals (Google only). Before you start investing in expensive keyword research tools (some of which can cost up to $30,000 a year!), I recommend that you simply brainstorm a basic set of keywords. There are five types of keyword sets that every campaign should have. These are:

a. Root terms. This is the most basic keyword that relates to your campaign. If you are buying keywords for a mortgage lead campaign, this would include words like “mortgage”, “mortgage rates” and “mortgage quotes.”

b. Synonyms. Alternative words that basically mean the same thing as your root terms. Again, thinking about mortgages, this might include “home loans”, “refinancing”, and “home equity.”

c. Action Prefixes and Suffixes. These are words that you can append to the front or back of a root term or suffix that user might type in to further qualify their query. There are two types of prefixes/suffixes: general and category-specific. A general prefix would be something like “buy”, “find”, or “best.” A category-specific prefix might include a geographic region, a qualifying statement “bad credit”, or a commercial name like “Wells Fargo.” Note that the most generic prefixes and suffixes (like “the”) have now been almost entirely broad-matched out of existence, so if you see a prefix or suffix getting no traffic, this may be the reason (and you should probably delete that keyword to clean up your account).

d. Run-ons and Misspellings. Like generic prefixes and suffixes, the utility of run-ons and misspellings is much less than it once was. Still, you can sometimes get a few cheap clicks by creating words like “mortgagerates” and “refiancing.” You should put these in their own ad groups, especially if you are using dynamic keyword insertion (DKI) in your ad text. I recommend that you don’t get too carried away with run-ons and misspellings – you should limit this practice to the highest volume keywords in your account.

e. Plurals. There can be significantly different user behavior on a singular versus plural keyword (see further discussion below). As such, you need to make sure that all of your top keywords include both iterations. Note that this is not necessary for Yahoo, as Yahoo does not differentiate between singular and plural.

If you create five root terms, five synonyms, 10 prefixes and suffixes, and use plurals, this will result in a list of 200 keywords. Add in another 20 misspellings and you are up to 220 keywords. Add in all 50 states, specific cities, and combining prefixes and suffixes on the same keyword, and you can see how these five simple rules can quickly build a keyword set for you without ever touching a fancy keyword tool!

2. Don’t Overdo It. While it may be true that the keyword “Pacifica California Subprime Refinancing Interest Rates Mortgage Companies” will not be specifically purchased by many of your competitors, it is no longer true that you alone will show up on this keyword should you be the only one to buy it. As I have noted numerous times in the past, the search engine “broad matching” algorithms have gotten increasingly better at aggregating tail keywords into the same auctions with head terms.

In the past, there were two advantages to tail terms – first, that you could show up by yourself on that keyword (no longer the case with broad matching), and second, that you could improve your click through rate (CTR) for that specific query and pay less for high position. The second may still be true to a limited degree, but you aren’t going to be able to pay $.10 on a six token (word) keyword phrase and outperform a big competitor paying $5.00 on a head keyword.

Moreover, Google has explicitly stated that keywords beyond five tokens will be automatically considered “low quality” by their Quality Score algorithm. The rationale behind this (which I don’t necessarily buy, by the way) was recently summarized as follows:

“very long phrases and very low volume keywords well down the long tail are not necessarily an advantage to a marketer, as they don’t reflect how “real users” normally search. The sweet spot of the long tail is 2-to-4-word phrase. 5-8 word phrases, not so much. Among other things, Google will have such limited data on these, they have no choice but to assign slightly worse quality scores to them.”

The other hidden danger of millions of obscure keywords is the risk of either slow bleeds or sudden keyword explosions. A slow bleed occurs when you have 50 or 100 keywords costing you $2 or $3 a month. These keywords fly below the radar but gradually can cost you thousands of dollars a year. Unless you have a bid management system that has the ability to cluster similarly-situated keywords, you are unlikely to discover these bleeders.

A sudden explosion occurs when one of your random long-tail keywords is suddenly matched on a major search, or a news event causes that keyword to get a spike in traffic. As an example, a few years ago I bought the word “Pope mortgage”, which happens to be the name of a city with the word mortgage appended to the end. When Pope John Paul II died, this keyword received a huge rush of unprofitable clicks in a short time.

All this being said, there is still value to the long tail. For most non-retailers (i.e., companies that don’t have thousands of products for sale), a good rule of thumb is to have somewhere between 500 and 5000 keywords in your account. If, however, you find yourself patting yourself on the back for having developed three million keywords, you are living in the past and need to start living in 2008!

3. Keep Them Targeted. Although Google allows 2000 keywords in an ad group, this does not mean you should strive to pack as many keywords into as few ad groups as possible. Indeed, in most instances, you will be better served by having few keywords in many ad groups. There are two primary reasons for narrowly targeted ad groups: CTR and Quality Score. Your CTR will increase if your keywords are closely related to your ad text. Segmenting similar keywords into well-defined ad groups enables you to create very relevant ad text.

Your Quality Score will also benefit from well-defined ad groups. Google rewards advertisers who send a targeted keyword to a targeted ad text to a targeted landing page. When you combine a better Quality Score and higher CTR, you have solved two of the three factors that impact your position on Google (the other being max CPC). This can enable you to pay a lot less than your competitors for the same keywords.

Just to be clear, you could take this targeting approach to the extreme by literally having a one-to-one relationship between a keyword and an ad group. If you have the ability to automatically create relevant ad text and automatically make bid adjustments, this might makes sense. If you are doing most of your work manually, however, the management costs associated with thousands of ad groups may not be worth the effort.

4. Track at the Keyword Level. Keywords are the DNA of your SEM campaigns. As such, you need to measure their performance on a keyword by keyword basis. Whenever I see a tracking URL that reads www.domain.com/?campaign=GoogleAdWords I know that the campaign is not being properly optimized. Individual keywords will vary tremendously in terms of performance. I often use the example of the word “mortgage rate” and “mortgage rates” to prove this point. Someone who types in “mortgage rate” is most likely looking for today’s current mortgage rate; someone who types in “mortgage rates” is looking to get multiple mortgage quotes. Depending on your business, the conversion rate between these two keywords can vary dramatically.

5. Test Match Types. Google offers three match types – broad, phrase, and exact – and you should make a point to test keywords on all of these match types. In most cases you will find that your exact match keyword has the highest conversion rate but also costs you the most with the least amount of traffic, and that the exact opposite is true for broad match. But every account is different and you need to test performance for your specific campaign. Note that I don’t count match types as part of the total number of keywords in your campaign – in other words, if you have 5000 keywords but you match each of these three times, your account would have a total of 15,000 keywords, which I still think is acceptable without “overdoing it.”

6. Be Negative. The number one mistake I see novice search marketers make is not paying enough attention to negative keywords. As the search engines continue to push the limits of broad matching, your best defense against getting a lot of unproductive clicks is to buy tons and tons of negative keywords. There are two ways to create negative keywords. The first way is to create a generic list of negatives that will apply to almost any keyword. This could include words like “lawsuit, complaint, refund, scam, do it yourself, free, sex, UK, etc” – this will vary of course depending on your business.

The second way to create negative keywords is to use the Google keyword tool and look for words that might be semantically related to your product but are in actuality not at all related. A funny example of this would be to exclude the word “one” from an advertisement for “night stands” that are used for bedroom furniture. I consider the creation of negative keywords to be just as important as the creation of actual keywords.