Keywords 101: What They Are and Why Most Marketers Get Them Wrong

Keywords are the words and phrases people type into search engines when they are looking for something. They are the bridge between what your audience is thinking and what your content, ads, and pages say. Get that bridge right and you attract the right people at the right moment. Get it wrong and you spend money chasing traffic that was never going to convert.

Most marketers understand keywords in theory. Far fewer use them well in practice. The gap is not technical knowledge, it is strategic thinking.

What Is a Keyword, Actually?

A keyword is any word or phrase someone uses in a search engine. That is the simple version. The more useful version is this: a keyword is a signal of intent. When someone types “best running shoes for flat feet” they are not just searching, they are telling you exactly where they are in their decision process, what problem they have, and roughly what kind of answer they want.

That intent signal is what makes keywords commercially valuable. It is not the keyword itself that matters, it is what the keyword tells you about the person behind it.

I spent years managing large performance budgets across dozens of industries. One of the things that struck me early on was how much money was being spent on keywords with no real connection to what the business was actually trying to achieve. The traffic numbers looked good. The conversion numbers told a different story. The keywords were attracting people who were curious, not people who were ready to act. That distinction is everything.

Head Terms, Long-Tail, and Everything in Between

Keywords are usually grouped into three broad categories based on their length and specificity.

Head terms are short, high-volume, highly competitive keywords. Things like “marketing”, “insurance”, “running shoes”. They attract enormous search traffic and almost no useful intent signal. Everyone searching for “insurance” wants something different. Ranking for head terms is expensive, slow, and often commercially pointless unless you are a brand with enough reach to benefit from general awareness.

Mid-tail keywords are two to three words and start to carry more specific intent. “Car insurance UK” or “content marketing strategy” narrow the audience considerably. They are still competitive but they begin to tell you something useful about what the searcher needs.

Long-tail keywords are longer, more specific phrases. “Cheap car insurance for young drivers in Manchester” or “content marketing strategy for B2B SaaS companies”. Lower search volume, lower competition, and significantly higher conversion rates because the person searching knows exactly what they want. They are closer to a decision.

The mistake most marketers make is chasing volume. Bigger numbers feel like bigger opportunity. But a thousand visitors who are vaguely interested are worth far less than a hundred visitors who are actively looking for what you sell. I have seen this play out repeatedly across client accounts: the long-tail terms that looked modest on paper were consistently the ones driving actual pipeline.

If you want to understand how keyword strategy fits into a broader commercial growth model, the Go-To-Market and Growth Strategy hub covers the wider framework this kind of thinking sits inside.

Search Intent: The Dimension Most People Ignore

Search intent is the reason behind a search. Understanding it is more important than understanding keywords themselves.

There are four main types of search intent:

Informational: The person wants to learn something. “What is keyword research?” or “how does SEO work?” They are not ready to buy. They are gathering information. Content targeting these keywords should educate, not sell.

Navigational: The person is trying to find a specific website or brand. “Semrush login” or “Ahrefs pricing page”. They already know where they want to go. These searches are rarely worth targeting unless you are the brand being searched for.

Commercial investigation: The person is comparing options before making a decision. “Best keyword research tools” or “Ahrefs vs Semrush”. They are close to a decision but not there yet. This is a valuable space to compete in because you can influence the outcome.

Transactional: The person is ready to act. “Buy keyword research tool” or “Semrush free trial”. High purchase intent. These are the keywords performance marketers love because they sit at the bottom of the funnel.

The problem with over-indexing on transactional keywords, which I have seen in almost every performance-heavy account I have worked on, is that you are only capturing demand that already exists. You are not creating it. You are fishing in a pool that someone else filled. That works up to a point, but it does not build a brand and it does not reach people who do not yet know they need you. Forrester’s intelligent growth model makes a similar point about the limits of demand capture as a long-term growth strategy.

How Keyword Research Actually Works

Keyword research is the process of identifying which keywords are worth targeting. It involves understanding what people search for, how often they search for it, how competitive those searches are, and whether the intent behind them aligns with your commercial goals.

The basic process looks like this:

Start with seed keywords. These are broad terms related to your business or topic. If you sell project management software, your seed keywords might be “project management”, “task management”, “team collaboration”. These are not necessarily the keywords you will target, they are the starting point for generating a wider list.

Expand using keyword tools. Tools like Semrush and Ahrefs take your seed keywords and generate related terms, questions, and variations. You will end up with hundreds or thousands of potential keywords. The job then is to filter and prioritise.

Evaluate search volume. How many people search for this term each month? Volume gives you a sense of scale, but it is not the only metric that matters. A keyword with 200 monthly searches and strong commercial intent can be more valuable than one with 20,000 searches and weak intent.

Assess keyword difficulty. How hard is it to rank for this term? Difficulty is usually expressed as a score based on the authority of pages currently ranking. A new site targeting a keyword with difficulty 80 out of 100 is going to struggle. Starting with lower-difficulty terms and building authority over time is a more realistic approach for most businesses.

Map intent to funnel stage. This is where most keyword research falls apart. People do the research, build the list, and then assign keywords to pages without thinking about what the person searching actually needs. Informational keywords need educational content. Transactional keywords need landing pages that make it easy to act. Mismatching intent and content is one of the most common reasons pages fail to convert.

Group and prioritise. Cluster related keywords together. Pages should target a primary keyword and a set of semantically related terms, not one isolated phrase. Search engines understand context. A page about keyword research should naturally cover related terms like keyword intent, search volume, keyword difficulty, and long-tail keywords. That is how modern SEO works.

Keywords in Paid Search: A Different Game With the Same Rules

Everything above applies to organic search. In paid search, the mechanics are different but the strategic principles are the same.

In Google Ads, you bid on keywords and your ads appear when people search for those terms. The intent logic is identical: the keyword tells you what the person wants and your job is to match that intent with a relevant ad and a relevant landing page. Where paid search differs is in the cost and speed. You can get visibility on competitive keywords immediately, but you pay for every click.

Match types matter in paid search. Broad match, phrase match, and exact match control how closely a search query needs to match your keyword before your ad is triggered. Broad match casts a wide net and can generate irrelevant traffic. Exact match is precise but limits reach. Most accounts use a combination, with negative keywords to filter out searches that are clearly irrelevant.

I have audited paid search accounts where the negative keyword list was almost empty. The account was bidding on broad match terms and serving ads to people with no commercial intent whatsoever. The click-through rate looked fine. The cost per acquisition was a disaster. Keyword strategy in paid search is not just about what you target, it is equally about what you exclude.

There is also a brand vs non-brand distinction worth understanding. Brand keywords (searches including your company name) are almost always high-intent and high-conversion. Non-brand keywords are where you compete for new customers. Both matter, but they serve different purposes and should be measured separately.

The Relationship Between Keywords and Content Strategy

Keywords should not drive content strategy. Business goals should drive content strategy, and keywords should inform how that content is shaped and optimised.

That sounds like a small distinction but it is not. When keywords drive strategy, you end up creating content around whatever has search volume, regardless of whether it is relevant to what you sell or who you are trying to reach. You get traffic without purpose. When business goals drive strategy, you start with the audience and the outcome you need, then use keyword research to understand how that audience talks about the problem and what they search for at each stage of the buying process.

The content then serves the audience and the algorithm, rather than just the algorithm.

Early in my career I overvalued the bottom of the funnel. I thought the closer to purchase, the better the keyword. What I have come to understand is that most of the commercial value in search is built further up the funnel, in the informational and commercial investigation phases, where you have the opportunity to shape how someone thinks about a problem before they have decided on a solution. By the time they are searching a transactional keyword, they have often already made up their mind. You are either in the consideration set or you are not. Keywords at the top of the funnel are how you get into it.

Understanding how growth-focused teams use content and search together is useful context here. The teams that do this well treat keyword research as audience research, not just a technical SEO exercise.

Common Keyword Mistakes Worth Avoiding

After two decades of working across agencies and client-side teams, the same keyword mistakes come up repeatedly. They are worth naming directly.

Targeting keywords your competitors target, not keywords your audience uses. Competitive analysis is useful for benchmarking but it should not be your primary source of keyword ideas. Your competitors may be targeting the wrong things too. Start with your audience, not your competition.

Ignoring keyword cannibalisation. This happens when multiple pages on your site target the same keyword, splitting authority and confusing search engines about which page to rank. A clear keyword map, where each target keyword is assigned to one primary page, prevents this.

Treating keywords as static. Search behaviour changes. New terms emerge. Seasonal patterns shift. A keyword audit should happen at least annually, more frequently in fast-moving categories. The keywords that drove traffic two years ago may be losing relevance.

Optimising for keywords without optimising the page experience. Getting someone to click is only half the job. If the page does not match what the keyword promised, they will leave. Bounce rate and time on page are signals that tell you whether your keyword-to-content match is working.

Confusing ranking with results. Ranking on page one for a keyword feels like a win. Whether it drives qualified traffic that converts into commercial outcomes is the actual measure of success. I have seen businesses celebrate rankings that generated no meaningful pipeline whatsoever. The ranking was real. The business impact was not.

Tools like Vidyard’s revenue pipeline research point to a consistent theme across go-to-market teams: the gap between activity metrics and commercial outcomes is wider than most teams realise. Keywords are no different. Activity without commercial connection is just noise.

How to Build a Basic Keyword Strategy From Scratch

If you are starting from zero, here is a practical framework that works regardless of business size or industry.

Step 1: Define the commercial goal. What are you trying to achieve? More leads, more e-commerce sales, more brand awareness in a new market? The goal shapes everything that follows. Without it, keyword research produces a list with no direction.

Step 2: Map your audience’s questions. What does your target customer ask at each stage of their experience? What do they search when they first recognise a problem? What do they search when they are comparing options? What do they search when they are ready to buy? These questions are your keyword seeds.

Step 3: Use tools to expand and validate. Take those seeds into a keyword tool and generate a broader list. Look at volume, difficulty, and the search results themselves. What kind of content is currently ranking? Is it informational, commercial, product pages? That tells you what Google thinks the intent is and what kind of content you need to create to compete.

Step 4: Prioritise ruthlessly. You cannot target everything. Pick the keywords where the intent matches your goal, the difficulty is realistic given your current authority, and the volume justifies the investment. Start with the most commercially relevant terms at a difficulty level you can compete at. Build from there.

Step 5: Create a keyword map. Assign each priority keyword to a specific page on your site. One primary keyword per page. Related secondary keywords that support the primary. This gives you a clear architecture and prevents cannibalisation.

Step 6: Measure and iterate. Track rankings, organic traffic, and conversions from organic traffic. Not just rankings. Rankings are a leading indicator, conversions are the outcome. Adjust based on what is working and what is not. Keyword strategy is not a one-time project.

When I was scaling the team at iProspect, one of the disciplines we built into every client engagement was a quarterly keyword review. Not because the keywords changed dramatically every quarter, but because the business context changed. New products, new competitors, new audience segments. The keyword strategy had to reflect the commercial reality, not just the search data. That discipline is what separated the accounts that grew from the ones that plateaued.

Keyword strategy does not exist in isolation. It is one component of a broader go-to-market approach. If you want to see how it connects to channel strategy, audience planning, and commercial measurement, the Go-To-Market and Growth Strategy hub pulls those threads together.

Keywords and the Bigger Picture

Keywords are a tool. Like any tool, their value depends entirely on how they are used and whether they are connected to a coherent strategy.

The marketers who get the most from keyword research are not the ones who know the most about SEO mechanics. They are the ones who understand their audience well enough to anticipate what those people are searching for, and why, and at what moment. That understanding comes from genuine audience insight, not from a keyword tool.

I remember early in my career sitting in a brainstorm for a major brand, unexpectedly handed the whiteboard pen when the founder had to leave. The instinct was to reach for the obvious, the safe, the high-volume answer. What actually moved the room was the specific, the unexpected, the thing that showed real understanding of the audience rather than just familiarity with the category. Keyword strategy works the same way. The obvious answer is usually the competitive one. The specific, insight-driven answer is usually the one that finds an audience that nobody else is reaching.

That is what good keyword strategy looks like in practice. Not a list of high-volume terms. A map of your audience’s thinking, at every stage of the process, translated into content and campaigns that meet them where they are.

About the Author

Keith Lacy is a marketing strategist and former agency CEO with 20+ years of experience across agency leadership, performance marketing, and commercial strategy. He writes The Marketing Juice to cut through the noise and share what works.

Frequently Asked Questions