Keyword Research Framework
Keyword research is demand mapping, not word collecting
The naive version of keyword research is opening a tool, typing a seed term, and exporting every suggestion with decent volume. That produces a list, not a strategy. Real keyword research maps search demand to search intent to business value, then prioritizes a build queue against the gaps between what people search for and what your site currently ranks for.
Done properly, it answers three questions in order: what are people actually typing, what do they want when they type it, and which of those searches are worth the effort of ranking for.
Search intent: the filter that matters more than volume
Every query maps to one of four intent categories, and ranking for a keyword with the wrong content type for its intent is the single most common reason pages don't convert even when they rank:
- Informational — "what is marketing attribution" — the searcher wants to learn. Best served by guides, definitions, explainers.
- Navigational — "hubspot login" — the searcher wants a specific site. Nearly impossible to rank for unless you own that brand.
- Commercial investigation — "best email marketing tools for ecommerce" — comparing options before deciding. Best served by comparisons, reviews, "best of" content.
- Transactional — "buy klaviyo subscription" / "hubspot pricing" — ready to act. Best served by product, pricing, and landing pages.
Google's own results reveal intent: check the SERP for a target keyword before writing anything — if it's full of listicles and comparison articles, a product page will not outrank them regardless of quality.
Intent mismatch wastes the ranking you get
Keyword difficulty: what it measures and what it doesn't
Keyword Difficulty (KD) scores from tools like Ahrefs and Semrush estimate how hard a keyword is to rank for, primarily by modeling the backlink profile strength of the current top-ranking pages. A KD of 70 generally means the current page-1 results have strong, hard-to-replicate backlink profiles.
The caveat every practitioner needs: KD scores backlinks, not content quality, topical authority, or SERP feature saturation. A keyword can show low KD but be effectively unwinnable because the SERP is dominated by AI Overviews, a featured snippet, and three "People Also Ask" boxes above the first organic result — leaving little real estate regardless of how weak the competing backlinks are.
Long-tail strategy: where new sites actually win
Search volume follows a power-law distribution: a small number of head terms ("CRM", "email marketing") carry enormous volume and near-impossible competition, while a long tail of specific, lower-volume queries ("how to set up UTM parameters for Klaviyo campaigns") carries far less individual volume but is dramatically easier to rank for and converts at a higher rate because the searcher's need is precisely defined.
The long-tail strategy for new or low-authority sites: target dozens of specific long-tail queries clustered around a topic before attempting the head term. Each long-tail page earns some authority and internal-linking equity; collectively, they build the topical depth that eventually makes competing for the head term realistic.
Head terms vs. long-tail keywords
| Dimension | Head term | Long-tail |
|---|---|---|
| Example | "email marketing" | "email marketing automation for shopify abandoned carts" |
| Search volume | Very high | Low to moderate |
| Competition | Very high | Low to moderate |
| Conversion rate | Low (broad intent) | High (specific intent) |
| Time to rank (new site) | Months to years, often never | Weeks to months |
Tooling: Ahrefs, Semrush, and what each is actually for
Ahrefs and Semrush are the two dominant paid platforms; both combine a keyword database (search volume, KD, related terms) with a backlink index and a rank tracker, but they have different strengths in practice. Ahrefs generally has the larger, more frequently refreshed backlink index and is favored for competitive link analysis. Semrush has stronger PPC/paid-search data (advertiser competition, CPC estimates) because it grew out of an SEM tool, making it useful when keyword decisions need to account for paid channel cost.
Free alternatives — Google Search Console (actual query and impression data for your own site, the most accurate source available), Google Keyword Planner (volume ranges, biased toward advertiser use cases), and AnswerThePublic-style question aggregators — fill gaps without a subscription, though none replace a competitive backlink index.
# Google Search Console > Performance > Search results
# Filter: Pages containing "/blog/" | Date: Last 3 months
# Sort by Impressions desc, then find rows where:
# Impressions > 500 AND Average Position between 8-20
# = pages already earning visibility, one optimization push
# away from page 1. Highest-leverage keyword list you have,
# because it's YOUR real ranking data, not a competitor estimate.Clustering keywords by topic, not by exact match
Modern search engines group semantically related queries and often rank a single well-built page for dozens or hundreds of keyword variants simultaneously. Building one page per exact-match keyword (a common legacy SEO practice) creates cannibalization — multiple pages on your own site competing against each other for the same ranking slot, diluting authority across both.
The fix is keyword clustering: group keywords that share the same search intent and SERP overlap (check by comparing which URLs already rank for each term) into a single cluster, then build one comprehensive page targeting the cluster as a whole, with the highest-volume term as the primary target and the rest addressed as subheadings or supporting sections within that same page.
Check SERP overlap before splitting into separate pages
What's next
A prioritized keyword list is the input; turning it into a coherent site structure that avoids cannibalization and builds topical authority over time is the next step.
Next: Content Marketing Strategy →
I build these systems professionally.
Whether it's a RAG pipeline, analytics migration, or AI workflow — let's talk.