The URLs Visitors Still Ask For: A Broken-Link Demand Audit for UK SMEs
Photo: Francisclarke, CC BY-SA 4.0, via Wikimedia Commons
A 404 page is usually treated as a minor technical inconvenience: something to fix quietly, or perhaps to decorate with a friendly message and a link home. That view misses the commercial value in the error itself. Every request for a URL that no longer exists is a small piece of evidence. It may come from a customer following an old link, a search engine revisiting a page it once knew, or an automated scanner probing for weaknesses. For UK small and medium-sized enterprises, the useful discipline is to separate those signals and ask what each missing URL is trying to tell the business.
Treat the error log as a demand record
A broken-link audit begins with collection, not correction. Over a representative period, such as the past 90 days, gather 404 and similar error responses from server logs, the Page Indexing report in Google Search Console, analytics platforms and a broken-link crawl of the website. Record the requested path, the number of requests, the referrer where available, the user agent and whether the link appears to originate internally or externally.
Patterns soon emerge. A cluster of requests for an old service page may point to a renamed offer. Repeated attempts to reach a discontinued product may show that stock has gone but interest has not. Requests for a former branch or location page may reflect local demand that has never been redirected properly. None of these findings automatically justifies a new page. They do justify a structured review.
Filter out the noise before drawing conclusions
Not every missing URL deserves attention. Automated scanners routinely request paths such as login pages, configuration files, administrative directories and long random strings. These are probes rather than customer demand and should be excluded from the main review unless they reveal a genuine security or configuration issue. The same applies to obviously malformed URLs generated by outdated tracking parameters.
Search engine crawler requests require different treatment. They show that a URL is still known to the search ecosystem, often because of an old sitemap, an external link or a legacy redirect. These requests are not proof of consumer interest, but they are a useful prompt to check whether the page should exist in some form. Human requests are usually the strongest signal, particularly when they arrive with a relevant referrer or follow a recognisable service, product or location pattern.
Sort the missing into four practical buckets
A simple classification keeps the audit manageable. First, redirect: a live page already meets the same need, so a permanent redirect to the closest relevant destination is appropriate. Second, rebuild: the missing URL reflects clear, repeated human demand and there is no suitable replacement. Third, retire: the page is deliberately obsolete and should remain absent. Fourth, monitor: the evidence is ambiguous or the volume is too low to justify action yet.
The redirect bucket is where many UK SMEs cause themselves unnecessary problems. Sending every missing URL to the homepage is rarely relevant and can confuse both visitors and search engines. A redirect should take the user to the nearest equivalent content, whether that is a renamed service page, a category page or a refreshed location page. Check for redirect chains and update internal links so that the old URL is no longer promoted.
Rebuild only where the evidence supports it
Rebuilding is not the same as restoring. If a missing service or product page attracts repeated human requests, a compact replacement may be worthwhile, provided the business still offers the relevant service and can describe it accurately. Use the wording in the requested URLs and referrers as a clue to what people expected to find. Include current pricing guidance where appropriate, clear contact routes and a straightforward explanation of what has changed.
Where a page has been intentionally withdrawn, retirement is a legitimate outcome. A 410 response can indicate permanent removal, although a standard 404 is also acceptable. The important step is to remove internal links to the retired URL, update sitemaps and avoid promoting it in campaigns or email templates. A dead end is only a blind spot if the business keeps pointing people towards it.
Make the review a monthly habit
A monthly routine of 30 to 45 minutes is usually enough for a small website. Export the latest 404 data, exclude obvious bot traffic, tag each URL with one of the four buckets, and assign an owner for any redirect or rebuild. Fix the most prominent internal broken links first, because they affect both visitors and crawlers. Keep a short register of decisions so that the same URLs are not debated repeatedly.
Each quarter, review the redirect map for chains, irrelevant destinations and pages that should now be retired. Each year, check legacy campaign URLs and former service names that may still attract external links. The aim is not to eliminate every 404 response. It is to ensure that the ones which matter are seen, assessed and resolved with commercial relevance in mind.
A 404 is a door, but not every door needs to be reopened. For UK SMEs, the value lies in reading the requests carefully, distinguishing real demand from automated noise and making a deliberate choice: redirect, rebuild or retire. Handled this way, dead ends become a modest but reliable source of search insight rather than a permanent blind spot.
