A website can have useful content and a strong brand yet still underperform in organic search because search engines cannot efficiently crawl, interpret, or serve its pages. A technical SEO audit is a structured way to identify those obstacles before they become persistent ranking, traffic, or user-experience problems.
The goal is not to collect the largest possible list of warnings. The goal is to determine which technical issues affect important pages, understand their likely cause, and give the right person a clear fix. A small business website may need only a focused review, while a large ecommerce or publishing site may require crawling, log analysis, template testing, and ongoing monitoring.
This guide explains a practical audit process and the questions to ask at each stage. For broader context, see the technical SEO pillar and the related SEO services overview.
What a technical SEO audit should evaluate
A useful audit examines the systems that determine whether search engines can discover, access, interpret, and revisit your pages. Core areas include:
- Crawlability and crawl directives
- Indexing controls and index coverage
- Canonical URLs and duplicate page versions
- Redirects, status codes, and broken links
- Site architecture and internal linking
- Mobile rendering and responsive behavior
- Page performance and key user-experience signals
- Structured data and page metadata
- HTTPS, domain versions, and security configuration
- International, multilingual, or faceted-navigation controls where relevant
Not every finding has the same business impact. An inaccessible revenue page deserves more attention than a minor warning on an unimportant archive. Always connect technical findings to page importance, search intent, conversions, and implementation effort.
1. Establish the audit scope and baseline
Before running a crawler, document the site you are auditing. Record the preferred domain, protocol, important subdomains, staging environments, major templates, and any recent migrations or redesigns. Confirm whether the audit covers the whole domain or a specific section.
Create a list of priority URLs, such as the homepage, service pages, product or category pages, location pages, key articles, and conversion pages. These URLs provide a manual comparison point against automated findings.
Also collect available baseline information from analytics and search performance platforms. Look for changes in organic traffic, indexed pages, impressions, clicks, conversions, and crawl or coverage patterns. If page-level data is unavailable, state that limitation rather than implying a diagnosis from incomplete evidence.
2. Check crawlability and robots.txt
The robots.txt file provides crawl guidance for compliant crawlers. Review whether it unintentionally blocks important folders, page templates, JavaScript, CSS, images, or entire sections of the site.
A sound review asks:
- Is the file available at the expected root location?
- Are important search-facing URLs disallowed?
- Are development, account, cart, filter, or internal-search paths controlled appropriately?
- Does the sitemap reference point to a valid, preferred sitemap location?
- Do the directives match the site’s actual architecture?
Robots.txt is not a substitute for authentication or a reliable method of removing a URL from search results. Sensitive material should be protected through appropriate access controls. Likewise, blocking a URL from crawling does not necessarily communicate that the URL should be excluded from indexing if it is discovered elsewhere.
3. Inspect XML sitemaps
An XML sitemap can help search engines discover important URLs, particularly on large, frequently changing, or internally complex sites. Confirm that sitemap files load successfully and contain only canonical, indexable URLs that return successful responses.
Check for redirected URLs, broken URLs, noindex pages, parameter variants, duplicate entries, and stale content. Segmenting sitemaps by content type or site section can make diagnostics easier. A sitemap should support a clear site architecture; it should not be used to compensate for weak internal linking.
4. Review status codes, redirects, and broken links
Every important URL should have an intentional response. Successful pages generally return a success status, removed pages may require a carefully selected not-found or gone response, and permanently relocated pages should use an appropriate permanent redirect.
Prioritize:
- Internal links returning errors
- Redirect chains and loops
- Temporary redirects used where a permanent move is intended
- Links to outdated URL versions
- Large groups of redirected URLs in navigation or sitemaps
- Soft error pages that return success codes while showing an error message
Do not redirect every deleted page to the homepage. When there is no close replacement, a useful not-found page is often clearer for users and crawlers. Redirects should preserve intent whenever a genuinely relevant destination exists.
5. Confirm canonicalization and indexing controls
Canonical signals help consolidate substantially similar URL versions, but they are hints rather than a universal solution. Review the canonical element on priority pages and compare it with the page’s response, internal links, sitemap inclusion, and indexability directives.
Look for conflicts such as a page that points canonically to another URL while being listed in the sitemap as preferred, or a page that is blocked from crawling but carries a canonical signal that cannot be reliably processed. Check common duplicate patterns, including protocol versions, trailing slashes, uppercase paths, query parameters, print pages, tag archives, and faceted navigation.
Indexing should be intentional. Ask whether each important page is:
- Accessible to crawling systems
- Allowed to be indexed when appropriate
- Canonicalized to the correct version
- Linked internally from relevant pages
- Included in a clean sitemap when useful
6. Test mobile rendering and page templates
Modern audits should evaluate the experience and rendered content on mobile as well as desktop. Review navigation, menus, forms, buttons, images, tables, embedded elements, and text visibility at common viewport sizes.
Compare what a user sees with what the rendered document exposes. Important content, links, structured data, and metadata should not disappear or become unusable in the mobile version. Test representative templates rather than assuming that one page represents the entire site.
Pay special attention after a redesign, JavaScript framework change, or migration. A page can appear visually complete in a browser while still failing when scripts, assets, or API responses are delayed or unavailable.
7. Evaluate performance and user experience
Performance work should begin with evidence. Measure representative pages using both field data where available and controlled testing. Examine server response time, render-blocking resources, image sizing and formats, caching, font loading, third-party scripts, layout shifts, and interaction delays.
Audit performance by template and device conditions, not only by the homepage. A product page, article, location page, and checkout-adjacent page may behave very differently. Coordinate optimization with developers because changes such as script removal, image compression, caching, and hosting adjustments can affect functionality.
Do not treat a performance score as a ranking guarantee. The practical objective is a faster, more stable experience for users and more efficient delivery of important content.
8. Review structured data and metadata
Structured data can help machines interpret information such as organizations, products, articles, events, breadcrumbs, or local entities when the markup accurately reflects visible page content and applicable guidelines. Its presence does not guarantee enhanced search results.
Validate the syntax, required properties, consistency with on-page information, and suitability for the page type. Remove outdated, misleading, or duplicated markup rather than adding every possible schema type.
Also review title elements, meta descriptions, language declarations, heading structure, image alternatives, and social-sharing metadata. These elements support understanding and usability, but they should not be treated as substitutes for clear content or a coherent information architecture.
9. Examine internal linking and site architecture
Internal links help users navigate and help crawlers discover relationships between pages. Map important pages that receive little or no internal support. Review navigation, breadcrumbs, contextual links, related-content modules, and links from high-value pages.
Use descriptive, natural anchor text and avoid creating large blocks of repetitive links. For sites with filters, tags, or search-generated URLs, decide which combinations deserve discovery and which should remain controlled.
A strong architecture usually makes important pages reachable through a reasonable number of relevant links. It also groups content by topic or business function so that users can move from broad explanations to specific services, products, or next steps.
10. Turn findings into an implementation plan
An audit becomes useful when every significant finding has an owner, priority, affected URLs, recommended action, and validation method. A simple prioritization model is:
- Critical: issues preventing crawling, indexing, access, or conversion on important pages.
- High: widespread problems affecting major templates, internal links, redirects, canonical signals, or mobile usability.
- Medium: meaningful improvements with limited scope or lower page importance.
- Low: cleanup items that should be addressed during routine maintenance.
Separate diagnosis from implementation. A crawler may identify a symptom, but developers need the likely cause and an acceptance test. For example, “redirect issue” is less useful than “replace the internal links to the old service URL, update the sitemap, and confirm the final URL returns the intended permanent response without a chain.”
After fixes are deployed, recrawl affected sections, inspect priority URLs manually, compare before-and-after data, and monitor for regressions. Technical SEO is an ongoing operating process, especially after releases, migrations, template changes, and CMS updates.
Technical SEO audit checklist
| Area | Questions to answer | Evidence to collect |
|---|---|---|
| Crawlability | Can important pages and assets be accessed? | Robots directives, crawler results, server responses |
| Indexing | Are valuable pages eligible and intended for indexing? | Indexing directives, canonical signals, coverage patterns |
| URLs | Are preferred versions consistent? | Redirects, canonicals, sitemap URLs, internal links |
| Performance | Do key templates load and respond reliably? | Field data, controlled tests, template comparisons |
| Rendering | Can users and crawlers access the same important content? | Mobile tests, rendered HTML, browser checks |
| Architecture | Can users and crawlers discover priority pages? | Internal-link maps, depth, orphan-page review |
| Structured data | Is markup accurate and appropriate? | Validated markup and page-content comparison |
Conclusion
A technical SEO audit is a decision-making process, not a score-chasing exercise. Start with important pages, verify the fundamentals of crawling and indexing, test real templates across devices, and prioritize issues according to business impact. When findings are documented with clear owners and validation steps, technical improvements become easier to implement and maintain.