Skip to content
GrowInSearch
Menu

SEO basics

What search engines read on your page, in order

A plain-language walk through the parts of a web page a search engine looks at, and what each one should say about your business.

By the GrowInSearch team · 6 minute read · Updated 12 November 2026

A search engine does not see your website the way a visitor does. It sends a program, usually called a crawler, that downloads the code of each page and reads specific parts of it. If those parts are missing or unclear, the page can look excellent to a person and still be hard to find.

This guide goes through those parts in roughly the order a crawler meets them, and says what each one should tell it about your business.

1. Whether it is allowed to read the page at all

Before anything else, a crawler checks a small file called robots.txt at the top of your site, and then a line inside the page called the robots tag. Either one can tell it to stay away.

These settings are often switched on while a site is being built and then forgotten. If your whole site is missing from search results, this is the first thing to check.

2. The address and the canonical tag

The same page can often be reached at several addresses: with or without "www", with tracking codes on the end, or through a category path. A canonical tag tells the search engine which address is the main one, so the page is not treated as several weak copies.

3. The title

The page title is the line that usually becomes the blue link in search results. It is one of the strongest signals of what a page is about.

  • Give every page its own title. A site where every page is titled "Home" tells a search engine nothing.
  • Say what the page offers and, where it matters, where you offer it: "Dried fruit exporter in Kabul" is clearer than "Welcome to our company".
  • Keep it short enough to be read in a glance. Very long titles are cut off.

4. The meta description

This is the short paragraph that may appear under the title in results. It does not directly raise your position, but it is your one chance to tell a searcher why to choose your link. Search engines sometimes replace it with their own extract from the page, which happens more often when the description is missing or vague.

5. Headings

Headings give the page an outline. One main heading should state the subject of the page, with sub-headings for each part. A crawler uses this outline to work out which topics the page covers and how they relate. A page built only from images of text, or from text styled to look large but not marked as a heading, has no outline to read.

6. The main text

This is where most businesses fall short. A product page with a photo, a price and one line of text gives a search engine very little to match against a buyer's question. Describe what you sell the way a buyer would ask about it: what it is, who it is for, sizes or specifications, where you deliver, and how to order.

A useful test: read only the text of the page aloud to someone who does not know your business. If they cannot tell what you sell and where, a search engine cannot either.

7. Images

Crawlers read the short written description attached to each image, known as alt text. Without it, a photo of your product is invisible to them. The same description is read aloud to people who use screen readers, so write it for a person: "Blue wool tribal rug, 2 by 3 metres".

8. Links

Links are how a crawler finds your other pages and how it judges which ones matter. A page that nothing links to is rarely discovered. Link to your important pages from your menu and from related pages, and make the linked words describe the destination. "Our export price list" is better than "click here".

9. Structured data

Structured data is a block of code, hidden from visitors, that states facts in a format machines read directly: this is an organisation, this is its address, this is a product, this is its price. It removes guesswork, and it is also one of the clearer signals available to AI assistants that summarise the web.

10. The sitemap

A sitemap is a list of the pages you want found. It does not guarantee anything, but it helps a search engine discover new and updated pages sooner, which matters most for larger sites and new ones.

What to do with this

You do not need to fix all ten at once. Start at the top: a page that cannot be read gains nothing from a better title. The free audit checks each of these points on your site and lists the pages affected, and our SEO audit page explains how each check is scored.