What is Crawl budget?

Crawl budget is the number of pages a search engine is willing and able to crawl on a site in a given time.

It mainly matters for large sites with thousands of URLs, such as e-commerce stores with filters.

Removing duplicate and low-value URLs, fixing redirect chains and keeping sitemaps clean help search engines spend their crawling on important pages.

Related terms

Chat with us