Home / Glossary / Crawler Crawler A program used by search engines to discover and index web pages. Also known as a spider or bot. Explore More SEO Terms Browse our comprehensive SEO glossaryto learn more about search engine optimization, backlinks, and digital marketing terms.