Definition of web crawler in English:

web crawler

noun

  • 1A person who habitually browses the web; a web surfer.

  • 2A program that systematically accesses and collects information from web pages, navigating by following links from one web page to another.

Origin

1990s; earliest use found in Usenet (newsgroups).