Standard web crawling relies on links. If Page A links to Page B, the crawler finds it. However, much of the world's most valuable data sits behind "search forms." Think of a patent database or a public court records portal. To see the data, you must type a query into a box and hit "Enter."

: Unlike a basic breadth-first search, a focused crawler uses classifiers (often based on Python libraries like BeautifulSoup