Crawltown is a comprehensive benchmark suite designed to evaluate web crawlers across real-world scenarios. We test crawlers against a standardized set of pages to measure performance, reliability, and data extraction accuracy.

Our benchmarks measure response times, pages crawled per second, and the accuracy of book metadata extraction from various source formats.