13 Feb 2009 - 13 Sep 2017
About this capture
The Internet Archive discovers and captures web pages through many different web crawls. At any given time several distinct crawls are running, some for months, and some every day or longer. View the web archive through the
Survey Crawl Number 6: Sep 11th, 2017 - running now
A survey crawl of domains.
The WARC files for this crawl are currently not publicly accessible.
The seed for Survey 6 was a list of 251million domains.
This crawl was run with no deduplication, at "level 0" (only archive the seed URLs and their embeds and do not follow any outlinks)