Common Crawl March 2014 Crawl Archive (CC-MAIN-2014-10)

The March 2014 crawl archive contains 2.80 billion pages, see the announcement for details.

Data Size and File Listings

Data Type File List #Files Total Size
Compressed (TiB)
Segments segment.paths.gz 557
WARC warc.paths.gz 55700 33.19
WAT wat.paths.gz 55699 11.43
WET wet.paths.gz 55699 4.01
URL index files cc-index.paths.gz 302 0.14
Columnar URL index files cc-index-table.paths.gz 300 0.15