Common Crawl January 2015 Crawl Archive (CC-MAIN-2015-06)

The January 2015 crawl archive contains 1.82 billion pages, see the announcement for details.

Data Size and File Listings

Data Type File List #Files Total Size
Compressed (TiB)
Segments segment.paths.gz 98
WARC warc.paths.gz 25139 27.91
WAT wat.paths.gz 25139 9.09
WET wet.paths.gz 25139 3.21
URL index files cc-index.paths.gz 303 0.11
Columnar URL index files cc-index-table.paths.gz 300 0.12