Common Crawl December 2014 Crawl Archive (CC-MAIN-2014-52)

The December 2014 crawl archive contains 2.08 billion pages, see the announcement for details.

Data Size and File Listings

Data Type File List #Files Total Size
Compressed (TiB)
Segments segment.paths.gz 314
WARC warc.paths.gz 43636 32.00
WAT wat.paths.gz 43636 10.41
WET wet.paths.gz 43636 3.69
URL index files cc-index.paths.gz 302 0.13
Columnar URL index files cc-index-table.paths.gz 300 0.14