Common Crawl July 2014 Crawl Archive (CC-MAIN-2014-23)

The July 2014 crawl archive contains 3.60 billion pages, see the announcement for details.

Data Size and File Listings

Data Type File List #Files Total Size
Compressed (TiB)
Segments segment.paths.gz 253
WARC warc.paths.gz 63560 53.89
WAT wat.paths.gz 63560 18.12
WET wet.paths.gz 63560 6.44
URL index files cc-index.paths.gz 302 0.21
Columnar URL index files cc-index-table.paths.gz 300 0.21