Common Crawl Winter 2013 Crawl Archive (CC-MAIN-2013-48)

The Winter 2013 crawl archive contains 2.30 billion pages, see the announcement for details.

Data Size and File Listings

Data Type File List #Files Total Size
Compressed (TiB)
Segments segment.paths.gz 519
WARC warc.paths.gz 51900 31.93
WAT wat.paths.gz 45195 9.64
WET wet.paths.gz 45195 3.36
URL index files cc-index.paths.gz 302 0.14
Columnar URL index files cc-index-table.paths.gz 300 0.15