Common Crawl April 2015 Crawl Archive (CC-MAIN-2015-18)

The April 2015 crawl archive contains 2.11 billion pages, see the announcement for details.

Data Size and File Listings

Data Type File List #Files Total Size
Compressed (TiB)
Segments segment.paths.gz 188
WARC warc.paths.gz 38609 33.27
WAT wat.paths.gz 38609 10.57
WET wet.paths.gz 38609 3.74
URL index files cc-index.paths.gz 302 0.13
Columnar URL index files cc-index-table.paths.gz 300 0.14