Common Crawl Foundation

commoncrawl's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Articles

malteos 

updated a bucket about 4 hours ago

commoncrawl/commoncrawl

311 TB

malteos 

updated a Space 10 days ago

Running

Agents

3

CommonLID Leaderboard

🌍

3

View the CommonLID language ID model leaderboard

malteos 

in commoncrawl/commonlid-results 10 days ago

Add commonlingua predictions.jsonl

#4 opened 10 days ago by

malteos

Add CommonLingua (PleIAs/CommonLingua) results on commonlid + commonlid_nano

#2 opened about 1 month ago by

malteos

malteos 

in commoncrawl/commonlid-results 11 days ago

Add supported_languages to summary.json for cov. leaderboard view

#3 opened 29 days ago by

malteos

pjox 

in commoncrawl/CommonLID 12 days ago

Dataset improvements

3

#4 opened 19 days ago by

konstantindobler

lfoppiano 

published a dataset 23 days ago

commoncrawl/web-graph-testing-v1

Updated 23 days ago • 43

lfoppiano 

updated a dataset 23 days ago

commoncrawl/web-graph-testing-v1

Updated 23 days ago • 43

parismic 

updated a dataset 27 days ago

commoncrawl/statistics

Viewer • Updated 27 days ago • 631k • 525 • 27

catherinearnett 

authored 2 papers about 1 month ago

CommonLID: Re-evaluating State-of-the-Art Language Identification Performance on Web Data

Paper • 2601.18026 • Published Jan 25

Soohak: A Mathematician-Curated Benchmark for Evaluating Research-level Math Capabilities of LLMs

Paper • 2605.09063 • Published May 9 • 81

malteos 

published a dataset about 1 month ago

commoncrawl/commonlid-results

Preview • Updated 10 days ago • 662 • 2

malteos 

updated a dataset about 1 month ago

commoncrawl/commonlid-results

Preview • Updated 10 days ago • 662 • 2

malteos 

in commoncrawl/commonlid-results about 1 month ago

Refresh results from refactor

#1 opened about 1 month ago by

malteos

malteos 

published a Space about 2 months ago

Running

Agents

3

CommonLID Leaderboard

🌍

3

View the CommonLID language ID model leaderboard

malteos 

updated a bucket about 2 months ago

commoncrawl/test-bucket

117 MB

lfoppiano 

updated a dataset about 2 months ago

commoncrawl/statistics

Viewer • Updated 27 days ago • 631k • 525 • 27

malteos 

published a bucket about 2 months ago

commoncrawl/commoncrawl

311 TB

lfoppiano 

authored 2 papers 2 months ago

SciLaD: A Large-Scale, Transparent, Reproducible Dataset for Natural Scientific Language Processing

Paper • 2512.11192 • Published Dec 12, 2025 • 1

CommonLID: Re-evaluating State-of-the-Art Language Identification Performance on Web Data

Paper • 2601.18026 • Published Jan 25