Commits

Breadcrumbs

History for

oncc

User selector

All users

All time

Commit History

Commits on May 17, 2026

• NUTCH-3177 Fetcher to report idle threads not as hung threads

  Show description for 514760b
  sebastian-nagel

  committed
  514760b

  Copy full SHA for 514760b

• NUTCH-3176 URLUtil and urlnormalizer-basic: add support for IDNA2008

  Show description for 98704c5
  sebastian-nagel

  committed
  98704c5

  Copy full SHA for 98704c5

Commits on May 15, 2026

• parse: fix 'occured' -> 'occurred' typo in ParseStatus FAILED javadoc (#910)

  Show description for 2b72674
  

  SAY-5

  authored and

  sebastian-nagel

  committed
  2b72674

  Copy full SHA for 2b72674

• NUTCH-3168 Sandbox Commons JEXL usage in crawl and index pipelines (#909)

  

  lewismc

  authored and

  sebastian-nagel

  committed
  0ea90c3

  Copy full SHA for 0ea90c3

• [NUTCH-3160] Remove System.exit(..) from reusable code (#903)

  

  lfoppiano

  authored and

  sebastian-nagel

  committed
  d0099c0

  Copy full SHA for d0099c0

Commits on Apr 3, 2026

• Log sitemap processing timeout

  sebastian-nagel

  committed
  d5c8ab7

  Copy full SHA for d5c8ab7

• Extract and inject localized links from sitemaps

  sebastian-nagel

  committed
  f4f1232

  Copy full SHA for f4f1232

• SitemapInjector: update Javadoc

  sebastian-nagel

  committed
  2f1e195

  Copy full SHA for 2f1e195

Commits on Mar 28, 2026

• Fix revisit content-type (#42)

  Show description for d0c4d97
  lfoppiano

  authored
  d0c4d97

  Copy full SHA for d0c4d97

Commits on Feb 26, 2026

• WARC writer: log capture date as ISO date

  sebastian-nagel

  committed
  bf01b43

  Copy full SHA for bf01b43

• NUTCH-3132 Standardize existing Nutch metrics naming and implementation

  Show description for 044dfd2
  sebastian-nagel

  committed
  044dfd2

  Copy full SHA for 044dfd2

• NUTCH-3132 Standardize existing Nutch metrics naming and implementation

  Show description for 0eda915
  sebastian-nagel

  committed
  0eda915

  Copy full SHA for 0eda915

Commits on Feb 25, 2026

• NUTCH-3152 Job counters getGroup to use metrics constants

  sebastian-nagel

  committed
  fef49b9

  Copy full SHA for fef49b9

• NUTCH-3150 Expand Caching Hadoop Counter References (#892)

  

  lewismc

  authored and

  sebastian-nagel

  committed
  2e2374d

  Copy full SHA for 2e2374d

• NUTCH-3142 Add Error Context to Metrics (#882)

  

  lewismc

  authored and

  sebastian-nagel

  committed
  1db8e7d

  Copy full SHA for 1db8e7d

• NUTCH-1564: address code review comments.

  Show description for 366a601
  

  Isabelle Giguere

  authored and

  sebastian-nagel

  committed
  366a601

  Copy full SHA for 366a601

• NUTCH-1564: fix AdaptiveFetchSchedule for unmodified pages

  Show description for 89e6b87
  

  Isabelle Giguere

  authored and

  sebastian-nagel

  committed
  89e6b87

  Copy full SHA for 89e6b87

• NUTCH-1564: fix immediate refetch for pages not modified

  Show description for 226ac7e
  

  Isabelle Giguere

  authored and

  sebastian-nagel

  committed
  226ac7e

  Copy full SHA for 226ac7e

• NUTCH-3141 Cache Hadoop Counter References in Hot Paths (#878)

  

  lewismc

  authored and

  sebastian-nagel

  committed
  2df25d1

  Copy full SHA for 2df25d1

• NUTCH-3136 Upgrade crawler-commons dependency

  Show description for 1c835c1
  sebastian-nagel

  committed
  1c835c1

  Copy full SHA for 1c835c1

• NUTCH-3134 Add latency metrics with percentile support to Fetcher, Parser, and Indexer (#876)

  

  lewismc

  authored and

  sebastian-nagel

  committed
  d9571d3

  Copy full SHA for d9571d3

• NUTCH-3132 Standardize existing Nutch metrics naming and implementation

  Show description for 595cf6c
  sebastian-nagel

  committed
  595cf6c

  Copy full SHA for 595cf6c

• NUTCH-3132 Standardize existing Nutch metrics naming and implementation (#871)

  

  lewismc

  authored and

  sebastian-nagel

  committed
  1d8106c

  Copy full SHA for 1d8106c

Commits on Feb 8, 2026

• UrlSamplerHost: make stripping of leading www. from host name configurable

  sebastian-nagel

  committed
  23e02c1

  Copy full SHA for 23e02c1

Commits on Jan 9, 2026

• Generator2: fix NPE when generate.count.mode != domain

  sebastian-nagel

  committed
  75d9759

  Copy full SHA for 75d9759

Commits on Jan 8, 2026

• AdaptiveScoringFilter: Delay revisits of non-canonical pages

  Show description for 9f90db1
  sebastian-nagel

  committed
  9f90db1

  Copy full SHA for 9f90db1

Commits on Dec 4, 2025

• Extract canonical links in Fetcher

  Show description for eaf94c6
  sebastian-nagel

  committed
  eaf94c6

  Copy full SHA for eaf94c6

• CanonicalLinkDetector: catch HTTP header parse exception

  sebastian-nagel

  committed
  b37880b

  Copy full SHA for b37880b

• Extract canonical links in Fetcher

  Show description for 5dd2215
  sebastian-nagel

  committed
  5dd2215

  Copy full SHA for 5dd2215

Commits on Dec 3, 2025

• Merge branch 'master' into cc

  Show description for d1b3ba6
  sebastian-nagel

  committed
  d1b3ba6

  Copy full SHA for d1b3ba6

Commits on Nov 10, 2025

• NUTCH-3040 Upgrade to Hadoop 3.4.2 (#866)

  lewismc

  authored
  1156801

  Copy full SHA for 1156801

Commits on Aug 27, 2025

• Merge upstream branch 'master' into cc

  sebastian-nagel

  committed
  f104a4f

  Copy full SHA for f104a4f

Commits on Aug 23, 2025

• [NUTCH-3122] Add test for backward compatibility of SpellCheckedMetadata

  TamimEhsan

  committed
  365f585

  Copy full SHA for 365f585

Commits on Aug 19, 2025

• [NUTCH-3122] Make SpellCheckedMetadata case-insensitive for all Metadata names

  TamimEhsan

  committed
  5ae91b6

  Copy full SHA for 5ae91b6

Commits on Jul 31, 2025

• WARC writer: improve extraction of HTTP status code

  Show description for 75c2969
  sebastian-nagel

  committed
  75c2969

  Copy full SHA for 75c2969