Commits

Breadcrumbs

History for

oncc

User selector

All users

All time

Commit History

Commits on May 22, 2026

• Add end to end tests for the SitemapInjector (#52)

  Show description for 29c642c
  lfoppiano

  authored
  29c642c

  Copy full SHA for 29c642c

Commits on May 21, 2026

• Add unit tests for plugin scoring-adaptive,

  Show description for 4861a66
  sebastian-nagel

  committed
  4861a66

  Copy full SHA for 4861a66

Commits on May 17, 2026

• NUTCH-3177 Fetcher to report idle threads not as hung threads

  Show description for 514760b
  sebastian-nagel

  committed
  514760b

  Copy full SHA for 514760b

• NUTCH-3176 URLUtil and urlnormalizer-basic: add support for IDNA2008

  Show description for 98704c5
  sebastian-nagel

  committed
  98704c5

  Copy full SHA for 98704c5

Commits on May 15, 2026

• NUTCH-3175 Implement integration testing framework for Nutch Protocol plugins using Testcontainers

  

  lewismc

  authored and

  sebastian-nagel

  committed
  f8e8583

  Copy full SHA for f8e8583

• parse: fix 'occured' -> 'occurred' typo in ParseStatus FAILED javadoc (#910)

  Show description for 2b72674
  

  SAY-5

  authored and

  sebastian-nagel

  committed
  2b72674

  Copy full SHA for 2b72674

• NUTCH-3168 Sandbox Commons JEXL usage in crawl and index pipelines (#909)

  

  lewismc

  authored and

  sebastian-nagel

  committed
  0ea90c3

  Copy full SHA for 0ea90c3

• [NUTCH-3160] Remove System.exit(..) from reusable code (#903)

  

  lfoppiano

  authored and

  sebastian-nagel

  committed
  d0099c0

  Copy full SHA for d0099c0

• NUTCH-3154 Implement integration testing framework for Nutch IndexWriter plugins using Testcontainers (#895)

  

  lewismc

  authored and

  sebastian-nagel

  committed
  3bf5541

  Copy full SHA for 3bf5541

Commits on May 8, 2026

• NUTCH-3174 protocol-okhttp: request may hang despite http.time.limit is set

  Show description for 3326bba
  sebastian-nagel

  committed
  3326bba

  Copy full SHA for 3326bba

Commits on May 4, 2026

• Revert "fix: apply URL normalisation for robots.txt redirect"

  Show description for 4560ffd
  lfoppiano

  committed
  4560ffd

  Copy full SHA for 4560ffd

• fix: apply URL normalisation for robots.txt redirect

  lfoppiano

  committed
  7f7cf6c

  Copy full SHA for 7f7cf6c

Commits on Apr 3, 2026

• Log sitemap processing timeout

  sebastian-nagel

  committed
  d5c8ab7

  Copy full SHA for d5c8ab7

• Extract and inject localized links from sitemaps

  sebastian-nagel

  committed
  f4f1232

  Copy full SHA for f4f1232

• SitemapInjector: update Javadoc

  sebastian-nagel

  committed
  2f1e195

  Copy full SHA for 2f1e195

Commits on Mar 28, 2026

• Fix revisit content-type (#42)

  Show description for d0c4d97
  lfoppiano

  authored
  d0c4d97

  Copy full SHA for d0c4d97

Commits on Feb 26, 2026

• WARC writer: log capture date as ISO date

  sebastian-nagel

  committed
  bf01b43

  Copy full SHA for bf01b43

• NUTCH-3132 Standardize existing Nutch metrics naming and implementation

  Show description for 044dfd2
  sebastian-nagel

  committed
  044dfd2

  Copy full SHA for 044dfd2

• NUTCH-3132 Standardize existing Nutch metrics naming and implementation

  Show description for 0eda915
  sebastian-nagel

  committed
  0eda915

  Copy full SHA for 0eda915

Commits on Feb 25, 2026

• NUTCH-3152 Job counters getGroup to use metrics constants

  sebastian-nagel

  committed
  fef49b9

  Copy full SHA for fef49b9

• NUTCH-3150 Expand Caching Hadoop Counter References (#892)

  

  lewismc

  authored and

  sebastian-nagel

  committed
  2e2374d

  Copy full SHA for 2e2374d

• NUTCH-3142 Add Error Context to Metrics (#882)

  

  lewismc

  authored and

  sebastian-nagel

  committed
  1db8e7d

  Copy full SHA for 1db8e7d

• NUTCH-1564: address code review comments.

  Show description for 366a601
  

  Isabelle Giguere

  authored and

  sebastian-nagel

  committed
  366a601

  Copy full SHA for 366a601

• NUTCH-1564: fix AdaptiveFetchSchedule for unmodified pages

  Show description for 89e6b87
  

  Isabelle Giguere

  authored and

  sebastian-nagel

  committed
  89e6b87

  Copy full SHA for 89e6b87

• NUTCH-1564: fix immediate refetch for pages not modified

  Show description for 226ac7e
  

  Isabelle Giguere

  authored and

  sebastian-nagel

  committed
  226ac7e

  Copy full SHA for 226ac7e

• NUTCH-3144 URLUtil unit tests fail after upgrade to crawler-commons 1.6

  Show description for e3d0af3
  sebastian-nagel

  committed
  e3d0af3

  Copy full SHA for e3d0af3

• NUTCH-3141 Cache Hadoop Counter References in Hot Paths (#878)

  

  lewismc

  authored and

  sebastian-nagel

  committed
  2df25d1

  Copy full SHA for 2df25d1

• NUTCH-3139 protocol-okhttp: add support for zstd content-encoding

  Show description for 488eacb
  sebastian-nagel

  committed
  488eacb

  Copy full SHA for 488eacb

• NUTCH-3136 Upgrade crawler-commons dependency

  Show description for bdbc897
  sebastian-nagel

  committed
  bdbc897

  Copy full SHA for bdbc897

• NUTCH-3136 Upgrade crawler-commons dependency

  Show description for 1c835c1
  sebastian-nagel

  committed
  1c835c1

  Copy full SHA for 1c835c1

• NUTCH-3134 Add latency metrics with percentile support to Fetcher, Parser, and Indexer (#876)

  

  lewismc

  authored and

  sebastian-nagel

  committed
  d9571d3

  Copy full SHA for d9571d3

• NUTCH-3132 Standardize existing Nutch metrics naming and implementation

  Show description for 595cf6c
  sebastian-nagel

  committed
  595cf6c

  Copy full SHA for 595cf6c

• NUTCH-3132 Standardize existing Nutch metrics naming and implementation (#871)

  

  lewismc

  authored and

  sebastian-nagel

  committed
  1d8106c

  Copy full SHA for 1d8106c

Commits on Feb 8, 2026

• UrlSamplerHost: make stripping of leading www. from host name configurable

  sebastian-nagel

  committed
  23e02c1

  Copy full SHA for 23e02c1

Commits on Jan 9, 2026

• Generator2: fix NPE when generate.count.mode != domain

  sebastian-nagel

  committed
  75d9759

  Copy full SHA for 75d9759