Commits

Breadcrumbs

History for

oncc

User selector

All users

All time

Commit History

Commits on May 17, 2026

• NUTCH-3176 URLUtil and urlnormalizer-basic: add support for IDNA2008

  Show description for 98704c5
  sebastian-nagel

  committed
  98704c5

  Copy full SHA for 98704c5

Commits on May 15, 2026

• NUTCH-3175 Implement integration testing framework for Nutch Protocol plugins using Testcontainers

  

  lewismc

  authored and

  sebastian-nagel

  committed
  f8e8583

  Copy full SHA for f8e8583

• NUTCH-3168 Sandbox Commons JEXL usage in crawl and index pipelines (#909)

  

  lewismc

  authored and

  sebastian-nagel

  committed
  0ea90c3

  Copy full SHA for 0ea90c3

Commits on Jan 8, 2026

• AdaptiveScoringFilter: Delay revisits of non-canonical pages

  Show description for 9f90db1
  sebastian-nagel

  committed
  9f90db1

  Copy full SHA for 9f90db1

Commits on Dec 4, 2025

• Extract canonical links in Fetcher

  Show description for 6a23e6e
  sebastian-nagel

  committed
  6a23e6e

  Copy full SHA for 6a23e6e

Commits on Dec 3, 2025

• Merge branch 'master' into cc

  Show description for d1b3ba6
  sebastian-nagel

  committed
  d1b3ba6

  Copy full SHA for d1b3ba6

Commits on Oct 12, 2025

• NUTCH-3099 Allow wildcard '*' in http.proxy.exception.list (via Isabelle Giguere) (#865)

  lewismc

  authored
  cefb48a

  Copy full SHA for cefb48a

Commits on Jul 23, 2025

• Merge upstream branch 'master' into cc

  Show description for e7e0329
  sebastian-nagel

  committed
  e7e0329

  Copy full SHA for e7e0329

Commits on Jul 22, 2025

• NUTCH-3119 Log4j package scanning is deprecated

  Show description for d1b70ad
  sebastian-nagel

  committed
  d1b70ad

  Copy full SHA for d1b70ad

Commits on Jul 20, 2025

• Prepare for new development after release of 1.21

  Show description for 11e9a6a
  sebastian-nagel

  committed
  11e9a6a

  Copy full SHA for 11e9a6a

Commits on Jul 14, 2025

• NUTCH-3115 update to set all fields access on each POJO individually, updated JUnit tests, improved logging

  CatChullain

  committed
  94a9935

  Copy full SHA for 94a9935

Commits on Jul 11, 2025

• Corrected element order on a couple nutch-default.xml nodes for index-arbitrary configs.

  CatChullain

  committed
  1834c89

  Copy full SHA for 1834c89

• Updated Arbitrary Indexer that passes all indexer constructor args to user's POJO instance.

  CatChullain

  committed
  d2adde2

  Copy full SHA for d2adde2

Commits on Jul 9, 2025

• NUTCH-3114 Avoid stale fetching when only URLs

  Show description for 14fc330
  sebastian-nagel

  committed
  14fc330

  Copy full SHA for 14fc330

Commits on Feb 6, 2025

• [NUTCH-3103] Fixed custom max intervals for AdaptiveFetchSchedule

  Show description for 931ba17
  

  martin

  committed
  931ba17

  Copy full SHA for 931ba17

Commits on Oct 22, 2024

• NUTCH-3067 Improve performance of FetchItemQueues if error state is preserved

  Show description for 63da626
  sebastian-nagel

  committed
  63da626

  Copy full SHA for 63da626

• NUTCH-3067 Improve performance of FetchItemQueues if error state is preserved

  Show description for bd2fce6
  sebastian-nagel

  committed
  bd2fce6

  Copy full SHA for bd2fce6

Commits on Oct 2, 2024

• NUTCH-3067 Improve performance of FetchItemQueues if error state is preserved

  Show description for 265ba07
  sebastian-nagel

  committed
  265ba07

  Copy full SHA for 265ba07

Commits on Oct 1, 2024

• NUTCH-3067 Improve performance of FetchItemQueues if error state is preserved

  Show description for eaf0277
  sebastian-nagel

  committed
  eaf0277

  Copy full SHA for eaf0277

Commits on Sep 17, 2024

• Merge upstream branch 'master' into cc

  Show description for 2ce7725
  sebastian-nagel

  committed
  2ce7725

  Copy full SHA for 2ce7725

• Merge pull request #816 from sebastian-nagel/NUTCH-1942-domain-utils-to-use-crawler-commons

  Show description for 8b11962
  sebastian-nagel

  authored
  8b11962

  Copy full SHA for 8b11962

Commits on Sep 16, 2024

• NUTCH-3058 Fetcher: counter for hung threads (#820)

  Show description for 582cdd4
  sebastian-nagel

  authored
  582cdd4

  Copy full SHA for 582cdd4

Commits on Sep 13, 2024

• NUTCH-3062 protocol-okhttp: optionally record HTTP and SSL/TLS versions (#822)

  Show description for 4200247
  sebastian-nagel

  authored
  4200247

  Copy full SHA for 4200247

Commits on Jul 17, 2024

• NUTCH-3062 protocol-okhttp: optionally record HTTP and SSL/TLS versions

  Show description for 518b2c1
  sebastian-nagel

  committed
  518b2c1

  Copy full SHA for 518b2c1

Commits on Jun 6, 2024

• Merge upstream pull-request branch 'NUTCH-3058-fetcher-counter-hung-threads' into 'cc'

  sebastian-nagel

  committed
  2976087

  Copy full SHA for 2976087

• Merge upstream 'master' into 'cc'

  Show description for 3a5690a
  sebastian-nagel

  committed
  3a5690a

  Copy full SHA for 3a5690a

Commits on Jun 5, 2024

• NUTCH-3058 Fetcher: counter for hung threads

  sebastian-nagel

  committed
  2596117

  Copy full SHA for 2596117

Commits on Apr 29, 2024

• NUTCH-1806 Delegate processing of URL domains to crawler commons

  Show description for d43f579
  sebastian-nagel

  committed
  d43f579

  Copy full SHA for d43f579

• Boostrap Nutch 1.21 development drive.

  lewismc

  committed
  817af69

  Copy full SHA for 817af69

Commits on Apr 4, 2024

• NUTCH-3032 Code for an ArbitraryIndexingFilter to index values resolved by user POJO code at index time (#810)

  CatChullain

  authored
  c9e2f4e

  Copy full SHA for c9e2f4e

Commits on Mar 13, 2024

• NUTCH-3029 Host specific max. and min. intervals in adaptive scheduler

  

  Markus Jelsma

  committed
  4642c30

  Copy full SHA for 4642c30

Commits on Nov 9, 2023

• Merged from apache master

  Show description for bec481b
  jnioche

  committed
  bec481b

  Copy full SHA for bec481b

Commits on Nov 8, 2023

• Merged changes from master; improved Javadoc and exception handling

  Show description for 49d85ea
  jnioche

  committed
  49d85ea

  Copy full SHA for 49d85ea

• [NUTCH-3017] Allow fast-urlfilter to load from HDFS/S3 and support gzipped input

  Show description for ac383fc
  sebastian-nagel

  committed
  ac383fc

  Copy full SHA for ac383fc

Commits on Nov 7, 2023

• Added filtering on whole string + documented config in nutch-default + fixed tests

  Show description for d764e4c
  jnioche

  committed
  d764e4c

  Copy full SHA for d764e4c