Commits

Breadcrumbs

History for

oncc-github-workflow

User selector

All users

All time

Commit History

Commits on Oct 2, 2024

• NUTCH-3067 Improve performance of FetchItemQueues if error state is preserved

  Show description for 265ba07
  sebastian-nagel

  committed
  265ba07

  Copy full SHA for 265ba07

Commits on Oct 1, 2024

• NUTCH-3067 Improve performance of FetchItemQueues if error state is preserved

  Show description for eaf0277
  sebastian-nagel

  committed
  eaf0277

  Copy full SHA for eaf0277

Commits on Sep 17, 2024

• Merge upstream branch 'master' into cc

  Show description for 2ce7725
  sebastian-nagel

  committed
  2ce7725

  Copy full SHA for 2ce7725

• Merge pull request #816 from sebastian-nagel/NUTCH-1942-domain-utils-to-use-crawler-commons

  Show description for 8b11962
  sebastian-nagel

  authored
  8b11962

  Copy full SHA for 8b11962

Commits on Sep 16, 2024

• NUTCH-3058 Fetcher: counter for hung threads (#820)

  Show description for 582cdd4
  sebastian-nagel

  authored
  582cdd4

  Copy full SHA for 582cdd4

Commits on Sep 13, 2024

• NUTCH-3062 protocol-okhttp: optionally record HTTP and SSL/TLS versions (#822)

  Show description for 4200247
  sebastian-nagel

  authored
  4200247

  Copy full SHA for 4200247

Commits on Jul 17, 2024

• NUTCH-3062 protocol-okhttp: optionally record HTTP and SSL/TLS versions

  Show description for 518b2c1
  sebastian-nagel

  committed
  518b2c1

  Copy full SHA for 518b2c1

Commits on Jun 6, 2024

• Merge upstream pull-request branch 'NUTCH-3058-fetcher-counter-hung-threads' into 'cc'

  sebastian-nagel

  committed
  2976087

  Copy full SHA for 2976087

• Merge upstream 'master' into 'cc'

  Show description for 3a5690a
  sebastian-nagel

  committed
  3a5690a

  Copy full SHA for 3a5690a

Commits on Jun 5, 2024

• NUTCH-3058 Fetcher: counter for hung threads

  sebastian-nagel

  committed
  2596117

  Copy full SHA for 2596117

Commits on Apr 29, 2024

• NUTCH-1806 Delegate processing of URL domains to crawler commons

  Show description for d43f579
  sebastian-nagel

  committed
  d43f579

  Copy full SHA for d43f579

• Boostrap Nutch 1.21 development drive.

  lewismc

  committed
  817af69

  Copy full SHA for 817af69

Commits on Apr 4, 2024

• NUTCH-3032 Code for an ArbitraryIndexingFilter to index values resolved by user POJO code at index time (#810)

  CatChullain

  authored
  c9e2f4e

  Copy full SHA for c9e2f4e

Commits on Mar 13, 2024

• NUTCH-3029 Host specific max. and min. intervals in adaptive scheduler

  

  Markus Jelsma

  committed
  4642c30

  Copy full SHA for 4642c30

Commits on Nov 9, 2023

• Merged from apache master

  Show description for bec481b
  jnioche

  committed
  bec481b

  Copy full SHA for bec481b

Commits on Nov 8, 2023

• Merged changes from master; improved Javadoc and exception handling

  Show description for 49d85ea
  jnioche

  committed
  49d85ea

  Copy full SHA for 49d85ea

• [NUTCH-3017] Allow fast-urlfilter to load from HDFS/S3 and support gzipped input

  Show description for ac383fc
  sebastian-nagel

  committed
  ac383fc

  Copy full SHA for ac383fc

Commits on Nov 7, 2023

• Added filtering on whole string + documented config in nutch-default + fixed tests

  Show description for d764e4c
  jnioche

  committed
  d764e4c

  Copy full SHA for d764e4c

Commits on Oct 31, 2023

• Merge branch 'master' into cc

  Show description for f3f948e
  sebastian-nagel

  committed
  f3f948e

  Copy full SHA for f3f948e

Commits on Oct 21, 2023

• NUTCH-3011 HttpRobotRulesParser: handle HTTP 429 Too Many Requests same as server errors (HTTP 5xx)

  sebastian-nagel

  committed
  b081c75

  Copy full SHA for b081c75

• NUTCH-2990 HttpRobotRulesParser to follow 5 redirects as specified by RFC 9309 (#779)

  Show description for ecdd19d
  sebastian-nagel

  authored
  ecdd19d

  Copy full SHA for ecdd19d

Commits on Sep 13, 2023

• Remove Any23 from Nutch

  tballison

  committed
  8a5ef49

  Copy full SHA for 8a5ef49

Commits on Aug 22, 2023

• Merge branch 'master' into cc

  Show description for adeb861
  sebastian-nagel

  committed
  adeb861

  Copy full SHA for adeb861

• NUTCH-2996 Use new SimpleRobotRulesParser API entry point crawler-commons 1.4

  Show description for 070c115
  sebastian-nagel

  authored
  070c115

  Copy full SHA for 070c115

• NUTCH-2993 ScoringDepth plugin to skip depth check based on URL Pattern

  Show description for eae3c52
  sebastian-nagel

  committed
  eae3c52

  Copy full SHA for eae3c52

Commits on Jun 6, 2023

• NUTCH-2991 Support HTTP/S Header Authorization for Solr connections (#763)

  Show description for 9109bdd
  sebastian-nagel

  authored
  9109bdd

  Copy full SHA for 9109bdd

Commits on May 25, 2023

• Fetcher: add option to archive robots.txt responses in WARC files if

  Show description for e8f9901
  sebastian-nagel

  committed
  e8f9901

  Copy full SHA for e8f9901

Commits on Mar 23, 2023

• WARC writer: document properties in nutch-default.xml

  sebastian-nagel

  committed
  04d7503

  Copy full SHA for 04d7503

Commits on Mar 22, 2023

• Adaptive scoring filter:

  Show description for 8ec96ed
  sebastian-nagel

  committed
  8ec96ed

  Copy full SHA for 8ec96ed

Commits on Mar 17, 2023

• Merge branch 'master' into cc

  sebastian-nagel

  committed
  0715793

  Copy full SHA for 0715793

Commits on Mar 6, 2023

• NUTCH-2985 Disable plugin urlfilter-validator by default

  sebastian-nagel

  committed
  1999b1e

  Copy full SHA for 1999b1e

• NUTCH-2983 nutch-default.xml improvements

  Show description for c8aecfa
  sebastian-nagel

  committed
  c8aecfa

  Copy full SHA for c8aecfa

• fix template to include new key store info. remove unused auth

  

  tballison

  authored and

  sebastian-nagel

  committed
  e03cad3

  Copy full SHA for e03cad3

• NUTCH-2920 -- first working attempt at migrating ElasticsearchIndexWriter to OpenSearch

  

  tballison

  authored and

  sebastian-nagel

  committed
  ca3824f

  Copy full SHA for ca3824f

Commits on Sep 12, 2022

• Merge branch 'master' into cc

  Show description for 04b54e9
  sebastian-nagel

  committed
  04b54e9

  Copy full SHA for 04b54e9