Skip to content

Pull requests: commoncrawl/nutch

New pull request New
Clear current search query, filters, and sorts
5 Open 16 Closed
5 Open 16 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Integrate Apache Nutch upstream improvements
#55 by sebastian-nagel was merged May 18, 2026 Loading…
Add end to end tests for the SitemapInjector
#52 by lfoppiano was merged May 22, 2026 Loading…
@sebastian-nagel
6
SitemapInjector: extract and inject localized links
#51 by sebastian-nagel was merged Apr 7, 2026 Loading…
6
Merge cherry-picked commits from upstream 1.22
#46 by sebastian-nagel was merged Feb 27, 2026 Loading…
1
2
Enable report for running tests
#45 by lfoppiano was closed Feb 25, 2026 Loading…
4
Fix tests org.commoncrawl.* being ignored/skipped
#44 by lfoppiano was closed Mar 24, 2026 • Draft
7
Fix revisit content-type
#42 by lfoppiano was merged Mar 28, 2026 Loading…
14
UrlSamplerHost: make stripping of leading www. from host name configurable
#38 by sebastian-nagel was merged Feb 8, 2026 Loading…
1
AdaptiveScoringFilter: Delay revisits of non-canonical pages
#37 by sebastian-nagel was merged Jan 10, 2026 Loading…
1
Detect canonical links in Fetcher
#36 by sebastian-nagel was merged Dec 19, 2025 Loading…
docs: Add comment about disabled plugins. Fix broken Apache Nutch link.
#35 by handecelikkanat was merged Jul 30, 2025 Loading…
5
WarcCdxWriter: normalize URL of redirect target location
#34 by sebastian-nagel was merged Mar 15, 2025 Loading…
Add Github workflow to build the branch 'cc'
#31 by sebastian-nagel was merged Nov 21, 2024 Loading…
WARC writer support HTTP/2
#30 by sebastian-nagel was merged Jul 27, 2024 Loading…
Generator2: improvements and fixes
#28 by sebastian-nagel was merged May 6, 2024 Loading…
WARC writer (CDX writer): new optional CDX JSON fields "redirect" and "truncated"
#15 by sebastian-nagel was merged Nov 12, 2019 Loading…
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.