Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Dec 3, 2025

• Merge remote-tracking branch 'iipc/master'

  sebastian-nagel

  committed
  39b5c22

  Copy full SHA for 39b5c22

Commits on Nov 14, 2025

• Merge pull request #128 from sebastian-nagel/127-avoid-methods-default-locale

  Show description for e90e6c0
  ato

  authored
  e90e6c0

  Copy full SHA for e90e6c0

Commits on Nov 13, 2025

• BasicURLCanonicalizer: more efficient normalization of dots in host name

  Show description for 44ec227
  sebastian-nagel

  committed
  44ec227

  Copy full SHA for 44ec227

Commits on Nov 12, 2025

• Use StandardCharsets to replace or initialize String constants

  Show description for 97f7eb0
  sebastian-nagel

  committed
  97f7eb0

  Copy full SHA for 97f7eb0

• Unit tests: replace FileReader and FileWriter

  Show description for 4a12fa4
  sebastian-nagel

  committed
  4a12fa4

  Copy full SHA for 4a12fa4

• Unit tests: add Locale.ROOT as parameter to all occurrences of

  Show description for 6b0f0f2
  sebastian-nagel

  committed
  6b0f0f2

  Copy full SHA for 6b0f0f2

• Unit tests: pass charset to all occurrences of String.getBytes()

  sebastian-nagel

  committed
  e3c06ef

  Copy full SHA for e3c06ef

Commits on Nov 11, 2025

• Add forbiddenAPIs Maven plugin to fail the build when

  Show description for bf3fcb9
  sebastian-nagel

  committed
  bf3fcb9

  Copy full SHA for bf3fcb9

Commits on Aug 26, 2025

• Merge remote-tracking branch 'iipc/master' into upgrade-webarchive-commons-3.0.0

  sebastian-nagel

  committed
  d69c8aa

  Copy full SHA for d69c8aa

Commits on Jul 15, 2025

• Upgrade from commons-lang 2.6 to commons-lang3 3.18.0

  Show description for 7c1cb7f
  ato

  committed
  7c1cb7f

  Copy full SHA for 7c1cb7f

• feat: handle unicode, handle unsorted input edge cases, namespace public suffixes file to avoid collisions with other jars

  adam-miller

  committed
  c28cb73

  Copy full SHA for c28cb73

Commits on May 21, 2025

• Add RecordingInputStream.asOutputStream()

  Show description for cc85f05
  ato

  committed
  cc85f05

  Copy full SHA for cc85f05

• Remove deprecated URL canonicalizer classes

  ato

  committed
  53f7009

  Copy full SHA for 53f7009

• Remove deprecated class org.archive.io.arc.ARCConstants

  ato

  committed
  21a9100

  Copy full SHA for 21a9100

• Remove deprecated class org.archive.io.warc.WARCConstants

  ato

  committed
  a851937

  Copy full SHA for a851937

Commits on May 19, 2025

• Remove dependency on Apache Commons HttpClient 3.1

  Show description for 21c81e5
  ato

  committed
  21c81e5

  Copy full SHA for 21c81e5

Commits on May 18, 2025

• Upgrade to JUnit 5

  ato

  committed
  c427a12

  Copy full SHA for c427a12

Commits on Mar 10, 2025

• Merge pull request #49 from commoncrawl/ia-web-commons-48

  Show description for 7ca82da
  sebastian-nagel

  authored
  7ca82da

  Copy full SHA for 7ca82da

Commits on Feb 26, 2025

• WAT: trim data URLs, fixes #48

  Show description for ba9dc70
  sebastian-nagel

  committed
  ba9dc70

  Copy full SHA for ba9dc70

Commits on Feb 20, 2025

• Improve WET text extraction, address #45 and #46

  Show description for 01052bc
  sebastian-nagel

  committed
  01052bc

  Copy full SHA for 01052bc

Commits on Jan 8, 2025

• Merge upstream 'master' branch from 'iipc/webarchive-commons'

  sebastian-nagel

  committed
  1446d35

  Copy full SHA for 1446d35

Commits on Dec 14, 2024

• Merge pull request #102 from sebastian-nagel/surt-non-utf-8-encoding

  Show description for 3907d24
  ato

  authored
  3907d24

  Copy full SHA for 3907d24

Commits on Dec 11, 2024

• WAT: Duplicated payload metadata values for "Actual-Content-Length" and "Trailing-Slop-Length"

  sebastian-nagel

  committed
  6a3cf1b

  Copy full SHA for 6a3cf1b

• WAT: Duplicated payload metadata values for "Actual-Content-Length" and "Trailing-Slop-Length"

  Show description for 8f4c43f
  sebastian-nagel

  committed
  8f4c43f

  Copy full SHA for 8f4c43f

• Remove unused import

  sebastian-nagel

  committed
  bf9a9e0

  Copy full SHA for bf9a9e0

Commits on Dec 10, 2024

• WAT extractor: do not add <meta itemprop="..." > from body as metadata

  Show description for b474f5d
  sebastian-nagel

  committed
  b474f5d

  Copy full SHA for b474f5d

• WAT extractor: do not add <meta itemprop="..." > from body as metadata

  sebastian-nagel

  committed
  febb13f

  Copy full SHA for febb13f

Commits on Dec 5, 2024

• WAT extractor: add attributes of the <html> element as metadata

  Show description for 8627773
  sebastian-nagel

  committed
  8627773

  Copy full SHA for 8627773

• WAT extractor: add attributes of the <html> element as metadata,

  Show description for 581b43a
  sebastian-nagel

  committed
  581b43a

  Copy full SHA for 581b43a

• Add non-UTF-8 encoded test from mailing list

  

  tfmorris

  authored and

  sebastian-nagel

  committed
  5161306

  Copy full SHA for 5161306

• Add failing test from Sebastian's issue

  

  tfmorris

  authored and

  sebastian-nagel

  committed
  a80b98d

  Copy full SHA for a80b98d

Commits on Nov 30, 2024

• Merge branch 'ia-web-commons-18-multivalued-metadata'

  Show description for ec69f0c
  sebastian-nagel

  committed
  ec69f0c

  Copy full SHA for ec69f0c

• Merge upstream 'master' from https://github.com/iipc/webarchive-commons

  Show description for d2bd9e1
  sebastian-nagel

  committed
  d2bd9e1

  Copy full SHA for d2bd9e1

Commits on Nov 27, 2024

• Merge pull request #98 from sebastian-nagel/metadata-multivalued

  Show description for dcbb052
  ato

  authored
  dcbb052

  Copy full SHA for dcbb052

• URLParser and WaybackURLKeyMaker fail on URLs with IPv6 address hostname

  sebastian-nagel

  committed
  a4748d9

  Copy full SHA for a4748d9