Upgrade dependency to ia-web-commons 3.0.1-SNAPSHOT by sebastian-nagel · Pull Request #11 · commoncrawl/ia-hadoop-tools

sebastian-nagel · 2025-08-26T19:53:41Z

major dependency upgrade of ia-web-commons (webarchive-commons) from 1.3.1-SNAPSHOT to 3.0.1-SNAPSHOT incorporating several upstream improvements, see Integrate upstream changes from iipc/webarchive-commons 3.0.0 ia-web-commons#51
adapt code to upstream changes: drop classes relying on now removed transitive dependency to Apache HTTP client
upgrade slf4j and commons-collections dependencies to latest versions

- upgrade transitive dependency commons-lang - drop classes depending on HTTP client

sebastian-nagel · 2025-08-28T13:35:35Z

Successfully tested converting 8 WARC files to WAT and WET. No regressions found, MapReduce job run smoothly.

sebastian-nagel added 2 commits August 26, 2025 21:30

Upgrade to ia-web-commons 3.0.1-SNAPSHOT

b533536

- upgrade transitive dependency commons-lang - drop classes depending on HTTP client

Dependency upgrades: slf4j and commons-collections

c1c6cb0

sebastian-nagel merged commit 3a740ce into master Aug 28, 2025

Provide feedback