Commits

Branch selector

 master

User selector

All users

All time

Commit History

Commits on Jun 15, 2020

• Merge pull request #89 from sebastian-nagel/webarchive-commons-88,

  Show description for 1115246
  

  ldko

  authored and

  sebastian-nagel

  committed
  1115246

  Copy full SHA for 1115246

• Update change log to include #85, #86 and #89

  sebastian-nagel

  committed
  c0381bc

  Copy full SHA for c0381bc

• WAT extractor: do not fail on missing WARC-Filename in warcinfo record, fixes #88

  Show description for d2c7379
  sebastian-nagel

  committed
  d2c7379

  Copy full SHA for d2c7379

Commits on Jun 5, 2020

• WET extractor: add identified natural language of text content (#22)

  Show description for a1f07ad
  sebastian-nagel

  committed
  a1f07ad

  Copy full SHA for a1f07ad

• - simplify date parsing resp. do not parse if not needed

  Show description for 37b40f5
  sebastian-nagel

  committed
  37b40f5

  Copy full SHA for 37b40f5

Commits on Dec 12, 2019

• Work-around issue processing WARC request records with invalid message

  Show description for 428022b
  sebastian-nagel

  committed
  428022b

  Copy full SHA for 428022b

Commits on Oct 22, 2019

• Upgrade dependencies

  sebastian-nagel

  committed
  00109ec

  Copy full SHA for 00109ec

• Merge remote-tracking branch 'iipc/master'

  sebastian-nagel

  committed
  95c7170

  Copy full SHA for 95c7170

Commits on Aug 28, 2019

• Remove pom-cdh5.xml as changes required to run under Cloudera Hadoop

  Show description for 248fb98
  sebastian-nagel

  committed
  248fb98

  Copy full SHA for 248fb98

• WAT: only unescape complete XML/HTML character entities (fixes #19)

  Show description for bb754a3
  sebastian-nagel

  committed
  bb754a3

  Copy full SHA for bb754a3

Commits on Aug 27, 2019

• WAT: only unescape complete XML/HTML character entities (fixes #19)

  Show description for 716eae9
  sebastian-nagel

  committed
  716eae9

  Copy full SHA for 716eae9

Commits on Aug 19, 2019

• WAT: only unescape complete XML/HTML character entities (fixes #19)

  Show description for 60b6f7e
  sebastian-nagel

  committed
  60b6f7e

  Copy full SHA for 60b6f7e

Commits on Aug 13, 2019

• Merge pull request #83 from ruebot/issue-82

  Show description for 336a49e
  ldko

  authored
  336a49e

  Copy full SHA for 336a49e

Commits on Jul 30, 2019

• Merge pull request #17 from commoncrawl/dunning-org-json

  Show description for f453915
  sebastian-nagel

  authored
  f453915

  Copy full SHA for f453915

Commits on Jul 23, 2019

• Use openjson as replacement for the org.json dependency

  Show description for d188b9e
  sebastian-nagel

  committed
  d188b9e

  Copy full SHA for d188b9e

Commits on Jul 22, 2019

• Replace the org.json dependency by Ted Dunning's open-json library

  Show description for 470c353
  sebastian-nagel

  committed
  470c353

  Copy full SHA for 470c353

Commits on Jul 8, 2019

• Merge branch 'cc-14-wat-decode-html-char-entities', fixes #14

  sebastian-nagel

  committed
  c7e79be

  Copy full SHA for c7e79be

• Add unit test for HTML entity decoding

  Show description for fb514ab
  sebastian-nagel

  committed
  fb514ab

  Copy full SHA for fb514ab

• WAT/WET extraction: use compiled regex Pattern to get better performance

  sebastian-nagel

  committed
  4a1f323

  Copy full SHA for 4a1f323

• WAT: unescape XML/HTML character entities (#14)

  Show description for d5af4e5
  sebastian-nagel

  committed
  d5af4e5

  Copy full SHA for d5af4e5

Commits on May 7, 2019

• Update TravisCI config; resolves #82.

  Show description for 723b18a
  ruebot

  committed
  723b18a

  Copy full SHA for 723b18a

• [maven-release-plugin] prepare for next development iteration

  ruebot

  committed
  da029db

  Copy full SHA for da029db

• [maven-release-plugin] prepare release webarchive-commons-1.1.9

  ruebot

  committed
  2e8cdea

  Copy full SHA for 2e8cdea

Commits on Aug 23, 2017

• upgrade to CDH 5.12.0

  sebastian-nagel

  committed
  538ec1d

  Copy full SHA for 538ec1d

• upgrade to CDH 5.11.1

  sebastian-nagel

  committed
  f7fd996

  Copy full SHA for f7fd996

• WAT extractor: get links from onClick attributes, fixes #8

  Show description for ea0729b
  sebastian-nagel

  committed
  ea0729b

  Copy full SHA for ea0729b

• WAT extracor: add rel attribute to A@/href links, fixes #10

  Show description for dda2c89
  sebastian-nagel

  committed
  dda2c89

  Copy full SHA for dda2c89

• WET extractor: improve spacing of textual content, fixes #13

  Show description for 7ce4e88
  sebastian-nagel

  committed
  7ce4e88

  Copy full SHA for 7ce4e88

Commits on Aug 18, 2017

• Update CHANGES.md for PR 77

  

  ldko

  authored and

  sebastian-nagel

  committed
  b2252fc

  Copy full SHA for b2252fc

• use commons-collections v3.2.2 to avoid v3.2.1 vulnerability

  

  ndushay

  authored and

  sebastian-nagel

  committed
  a9d9ed9

  Copy full SHA for a9d9ed9

Commits on Aug 9, 2017

• Update CHANGES.md for PR 77

  ldko

  committed
  988bec7

  Copy full SHA for 988bec7

• Merge branch 'ndushay-patched-commons-coll'

  ldko

  committed
  229a186

  Copy full SHA for 229a186

Commits on Aug 8, 2017

• use commons-collections v3.2.2 to avoid v3.2.1 vulnerability

  ndushay

  committed
  4101f7e

  Copy full SHA for 4101f7e

Commits on Jun 5, 2017

• Limit pattern matching URLs embedded in CSS to match max. 8000 characters,

  Show description for ea00e6d
  sebastian-nagel

  committed
  ea00e6d

  Copy full SHA for ea00e6d

Commits on May 4, 2017

• bump version, sync with iipc/webarchive-commons

  sebastian-nagel

  committed
  a0dcbc5

  Copy full SHA for a0dcbc5