Commits

Branch selector

 master

User selector

All users

All time

Commit History

Commits on Jul 8, 2019

• Merge branch 'cc-14-wat-decode-html-char-entities', fixes #14

  sebastian-nagel

  committed
  c7e79be

  Copy full SHA for c7e79be

• Add unit test for HTML entity decoding

  Show description for fb514ab
  sebastian-nagel

  committed
  fb514ab

  Copy full SHA for fb514ab

• WAT/WET extraction: use compiled regex Pattern to get better performance

  sebastian-nagel

  committed
  4a1f323

  Copy full SHA for 4a1f323

• WAT: unescape XML/HTML character entities (#14)

  Show description for d5af4e5
  sebastian-nagel

  committed
  d5af4e5

  Copy full SHA for d5af4e5

Commits on Aug 23, 2017

• upgrade to CDH 5.12.0

  sebastian-nagel

  committed
  538ec1d

  Copy full SHA for 538ec1d

• upgrade to CDH 5.11.1

  sebastian-nagel

  committed
  f7fd996

  Copy full SHA for f7fd996

• WAT extractor: get links from onClick attributes, fixes #8

  Show description for ea0729b
  sebastian-nagel

  committed
  ea0729b

  Copy full SHA for ea0729b

• WAT extracor: add rel attribute to A@/href links, fixes #10

  Show description for dda2c89
  sebastian-nagel

  committed
  dda2c89

  Copy full SHA for dda2c89

• WET extractor: improve spacing of textual content, fixes #13

  Show description for 7ce4e88
  sebastian-nagel

  committed
  7ce4e88

  Copy full SHA for 7ce4e88

Commits on Aug 18, 2017

• Update CHANGES.md for PR 77

  

  ldko

  authored and

  sebastian-nagel

  committed
  b2252fc

  Copy full SHA for b2252fc

• use commons-collections v3.2.2 to avoid v3.2.1 vulnerability

  

  ndushay

  authored and

  sebastian-nagel

  committed
  a9d9ed9

  Copy full SHA for a9d9ed9

Commits on Jun 5, 2017

• Limit pattern matching URLs embedded in CSS to match max. 8000 characters,

  Show description for ea00e6d
  sebastian-nagel

  committed
  ea00e6d

  Copy full SHA for ea00e6d

Commits on May 4, 2017

• bump version, sync with iipc/webarchive-commons

  sebastian-nagel

  committed
  a0dcbc5

  Copy full SHA for a0dcbc5

• Update with fixes for 1.1.9

  

  ldko

  authored and

  sebastian-nagel

  committed
  9722bcc

  Copy full SHA for 9722bcc

• Fix HTTP-Response-Metadata for wget WARCs. Changes came from https://github.com/commoncrawl/ia-web-commons/commit/58e85a60d75707da55ed499f836e57d49347484a

  

  ldko

  authored and

  sebastian-nagel

  committed
  3fac189

  Copy full SHA for 3fac189

Commits on Apr 28, 2017

• Merge remote-tracking branch 'origin/master' into merge-webarchive-commons

  sebastian-nagel

  committed
  75e1d3d

  Copy full SHA for 75e1d3d

• Do not add value of preceding HTTP header field if there is no value (or

  Show description for aad4e05
  sebastian-nagel

  committed
  aad4e05

  Copy full SHA for aad4e05

• Merge with recent master of iipc/webarchive-commons, transfer all

  Show description for 58e85a6
  sebastian-nagel

  committed
  58e85a6

  Copy full SHA for 58e85a6

Commits on Mar 21, 2017

• Merge branch 'sebastian-nagel-wat-improved-link-extraction'

  ldko

  committed
  8bf28f2

  Copy full SHA for 8bf28f2

• Updating change log.

  ldko

  committed
  b655796

  Copy full SHA for b655796

• Merge branch 'wat-improved-link-extraction' of https://github.com/sebastian-nagel/webarchive-commons into sebastian-nagel-wat-improved-link-extraction

  ldko

  committed
  f12e86f

  Copy full SHA for f12e86f

Commits on Mar 9, 2017

• Merge branch 'MohammedElsayyed-issue-25-unit-tests'

  ldko

  committed
  59f8d26

  Copy full SHA for 59f8d26

• Updating CHANGES.md

  ldko

  committed
  b04f5d8

  Copy full SHA for b04f5d8

Commits on Mar 2, 2017

• Fix #25: move missing unit tests over from Heritrix3

  MohammedElsayyed

  committed
  6aa43f8

  Copy full SHA for 6aa43f8

Commits on Feb 22, 2017

• upgrade to CDH 5.10.0

  sebastian-nagel

  committed
  5536dbe

  Copy full SHA for 5536dbe

• sync unit test with iipc/webarchive-commons (including iipc/webarchive-commons#72)

  sebastian-nagel

  committed
  5ac0e78

  Copy full SHA for 5ac0e78

• Improve HTML link extraction

  Show description for 11579c2
  sebastian-nagel

  committed
  11579c2

  Copy full SHA for 11579c2

• Extract links/URLs from data-href and data-uri attributes, fixes #7

  sebastian-nagel

  committed
  4b0deb4

  Copy full SHA for 4b0deb4

Commits on Feb 21, 2017

• Improve HTML link extraction, fixes #9

  Show description for 5626c90
  sebastian-nagel

  committed
  5626c90

  Copy full SHA for 5626c90

Commits on Feb 20, 2017

• upgrade to CDH 5.10.0

  sebastian-nagel

  committed
  4a56f81

  Copy full SHA for 4a56f81

• fix indentation (use tab)

  sebastian-nagel

  committed
  7b9e812

  Copy full SHA for 7b9e812

Commits on Feb 15, 2017

• Merge pull request #71 from ldko/1.1.8-changesmd

  Show description for 4c23150
  ldko

  authored
  4c23150

  Copy full SHA for 4c23150

• Merge pull request #69 from sebastian-nagel/cc-url-parser-ignore-empty-port

  Show description for cb91063
  ldko

  authored
  cb91063

  Copy full SHA for cb91063

• Merge pull request #68 from sebastian-nagel/HTMLResourceFactory_to_use_CharsetDetector

  Show description for ed33bae
  ldko

  authored
  ed33bae

  Copy full SHA for ed33bae

• Merge pull request #65 from dportabella/fix

  Show description for 1ee2529
  ldko

  authored
  1ee2529

  Copy full SHA for 1ee2529