This repository was archived by the owner on Nov 21, 2025. It is now read-only.

Commits

History for

Commits on Mar 21, 2017

Merge branch 'wat-improved-link-extraction' of https://github.com/sebastian-nagel/webarchive-commons into sebastian-nagel-wat-improved-link-extraction
ldko
committed

Commits on Mar 2, 2017

Fix #25: move missing unit tests over from Heritrix3
MohammedElsayyed
committed

Commits on Feb 22, 2017

Improve HTML link extraction
sebastian-nagel
committed

Commits on Jan 27, 2017

CharsetDetector: remove unnecessary check for empty string (contributed by @ldko)
sebastian-nagel
committed

Commits on Jan 18, 2017

CSS link extraction: clip also unpaired leading and trailing quotation marks
sebastian-nagel
committed

Commits on Jan 4, 2017

Improve clipping of quotation marks in CSS link extraction
sebastian-nagel
committed

Commits on Dec 9, 2016

Strip empty port, do not fail
sebastian-nagel
committed

Commits on Nov 24, 2016

Commits on Sep 21, 2016

fix: last header was lost if LF LF (intead of CRLF CRLF)
dportabella
committed

Commits on Aug 7, 2016

Make regular expression to extract URLs from CSS more restrictive
sebastian-nagel
committed

Commits on Jul 13, 2016

Remove invalid constant
Kristinn Sigurðsson
authored

Commits on May 26, 2016

Merge pull request #54 from vonrosen/modify-strip-session-params
Kristinn Sigurðsson
committed
Merge pull request #50 from nlevitt/her-2089
Kristinn Sigurðsson
committed
Merge pull request #51 from nlevitt/fix-warc-sizeOnDisk
Kristinn Sigurðsson
committed

Commits on Mar 22, 2016

Make canonicalizer be able to strip session id params even if they are the first params in the query string. And add session id strip test. And change IAURLCanonicalizer.java to ensure that if afte…
Hunter Stern
committed

Commits on Mar 11, 2016

Update ArchiveFileConstants.java
jrwiebe
committed

Commits on Mar 8, 2016

Store origin-code in ARCRecord header; accessible through getOrigin() method.
jrwiebe
committed

Commits on Dec 14, 2015

flush output etc before tallying stats to fix sizeOnDisk calculation
nlevitt
committed

Commits on Oct 28, 2015

fix for HER-2089 - get rid of broken, seemingly unnecessary escapeWhitespace() step of uri fixup
nlevitt
committed

Commits on Jul 14, 2015

Adding commit for: Fix issues #42 #43 #44 #45 and #47 #46
RogerMathisen
committed

Commits on Jun 15, 2015

Handle empty String argument in CharsetDetector.trimAttrValue
gerhardgossen
committed

Commits on Jan 7, 2015

move TmpDirTestCase.java from heritrix to webarchive-commons
nlevitt
committed

Commits on Jan 6, 2015

Commits on Dec 17, 2014

Improve URL escaping in CDX writer
gerhardgossen
committed