Syncing up code moves from IA#6

Merged

anjackson merged 29 commits into

iipc:masterfrom

Dec 12, 2013

Commits on Oct 3, 2013

ZipNum: fixes: cached locations: don't throw RunTimeException if required (handled later), add a locCacheMaxDuration to cache only if below threshold
ikreymer
committed

Commits on Oct 4, 2013

CDX: Add CloseableCompositeIterator which iterates in sequence, optimization for zipnum clusters to be loaded sequentially when only looking for last line
ikreymer
committed

Commits on Oct 6, 2013

ZIP & SLR improvements: store connectedUrl immediately on connection, print connectedUrl on error, skip cached url on fallback to location list
ikreymer
committed

Commits on Oct 14, 2013

Commits on Oct 15, 2013

FIX: ApacheHttp31SLR save the connected url even on error!
ikreymer
committed

Commits on Oct 17, 2013

Commits on Oct 18, 2013

Commits on Oct 23, 2013

FEATURE: add getTotalCount() to cdx input sources
ikreymer
committed

Commits on Oct 24, 2013

log RuntimeIOException
ikreymer
committed

Commits on Nov 2, 2013

Commits on Nov 4, 2013

canonicalizer: add ExtractRule and RewriteRule
ikreymer
committed

Commits on Nov 16, 2013

FIX: add cdxlinefactory doesn't require custom format
ikreymer
committed

Commits on Nov 23, 2013

Extract outlinks/hopinfo from warc/metadata records
vinaygoel
committed

Commits on Nov 25, 2013

reference pom.xml for building with CDH4
vinaygoel
committed

Commits on Dec 6, 2013

Commits on Dec 11, 2013

Removed older PublicSuffix code.
anjackson
committed

Commits on Dec 12, 2013