Commits

Branch selector

 v1

User selector

All users

All time

Commit History

Commits on Feb 22, 2016

• indexwarcsjob.py: update hard-coded path to be correct (TODO: load from env)

  Show description for 0ee5018
  ikreymer

  committed
  0ee5018

  Copy full SHA for 0ee5018

Commits on Nov 24, 2015

• add newline after last line in zipnum block, fixes #4

  ikreymer

  committed
  7041826

  Copy full SHA for 7041826

Commits on Oct 9, 2015

• build local zipnum: add line numbering to final index (summary), add option to specify cdx lines per block

  ikreymer

  committed
  b0ad9c3

  Copy full SHA for b0ad9c3

Commits on Jun 11, 2015

• Merge pull request #2 from machawk1/patch-1

  Show description for 9e90b67
  ikreymer

  committed
  9e90b67

  Copy full SHA for 9e90b67

• Fixed various MD weirdnesses

  machawk1

  committed
  6edfded

  Copy full SHA for 6edfded

Commits on Mar 29, 2015

• minor fixes from latest CC index build:

  Show description for 0005813
  ikreymer

  committed
  0005813

  Copy full SHA for 0005813

Commits on Mar 13, 2015

• readme tweaks

  ikreymer

  committed
  70339a0

  Copy full SHA for 70339a0

• readme tweaks

  ikreymer

  committed
  e145669

  Copy full SHA for e145669

• Add local cluster build info

  ikreymer

  committed
  35b85c4

  Copy full SHA for 35b85c4

Commits on Mar 12, 2015

• Merge branch 'master' of https://github.com/ikreymer/webarchive-indexing

  ikreymer

  committed
  aae924d

  Copy full SHA for aae924d

• add local zip num cluster building support!

  ikreymer

  committed
  fc6223b

  Copy full SHA for fc6223b

Commits on Mar 11, 2015

• sample job: add scaler to mapper also

  ikreymer

  committed
  6bee704

  Copy full SHA for 6bee704

• readme update

  ikreymer

  committed
  b25e634

  Copy full SHA for b25e634

• Update README.md with more usage instuctions.

  ikreymer

  committed
  70c255a

  Copy full SHA for 70c255a

• make scripts runnable

  ikreymer

  committed
  89ab48c

  Copy full SHA for 89ab48c

• update path to index_env.sh

  ikreymer

  committed
  4f5e4db

  Copy full SHA for 4f5e4db

• add sample index_env.sample.sh

  ikreymer

  committed
  f079e8a

  Copy full SHA for f079e8a

• fix typos

  ikreymer

  committed
  8f54132

  Copy full SHA for 8f54132

• Merge branch 'master' of https://github.com/ikreymer/webarchive-indexing

  ikreymer

  committed
  0378178

  Copy full SHA for 0378178

• tweak README

  ikreymer

  committed
  fcfc82a

  Copy full SHA for fcfc82a

• Update README after refactor

  ikreymer

  committed
  48fcf9f

  Copy full SHA for 48fcf9f

• add .gitignore and LICENSE

  ikreymer

  committed
  5c553b7

  Copy full SHA for 5c553b7

• more cleanup of run scripts, integrate seq upload into dosample job

  ikreymer

  committed
  71ccd91

  Copy full SHA for 71ccd91

Commits on Mar 10, 2015

• refactoring: use cmdline options instead of fixed constants!

  Show description for 57cb430
  ikreymer

  committed
  57cb430

  Copy full SHA for 57cb430

• More README work

  ikreymer

  committed
  1ca6de7

  Copy full SHA for 1ca6de7

• Update README.md, part two

  ikreymer

  committed
  adbb359

  Copy full SHA for adbb359

• Update README.md, first job

  ikreymer

  committed
  f4dde78

  Copy full SHA for f4dde78

• Update README.md

  Show description for c05aa4f
  ikreymer

  committed
  c05aa4f

  Copy full SHA for c05aa4f

Commits on Mar 9, 2015

• update README

  ikreymer

  committed
  507b2ea

  Copy full SHA for 507b2ea

• add sample mrjob.conf and different run* scripts

  Show description for 7e01edc
  ikreymer

  committed
  7e01edc

  Copy full SHA for 7e01edc

• add readme

  ikreymer

  committed
  6ec091d

  Copy full SHA for 6ec091d

• zipnumwriter: add convert_line to convert to json line format

  ikreymer

  committed
  8a7ab30

  Copy full SHA for 8a7ab30

Commits on Mar 8, 2015

• update indexwarcs with better retry mechanism

  Show description for 0d74e79
  ikreymer

  committed
  0d74e79

  Copy full SHA for 0d74e79

• update indexwarcs for latest iteration

  Show description for 2d6c985
  ikreymer

  committed
  2d6c985

  Copy full SHA for 2d6c985

Commits on Mar 7, 2015

• fixes for running indexwarcs

  ikreymer

  committed
  45e4d75

  Copy full SHA for 45e4d75