Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit History

Commits on Jun 12, 2026

• Upgrade to StormCrawler 3.6.0, Storm 2.8.8

  sebastian-nagel

  committed
  0d68ae5

  Copy full SHA for 0d68ae5

Commits on Mar 31, 2026

• Replace Dockerfile by docker compose config

  Show description for 6bd1e31
  sebastian-nagel

  committed
  6bd1e31

  Copy full SHA for 6bd1e31

• Upgrade code to StormCrawler 3.5.1

  Show description for c4519b8
  sebastian-nagel

  committed
  c4519b8

  Copy full SHA for c4519b8

Commits on Nov 16, 2023

• Port to SC 2.x, overall updates of components

  Show description for 1e7a11b
  jnioche

  committed
  1e7a11b

  Copy full SHA for 1e7a11b

Commits on Mar 31, 2022

• Improve command (command-line bin/es_status) to reset URL status

  sebastian-nagel

  committed
  4194f9c

  Copy full SHA for 4194f9c

Commits on Jul 28, 2020

• Update es_status script:

  Show description for 45ec767
  sebastian-nagel

  committed
  45ec767

  Copy full SHA for 45ec767

Commits on Jan 30, 2020

• Remove Injector topology from crawler run script

  Show description for 7281e85
  sebastian-nagel

  committed
  7281e85

  Copy full SHA for 7281e85

Commits on Dec 12, 2019

• Elasticsearch metrics index initialization, merge changes from StormCrawler:

  Show description for eafe3e2
  sebastian-nagel

  committed
  eafe3e2

  Copy full SHA for eafe3e2

Commits on May 22, 2019

• Update and improve crawler configuration

  sebastian-nagel

  committed
  fc91ef7

  Copy full SHA for fc91ef7

• Upgrade to StormCrawler 1.14 and Elasticsearch 7.0

  Show description for 16d7f1a
  sebastian-nagel

  committed
  16d7f1a

  Copy full SHA for 16d7f1a

• ES_IndexInit.sh

  Show description for 6852676
  sebastian-nagel

  committed
  6852676

  Copy full SHA for 6852676

Commits on Mar 7, 2019

• Add command to simulate "next fetch" list for given date and host

  sebastian-nagel

  committed
  40870f7

  Copy full SHA for 40870f7

Commits on Jan 7, 2019

• Add commands to

  Show description for 319e2f3
  sebastian-nagel

  committed
  319e2f3

  Copy full SHA for 319e2f3

Commits on Nov 12, 2018

• Add command (command-line bin/es_status) to inject URL to status index

  sebastian-nagel

  committed
  b79cdbc

  Copy full SHA for b79cdbc

Commits on Mar 14, 2018

• Add command to trigger fetch of an URL at a given date

  sebastian-nagel

  committed
  2b449d2

  Copy full SHA for 2b449d2

Commits on Mar 7, 2018

• improve command-line help

  sebastian-nagel

  committed
  adf424f

  Copy full SHA for adf424f

Commits on Jan 5, 2018

• Merge branch 'sc-1.8', upgrade to Storm-crawler 1.8, Elasticsearch 6.0, Storm 1.1

  sebastian-nagel

  committed
  1755df6

  Copy full SHA for 1755df6

• Fix bash syntax

  sebastian-nagel

  committed
  b9744ea

  Copy full SHA for b9744ea

Commits on Dec 25, 2017

• Fix calls for ES 6.x

  sebastian-nagel

  committed
  f1a8377

  Copy full SHA for f1a8377

Commits on Dec 22, 2017

• Upgrade to Storm-crawler 1.8 and Elasticsearch 6.0

  Show description for f010561
  sebastian-nagel

  committed
  f010561

  Copy full SHA for f010561

Commits on Dec 19, 2017

• Upgrade to Storm-crawler 1.8 and Elasticsearch 6.0

  Show description for 022ad09
  sebastian-nagel

  committed
  022ad09

  Copy full SHA for 022ad09

Commits on Dec 13, 2017

• Fix bash syntax

  sebastian-nagel

  committed
  742f9b1

  Copy full SHA for 742f9b1

Commits on Feb 3, 2017

• escape white space in IDs

  sebastian-nagel

  committed
  30b6ccb

  Copy full SHA for 30b6ccb

• escape white space in IDs

  sebastian-nagel

  committed
  13b12a6

  Copy full SHA for 13b12a6

Commits on Feb 1, 2017

• Merge branch 'master' into private-production,

  Show description for 0312ee7
  sebastian-nagel

  committed
  0312ee7

  Copy full SHA for 0312ee7

Commits on Jan 25, 2017

• query ES status index: improve help, add aggregation commands

  sebastian-nagel

  committed
  086555c

  Copy full SHA for 086555c

Commits on Jan 6, 2017

• Merge branch 'master' into private-production

  sebastian-nagel

  committed
  ab595a8

  Copy full SHA for ab595a8

• ES status tool

  Show description for 82dbd7a
  sebastian-nagel

  committed
  82dbd7a

  Copy full SHA for 82dbd7a

• decrease log level for news sitemap parser to avoid too many or long messages

  sebastian-nagel

  committed
  a922b3b

  Copy full SHA for a922b3b

Commits on Jan 5, 2017

• Merge branch 'master' into private-production

  sebastian-nagel

  committed
  adf071f

  Copy full SHA for adf071f

Commits on Dec 22, 2016

• add script to query ES status index

  sebastian-nagel

  committed
  c52d6fa

  Copy full SHA for c52d6fa

Commits on Dec 21, 2016

• Merge branch 'master' into private-production

  sebastian-nagel

  committed
  f056cc3

  Copy full SHA for f056cc3

• improvements to Docker image

  Show description for e93999b
  sebastian-nagel

  committed
  e93999b

  Copy full SHA for e93999b

Commits on Oct 17, 2016

• fix file mode / permissions: scripts should be executable

  sebastian-nagel

  committed
  e412031

  Copy full SHA for e412031

• fix permissions

  sebastian-nagel

  committed
  d111cdf

  Copy full SHA for d111cdf