Commits

History for

Commits on Nov 14, 2016

Rename "path" parameter to "output" in many plugins. Documentation improvements after feedbacks from PyConFR sprint. Add Python implementation of PageRank for education purposes. Generalize the use…
sylvinus
committed

Commits on Oct 12, 2016

Added quotes around grep words, was causing error (#61)

bakztfuture
authored and
sylvinus
committed

Commits on Aug 25, 2016

Exclude nofollow links from the webgraph (#52), rename "datasources" to "dataproviders" to avoid confusion with document sources, and other smaller refactors
sylvinus
committed

Commits on Aug 11, 2016

Smarter defaults for filter plugin + Move partition logic to document sources
sylvinus
committed

Commits on Aug 2, 2016

Commits on Jul 21, 2016

Introduce intermediate document metadata Parquet dumps. Misc refactorings
sylvinus
committed

Commits on Jul 18, 2016

Output graph files as Parquet. Move jobs/spark to spark/jobs. Add Hadoop distribution to the local Docker image.
sylvinus
committed

Commits on Jul 15, 2016

Move tree traversal to Cython (3x indexation speedup), reimplement filters as plugins
sylvinus
committed

Commits on Jul 12, 2016

Refactor the indexing pipeline by adding support for plugins & many other small fixes.
sylvinus
committed

Commits on Jun 16, 2016

Add INSTALL.md and deprecate Docker-less install method.
sylvinus
committed

Commits on Mar 15, 2016

Add import_commoncrawl step to the README
sylvinus
committed

Commits on Mar 14, 2016

Add coverage via coveralls for #32
sylvinus
committed

Commits on Feb 26, 2016

First prototype of the Explainer
sylvinus
committed

Commits on Feb 23, 2016

Add architecture diagram to the README for commonsearch/cosr-participation#8
sylvinus
committed

Commits on Feb 18, 2016

More details on how to run tests + Travis CI
sylvinus
committed

Commits on Feb 17, 2016

First code import!
sylvinus
committed

Loading