Skip to content
This repository was archived by the owner on Jan 18, 2025. It is now read-only.
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: bityon/python-hadoop
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: master
Choose a base ref
...
head repository: commoncrawl/python-hadoop
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: main
Choose a head ref
Checking mergeability… Don’t worry, you can still create the pull request.
  • 9 commits
  • 36 files changed
  • 6 contributors

Commits on Sep 24, 2021

  1. Fix reading after sync at EOF

    @artem-garmash @sebastian-nagel
    artem-garmash authored and sebastian-nagel committed Sep 24, 2021
    Configuration menu
    Copy the full SHA
    0cdd7e7 View commit details
    Browse the repository at this point in the history

  2. Add LZ4 support for SequenceFile.

    @haohui @sebastian-nagel
    haohui authored and sebastian-nagel committed Sep 24, 2021
    Configuration menu
    Copy the full SHA
    330c33d View commit details
    Browse the repository at this point in the history

  3. Add BytesWritable class.

    @sebastian-nagel
    Carl Scheffler authored and sebastian-nagel committed Sep 24, 2021
    Configuration menu
    Copy the full SHA
    6ec479c View commit details
    Browse the repository at this point in the history

  4. filter our non-printable characters

    @sebastian-nagel
    Wes Widner authored and sebastian-nagel committed Sep 24, 2021
    Configuration menu
    Copy the full SHA
    33776cf View commit details
    Browse the repository at this point in the history

  5. change toString to use mod 256 to make the method more generally appl… 

    …icable
    @kai5263499 @sebastian-nagel
    kai5263499 authored and sebastian-nagel committed Sep 24, 2021
    Configuration menu
    Copy the full SHA
    0d8620b View commit details
    Browse the repository at this point in the history

Commits on Sep 28, 2021

  1. Merge branch 'matteobertozzi/master' 

    to include changes made in 2016 in the original
repository https://github.com/matteobertozzi/Hadoop
    @sebastian-nagel
    sebastian-nagel committed Sep 28, 2021
    Configuration menu
    Copy the full SHA
    27fdd3a View commit details
    Browse the repository at this point in the history

  2. Run 2to3-2.7 to upgrade from Python 2.7 to Python 3

    @sebastian-nagel
    sebastian-nagel committed Sep 28, 2021
    Configuration menu
    Copy the full SHA
    0c360c0 View commit details
    Browse the repository at this point in the history

  3. Upgrade to Python 3 

    - run examples and fix errors
- fix reading Sequence file version numbers
- convert byte<>string where necessary
- import NullWritable so that the Sequence file reader supports it
- format code

Thanks to @jingcwang (https://github.com/jingcwang/Hadoop)
and @jtang7 (https://github.com/jtang7/Hadoop)
for some solutions to fix Python 3 errors!
    @sebastian-nagel
    sebastian-nagel committed Sep 28, 2021
    Configuration menu
    Copy the full SHA
    1bdb52a View commit details
    Browse the repository at this point in the history

  4. - update description in README, package init scripts 

    - add license
- update setup script
    @sebastian-nagel
    sebastian-nagel committed Sep 28, 2021
    Configuration menu
    Copy the full SHA
    0fe998f View commit details
    Browse the repository at this point in the history
Loading