Skip to content

Some perf tweaks to the tokenizer. #112

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 5 commits into from
Jan 21, 2017
Merged

Some perf tweaks to the tokenizer. #112

Changes from 1 commit
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
afcf259
Use less UTF-8 logic when not needed.
emilio Jan 17, 2017
4676208
Use a procedural macro to create jump tables instead of doing branching.
emilio Jan 17, 2017
b509dc0
Change the signature of next_token to match Tokenizer::next()
emilio Jan 18, 2017
52e6527
Remove most of the unnecessary UTF-8 logic from the tokenizer.
emilio Jan 18, 2017
21f8573
travis: Test with and without procedural macro.
emilio Jan 18, 2017
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
travis: Test with and without procedural macro.
  • Loading branch information
@emilio
emilio committed Jan 21, 2017
commit 21f85731aa14ccc0a1f75da9ae31c66b2a88654f
3 changes: 3 additions & 0 deletions .travis.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,9 @@ script:
- cargo test --verbose
- cargo doc --verbose
- cargo test --features heapsize
- cargo test --features dummy_match_byte
- if [ "$TRAVIS_RUST_VERSION" == "nightly" ]; then cargo test --features bench; fi
- if [ "$TRAVIS_RUST_VERSION" == "nightly" ]; then cargo test --features "bench dummy_match_byte"; fi

notifications:
webhooks: http://build.servo.org:54856/travis