sitegui/json-to-parquet
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
No description
19 commits 1 branch 0 tags 238 KiB
Find a file
Exact
sitegui 1c1a198e6e Add benchmark for json_tokenizer
2026-04-26 12:07:18 -03:00
benches/bench Add benchmark for json_tokenizer 2026-04-26 12:07:18 -03:00
examples Add benchmark for json_tokenizer 2026-04-26 12:07:18 -03:00
src Add benchmark 2026-04-25 15:54:42 -03:00
.gitignore Add benchmark for json_tokenizer 2026-04-26 12:07:18 -03:00
Cargo.lock Add benchmark for json_tokenizer 2026-04-26 12:07:18 -03:00
Cargo.toml Add benchmark for json_tokenizer 2026-04-26 12:07:18 -03:00
README.md Add benchmark for json_tokenizer 2026-04-26 12:07:18 -03:00
rust-toolchain Add unescape logic 2026-04-17 14:30:28 -03:00

README.md

JSON to Arrow converter

Improving json_tokenizer

Ideas:

  • make pos tracking optional
  • remove mem::replace() of state
  • read multiple tokens at once
  • reduce size of state