Releases · Phelsong/mojo_csv

22 Jul 14:12

Phelsong

v1.4.0

d92e7b7

v1.4.0 Latest

Latest

Add byte-level comparison optimization
Use logical cores to determine thread count for better compatibility
Added Large File benchmark
Single Threaded Performance Improvements, ~3x speedup
Threaded Performance Improvements, +100% over previous / ~+40% over single threaded on large files

average time in ms for micro file:
0.0076ms -> .0018ms

average time in ms for mini file:
0.24ms -> .073ms

average time in ms for small file:
1.39ms -> .41ms -> [T] .39ms

running benchmark for medium csv:
average time in ms for medium file:
121.22ms -> 36.46ms -> [T] 24.84ms

running benchmark for large csv:
average time in ms for large file:
3582.88ms -> 1253.20ms -> [T] 845.33ms

Note: Threaded Reader will be the default next release.

Assets 4

07 Jul 01:17

Phelsong

v1.3.0

bfffd9f

v1.3.0

Performance Improvements! 🎉

[BETA] ThreadedCsvReader - A drop-in replacement for CsvReader with parallel processing capabilities
Several minor optimizations (for single and threaded versions)
More available methods (repr, etc...)
Benchmarking - Performance benchmarks comparing sizes and single vs multi-threaded parsing
Tests - to help maintain consistency
Documentation - Usage examples and demonstrations

[BETA] ThreadedCsvReader Key Features

✅ Parallel Processing: Lightly Threaded
✅ Smart Fallback: Automatically uses single-threaded mode for small files
✅ Thread Safety: Safe to read from multiple threads after construction
✅ API Compatibility: Identical interface to the original CsvReader (Will likely fully replace in a version or 2)
✅ Configurable: Choose thread counts (default is 50% of all available)
✅ Robust: Handles quoted fields, different delimiters, and edge cases

Assets 4