Releases: hellige/au
"Standardize" printing of NaN, etc.
Bug fixes, build updates
This release fixes a bug in the behavior of tail -f and improves the handling of time/date prefix patterns from command line. There were also small build updates for newer compilers and distros.
Added ztail command
In this release we have the ability to tail a gzipped file, provided an index is availble. A new command, au ztail, forces au to treat the input stream as compressed (and error if no index is available), while the existing tail command will detect this automatically.
Bug fix: improve handling of large records
This release improves the handling of very large records during binary search (grep -o).
new features
This release contains various new features in the au command-line tool, mostly related to the grep command:
auwill now detect gzipped files and automatically handle them correctly.zcat/zgrepare now deprecated.au grepcan now handle plain ASCII log files with timestamps at the start of (some) lines. Seeau grep -l.au grepgained several other new arguments, including-gand-F, and the bisect functionality was improved.au grepwill now accept timestamps without a date (e.g.,12:34:56.100) and attempt to infer the date from the input stream.
grep now supports json files!
The au grep command now supports normal JSON files as well as au-encoded files. au will attempt to auto-detect whether the input stream is JSON. Gzipped JSON files are supported as well, provided you build an index first using au zindex (just like with au-encoded files).
The ability to binary search large gzipped JSON log files can be very convenient:
[~]% ls -lh big.json
-rw-r--r-- 1 mhellige mhellige 22G Dec 29 17:00 big.json
[~]% time au grep -c -o estdEventTime 2021-12-17T08:00:00 big.json
1263
au grep -c -o estdEventTime 2021-12-17T08:00:00 big.json 0.12s user 0.02s system 99% cpu 0.141 total
Not bad for a 22G JSON file!
Improve handling of large records
Previously, grep could fail upon encountering large records when the underlying stream was non-seekable (e.g., when grepping stdin or a non-indexed gzipped file). This release fixes that problem.
Fix performance regression
This release fixes a performance regression in zgrep -o that was introduced in the last release.
Added zcat command
This release adds the au zcat command as a convenience.
Performance improvements
Performance improvements, fixes for recent compilers.