Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Add ISA-L to the comparison #94

@rhpvorderman

Description

@rhpvorderman

The Intel Storage Acceleration Library is an implementation of the DEFLATE algorithm written in assembly. As a result it is very fast. It can be used as a replacement for zlib.

Unlike libdeflate, ISA-L has a streaming implementation as well as an all-at-once implementation. Libdeflate only has an all-at-once implementation which makes it unsuitable for big compressed files of genomic data (FASTQ format) as these would need to be read into memory entirely.

It would be quite interesting to see how ISA-L compares to the rest of the compression programs. Especially since it is 100%-compatible with the zlib formats. This allows for smooth transition.

From my own experiments my ballpark estimates are that ISA-L is 6x faster when compressing data and 3x faster when decompressing data than zlib. So it would be a quite nice addition to this already impressive comparison of programs.

A disadvantage of adding it would be that it needs an assembler (NASM or YASM) besides a c-compiler since it is written in assembly with C-bindings provided. So it would complicate the build slightly.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions