Expand description
ETL data collector.
This crate is useful for dumping unsorted data into temporary files and iterating on their sorted representation later on.
This has multiple uses, such as optimizing database inserts (for Btree based databases) and memory management (as it moves the buffer to disk instead of memory).
Structsยง
- An ETL (extract, transform, load) data collector.
EtlIter
is an iterator for traversing through sorted key-value pairs in a collection of ETL files. These files are created using theCollector
and contain data where keys are encoded and values are compressed.