Category Archives: Compression

Efficiently writing large objects to Azure Blob Storage – JSON, Compression, Caching, Streaming in .Net

Figure: The Goal - Efficiency & Throughput

Azure Storage Blob Azure Storage Blob is an Azure Storage offering that allows you to store GigaBytes of data in from hundreds to billions of objects in hot, cool, or archive tiers, depending on how often data access is needed. Store any type of unstructured data—images, videos, audio, documents and more—easily… Read more »

Compress sequence of UNIX timestamps with microseconds accuracy to ~10bits/timestamp

Problem Setup: There is a stream of timestamps that need to be transferred across some network stream; Goal is to compress this sequence of timestamps (with microseconds accuracy, lossless). Also the encoding and decoding process should be very fast so that it can scale for time critical processes; Some assumptions:… Read more »