An open format for storing and transferring high-frequency device telemetry.
Designed for resource-constrained environments
- Lightweight to encode
- Lightweight to decode
Extensible
Efficient data representation can be extended with :
- custom value types
- user-defined metadata
Well supported
Based on FlatBuffers, an open-source technology deployed in production at massive scale.
With encoders/decoders available for all major programming languages:
- C++
- Go
- Java
- JavaScript / TypeScript
- Python
- Rust
High performance
Streaming
Highly compressible thanks to struct of arrays (SoA) data layout.
Storage
File format (.osig) designed for append-only operations.
Aggregations
Multiple telemetry sources can be combined without the need for expensive re-encoding steps.
Data access
File can be memory-mapped and accessed non-sequentially
Signals are organized in pages indexed by timestamp, for fast seek over large telemetry files.