Data Storage Optimisation

Alluxio is a virtual distributed storage system that enables data orchestration between computation frameworks and …

Apache Arrow is an in-memory columnar data format designed for efficient data interchange and analytics. It provide…

Apache Druid is a high-performance, column-oriented, distributed data store designed for real-time analytics on lar…

Apache Hudi is an open-source data lake platform that enables incremental data processing and upserts on large-scal…

Apache Iceberg is an open table format designed for large-scale analytics workloads, enabling ACID transactions, sc…

Apache Ignite is an in-memory computing platform that functions as a distributed database, caching layer, and proce…

Apache Parquet is an open-source columnar storage format optimized for efficient data storage and retrieval. It is …

Apache Pinot is a realtime distributed OLAP datastore designed to deliver low-latency analytics on large-scale data…

Chroma is an open-source embedding database designed for storing and querying vector embeddings efficiently. It spe…

ClickHouse is a high-performance, column-oriented database management system designed for online analytical process…

Delta Lake is an open-source storage layer that provides ACID transactions, scalable metadata handling, and unified…

EdgeDB is an open-source database system that enhances PostgreSQL with a modern data model, graph query capabilitie…

GPTCache is an open-source library designed to create a semantic cache for large language model (LLM) queries, redu…

InfluxDB is a time-series database designed to handle high write and query loads for metrics, events, and real-time…

Marqo is an open-source vector search engine designed for efficient indexing and retrieval of high-dimensional vect…

Milvus is an open-source vector database designed for efficient storage, indexing, and retrieval of high-dimensiona…

pgvector is an open-source extension for PostgreSQL that enables efficient storage and retrieval of vector embeddin…

PostgresML is a PostgreSQL extension that integrates machine learning directly into the database, allowing users to…

Redis is an open-source, in-memory data store that supports vector similarity search. It is suitable for AI/ML appl…

Safetensors is a library for safely storing and distributing tensors, the fundamental data structures in machine le…

TimescaleDB is an open-source time-series database optimized for fast data ingestion and complex queries, built as …

Weaviate is an open-source vector search engine designed for efficient storage and retrieval of vectorized data, su…

Zarr is a Python library for efficiently storing and accessing chunked, compressed, multi-dimensional arrays, optim…