Show HN: Arc – high-throughput time-series warehouse with DuckDB analytics

Summary

Arc Core High-performance time-series data warehouse built on DuckDB, Parquet, and MinIO. ⚠️ Alpha Release - Technical Preview Arc Core is currently in active development and evolving rapidly. While the system is stable and functional, it is not recommended for production workloads at this time. We are continuously improving performance, adding features, and refining the API. Use in development and testing environments only. Features High-Performance Ingestion : MessagePack binary protocol (recommended), InfluxDB Line Protocol (drop-in replacement), JSON : MessagePack binary protocol (recommended), InfluxDB Line Protocol (drop-in replacement), JSON DuckDB Query Engine : Fast analytical queries with SQL : Fast analytical queries with SQL Distributed Storage with MinIO : S3-compatible object storage for unlimited scale and cost-effective data management (recommended). Also supports local disk, AWS S3, and GCS : S3-compatible object storage for unlimited scale and cost-effective data management (recommended). Also supports local disk, AWS S3, and GCS Data Import : Import data from InfluxDB, TimescaleDB, HTTP endpoints : Import data from InfluxDB, TimescaleDB, HTTP endpoints Query Caching : Configurable result caching for improved performance : Configurable result caching for improved performance Production Ready: Docker deployment with health checks and monitoring Performance Benchmark 🚀 Arc achieves 1.89M records/sec with MessagePack binary protocol! Metric Value Notes Throughput 1.89M records/sec MessagePack binary protocol p50 Latency 21ms Median response time p95 Latency 204ms 95th percentile Success Rate 99.9998% Production-grade reliability vs Line Protocol 7.9x faster 240K → 1.89M RPS Tested on Apple M3 Max (14 cores), native deployment with MinIO 🎯 Optimal Configuration: Workers: 3x CPU cores (e.g., 14 cores = 42 workers) 3x CPU cores (e.g., 14 cores = 42 workers) Deployment: Native mode (2.4x faster than Docker) Native mode (2.4x faster than Docker) Storage: M...