Arq

Verified open-source repositories and technical documentation formatted for LLM context windows and autonomous AI coding agents (15 repositories indexed).

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

16,999 GitHub

Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

6,904 GitHub

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

5,685 GitHub

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

4,109 GitHub