awesome-infra-for-ai digest (2026-08-03)

The awesome-infra-for-ai list received 11 new repositories. FlowElement-ai/m_flow (4,421 stars) — M-flow is a bio-inspired cognitive memory engine that uses a four-layer cone graph for Retrieval Augmented Generation (RAG), scoring knowledge units by the strongest chain of reasoning paths. NGT-labs/NGT (1,368 stars) — NGT is a high-speed approximate nearest neighbor search library for high-dimensional vector data, featuring graph and tree-based methods, quantization techniques, and multi-language support. comet-ml/opik-openclaw (707 stars) — An official plugin for OpenClaw that exports agent traces to Opik for comprehensive LLM observability, monitoring, and evaluation. mikehasa/agentacct (541 stars) — Agentacct is a local-first agent work intelligence tool for coding agents, providing a dashboard to track token usage, estimated costs, tasks, and work steps without external telemetry. Paritok-official/paritok-4b-v1 (344 stars) — Paritok is an open-source, non-destructive compression model and gateway purpose-built for coding agents, significantly reducing LLM input token costs while maintaining performance on SWE-bench. FareedKhan-dev/kimi-k3-in-c (321 stars) — kimi-k3-in-c is a portable C99 inference engine designed to run the Kimi K3 2.78-trillion-parameter LLM on a single CPU with minimal RAM, focusing on extreme memory efficiency without GPUs or exter... comet-ml/opik-mcp (216 stars) — Opik MCP (Model Context Protocol) server for integrating AI hosts (Claude Code, Cursor, VS Code Copilot) with Opik for LLM observability, evaluation, and prompt management. MigoXLab/LMeterX (201 stars) — LMeterX is a professional, full-lifecycle platform for load testing and performance benchmarking of large language models and other AI inference services, offering real-time monitoring and AI-power... Jia-Ethan/grok-keysmith (160 stars) — A Python CLI tool for deploying versioned instruction Markdown files, such as AGENTS.md, to Grok Build, ensuring global configuration with compatibility and hook isolation and providing a robust un... youssefvdel/qwengate (127 stars) — Qwen Gate is a self-hosted, OpenAI-compatible API gateway that allows users to access Qwen AI models (via chat.qwen.ai) for free, featuring multi-account rotation, tool calling, and a web dashboard. huangyiminghappy/ai-eval-platform (115 stars) — An open-source, self-hosted AI evaluation platform offering a web UI for assessing RAG, AI Agents, and multi-turn conversations through dataset management, scenario presets, metrics, LLM-as-a-Judge...