Useful Projects
Open-source projects pushing the boundaries of local AI.
chopratejas/headroom
800
headroom
Beautiful macOS menubar app that shows which LLMs fit on your Mac in real time. Monitors available memory and recommends models.
rtk-ai/rtk
2k
RTK (Real-Time Kit)
Agent framework for building real-time AI applications. WebSocket-native, streaming-first, with built-in tool orchestration.
cwinvestments/memstack
500
memstack
Memory-efficient model stacking — run multiple small models as a committee. Ensemble inference on consumer hardware.