Large Language Model (LLM)

AI Agent Retrieval Augmented Generation (RAG) LLM Prompting Guidelines

Benchmarks

• https://aider.chat/docs/leaderboards/
• https://github.com/petergpt/bullshit-benchmark

RAG

• https://github.com/VectifyAI/PageIndex
• What are knowledge graphs and why is everyone talking about them? | Blog | SurrealDB

Search

• https://github.com/tobi/qmd

Evals

• Build Secure AI Applications | Promptfoo
• https://agenta.ai

Security

• My self-sovereign / local / private / secure LLM setup, April 2026 — Vitalik Buterin’s guide to running LLMs locally with focus on privacy, security and self-sovereignty

Local Models and Hosting

• https://github.com/AlexsJones/llmfit
• https://github.com/microsoft/BitNet
• https://github.com/av/harbor
• CanIRun.ai — Can your machine run AI models?

Fine-tuning

• LoRA fine-tuning Hyperparameters Guide | Unsloth Documentation

Training

• https://github.com/karpathy/autoresearch

Inference servers

• https://github.com/ericcurtin/inferrs
• GitHub - jundot/omlx: LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar · GitHub

Gateways

• https://ngrok.ai