排行榜

  1. https://www.swebench.com/
  2. https://llm-stats.com/
  3. https://openrouter.ai/rankings
  4. https://llmdb.com/
  5. https://crfm.stanford.edu/helm/lite/latest/#/leaderboard

运行

CLI

  1. https://github.com/ggerganov/llama.cpp
  2. https://github.com/foldl/chatllm.cpp
  3. https://github.com/ggerganov/whisper.cpp
  4. https://github.com/google/gemma.cpp
  5. https://github.com/EricLBuehler/mistral.rs
  6. https://github.com/ml-explore/mlx-lm

Desktop

  1. https://ollama.com
  2. https://lmstudio.ai
  3. https://cherry-ai.com
  4. https://msty.app
  5. https://github.com/open-webui/open-webui
  6. https://github.com/lobehub/lobe-chat
  7. https://github.com/chatboxai/chatbox
  8. https://anythingllm.com
  9. https://www.nomic.ai/gpt4all
  10. https://github.com/lostruins/koboldcpp
  11. https://github.com/Mozilla-Ocho/llamafile

Server

  1. https://github.com/vllm-project/vllm
  2. https://github.com/sgl-project/sglang
  3. https://github.com/triton-inference-server/tensorrtllm_backend https://github.com/NVIDIA/TensorRT-LLM
  4. https://github.com/skypilot-org/skypilot
  5. https://github.com/huggingface/text-generation-inference
  6. https://github.com/lm-sys/FastChat
  7. https://github.com/bentoml/OpenLLM
  8. https://haystack.deepset.ai

Proxy

  1. https://github.com/maximhq/bifrost
  2. https://github.com/BerriAI/litellm
  3. https://github.com/QuantumNous/new-api
  4. https://github.com/songquanpeng/one-api
  5. https://github.com/helicone/helicone
  6. https://portkey.ai/

智能体

  1. https://github.com/openclaw 239k stars
  2. https://github.com/HKUDS/nanobot 26.8k stars
  3. https://github.com/bytedance/deer-flow 22.4k stars
  4. https://github.com/sipeed/picoclaw 21.1k stars
  5. https://github.com/zeroclaw-labs/zeroclaw 21k stars
  6. https://github.com/AstrBotDevs/AstrBot 18.4k stars
  7. https://github.com/badlogic/pi-mono 18k
  8. https://github.com/qwibitai/nanoclaw 16.3k stars
  9. https://github.com/langbot-app/LangBot 15.4k stars
  10. https://github.com/RightNow-AI/openfang 4.8k stars
  11. https://github.com/nearai/ironclaw 3.9k stars
  12. https://github.com/agentscope-ai/CoPaw 3.1k stars
  13. https://github.com/netease-youdao/lobsterai 3k stars
  14. https://github.com/microclaw/microclaw 458 stars
  15. https://github.com/qhkm/zeptoclaw 394 stars

参考

  1. https://en.wikipedia.org/wiki/Large_language_model
  2. https://github.com/Hannibal046/Awesome-LLM