the real-time terminal for AI news

↗

TOOLING llama_moe_cache: run missed experts on CPU, add tuning script by am17an · Pull Request #30966 · ggml-org/llama.cpp

6d ago · r/LocalLLaMA →

Depending on --moe-cache-cpu-share, this PR executes experts on the CPU.

Why is this ranked here?