4d ago
TOOLING
More interesting and unusual Qwen3.5-4B neurons #
You guys seemed to like my last post about the 'redditor neuron' so I'm listing some other interesting neurons I've found while poking… — r/LocalLLaMA
4d ago
TOOLING
ConceptCountry/qwen-concept-27b · Hugging Face #
Machine learning model with 27B parameters. — r/LocalLLaMA
4d ago
TOOLING
Anyone else feeling like Qwen4's release happens in slow-motion? #
So if my memory serves me well: Late summer, Qwen 3.8 Flash Next announces the architecture Late october, conference talk, Qwen announces… — r/LocalLLaMA
5d ago
TOOLING
Drummer's Orion 26B A4B v1 and v1.1! ... Plus a new project from yours truly. #
https://huggingface.co/TheDrummer/Orion-26B-A4B-v1.1 v1.1 pushes creative writing further and makes full use of Gemma's reasoning. — r/LocalLLaMA
5d ago
TOOLING
meituan-longcat/LongCat-2.5 · Hugging Face #
Image-Text-to-Text model with 1.8T parameters. — r/LocalLLaMA
5d ago
TOOLING
New Gemma Models #
Are there any (insider) infos to upcoming Gemma Models? — r/LocalLLaMA
5d ago
TOOLING
L11 N8147 is a neuron that will make Qwen-3.5-4B get things confidently wrong while being weirdly snarky... But also makes it write interesting poetry #
Inspired by some of the other brain surgery posts, I wanted to see if I could find anything interesting in Qwen. — r/LocalLLaMA
5d ago
TOOLING
Joined the 4x R9700 Club | Initial Benchmarks for QFN 3.8 Below #
Posted this on the r/R9700 subreddit as well, but figured I'd share my initial findings here. — r/LocalLLaMA
5d ago
TOOLING
Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text Generation: This will completely change everything! #
Diffusion language models (DLMs) offer parallel sampling for faster generation than autoregressive models, an increasingly important… — r/LocalLLaMA
5d ago
TOOLING
GPT-5.5 dataset across my used 25 billion tokens! #
Dataset. Explore, preview and download it on Hugging Face. — r/LocalLLaMA
5d ago
TOOLING
Motion graphics video made with Qwen3.8 Flash Next GSQ RCO IQ3_XXS on strata #
I've seen the insane motion graphics videos people made when opus 5.5 first came out and wondered how good QFN would do with the same… — r/LocalLLaMA
5d ago
TOOLING
4x Radeon AI PRO R9700 + 2x RTX 3090 on one x16 slot, using a PCIe switch #
Four Radeon AI PRO R9700s and two RTX 3090s behind a PEX88096 switch on one X570 slot: BIOS, kernel flags, ROCm and CUDA, and Qwen3.8-27B… — r/LocalLLaMA
6d ago
TOOLING
"Does censorship exist in [country]?", according to various LLMs #
I wrote a small program that asks the same Yes/No question about every country to a language model, and generates an SVG world map that… — r/LocalLLaMA
6d ago
TOOLING
Users have started buying RTX 5060 Ti 16GB graphics cards en masse for the sake of AI. #
The consumer graphics accelerator market is seeing a noticeable shift in consumer demand as regular users begin to... — r/LocalLLaMA
6d ago
TOOLING
"Ram Altman" Is Now a Linux Script That Emails Sam Altman Daily to Report How Much Unused RAM Is in Your PC #
Developer builds Ram-Altman, a Linux script that automatically emails OpenAI CEO Sam Altman daily progress reports on idle desktop memory. — r/LocalLLaMA
6d ago
TOOLING
OpenClaw Retrospective #
A long time ago there was this massive phenomenon called OpenClaw that took the world by storm. — r/LocalLLaMA
6d ago
TOOLING
follistatin on X: "Qwen-4-Flash-Early (codename hawk) added to GameFeel Bench! (and audio score was calculated #
6d ago
TOOLING
Saw this benchmark where small changes to coding tasks made a big difference #
Saw this tweet about a coding benchmark and thought it was kinda interesting. — r/LocalLLaMA
6d ago
TOOLING
Anyone running local AI on 16GB vram? #
Hey everyone, Is anyone here running any useful AI agents, harnesses or toolings with local AI on 16GB vram? — r/LocalLLaMA
6d ago
TOOLING
The Stylome bot is useless spam and should be removed #
I've recently been seeing comments everywhere from the Stylome bot, which is also a mod in this sub. — r/LocalLLaMA
6d ago
TOOLING
Betelgeuse running DeepSeek V4.1 Flash Q8_XL (1017) at 19 tok/s decode & 62 tok/s prefill on an RTX 3060 12GB + 16GB RAM: How we finally fixed the prefill bottleneck on out-of-core MoEs #
After my last post on Qwen 3.8 Flash Next, a lot of people were asking if out-of-core MoE streaming could ever work on an actual frontier… — r/LocalLLaMA
6d ago
TOOLING
Use your phone to monitor anything with local models! Demo of my Open Source and 100% local agent (iOS and Android!) #
Hey r/LocalLLaMA ! — r/LocalLLaMA
6d ago
TOOLING
Also experienced the Qwen3.8-Flash-Next URL issue #
I was asking QFN (4.18bpw EXL3 quant via Pi) to help refactor a neovim configuration, and saw that it tried to find API keys and fetch an… — r/LocalLLaMA Qwen3.8-Flash-Next
6d ago
TOOLING
testing Qoduck (Maybe qwen4) on Qoder #
I noticed that it has native image and video generation. — r/LocalLLaMA
6d ago
TOOLING
llama_moe_cache: run missed experts on CPU, add tuning script by am17an · Pull Request #30966 · ggml-org/llama.cpp #
Depending on --moe-cache-cpu-share, this PR executes experts on the CPU. — r/LocalLLaMA
7d ago
TOOLING
Valet: use local LLMs to manage your homelab (open source) #
My favourite use case for local LLMs is running my homelab, because everything stays private (and it helps me justify the GPU lol) I wanted… — r/LocalLLaMA
7d ago
TOOLING
Obsessive-1.7B: a 1.1 GB web-search subagent #
I fine-tuned LFM3-1.7B to do one job: take a factual question, call web_search once, and answer with a short value, a word-for-word quote… — r/LocalLLaMA
7d ago
TOOLING
Another benchmark has hit the quant war #
If you have not been following ISTA-DASLab the creators of the gsq-rco quants have received some criticism from unsloth regarding the… — r/LocalLLaMA
7d ago
TOOLING
Good Luck Getting a Cheap GPU. AMD Is a 'Data Center First Company,' CEO Says #
Days after US voters approved dozens of data center moratoriums, Lisa Su says she wants AMD to 'be the best partner to the largest users of… — r/LocalLLaMA
7d ago
TOOLING
Harness Leaderboard - Kimi Code, Hermes, Pi, Claude Code, Codex, and Others Were Benchmarked Against Terminal Bench 2.1 & Deep SWE 1.1 #
7d ago
TOOLING
Six Pallets of NVIDIA Hardware Worth $11.4 Million Stolen on the Way to Texas #
Police in Oakland, California, are investigating the theft of six pallets of NVIDIA hardware worth $11.4 million that were bound for Fort… — r/LocalLLaMA
7d ago
TOOLING
I'm going to try to turn a 4B model into a genuinely useful coding agent that can compete with much larger models #
After releasing 3D Coder and GLB 3D Coder, I realized I should have involved the community earlier. — r/LocalLLaMA
7d ago
TOOLING
Some GPU prices are dropping #
Some context: RTX 6000 cards hit a peak price of 18k and were sold out in many places even at that price. — r/LocalLLaMA
7d ago
TOOLING
We are in the golden age of Local LLM #
Q4 of 2026 has been astronomical for local LLM. — r/LocalLLaMA
7d ago
TOOLING
We are cooked. My QFN 3.8 NVFP4 just drew a dog freehand in MS Paint (using new Open WebUI 0.13.0 and Open Terminal 0.17.2) #
Forget stupid pelican on a bike SVG bullshit. — r/LocalLLaMA
7d ago
TOOLING
NousResearch/Arete-27B · Hugging Face (Qwen finetune) #
from NousResearch: Arete-27B We post-trained over Alibaba's Qwen3.8-27B to reinforce western values on a Chinese-trained model. — r/LocalLLaMA
7d ago
TOOLING
Mirage: A 22 MB visual-language model that runs scene descriptions + object detection + OCR + segmentation + spatial relations analysis + extractions + decisions, in a single pass. #
Hey all, Henry from Cactus Compute here. — r/LocalLLaMA
8d ago
TOOLING
Oc-e-Non-v1: A language model that gets to the f*cking point #
Richard I of England was called "Oc-e-Non" (Yes and No in Occitan) by some of contemporaries, supposedly because he used few words. — r/LocalLLaMA
8d ago
TOOLING
Qwen Developers on X: "Qwhen? Qsoon! For our friends outside China, the Chinese text in the poster comes from #
8d ago
TOOLING
A 0.1B model just killed 8B embedding models... I tried it out. #
I bet you guys are familiar with embedding models such as Qwen3-Embedding or Gemini Embedding. — r/LocalLLaMA
8d ago
TOOLING
Good news bad news… #
In the future, we will continue to push toward even larger scales, in the Qwen 4.5 and Qwen 5… Screen capture from the announcement that… — r/LocalLLaMA
8d ago
TOOLING
Latest Open-Source Labs are gutting away cybersecurity and reverse-engineering capabilities #
Kimi K3.1 and Tencent’s Hy4 are both gutting out cybersecurity, reverse engineering, and vulnerability-patching capabilities from their… — r/LocalLLaMA
8d ago
TOOLING
Asking questions to a 0.5b model is hillarious #
Yes IK it's supposed to be this dumb, but it's still funny (Qwen2 0.5b Q4_K_M) — r/LocalLLaMA
8d ago
TOOLING
Introducing Inkling 2 Small #
Today we are introducing our second model generation with Inkling 2 Small. — r/LocalLLaMA Inkling
8d ago
TOOLING
CCORE GLB-3D-Coder dataset is here: 3,918 rendered and tested examples across 40 domains #
As promised in my previous posts, I’m releasing… — r/LocalLLaMA