AI Squawk the real-time terminal for AI news

↗
← all sources
RSS for r/LocalLLaMA
4d ago TOOLING More interesting and unusual Qwen3.5-4B neurons
You guys seemed to like my last post about the 'redditor neuron' so I'm listing some other interesting neurons I've found while poking… — r/LocalLLaMA
4d ago TOOLING ConceptCountry/qwen-concept-27b · Hugging Face
Machine learning model with 27B parameters. — r/LocalLLaMA
4d ago TOOLING Anyone else feeling like Qwen4's release happens in slow-motion?
So if my memory serves me well: Late summer, Qwen 3.8 Flash Next announces the architecture Late october, conference talk, Qwen announces… — r/LocalLLaMA
5d ago TOOLING Drummer's Orion 26B A4B v1 and v1.1! ... Plus a new project from yours truly.
https://huggingface.co/TheDrummer/Orion-26B-A4B-v1.1 v1.1 pushes creative writing further and makes full use of Gemma's reasoning. — r/LocalLLaMA
5d ago TOOLING meituan-longcat/LongCat-2.5 · Hugging Face
Image-Text-to-Text model with 1.8T parameters. — r/LocalLLaMA
5d ago TOOLING New Gemma Models
Are there any (insider) infos to upcoming Gemma Models? — r/LocalLLaMA
5d ago TOOLING L11 N8147 is a neuron that will make Qwen-3.5-4B get things confidently wrong while being weirdly snarky... But also makes it write interesting poetry
Inspired by some of the other brain surgery posts, I wanted to see if I could find anything interesting in Qwen. — r/LocalLLaMA
5d ago TOOLING Joined the 4x R9700 Club | Initial Benchmarks for QFN 3.8 Below
Posted this on the r/R9700 subreddit as well, but figured I'd share my initial findings here. — r/LocalLLaMA
5d ago TOOLING Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text Generation: This will completely change everything!
Diffusion language models (DLMs) offer parallel sampling for faster generation than autoregressive models, an increasingly important… — r/LocalLLaMA
5d ago TOOLING GPT-5.5 dataset across my used 25 billion tokens!
Dataset. Explore, preview and download it on Hugging Face. — r/LocalLLaMA
5d ago TOOLING Motion graphics video made with Qwen3.8 Flash Next GSQ RCO IQ3_XXS on strata
I've seen the insane motion graphics videos people made when opus 5.5 first came out and wondered how good QFN would do with the same… — r/LocalLLaMA
5d ago TOOLING 4x Radeon AI PRO R9700 + 2x RTX 3090 on one x16 slot, using a PCIe switch
Four Radeon AI PRO R9700s and two RTX 3090s behind a PEX88096 switch on one X570 slot: BIOS, kernel flags, ROCm and CUDA, and Qwen3.8-27B… — r/LocalLLaMA
6d ago TOOLING "Does censorship exist in [country]?", according to various LLMs
I wrote a small program that asks the same Yes/No question about every country to a language model, and generates an SVG world map that… — r/LocalLLaMA
6d ago TOOLING Users have started buying RTX 5060 Ti 16GB graphics cards en masse for the sake of AI.
The consumer graphics accelerator market is seeing a noticeable shift in consumer demand as regular users begin to... — r/LocalLLaMA
6d ago TOOLING "Ram Altman" Is Now a Linux Script That Emails Sam Altman Daily to Report How Much Unused RAM Is in Your PC
Developer builds Ram-Altman, a Linux script that automatically emails OpenAI CEO Sam Altman daily progress reports on idle desktop memory. — r/LocalLLaMA
6d ago TOOLING OpenClaw Retrospective
A long time ago there was this massive phenomenon called OpenClaw that took the world by storm. — r/LocalLLaMA
6d ago TOOLING Saw this benchmark where small changes to coding tasks made a big difference
Saw this tweet about a coding benchmark and thought it was kinda interesting. — r/LocalLLaMA
6d ago TOOLING Anyone running local AI on 16GB vram?
Hey everyone, Is anyone here running any useful AI agents, harnesses or toolings with local AI on 16GB vram? — r/LocalLLaMA
6d ago TOOLING The Stylome bot is useless spam and should be removed
I've recently been seeing comments everywhere from the Stylome bot, which is also a mod in this sub. — r/LocalLLaMA
6d ago TOOLING Crowd-v1 - The collaborative LLM
Processing img 0ybf7gn4c90i1... — r/LocalLLaMA
6d ago TOOLING Betelgeuse running DeepSeek V4.1 Flash Q8_XL (1017) at 19 tok/s decode & 62 tok/s prefill on an RTX 3060 12GB + 16GB RAM: How we finally fixed the prefill bottleneck on out-of-core MoEs
After my last post on Qwen 3.8 Flash Next, a lot of people were asking if out-of-core MoE streaming could ever work on an actual frontier… — r/LocalLLaMA
6d ago TOOLING Also experienced the Qwen3.8-Flash-Next URL issue
I was asking QFN (4.18bpw EXL3 quant via Pi) to help refactor a neovim configuration, and saw that it tried to find API keys and fetch an… — r/LocalLLaMA Qwen3.8-Flash-Next
6d ago TOOLING testing Qoduck (Maybe qwen4) on Qoder
I noticed that it has native image and video generation. — r/LocalLLaMA
6d ago TOOLING llama_moe_cache: run missed experts on CPU, add tuning script by am17an · Pull Request #30966 · ggml-org/llama.cpp
Depending on --moe-cache-cpu-share, this PR executes experts on the CPU. — r/LocalLLaMA
7d ago TOOLING Valet: use local LLMs to manage your homelab (open source)
My favourite use case for local LLMs is running my homelab, because everything stays private (and it helps me justify the GPU lol) I wanted… — r/LocalLLaMA
7d ago TOOLING Obsessive-1.7B: a 1.1 GB web-search subagent
I fine-tuned LFM3-1.7B to do one job: take a factual question, call web_search once, and answer with a short value, a word-for-word quote… — r/LocalLLaMA
7d ago TOOLING Another benchmark has hit the quant war
If you have not been following ISTA-DASLab the creators of the gsq-rco quants have received some criticism from unsloth regarding the… — r/LocalLLaMA
7d ago TOOLING Good Luck Getting a Cheap GPU. AMD Is a 'Data Center First Company,' CEO Says
Days after US voters approved dozens of data center moratoriums, Lisa Su says she wants AMD to 'be the best partner to the largest users of… — r/LocalLLaMA
7d ago TOOLING Six Pallets of NVIDIA Hardware Worth $11.4 Million Stolen on the Way to Texas
Police in Oakland, California, are investigating the theft of six pallets of NVIDIA hardware worth $11.4 million that were bound for Fort… — r/LocalLLaMA
7d ago TOOLING I'm going to try to turn a 4B model into a genuinely useful coding agent that can compete with much larger models
After releasing 3D Coder and GLB 3D Coder, I realized I should have involved the community earlier. — r/LocalLLaMA
7d ago TOOLING Some GPU prices are dropping
Some context: RTX 6000 cards hit a peak price of 18k and were sold out in many places even at that price. — r/LocalLLaMA
7d ago TOOLING We are in the golden age of Local LLM
Q4 of 2026 has been astronomical for local LLM. — r/LocalLLaMA
7d ago TOOLING NousResearch/Arete-27B · Hugging Face (Qwen finetune)
from NousResearch: Arete-27B We post-trained over Alibaba's Qwen3.8-27B to reinforce western values on a Chinese-trained model. — r/LocalLLaMA
8d ago TOOLING Oc-e-Non-v1: A language model that gets to the f*cking point
Richard I of England was called "Oc-e-Non" (Yes and No in Occitan) by some of contemporaries, supposedly because he used few words. — r/LocalLLaMA
8d ago TOOLING A 0.1B model just killed 8B embedding models... I tried it out.
I bet you guys are familiar with embedding models such as Qwen3-Embedding or Gemini Embedding. — r/LocalLLaMA
8d ago TOOLING Good news bad news…
In the future, we will continue to push toward even larger scales, in the Qwen 4.5 and Qwen 5… Screen capture from the announcement that… — r/LocalLLaMA
8d ago TOOLING Latest Open-Source Labs are gutting away cybersecurity and reverse-engineering capabilities
Kimi K3.1 and Tencent’s Hy4 are both gutting out cybersecurity, reverse engineering, and vulnerability-patching capabilities from their… — r/LocalLLaMA
8d ago TOOLING Asking questions to a 0.5b model is hillarious
Yes IK it's supposed to be this dumb, but it's still funny (Qwen2 0.5b Q4_K_M) — r/LocalLLaMA
8d ago TOOLING Introducing Inkling 2 Small
Today we are introducing our second model generation with Inkling 2 Small. — r/LocalLLaMA Inkling
8d ago TOOLING CCORE GLB-3D-Coder dataset is here: 3,918 rendered and tested examples across 40 domains
As promised in my previous posts, I’m releasing… — r/LocalLLaMA