AI news daily: what changed on October 22, 2026

1. [New Model] Sage-A1.5 released based on Qwen3.6-35B MoE with marketed benchmarks: "highly competitive

A new model called Sage-A1.5 was released, based on the Qwen3.6-35B MoE architecture. The model's benchmarks are marketed as "highly competitive," though specific performance metrics were not provided. The developer is setting up the model and testing it with local benchmarks using the official q4_k_m quantization. It is unclear if the model will function on Strata, but reports are expected soon. The post asks if anyone has experimented

Source: Reddit r/LocalLLaMA

2. what can you do with smaller gpu's?

A Reddit user asked about using GPUs with 6/8/12GB VRAM for AI tasks beyond coding. The post questioned whether smaller models could handle tasks like organizing digital files, classification, image/text analysis, or voice/TTS processing. It also asked if these tasks require tool calling or agentic behavior for effectiveness. The user sought advice on practical applications for older, cheaper GPUs. The discussion highlighted challenges of running large models on limited VRAM. Specific models or tools were not named in the query. The post aimed to explore viable use cases for lower-end hardware. It invited responses from users with similar setups.

Source: Reddit r/LocalLLaMA

3. Huawei Atlas AI Accelerator Latest Comparison Overview

A Reddit user shared insights about Huawei's Atlas AI accelerator lineup, including details on the 950 series and 150 model. The user obtained information from a Silver-rated Huawei partner and translated Chinese specifications for the 150 model. They described using three Atlas 300I duo cards in a system, optimizing QFN for performance and testing models like GLM5.3-flash, deepseek, and Meta Muse. The user noted these models ran slowly on their setup but continued refining configurations. A collaborator used an Atlas 300I duo for image generation and video analysis of security camera feeds. The post highlights ongoing experimentation with Atlas hardware for AI workloads, though no official product announcements or performance benchmarks were cited.

Source: Reddit r/LocalLLaMA

4. What's your favorite medium to large (~50-150b params) MOE model? Aside from Qwen flash next

A Reddit user shared their experience of upgrading desktop RAM to run larger mixture-of-experts (MOE) models by splitting memory between RAM and VRAM. They asked for recommendations on medium to large MOE models (50-150b parameters) besides Qwen Flash Next. The user listed models they are considering, including GPT OSS 120b, Mistral 4 small 119b, Qwen 3.5 122b, A10b, and Ling 3.0 Flash. They questioned the current usability of some models and sought suggestions for other viable options. The user emphasized interest in models excelling at tasks other than coding, noting they prioritize other capabilities over agentic coding. The post included links to the original discussion.

Source: Reddit r/LocalLLaMA

5. I have an answer! Qwen Flash Next IQ2 IS better than Q8 of 27B (for me)

A Reddit user shared a subjective comparison between Qwen Flash Next and Q8 of 27B, stating that Qwen Flash Next outperformed the Q8 model in handling complex coding tasks. The user noted that while others suggested Q8 would be superior, they found Qwen Flash Next better at identifying subtle bugs and solving problems methodically. The model demonstrated capabilities such as analyzing tests and reasoning through issues, which the user felt were absent in the Q8 version. The user emphasized the comparison was subjective but highlighted improved performance in specific scenarios. They also mentioned Qwen Flash Next performed better in role-playing as a "cute furry guy" compared to the Q8 model. The post reflects the user's personal experience after testing both models, concluding that Qwen Flash Next was worthwhile despite initial doubts.

Source: Reddit r/LocalLLaMA

6. Ran Flint on RTX PRO 6000 at NVFP4 in vLLM

A user reported running the Flint model in vLLM using an RTX 6000 Pro GPU. The model utilized an OKF knowledge base, performed web scraping, and followed character-specific instructions. Benchmarks showed LiveCodeBench v6 accuracy of 82.2 (vs 80.8 reported) and SWE-bench Verified score of 80 (vs 74.1 reported). Throughput reached 110-180 tokens per second single stream, with peaks up to 2,500 tokens per second using 64 requests. The user is evaluating if the performance justifies replacing Qwen3.8 27b. Issues with the chat_template.yml file were noted, along with a Docker Compose configuration for vLLM. The setup included GPU memory utilization at 65% and specific model serving parameters.

Source: Reddit r/LocalLLaMA

7. Open source LLM appreciation post

A Reddit user shared enthusiasm for open-source large language models, mentioning downloads of Raon-1-mini 30B A4B and Flint 40B A2.5B. The user highlighted the availability of diverse models from multiple countries, emphasizing collaborative software development efforts. They expressed amazement at the ability to interact with computers in a conversational manner, comparing it to fictional depictions like Star Trek. The post reflects growing accessibility of advanced AI tools through open-source projects. No specific technical details beyond model names and parameter counts were provided. The user described increasing admiration for daily use of the technology. The post was submitted to the r/LocalLLaMA subreddit.

Source: Reddit r/LocalLLaMA

8. 2-bit copy in VRAM + exact residual in system RAM as the verifier: speculative decoding for models that don't

A researcher shared a method for speculative decoding using a 2-bit model copy in VRAM and the remaining weights (residual) in system RAM. The approach splits model weights into 2-bit and 6-8-bit portions, with the 2-bit section generating draft tokens and the residual verifying them. Testing showed this configuration achieved quality comparable to Q8_0 with 28% lower RAM data reads. The method processed 25-30% more accepted tokens per check than Google's Gemma 4 drafter. A CPU kernel handled 16 tokens in the same time as one, constrained by memory bandwidth. The technique avoids extra memory costs by reusing the verifier's KV cache. The user noted similarities to SubSpec but highlighted differences in weight handling. They provided a public repository for experimentation, emphasizing its use when Q8 does not fit VRAM.

Source: Reddit r/LocalLLaMA

9. Kitten-TTS 2: New Open-source SOTA 1.58 bit TTS (CPU-only with voice cloning, multilingual, emotion control)

KittenML released Kitten-TTS 2, an open-source text-to-speech model with 1.58-bit ternary weights, claiming to be the first of its kind. The model operates in real time on a CPU without requiring a GPU, featuring zero-shot voice cloning from under five seconds of audio and multilingual support across 20+ languages. It includes expressive control over speech emphasis and emotion, with 1.7B parameters. The ternary weights use three values (-1, 0, +1) per group of 128 elements, enabling efficient local deployment. Code and weights are available on GitHub and Hugging Face. The update from version 0.8 introduces a new architecture, natural-sounding speech, and cross-language voice cloning. The project emphasizes low-cost, self-hosted alternatives to commercial TTS services.

Source: Reddit r/LocalLLaMA

10. Recursive Flint - the "Qwen3.8 35B" we've all been waiting for?

A model named Recursive Flint, part of the Qwen series, was shared on Reddit. It is described as a coding agent with 40B parameters, 2.5B active. It outperforms Qwen3.6-35B-A3B in TerminalBench 2.1 and SWE-bench Pro v2, according to a HF repository table, and matches or exceeds it in other benchmarks. The model uses 3:1 SWA:full attention and has a 262k context length. The poster plans to test it and share results. WIRED Magazine and a blog post mention the model. Llama.cpp and Unsloth GGUFs are noted as related projects. Early reports suggest Ornith-1.5 may still lead in this category, though initial issues are reported. The user acknowledges potential implementation challenges.

Source: Reddit r/LocalLLaMA