AI 속보

New Qwen3.8-27B Unsloth Dynamic V3.1 GGUFs

Hey r/LocalLLaMA ! We're releasing new new Unsloth Dynamic v3.1 GGUFs for Qwen3.8-27B!

#Meta · Llama#Qwen

Llama-modchip: GPU 없이 64GB RAM에서 284B DeepSeek 실행

llama-modchip은 모델 압축과 CPU 커널 최적화를 결합해 DeepSeek-V4-Flash 284B를 64GB RAM에서 실행함.

#Meta · Llama#DeepSeek#AI 반도체 · GPU

다른 보도 Hacker News

Which Routing Does Each MoE Model Use? DeepSeek, Qwen, Mixtral, Llama 4, gpt-oss Compared

A config-verified comparison of how 10 open MoE models route tokens: total and active parameters, expert counts, top-k, shared experts, gating functions and…

#Meta · Llama#DeepSeek#Qwen

다른 보도 r/singularity

Use your phone to monitor anything with local models! Demo of my Open Source and 100% local agent (iOS and Android!)

Hey r/LocalLLaMA ! I made this quick demo of how Observer can run local models to monitor anything with your phone!

#Meta · Llama#AI 에이전트#오픈소스 모델

다른 보도 Anthropic Research

llama_moe_cache: run missed experts on CPU, add tuning script by am17an · Pull Request #30966 · ggml-org/llama.cpp

This is a significant speedup for MoE offloading (low VRAM people). I tried Strata once, and it had some tuning mechanism, so probably this is a similar idea.

#Meta · Llama

Transformers now runs llama.cpp quants

#Meta · Llama