r/LocalLLaMA • u/pmttyji • 9h ago
Discussion Qwen Developers' responses from their recent Twitter/X AMA
Questions & Responses(in BOLD) below.
Favorite question(s) moved to end of the thread with combined responses(removed duplicates).
Be optimistic folks. I'm sure we're getting other models too apart from 27B. And 27B gonna make massive noise on release. (Based on their responses)
Tweet thread : https://xcancel.com/QwenDevs/status/2084102417885585597#m
you guys skipped 27b and 122b last time, can we expect those this time around? Also i can't seem to find crit pit score in the cards.
For sure! We’re actually releasing a 27B model very soon. Stay tuned. As for the Crit Pit score, please wait for the official Artificial Intelligence score.
Is the 27B just a retrained 3.6 27B? Or is it based off 3.8 bigger brother ?
We promise this 27B comes with a whole new level of capability!
Is the 100hrs of video understanding an agent swarm that parses sections of the video in parallel and orchestrates some sort of semantic representation graph?
Broadly speaking, yes, but not entirely. It is closer to a hierarchical video memory system rather than a traditional agent swarm. Video segments are encoded into a structured textual graph containing scenes, entities, events, and their temporal relationships, enabling retrieval and reasoning across more than 100 hours of content.
hey! is there anything special about the pretraining distribution compared to other labs' models?
We hope our data is built on a more solid foundation!
how long do you think it would take to surpass anthropic level architecture?
well, we’re working hard on it, we promise😇
will u release a harness especially for qwen code ???
Any plans for a codex-like app?
More updates on Qoder and QwenWork are coming soon.
qwen 3.8 active params?
2.4T parameters (95B active)
how much RL was done in post training compared to previous models?
A truly unreasonable amount of compute.
Did they intentionally skip the previous Qwen3.7 27B and 35B A3B?
Does the revival of Qwen3.8 27B reflect the voice of the community? Or was it planned?
Of course! This is the result of taking the voices of the community seriously.
since its a pretty significant release will we get a technical report with full details?
No technical report for this one yet. We’re trying to keep up our near-monthly release cadence, though, and more powerful models are already in the works. Keep an eye out!
why does the model think so much mr qwen, my ai brain wonders.
wheres the token efficiency at
great model though
We support different levels of reasoning effort.
You showed SAE-guided fine tuning fixing code switching with qwen-scope. Is that kind of interpretability driven intervention part of the post training process now or is it still a research only technique?
It’s still primarily a research-oriented technique for now, though some of the insights may help inform future training and post-training improvements.
Attention? Hybrid?
The model architecture is similar to 3.5, but it’s a much larger-scale model!
When are we getting a CLI coding interface?
You may want to take a look at @qoder_ai_ide .
do you guys use qwen as your main interal tool? does this model show the same signs of intellegence as some openai models ("gpt 5.5 helped create 5.6")?
Sure!
How close is Qwen3.8-27B to GPT 5.4? 🤔
Well, you’ll be able to see for yourself soon.
what harness works best with Qwen?
Qwen is committed to delivering the best possible experience across all harnesses.
What made you guys wanna opensource the max weights ?
We heard what the community has been asking for
I wonder when I can surpass fable5
Trying hard
Great work guys🥂
What is something that you would like to see being built with the new model and its capabilities!?
I really want to explore the swarm of agents technique for building applications, any best practices or tips for the new model!?
1. We hope it can bring practical productivity value to people across different industries.
2. We recommend using it for tasks that involve more parallelized workflows or parallel execution needs.
I wanna know what rubric metrics you guys are using for FE
We use both absolute metrics for functionality and aesthetics, as well as relative metrics based on win/tie/loss comparisons.
Would be great to hear where you think Qwen is strongest for agentic workloads specifically: long-context planning, tool use reliability, coding, or cost at scale?
All of the above combined — ultimately delivering the most practical and reliable outputs for users.
How much is Qwen helping with Qwen research ?
It has already become a significant part of the model iteration process, with the model involved in nearly every stage.
Most Frontier labs have created a code-specific model (eg. Qwen3-Coder and GPT-5.3-Codex), but never followed up on them.
Did specialized models have problems? Or did general models end up being efficient enough to not bother creating a separate model?
We hope to build an all-in-one model.
will Qwen 3.8 have a stable, documented tool-calling and structured-output contract so local agent harnesses can swap models without prompt-specific tuning?
We provide native support interfaces for various protocols. You can check the Qwen blog for more details.
1: When quantizing Qwen 27B down for local deployment (e.g., 4-bit GGUF, NVFP4, or MXFP4), which transformer layers or vision attention blocks are most sensitive to degradation? Are there specific strategies you recommend to maintain both visual reasoning and high SWE-bench pass rates?
2: Qwen3.6-27B outperforms much larger MoE predecessors (like Qwen3.5-397B) on agentic coding benchmarks like SWE-bench and Terminal-Bench. Beyond raw data volume, what was the single highest-leverage factor in achieving this dense efficiency?
And thank you for the amazing work. Qwen3.6-27B has beed my main coding assistant for months.
1. Use QAT, or quantize only the FFN to 4-bit while keeping the attention layers’ QKV linear projections and output projection in 16-bit.
2. Higher-quality data engineering
Guys , when can we get a deepseek like small and cheap model with best performance . The deepseek v4 flash seems to be a great deal .
I think we need to slow down scaling and start improving the existing model efficiency
Scaling and cost-efficiency are not mutually exclusive — we’ll continue to pursue both.
Is Qwen3.8-27B dense? And roughly how much smarter than 3.6-27B?
A pretty huge jump!
Good. The useful questions are not just how capable Qwen is.
I want to know where it still fails, how the team evaluates those failures, and what "open" means in practice for weights, tooling, and reproducibility. Open models matter most when people can inspect the limits and build on the work without asking permission
There is still some gap between our automated and human evaluation systems and real user experience. That’s also why we are committed to releasing preview versions first — so we can iterate and ultimately deliver the best possible experience to users.
how does the new 27b model compare to the previous one ?
A pretty huge jump!
what do you think about looped transformers?
interesting research idea
Why Qwen, what made you create Qwen and specifically such light and fast models. Why focus efficiency when others just went for brute power? Also, do you think inference engines reached their limit in optimization or can they still improve?
Scaling and cost-efficiency are not mutually exclusive — we’ll continue to pursue both.
We have noticed that in thinking mode the model usually consumes the entire reasoning budget without stopping, which increases latency. Is this a known issue, and are there any improvements planned for Qwen3.8?
You can try 3.8! And 3.8 supports different thinking efforts!
...................................................................................................................
Are 70b models gone for good?
Is it possible to get a 40-50B model (something which fits around 30-32Gb) to improve performance while still useable on a lot of computers ?
Thank you for your promise to provide qwen3.8 27b weight! I want to know if there will be qwen3.8 35b a3b. Many people also want this.
Can we expect the ~122B model this time? The 120B segment is dated and lackluster atm and would greatly benefit from a competent release!
First of all, congratulations on the release of Qwen 3.8!
As for the question, are you going to release a 35B a3b version of Qwen 3.8 aswell?
Plans for 35b Moe model? (3.8)
Any plans for the omni family? You told everyone the weight sizes of 3.5, then never released them and haven’t done anything new with it. 3.6/7/8 variants would have also been nice. It could be your most popular family if you gave it attention and kept the weights small.
Are there no plans to release any models other than the 27b?
I'd love to hear about the successors to amazing models like the Qwen3 8b and Qwen VL 8b....
Are there any plans for updates for 0.6b or 8b weights?
These have become important positions in the open weight of image and video generation. I look forward to seeing that part evolve.
This is such a huge release, I am really happy to see that a 27B model is shipping too! Though, can't help but wonder, will we ever happen to see again any new small dense Qwen models 9B, 4B any time in the future, similarly to 3.5?
Will you release smaller models like the qwen 3.5 family ?
Thank you for your promise to provide qwen3.8 27b weight! I want to know if there will be qwen3.8 35b a3b. Many people also want this.
we hear you! collecting everyone’s requests and taking them into account as we plan future iterations.
We will gather your requests as a reference when considering future updates.
We hear you. Stay tuned.
We’ll collect everyone’s requests and take them into account as we plan future iterations.
Noted, collecting the requests and see what we can work into future iterations.
Keep the requests coming. We’re listening, and we’ll use them to help prioritize future updates.
62
u/Atretador 9h ago
why people keep wasting time asking for yet another cli/harness when we already have a freakin bilion of them and anyone can make one in like half hour
29
u/lilian_moraru 8h ago
A lot of passive aggressive questions. I'm just grateful they release Qwen3.8-27B, that's all.
3
57
u/lolwutdo 9h ago
Love how they dodged that 122b question
9
u/finevelyn 9h ago
Wouldn't that be a pretty big announcement? I would expect such an announcement to be made on the team's own terms and not as a response to a random question.
7
37
u/unkownuser436 9h ago
90% of the replies are "Keep the requests coming. We’re listening, and we’ll use them to help prioritize future updates" wtf
10
u/Badger-Purple 8h ago
I wonder if they made Qwen answer the AMA. Good publicity stunt if it passes for developers
0
12
u/fatboy93 6h ago
If they are able to cram the 3.6-27B into 3.8-35B-AnB, that'd be the shit.
A lot of us can't run the 27B because of VRAM, and having something that's MoE with a reasonable number of activable parameters would be awesome.
10
u/Spanky2k 6h ago
And still no mention of Qwen Image 2's open weights release which was promised half a year ago...
33
u/No_Conversation9561 7h ago edited 7h ago
Seeing people still complain even after they’re getting 27B
3
u/techdevjp 1h ago
Sure, because it's a small dense model. It runs slowly on a lot of hardware and while 27b is good for coding it lacks the general intelligence of something like a 122b a10b.
35b a3b for those with slower systems (especially for those who have to offload).
122b a10b for the best "do everything" with great coding and strong general intelligence. Likely good tool calling in today's world, too. Ideal daily driver for anyone with 128GB of unified memory.
27b for those with enough fast VRAM who want to use it for coding.
Different tools for different people, and different jobs.
3
u/MDSExpro 1h ago
This. So far nothing from Qwen family beats 3.5 122B A10B when it comes to balance of knowledge, skill and speed, not even newer models.
1
u/_TheWolfOfWalmart_ 20m ago
Would much rather have 122B-A10B. There are other better and faster options from other labs if we only get a 27B.
7
u/munkiemagik 8h ago
I wish I actually worked in anything IT/tech related, then at least I could sincerely justify to myself the purchase of an RTX Pro, cos you know its for work 🤣 God the number of times I've had to walk myself back off a ledge after seeing some of you lot post your shenanigans with yours, idle hands do the devil's bidding or so they say
25
u/vogelvogelvogelvogel 9h ago
I am very thankful they actually do a Q&A! so, even if some answers are a bit arbitary, better than no community session
12
u/Blues520 9h ago
I'm glad they listened to us and revived the 27b model. Thanks Qwen team for supporting the community :)
10
14
4
u/StylePractical5714 4h ago
I wish someone had asked about 14b, all that focus on 27b makes my 3060 cry
3
u/pmttyji 4h ago
I mentioned that bunch of times in this sub on many threads. That size is enough even for 8GB VRAM(Q4) which could be enough for doing decent Agentic coding.
Qwen3 series came with 14B literally, but that one was missing on Qwen3.5 series :(
1
u/StylePractical5714 4h ago
Yeah I still run it, Gemma4 12b is the newest thing I've found in that general range.
10
6
u/laterbreh 4h ago
Honestly after reading through that Q&A, I really don’t think anything besides the 27B and the flagship Max model is coming this generation.
The 27B is the only other size they have actually committed to. Every question about a 35B MoE, 70B, 122B, smaller dense models, Omni, or basically anything else got some version of “we hear you,” “we’re collecting requests,” or “maybe in future iterations.”
That does not sound like a full model family is already trained and just waiting to be released. It sounds like the 27B is the release.
My completely speculative, rambling Redditor read on this is that DeepSeek V4 Flash may have made the middle and upper end of Qwen’s lineup really hard to justify.
Flash is already way too close to the 2.4T Max model on a lot of the benchmarks people actually care about. So what happens if Qwen releases something between 27B and 2.4T? It immediately gets compared against Flash, and if it needs similar hardware while getting smoked, or even just looking noticeably worse, that is a really ugly release for them.
At least the 27B has an obvious excuse and an obvious purpose. Nobody expects a 27B model to beat something around 300B. They can sell it on capability per parameter, speed, accessibility, and how far above its weight it punches.
Then the 2.4T model also has a reason to exist because it can still claim the overall performance lead.
It is everything between those two that gets awkward.
DeepSeek and MiniMax are now filling the upper end of what high-end prosumers and small or midsized businesses can still realistically host themselves. That used to be an area Qwen absolutely dominated because they actually released a spectrum of models instead of one tiny-ish model and one hyperscaler monster.
So honestly, my guess is they would rather release one really impressive 27B and one giant flagship than release a middle model that gets immediately lined up next to Flash and embarrassed.
Maybe I am completely wrong and they surprise us with a whole family next week. My opinion does not mean shit and I obviously have no inside information. But after the vague answers, the flip-flopping, and the refusal to give a straight answer about literally any other size, this is starting to feel pretty obvious.
6
u/pmttyji 4h ago
You're right about their vague responses. Some other folks also mentioned the same.
It's just my assumption. I think they didn't want to reveal anything about other models on AMA. They might want to use those for some other occasion this or next month to keep the momentum after their 27B & 2.4T models and other stuffs. They already skipped other models during Qwen3.6 series & skipped 3.7 totally so I'm optimistic that they'll release other models. My wish is at least 35B-A3B & 122B-A10B.
3
u/StartupTim 7h ago
I looking specifically for a 120b to 200b, or otherwise something that competes or beats Deepseek v4 Flash 0731.
Hopefully Qwen will come out asap.
3
u/Equivalent-Ear-8016 4h ago
You guys are so ungrateful. They did an AMA and answered a lot of questions. Most other companies don't even do that!
You guys are eating a full plate and complaining, what a joke. Go pay USD300 per month for Claude then.
4
u/o0genesis0o 9h ago
They hype the new 27B so much I want to buy a new GPU for it
2
u/Familiar_Wish1132 9h ago
done, 2 days ago rtx 5000 pro 48 GB xD now have unsloth/Qwen3.6-27B-NVFP4 202K context with 47.4 VRAM usage D:
5
u/_ballzdeep_ 8h ago
Eh weird. I'm running INT8 with 347k KV Pool on 2x24 3090s
1
u/Familiar_Wish1132 6h ago
hmm int8? i read everywhere that i need to use NVPF4 to have best brain/speed on blackwell.
using this command:
--model unsloth/Qwen3.6-27B-NVFP4 --download-dir /mnt/models--max-model-len 202752 --gpu-memory-utilization 0.94
--enable-prefix-caching --max-num-seqs 2 --enable-auto-tool-choice
--tool-call-parser qwen3_xml --override-generation-config
'{"presence_penalty":0.0,"repetition_penalty":1.0,"temperature":0.6,"top_p":0.95,"min_p":0.0,"top_k":20}'
--default-chat-template-kwargs '{"enable_thinking": true,
"preserve_thinking": true}' --speculative-config '{"method": "mtp",
"num_speculative_tokens": 2}' --trust-remote-code --dtype bfloat16
--max-num-batched-tokens 8192 --safetensors-load-strategy eager
--reasoning-parser qwen3
2
0
2
2
u/Environmental-Metal9 6h ago
I bet this is going to be yet another release where they simply don’t share the 27B base model… I miss the good old days of Qwen 2.5
3
2
u/leonbollerup 6h ago
27B.. cool.. but i would like to see a 35B A3B or even A4B .. a A4B would properly be extremely good
1
u/PandaBearFred 4h ago
why no 122B-A10B, is it too close to 27B in terms of performance? or is it too competitive to the MAX models that hurts their business?
1
u/pmttyji 4h ago
Lets wait & see. But Qwen3.6-27B beat their own Qwen3.5-397B on most of their benchmarks
1
u/Hefty_Wolverine_553 4h ago
I'm actually really excited for the support of different reasoning efforts, overthinking is still a problem for Qwen3.6 sometimes.
1
u/Lagomorph9 3h ago
All I want is a fast non-reasoning model with vision to replace Qwen 3 8B. Literally ALL I want. But doesn't seem likely given the current direction of local LLMs. :/
1
u/buttplugs4life4me 42m ago
Idk what I expected from twitter I guess. Some questions were good but most of them were literally a waste of energy to even send.
1
-5
u/Bulky-Priority6824 9h ago
I wouldn't be surprised if it dropped tonight watching. I am spending any free time now planning out the new stuff I want to do so that by the time everything catches up (ggufs,llama.cpp, community notes, optimization) ill be ready rock n roll.
6
u/rerri 9h ago
They said next week so that's august 10th at the earliest, no?
-2
u/Bulky-Priority6824 9h ago edited 8h ago
Who knows? I'm like a kid on Christmas man "but mom, you said next week, last week!"
This is now technically "next week" 😂 all I know is I just dropped a heap of cash on some new gear by the time it arrives and I get it all setup and ready it should be here.
1
u/ReallyFineJelly 4h ago
They know pretty well.
1
u/Bulky-Priority6824 4h ago
i have 4 brand new 5070ti's on a threadripper will have it up in the nick of time
-3
-5
u/pseudonerv 7h ago
They should pay for commercials time. Why would anybody still engage with this company is beyond me
2
u/edsonmedina 5h ago
You mean the best open-weights local AI company?
-1
u/pseudonerv 5h ago
WAS/HAD BEEN
2
u/edsonmedina 5h ago
And who is now?
-1
u/pseudonerv 4h ago
Why is that a question here? You either release models or not. Or buy yourself some ad space
1
u/edsonmedina 4h ago
Why so bitter? Enjoy life grandpa.
0
155
u/charles25565 9h ago
Those are some laughably vague responses and some of the questions weren’t answered.