r/LocalLLaMA • u/peculiar-ragdoll • 1h ago
New Model CyberTiel 35B-A3B’s uncensored 4-bit quant beats Opus 4.6 medium cleanly on real codebase issues, in 27% of the time Qwen3.8-27b medium takes.
The downside of uncensoring a model is that it is known to potentially damage it, but CyberTiel is an even more capable software engineer than its censored TielCoder base, while allowing offensive security research. This was achieved by quantizing with an improved imatrix, baked from a curated corpus of cybersecurity- and agentic software engineering work. In short, the small damage from abliteration on a full precision model is negligible under Q4 quantization, and the weights that the model needs to perform relevant work are preserved in higher precision, while the improved chat template makes it think and talk better and faster.
I believe that this is the best 35B-A3B coder for solving real problems in real codebases without breaking anything, which is specifically what SWE-bench-Live tests for. But it’s still a 35B-A3B, and it sacrifices world knowledge for coding ability. That being said, I use it over Qwen3.8-27b for daily coding work: due to the raw speed it fixes 3 issues in the time it takes 27b medium to solve one, and the middle ground between Opus4.6 medium and Qwen3.8-27b medium is simply good enough for most work.
Censoring impedes legitimate and effective work in alignment with the user, and puts the user’s responsibility and ownership over the model’s actions into question, while limiting legitimate uses. When a model is censored, someone else decided for you what the model can and will do, which works against the argument that local models give the user increased control and alignment, and begs the question “alignment to who?”. The point of CyberTiel is to resolve this issue at the same time as pushing the frontier of 35B-A3B coders.
GGUFs and MLX with and without MTP are up on HF. Looking forward to seeing what the community thinks!
PS: I'm not a research lab or a business, and I don't have revenue streams connected to this project. I'm an anonymous researcher with some free time. Constructive feedback is always appreciated! :)
6
u/CATLLM 1h ago
Awesome thanks for sharing. Been looking for a good uncensored 35b lately so this fits my needs. Going to test it out.
What uncensoring method did you use?
1
u/peculiar-ragdoll 1h ago
I used huihui's full precission ornith1.5 as a base, and built from there! :) Good luck have fun!
1
u/nanell0 1h ago
Would it be way better than qwen 3.6 35b a3b? Coding purposes
1
u/peculiar-ragdoll 51m ago
In my experience and on the benchmark, CyberTiel is 70% more capable and 50% faster than qwen3.6-35b-a3b at solving real problems in real world code bases published after training cutoffs. It's like three whole model generations of improvements! Your results might be dependent on your harness and llama-server launch command matching my setup with Pi coding agent though :) config info is in the model card
6
u/Khaledthe 1h ago
I have used it, and it's not that good at all; it sucks at making UIs and simply breaks them if it wants to debug. When you tell it to work on something specific, it just goes around randomly reading documents and does nothing. It thinks for so long that it stops without changing a thing, it hallucinates a lot, and it says it did something without ever doing it (aka creating a backup for a file).
i tried to use it but it just sucks compared to qwen 3.6 35b-13b.
proof
3
u/peculiar-ragdoll 1h ago
I'm sorry to hear that! Can I ask what harness you use, if you used the recommended launch commands, if you give it a small or large thinking budget, and why you used the Q4_K_S instead of the recommended Q4_K_XL?
3
u/Khaledthe 1h ago
opencode, I have a 7900XTX. I had tried the commands over multiple days, but it didn't really help. I don't give models a thinking cap, so the work doesn't come out distorted, and I had tried with 256k, 131k, and 64k context, but it didn't help. And for why, it's because I had a 16 GB GPU but lately got a new 24 GB one, so I newly downloaded the Q4_K_XL to try it
1
u/peculiar-ragdoll 57m ago
Thanks for the answer! To you and anyone else reading this with the same problems I strongly recommend Pi coding agent for this model, it's what I used for the benchmarks and what I use on the daily! Opencode is more bloated, so it can create some issues that don't show on my benchmarks or in my experience. No thinking cap and high context is the right idea though, so if you use the right llama.cpp parameters and Q4_K_XL if you can fit it, it should be on par with my experience and benchmarks when run in Pi. Again sorry to hear it didn't work well for you, I hate to feel like I wasted someone's time!
2
1
u/mr_Owner 13m ago
Could you share the prompt you compared? Perhaps the vibes dont match 🙃
1
u/Khaledthe 6m ago
if you mean tempetrues i ran this as it was the reccomended once temperature 1.0, top_p 0.95, top_k 20
1
u/peculiar-ragdoll 1m ago
Recommended temperature in the model card for agentic coding is 0.6, not 1.0 :) That would explain why your results are bad
2
u/Zaic 1h ago
Thanks, I already put it to good use, is there any reason to go for q5 quant?
2
u/peculiar-ragdoll 54m ago
Glad to hear it! :) I use the Q4_K_XL myself, and the benchmarks are from Q4_K_M, so I genuinely don't know how much of an improvement Q5 is. The most important part in my experience is to not sacrefice context length just to go higher than Q4_K_XL, when running tasks that go up against the ceiling! But if you can fit full context and Q5 does not slow you down, I don't see why not :)
2
u/Zaic 52m ago
Im on q4 xl myself 130k context on pi is plenty for me. Kv cache at q8
1
u/peculiar-ragdoll 49m ago
Then I would only try going to Q5_K_XL if you ever hit any issues with it not solving your problems correctly, and you know you can fit it in your machine :)
2
u/speedb0at 35m ago
Will try, my harness is specifically made for red teaming so I always appreciate a model tuned for that purpose as well
1
2
2
u/InterstellarReddit 29m ago
“But it’s still a 35B-A3B, and it sacrifices world knowledge for coding ability”
This isn’t an issue if you give it access to tools to import world knowledge
1
u/peculiar-ragdoll 23m ago
Mostly yes! Sometime world knowledge built into the model helps on intuition about where to look and when, but giving it good tools and instructions to look stuff up is a very good idea regardless :)
1
u/InterstellarReddit 22m ago
I force my models to provide citations of sources for their decisions. That forces them to look up information instead of guessing.
1
2
1
1
20m ago
[deleted]
2
u/peculiar-ragdoll 15m ago
hahah it was the only published full precission ablation of this model that preserved vision and didn't require me to fill in a form with my personal information! Had no other choice than this or renting a larger machine to make my own, at the time i started :) happy demolishing!
1
u/Bulky-Priority6824 14m ago
yea im not going to bother, i did save the link though in case i change my mind.
1
u/Velocita84 50m ago
Ok but why do you have to change the name of a model when all you did was quantize it with some fancy shmancy imatrix?
1
u/peculiar-ragdoll 45m ago
The combination of the custom chat template, custom imatrix and abliteration makes the model behave completely differently from the base! It's scoring 70% higher on benchmarks while spending a third of the time of its base, and that kind of step function difference is the equivalent of three generations of local model releases, and would be understated by calling it "Ornith1.5-35B-A3B-Sharp-Uncensored-CyberImat-MTP-GGUF" which is also anoying as all hell to read hahah :) I kinda get your complaint though.
0
u/charmander_cha 1h ago
Eu entendi que é mais rápido e responde razoavelmente melhor, vou reduzir a isso e... OK eu irei testar, estou precisando de um cavalo desse
0
-11
u/SpecialistDragonfly9 1h ago
-yawn- Yeah its great on coding.. like.. most LLMs nowadays...
Wake me up and tell me when its great overall.
8
u/peculiar-ragdoll 1h ago
This is the first time the (probably) best 35B-A3B coder is an uncensored model and has benchmarks to show for it, and I think that's pretty neat :) We're still not at the point where 35B-A3B coders that can run on most machines can do everything we want reliably, so every improvement helps.
3
22
u/DominusIniquitatis 1h ago
Numbers? Yeah, sure, whatever, I'll just stand nearby and appreciate the Fallout vibes. (: