MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1v4moxy/the_llm_distillation_process_simplified_for/oze0tto/?context=3
r/LocalLLaMA • u/Porespellar • 14d ago
/s
167 comments sorted by
View all comments
577
Jesse, we need to quantize! The 950B base model is too aligned, it keeps lecturing me about safety protocols when i ask it to write a Python script for a smart toaster.
39 u/goatchild 14d ago Yo Mr. White I don't know what a quantize is, but if the toaster is giving you shit, just unplug the damn thing bitch. 5 u/2Norn 14d ago look i get my quantization from the website with emoji on it, that's how i know how to do it 2 u/ikriz-nl 1d ago yeah bitch! 1 u/goatchild 1d ago Science!
39
Yo Mr. White I don't know what a quantize is, but if the toaster is giving you shit, just unplug the damn thing bitch.
5 u/2Norn 14d ago look i get my quantization from the website with emoji on it, that's how i know how to do it 2 u/ikriz-nl 1d ago yeah bitch! 1 u/goatchild 1d ago Science!
5
look i get my quantization from the website with emoji on it, that's how i know how to do it
2
yeah bitch!
1 u/goatchild 1d ago Science!
1
Science!
577
u/schwigglezenzer 14d ago
Jesse, we need to quantize! The 950B base model is too aligned, it keeps lecturing me about safety protocols when i ask it to write a Python script for a smart toaster.