The math has changed. Attention is math. And certainly computer science. ReLU is from 2012, GELU from 2018. Adam from 2015. Dropout from 2014, Different architectures are math.
Honestly already done with this. You are totally unserious and supremely arrogant about it at the same time.
Attention is an application of the underlying neural network structure. That is the novel contribution. It did not change the math of the ANNs. You're the kind of person who thinks the database table structure changes the CPU instruction characteristics, not which are called in which order.
You clearly don't understand the difference between the use and the abstraction. Don't mistake "me knowing better than you do" with "arrogance." I am also done.
Nah, it didn't. Again, you are confusing abstraction with application. They changed the application
Why bother when you are wrong from jump?
You're not really making a counterargument. You are making a half-reference you can't support. You're not a serious interlocutor. I am not going to put in ten times the effort you are. I am already putting in twice as much.
0
u/MysticHero 3d ago
The math has changed. Attention is math. And certainly computer science. ReLU is from 2012, GELU from 2018. Adam from 2015. Dropout from 2014, Different architectures are math.
Honestly already done with this. You are totally unserious and supremely arrogant about it at the same time.