@corbin@infosec.pub to Lemmy Shitpost@lemmy.worldEnglish • 2 months agocan't beat the classicsinfosec.pubimagemessage-square43fedilinkarrow-up1420arrow-down19
arrow-up1411arrow-down1imagecan't beat the classicsinfosec.pub@corbin@infosec.pub to Lemmy Shitpost@lemmy.worldEnglish • 2 months agomessage-square43fedilink
minus-squarePennomilinkfedilinkEnglish11•2 months agoAs always, technology isn’t the enemy, it’s the corporations controlling it that are. And honestly the freely available local LLMs aren’t too far behind the big ones.
minus-square@lmuel@sopuli.xyzlinkfedilinkEnglish8•2 months agoWell in some ways they are. It also depends a lot on the hardware you have of course. A normal 16GB GPU won’t fit huge LLMs. The smaller ones are getting impressively good at some things but a lot of them are still struggling when using non-English languages for example.
As always, technology isn’t the enemy, it’s the corporations controlling it that are. And honestly the freely available local LLMs aren’t too far behind the big ones.
Well in some ways they are. It also depends a lot on the hardware you have of course. A normal 16GB GPU won’t fit huge LLMs.
The smaller ones are getting impressively good at some things but a lot of them are still struggling when using non-English languages for example.