@ElCanut@jlai.lu to solarpunk memes@slrpnk.net • 5 months agoBaybe what's wrong? You've barely touched your Strawberrumjlai.luimagemessage-square76fedilinkarrow-up1547arrow-down18
arrow-up1539arrow-down1imageBaybe what's wrong? You've barely touched your Strawberrumjlai.lu@ElCanut@jlai.lu to solarpunk memes@slrpnk.net • 5 months agomessage-square76fedilink
minus-square@ramirezmike@programming.devlinkfedilink1•5 months agodoesn’t it work literally by passing in everything it said to determine what the next word is?
minus-squareadderalinelinkfedilinkEnglish1•5 months agoit chunks text up into tokens, so it isn’t processing the words as if they were composed from letters.
doesn’t it work literally by passing in everything it said to determine what the next word is?
it chunks text up into tokens, so it isn’t processing the words as if they were composed from letters.