• adderaline
      link
      fedilink
      English
      17 months ago

      it chunks text up into tokens, so it isn’t processing the words as if they were composed from letters.