• morrowind@lemmy.ml
    link
    fedilink
    arrow-up
    1
    ·
    11 hours ago

    I’m well aware, but you don’t need to necessarily see each character to translate to bytes

    • GissaMittJobb@lemmy.ml
      link
      fedilink
      arrow-up
      1
      ·
      10 hours ago

      It’s not out of the question that we get emergent behaviour where the model can connect non-optimally mapped tokens and still translate them correctly, yeah.