alt text

Crudely drawn drawing of a person telling a computer “say ‘i am in pain’”. The computer replies with “> I AM IN PAIN”. The person then says “oh my god.”

yes, it’s a real thing

  • midribbon_action@lemmy.blahaj.zone
    link
    fedilink
    arrow-up
    1
    ·
    edit-2
    11 hours ago

    OK, that’s not helpful at all. My answer is no, it does not meet my definition of changing behavior, and I have no idea why you think it would.

    Edit: ok maybe this does make sense from a very stupid point of view, if you allow me to interpret what you mean: you believe because the kv cache is generated during inference, that proves the model is learning a new behavior, and if you save that cache, that proves… Something??

    It’s absolutely silly: the model’s behavior is to generate a key-value cache, and that’s exactly what it did. The fact that the model is doing intermediate calculations based on the input is not evidence of a new behavior being generated, that is just how algorithms work. That’s what ‘processing’ is, you dunce.

    Edit 2: I also just want to point out, if you think the word ‘cache’ is important, it’s really not. Caches are fundamental to how a computer works, no processing could ever occur without them: every cpu instruction involves reading from or writing to at least one L1 cache (register).