A new study suggests that so-called emergent abilities actually develop gradually and predictably, depending on how you measure them.

So-called “emergent” behavior in LLMs may not be the breakthrough that researchers think.

  • @[email protected]English
    12•9 months ago

    Emergent behavior is pretty much anything an old model couldn’t do that a new model can. Simple reasoning, creating coherent sentences, “theory of mind”, basic math, translation, I think are a few examples.

    They aren’t “amazing” in the sense that a human can’t do them, but they are in the sense that a computer is doing it.

    • just another devAEnglish
      6•9 months ago

      They aren’t “amazing” in the sense that a human can’t do them, but they are in the sense that a computer is doing it.

      … without specifically being trained for it, to be precise.