• Buttons@programming.dev
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 year ago

    The “trees” for an LLM are their neural networks and word vectors. The forest is a word prediction algorithm. There is no higher level to what they do.

    At what level do LLMs teach? Something was teaching me linear algebra and I thought it was the GPT4. When GPT4 was able to recognize a valid mathematical proof that was previously unknown to it, what level was it operating at?

    • Veraticus@lib.lgbtOP
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      LLMs do not “teach,” and that is why learning from them is dangerous. They synthesize words and return other words, but they do not understand the content presented to them in any sense. Because of this, there is the chance that they are simply spouting bullshit.

      Learn from them if you like, but remember they are absolutely no substitute for a human, and basically everything they tell you must be checked for correctness.