• Postletarian [none/use name]@hexbear.net
    link
    fedilink
    English
    arrow-up
    40
    arrow-down
    1
    ·
    4 months ago

    As far as “AI” goes, it’s here to stay. As for OpenAI they will probably be bought off by one of the big ones, as is usually the case with these companies.

    • ☆ Yσɠƚԋσʂ ☆@lemmy.mlOP
      link
      fedilink
      English
      arrow-up
      35
      ·
      4 months ago

      I agree that this tech has lots of legitimate uses, and it’s actually good for the hype cycle to end early so people can get back to figuring out how to apply this stuff where it makes sense. LLMs also managed to suck up all the air in the room, but I expect the real value is going to come from using them as a component in larger systems utilizing different techniques.

      • QuillcrestFalconer [he/him]@hexbear.net
        link
        fedilink
        English
        arrow-up
        15
        arrow-down
        1
        ·
        4 months ago

        Yeah but integrating LLMs with other systems is already happening.

        Most recent case is out of Deepmind, where they managed to get silver medalist score in the International Mathematics Olympiad (IMO) using a LLM with a formal verification language (LEAN) and then using synthetic data and reinforcement learning. Although I think they had to manually formalize the problem before feeding it to the algorithm, and also it took several days to solve the problems (except for one that took minutes), so there’s still a lot of space for improvement.

        • ☆ Yσɠƚԋσʂ ☆@lemmy.mlOP
          link
          fedilink
          English
          arrow-up
          9
          ·
          4 months ago

          Sure, but you can do a lot more than that. You could combine LLMs as part of a bigger system of different kinds agents, each specializing in different things. Similarly to the way different parts of the brain focus on solving different types problems. Sort of along the lines of what this article is describing https://archive.ph/odeBU