• Zacryon@feddit.org
    link
    fedilink
    arrow-up
    39
    ·
    1 day ago

    In fact, you can.

    How good it will be, how performant and how fast you’ll have it ready is an entirely different question.

    There are plenty of open source models though that can be run locally. So getting a beefy server and running a local LLM there might already do sobe of the tasks you need the big babble machines for.

    • teyrnon@sh.itjust.works
      link
      fedilink
      arrow-up
      10
      ·
      1 day ago

      Others were talking on other threads that local llm models made for a specific task would have a lot more accuracy and usefulness. Forget all of the technical details they cited though.

      • Phantaloons@piefed.zip
        link
        fedilink
        English
        arrow-up
        2
        ·
        20 hours ago

        Ai isn’t bad at tasks where the end result is essentially known to start with, translation, data organization, metadata tagging, etc. You know what the result should be already, somewhat, and so does the Ai. The problem is solved in that there isn’t one.

        It’s the shit that it’s bad at that it’s sold on, though - objective truth per itself and self-help also, according to itself.

    • rose56@lemmy.zip
      link
      fedilink
      arrow-up
      9
      ·
      1 day ago

      Open source? Other LLM? I thought we would do it from scratch, mathematics or something lol

    • FiniteBanjo@feddit.online
      link
      fedilink
      English
      arrow-up
      5
      arrow-down
      1
      ·
      1 day ago

      Pretty sure in a month building and running such a thing they’d have spent more money than a year’s worth of tokens. Unless it just sucked. I could get a model that sucks real bad running in like an hour for him, have him call me.