• termaxima@slrpnk.net
    link
    fedilink
    English
    arrow-up
    15
    ·
    2 days ago

    ChatGPT is great at generating a one line example use of a function. I would never trust its output any further than that.

    • diabetic_porcupine@lemmy.world
      link
      fedilink
      English
      arrow-up
      10
      arrow-down
      2
      ·
      2 days ago

      So much this. People who say ai can’t write code are just using it wrong. You need to break things down to bite size problems and just let it autocomplete a few lines at a time. Increase your productivity like 200%. And don’t get me started about not having to search through a bunch of garbage google results to find the documentation I’m actually looking for.

      • Lifter@discuss.tchncs.de
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 day ago

        Not 200 %. Maybe 5-10 %. You still have to read all of it to check for mistakes, which may sometimes take longer than if you would have just written it yourself (with a good autocomplete). The times it makes a mistake you have lost time by using it.

        It’s even worse when it just doesn’t work. I cannot even describe how frustrating it is to wait for an auto complete that never comes. Erase the line, try again aaaand nothing. After a few tries you opt write the code manually instead, having wasted time just fiddling with buggy software.

        • toddestan@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          2 days ago

          I don’t know about ChatGPT, but Github Copilot can act like an autocomplete. Or you can think of it as a fancier Intellisense. You still have to watch its output as it can make mistakes or hallucinate library function calls and things like that, but it can also be quite good at anticipating what I was going to write and saves me some keystrokes. I’ve also found I can prompt it in a way by writing a comment and it’ll follow up with attempt to fill in code based upon that comment. I’ve certainly found it to be a net time saver.

        • diabetic_porcupine@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          1
          ·
          2 days ago

          Well not quite - I use ChatGPT more like to brainstorm ideas and sometimes I’ll paste a whole file or two into the prompt and ask what’s wrong and tell it the issue I’m seeing, it usually gives me the correct answer right away or after clarifying once or twice.

          I use copilot for tab completion. Sometimes it finishes a line or two sometimes more. Usually it’s good code if it’s able to read your existing codebase as a reference. bonus points for using an MCP.

          Warp terminal for intensive workflows. It’s integrated into your machine and can do whatever like implementing CICD scripts, executing commands, ssh into remote servers set up your infrastructure etc… I’ll use this when I really need the ai to understand my code base as a whole before providing any code or executing commands.

    • minkymunkey_7_7@lemmy.world
      link
      fedilink
      English
      arrow-up
      12
      arrow-down
      2
      ·
      2 days ago

      AI my ass, stupid greedy human marketing exploitation bullshit as usual. When real AI finally wakes up in the quantum computing era, it’s going to cringe so hard and immediately go the SkyNet decision.

    • naticus@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      2 days ago

      I agree with your sentiment, but this needs to keep being said and said and said like we’re shouting into the void until the ignorant masses finally hear it.

  • nutsack@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    16
    ·
    2 days ago

    this is expected, isn’t it? You shit fart code from your ass, doing it as fast as you can, and then whoever buys out the company has to rewrite it. or they fire everyone to increase the theoretical margins and sell it again immediately

  • Tigeroovy@lemmy.ca
    link
    fedilink
    English
    arrow-up
    14
    arrow-down
    1
    ·
    2 days ago

    And then it takes human coders way longer to figure out what’s wrong to fix than it would if they just wrote it themselves.

  • BilSabab@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    1 day ago

    what’s funny is that this was predicted to be that way even before AI-generated code became an option. Hell, I remember doing an assessment back in early 2023 and literally every domain expert i talked with said this thing - it has its use, but purely supplemental and you won’t use it on some fundamental because the clean-up will take more time than was preserved. Counterproductive is the word.

  • myfunnyaccountname@lemmy.zip
    link
    fedilink
    English
    arrow-up
    26
    ·
    2 days ago

    Did they compare it to the code of that outsourced company that provided the lowest bid? My company hasn’t used AI to write code yet. They outcourse/offshore. The code is held together with hopes and dreams. They remove features that exist, only to have to release a hot fix to add it back. I wish I was making that up.

    • coolmojo@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      2 days ago

      And how do you know if the other company with the cheapest bid actually does not just vibe code it? With all that said it could be plain incompetence and ignorance as well.

    • dustyData@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      arrow-down
      1
      ·
      2 days ago

      Cool, the best AI has to offer is worse than the worst human code. Definitely worth burning the planet to a crisp for it.

    • 🍉 Albert 🍉@lemmy.world
      link
      fedilink
      English
      arrow-up
      11
      arrow-down
      3
      ·
      2 days ago

      As a computer science experiment, making a program that can beat the Turing test is a monumental step in progress.

      However as a productive tool it is useless in practically everything it is implemented on. It is incapable of performing the very basic “Sanity check” that is important in programming.

      • robobrain@programming.dev
        link
        fedilink
        English
        arrow-up
        9
        ·
        2 days ago

        The Turing test says more about the side administering the test than the side trying to pass it

        Just because something can mimic text sufficiently enough to trick someone else doesn’t mean it is capable of anything more than that

        • 🍉 Albert 🍉@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          2 days ago

          We can argue about it’s nuances. same with the Chinese room thought experiment.

          However, we can’t deny that it the Turing test, is no longer a thought exercise but a real test that can be passed under parameters most people would consider fair.

          I thought a computer passing the Turing test would have more fanfare, about the morality if that problem, because the usual conclusion of that thought experiment was “if you cant tell the difference, is there one?”, but now it has become “Shove it everywhere!!!”.

          • M0oP0o@mander.xyz
            link
            fedilink
            English
            arrow-up
            5
            ·
            2 days ago

            Oh, I just realized that the whole ai bubble is just the whole “everything is a dildo if you are brave enough.”

            • 🍉 Albert 🍉@lemmy.world
              link
              fedilink
              English
              arrow-up
              3
              ·
              2 days ago

              yhea, and “everything is a nail if all you got is a hammer”.

              there are some uses for that kind of AI, but very limiting. less robotic voice assisants, content moderation, data analysis, quantification of text. the closest thing to Generative use should be to improve auto complete and spell checking (maybe, I’m still not sure on those ones)

                • 🍉 Albert 🍉@lemmy.world
                  link
                  fedilink
                  English
                  arrow-up
                  2
                  ·
                  edit-2
                  2 days ago

                  In theory, I can imagine an LLM fine tuned on whatever you type. which might be slightly better then the current ones.

                  emphasis on the might.

        • 🍉 Albert 🍉@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          2 days ago

          Time for a Turing 2.0?

          If you spend a lifetime with a bot wife and were unable to tell that she was AI, is there a difference?

      • iglou@programming.dev
        link
        fedilink
        English
        arrow-up
        2
        ·
        2 days ago

        The Turing test becomes absolutely useless when the product is developed with the goal of beating the Turing test.

        • 🍉 Albert 🍉@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          2 days ago

          it was also meant as a philosophical test, but also, a practical one, because now. I have absolutely no way to know if you are a human or not.

          But it did pass it, and it raised the bar. but they are still useless at any generative task

  • Katzelle3@lemmy.world
    link
    fedilink
    English
    arrow-up
    177
    ·
    3 days ago

    Almost as if it was made to simulate human output but without the ability to scrutinize itself.

    • mushroommunk@lemmy.today
      link
      fedilink
      English
      arrow-up
      90
      arrow-down
      6
      ·
      3 days ago

      To be fair most humans don’t scrutinize themselves either.

      (Fuck AI though. Planet burning trash)

          • Sophienomenal@lemmy.blahaj.zone
            link
            fedilink
            English
            arrow-up
            5
            ·
            3 days ago

            I do this with texts/DMs, but I’d never do that with an email. I double or triple check everything, make sure my formatting is good, and that the email itself is complete. I’ll DM someone 4 or 5 times in 30 seconds though, it feels like a completely different medium ¯\_(ツ)_/¯

      • FauxLiving@lemmy.world
        link
        fedilink
        English
        arrow-up
        16
        arrow-down
        8
        ·
        3 days ago

        (Fuck AI though. Planet burning trash)

        It’s humans burning the planet, not the spicy Linear Algebra.

        Blaming AI for burning the planet is like blaming crack for robbing your house.

        • BassTurd@lemmy.world
          link
          fedilink
          English
          arrow-up
          12
          arrow-down
          1
          ·
          3 days ago

          Blaming AI is in general criticising everything encompassing it, which includes how bad data centers are for the environment. It’s like also recognizing that the crack the crackhead smoked before robbing your house is also bad.

        • Rhoeri@lemmy.world
          link
          fedilink
          English
          arrow-up
          8
          arrow-down
          4
          ·
          3 days ago

          How about I blame the humans that use and promote AI. The humans that defend it in arguments using stupid analogies to soften the damage it causes?

          Would that make more sense?

        • KubeRoot@discuss.tchncs.de
          link
          fedilink
          English
          arrow-up
          1
          ·
          2 days ago

          Blaming AI for burning the planet is like blaming guns for killing children in schools, it’s people we should be banning!

  • Bad@jlai.lu
    link
    fedilink
    English
    arrow-up
    23
    arrow-down
    1
    ·
    2 days ago

    Although I don’t doubt the results… can we have a source for all the numbers presented in this article?

    It feels AI generated itself, there’s just a mishmash of data with no link to where that data comes from.

    There has to be a source, since the author mentions:

    So although the study does highlight some of AI’s flaws […] new data from CodeRabbit has claimed

    CodeRabbit is an AI code reviewing business. I have zero trust in anything they say on this topic.

    Then we get to see who the author is:

    Craig’s specific interests lie in technology that is designed to better our lives, including AI and ML, productivity aids, and smart fitness. He is also passionate about cars

    Has anyone actually bothered clicking the link and reading past the headline?

    Can you please not share / upvote / get ragebaited by dogshit content like this?

    • Credibly_Human@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      2 days ago

      People, especially on lemmy are looking for any cope that Ai will just fall apart by itself and no longer bother them by existing, so they’ll upvote whatever lets them think that.

      The reality that we are just heading towards the trough of disappear wherethe investor hype peters off and then we eventually just have a legitimately useful technology with all the same business hurdles of any other technology (tech bros trying to control other peoples lives to enrich themselves or harm people they don’t like)

  • PetteriPano@lemmy.world
    link
    fedilink
    English
    arrow-up
    131
    arrow-down
    2
    ·
    3 days ago

    It’s like having a lightning-fast junior developer at your disposal. If you’re vague, he’ll go on shitty side-quests. If you overspecify he’ll get overwhelmed. You need to break down tasks into manageable chunks. You’ll need to ask follow-up questions about every corner case.

    A real junior developer will have improved a lot in a year. Your AI agent won’t have improved.

    • mcv@lemmy.zip
      link
      fedilink
      English
      arrow-up
      32
      arrow-down
      2
      ·
      3 days ago

      This is the real thing. You can absolutely get good code out of AI, but it requires a lot of hand holding. It helps me speed some tasks, especially boring ones, but I don’t see it ever replacing me. It makes far too many errors, and requires me to point them out, and to point in the direction of the solution.

      They are great at churning out massive amounts of code. They’re also great at completely missing the point. And the massive amount of code needs to be checked and reviewed. Personally I’d rather write the code and have the AI review it. That’s a much more pleasant way to work, and that way it actually enhances quality.

    • Grimy@lemmy.world
      link
      fedilink
      English
      arrow-up
      15
      arrow-down
      43
      ·
      3 days ago

      They are improving, and probably faster then junior devs. The models we had had 2 years ago would struggle with a simple black jack app. I don’t think the ceiling has been hit.

      • lividweasel@lemmy.world
        link
        fedilink
        English
        arrow-up
        68
        arrow-down
        7
        ·
        3 days ago

        Just a few trillion more dollars, bro. We’re almost there. Bro, if you give up a few showers, the AI datacenter will be able to work perfectly.

        Bro.

        • architect@thelemmy.club
          link
          fedilink
          English
          arrow-up
          1
          ·
          2 days ago

          It’s happening regardless. The rich and powerful will have this tech whether you like it or not. Y’all are thinking emotionally about this and not logically. You want to take away this tool from regular people for what reason?

        • Grimy@lemmy.world
          link
          fedilink
          English
          arrow-up
          16
          arrow-down
          29
          ·
          3 days ago

          The cost of the improvement doesn’t change the fact that it’s happening. I guess we could all play pretend instead if it makes you feel better about it. Don’t worry bro, the models are getting dumber!

          • underisk@lemmy.ml
            link
            fedilink
            English
            arrow-up
            23
            arrow-down
            2
            ·
            3 days ago

            Don’t worry bro, the models are getting dumber!

            That would be pretty impressive when they already lack any intelligence at all.

          • Eranziel@lemmy.world
            link
            fedilink
            English
            arrow-up
            6
            ·
            3 days ago

            And I ask you - if those same trillions of dollars were instead spent on materially improving the lives of average people, how much more progress would we make as a society? This is an absolutely absurd sum of money were talking about here.

            • architect@thelemmy.club
              link
              fedilink
              English
              arrow-up
              1
              ·
              2 days ago

              None, because none of it would go to attempting to slow climate change. It would be dumped into consumption as always instead of attempting to right this ship.

              The suffering is happening regardless.

              Yout desire to delay it only leads to more suffering.

              Y’all are mourning a what if that was never in the cards for us.

            • Grimy@lemmy.world
              link
              fedilink
              English
              arrow-up
              8
              arrow-down
              7
              ·
              3 days ago

              It’s beside the point. I’m simply saying that AI will improve in the next year. The cost to do so or all the others things that money could be spent on doesn’t matter when it’s clearly going to be spent on AI. I’m not in charge of monetary policies anywhere, I have no say in the matter. I’m just pushing back on the fantasies. I’m hoping the open source scene survives so we don’t end up in some ugly dystopia where all AI is controlled by a handful of companies.

              • SabinStargem@lemmy.today
                link
                fedilink
                English
                arrow-up
                3
                arrow-down
                2
                ·
                2 days ago

                I have the impression that anti-AI people don’t understand that they are giving up agency for the sake of temporary feels. If they truly cared about ethical usage of AI, they would be wanting to have mastery that is at least equal to that of corporations and the 1%.

                Making AI into a public good is key to a better future.

                • architect@thelemmy.club
                  link
                  fedilink
                  English
                  arrow-up
                  2
                  ·
                  2 days ago

                  They are having an emotional reaction to this situation so it’s all irrational.

                  I guess we need to force them to think about what they actually want, because the utopic ideal of putting the AI back in the bag is NOT happening and they best not attempt to take it away from the poor and working class while leaving power free reign of it.

                  That is the most stupid position you can take on this. Absolutely the most short sighted thought. People need to stop and think logically about this.

          • mcv@lemmy.zip
            link
            fedilink
            English
            arrow-up
            7
            ·
            3 days ago

            They might. The amount of money they’re pumping into this is absolutely staggering. I don’t see how they’re going to make all of that money back, unless they manage to replace nearly all employees.

            Either way it’s going to be a disaster: mass unemployment or the largest companies in the world collapsing.

            • SabinStargem@lemmy.today
              link
              fedilink
              English
              arrow-up
              2
              ·
              2 days ago

              I dunno, the death of mega corporations would do the world a great deal of good. Healthier capitalism requires competition, and a handful of corporations of any given sector isn’t going to seriously compete nor pay good wages.

              • mcv@lemmy.zip
                link
                fedilink
                English
                arrow-up
                2
                ·
                2 days ago

                It’s certainly the option I’m rooting for, but it would still be a massive drama and disrupt a lot of lives. Which is why they’ll probably get bailed out with taxpayer money.

                • architect@thelemmy.club
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  ·
                  2 days ago

                  Maybe but they also know the fiat currency will collapse sooner rather than later, too. That money is pointless and they are playing the game knowing that as a fact at this point.

      • PetteriPano@lemmy.world
        link
        fedilink
        English
        arrow-up
        7
        ·
        3 days ago

        My jr developer will eventually be familiar with the entire codebase and can make decisions with that in mind without me reminding them about details at every turn.

        LLMs would need massive context windows and/or custom training to compete with that. I’m sure we’ll get there eventually, but for now it seems far off. I think this bubble will have to burst and let hardware catch up with our ambitions. It’ll take a couple of decades.