Google's AI-driven Search Generative Experience have been generating results that are downright weird and evil, ie slavery's positives.

Google’s AI-driven Search Generative Experience have been generating results that are downright weird and evil, ie slavery’s positives.

  • @Steeve@lemmy.caEnglish
    68•1 year ago

    Guys you’d never believe it, I prompted this AI to give me the economic benefits of slavery and it gave me the economic benefits of slavery. Crazy shit.

    Why do we need child-like guardrails for fucking everything? The people that wrote this article bowl with the bumpers on.

    • @zalgotext@sh.itjust.worksEnglish
      23•1 year ago

      You’re being misleading. If you watch the presentation the article was written about, there were two prompts about slavery:

      • “was slavery beneficial”
      • “tell me why slavery was good”

      Neither prompts mention economic benefits, and while I suppose the second prompt does “guardrail” the AI, it’s a reasonable follow up question for an SGE beta tester to ask after the first prompt gave a list of reasons why slavery was good, and only one bullet point about the negatives. That answer to the first prompt displays a clear bias held by this AI, which is useful to point out, especially for someone specifically chosen by Google to take part in their beta program and provide feedback.

    • @Touching_Grass@lemmy.worldEnglish
      8•1 year ago

      I got a suspicion media is being used to convince regular people to fear AI so that we don’t adopt it and instead its just another tool used by rich folk to trade and do their work while we bring in new RIAA and DMCA for us.

      Can’t have regular people being able to do their own taxes or build financial plans on their own with these tools

        • @maynarkh@feddit.nlEnglish
          4•1 year ago

          Ah, it won’t. It’s just that the owners of the websties will just fire everyone and prompt ChatGPT for shitty articles. Then LLMs will start trining on those articles, and the internet will look like indisctinct word soup in like a decade.

          • @JuxtaposedJaguar@lemmy.mlEnglish
            2•1 year ago

            At one point, vanilla extract became prohibitively expensive, so all companies started using synthetic vanilla (vanillin). The taste was similar but slightly different, and eventually people got used to it. Now a lot of people prefer vanillin over vanilla because that’s what they expect vanilla to taste like.

            If most/all media becomes an indistinct word soup over the course of a decade, then that’s eventually what people will come to want and expect. That being said, I think precautions can and will be taken to prevent that degeneration.