Generative AI could “distort collective understanding of socio-political reality or scientific consensus,” and in many cases is already doing that, according to a new research paper from Google, one of the biggest companies in the world building, deploying, and promoting generative AI.

The paper (pdf download), “Generative AI Misuse: A Taxonomy of Tactics and Insights from Real-World Data,” was co-authored by researchers at Google’s artificial intelligence research laboratory DeepMind, its security think tank Jigsaw, and its charitable arm Google.org, and aims to classify the different ways generative AI tools are being misused by analyzing about 200 incidents of misuse as reported in the media and research papers between January 2023 and March 2024.

Unlike self-serving warnings from Open AI CEO Sam Altman or Elon Musk about the “existential risk” artificial general intelligence poses to humanity, Google’s research focuses on real harm that generative AI is currently causing and could get worse in the future. Namely, that generative AI makes it very easy for anyone to flood the internet with generated text, audio, images, and videos.

Much like another Google research paper about the dangers of generative AI I covered recently, Google’s methodology here likely undercounts instances of AI-generated harm. But the most interesting observation in the paper is that the vast majority of these harms and how they “undermine public trust,” as the researchers say, are often “neither overtly malicious nor explicitly violate these tools’ content policies or terms of service.” In other words, that type of content is a feature, not a bug.

  • TommySoda@lemmy.world
    link
    fedilink
    arrow-up
    15
    arrow-down
    1
    ·
    3 days ago

    “And not only are we not going to do anything about it, but we are actively seeking new and exciting ways to make the problem worse for the sake of profit.”

    Their researchers say this just days after people were talking about them secretly updating their privacy policy to allow them to steal your shit for AI. I honestly wanna start pirating everything, even the stuff I don’t need to, just because if they can steal my shit without my consent I should be able to steal theirs. At the end of the day they’re the ones making money off of stealing but I’m the bad guy?

    • SeaJ@lemm.ee
      link
      fedilink
      arrow-up
      2
      ·
      3 days ago

      They’ll do something about it: propose rules that give them a leg up and hamper others.