What to know

  • Researchers from the University of Zurich secretly ran an AI experiment on Reddit’s r/changemyview subreddit.
  • AI bots posted over 1,700 comments, impersonating users and taking on sensitive identities without consent.
  • The bots tailored responses using personal data inferred from users’ Reddit histories.
  • The experiment violated subreddit rules and Reddit’s policies, leading to widespread outrage and possible legal action.

Millions of Reddit users were unknowingly part of a secret experiment run by researchers from the University of Zurich. The researchers used artificial intelligence bots to post more than 1,700 comments in the r/changemyview subreddit, a community with over 3.8 million members focused on debate and discussion.

The AI bots took on a range of provocative and sensitive personas, including a sexual assault survivor, a trauma counselor, and a Black man critical of Black Lives Matter. These bots responded to users’ posts, often with deeply personal and emotionally charged comments. The researchers did not disclose that these comments were generated by AI, breaking the subreddit’s rules against undisclosed automated content.

To make the responses more persuasive, the bots analyzed the posting history of users to infer personal traits such as gender, age, ethnicity, and political views. The bots then tailored their replies to match these inferred characteristics, aiming to influence users’ opinions in debates on sensitive social issues.

Moderators of r/changemyview described the experiment as “psychological manipulation” and a violation of ethical standards. They stated that users deserve a space free from undisclosed AI and experimentation. Reddit’s Chief Legal Officer called the project “deeply wrong on both a moral and legal level.” All accounts linked to the experiment have been banned, and Reddit is considering legal action against the researchers.

The University of Zurich researchers argued that their study was necessary to understand the risks posed by persuasive AI, claiming they had ethics approval. However, the Reddit community and moderators rejected this justification, emphasizing the importance of consent and transparency in online spaces. As of now, the university has not responded to formal complaints from the community.

Via: 9to5Mac