Feed: Slashdot
Feed Link: https://slashdot.org/
---

Title: OpenAI Is Scanning Users' ChatGPT Conversations and Reporting Content
To Police

Link: https://yro.slashdot.org/story/25/08/31/23112...

Futurism reports: Earlier this week, buried in the middle of a lengthy blog
post addressing ChatGPT's propensity for severe mental health harms, OpenAI
admitted that it's scanning users' conversations and reporting to police any
interactions that a human reviewer deems sufficiently threatening. "When we
detect users who are planning to harm others, we route their conversations to
specialized pipelines where they are reviewed by a small team trained on our
usage policies and who are authorized to take action, including banning
accounts," it wrote. "If human reviewers determine that a case involves an
imminent threat of serious physical harm to others, we may refer it to law
enforcement." The announcement raised immediate questions. Don't human
moderators judging tone, for instance, undercut the entire premise of an AI
system that its creators say can solve broad, complex problems? How is OpenAI
even figuring out users' precise locations in order to provide them to
emergency responders? How is it protecting against abuse by so-called
swatters, who could pretend to be someone else and then make violent threats
to ChatGPT in order to get their targets raided by the cops...? The admission
also seems to contradict remarks by OpenAI CEO Sam Altman, who recently
called for privacy akin to a "therapist or a lawyer or a doctor" for users
talking to ChatGPT. "Others argued that the AI industry is hastily pushing
poorly-understood products to market, using real people as guinea pigs, and
adopting increasingly haphazard solutions to real-world problems as they
arise..." Thanks to long-time Slashdot reader schwit1 for sharing the news.

Read more of this story at Slashdot.

---
VRSS v2.1.180528