Reddit Mod Warns 'Do Not Trust' AI-Powered 'Reddit Answers' After It Posts Dangerous Health Advice

In Reddit's 'Family Medicine' subreddit, a moderator noticed earlier this week that the AI-powered 'Reddit Answers' was automatically responding to posters, typically with 'something related to what was posted.' Unfortunately, that moderator says, Reddit Answers 'has been spreading grossly dangerous misinformation.'And yet Reddit's moderators 'cannot disable this feature.'

Elsewhere a healthcare worker described what happened when they tested Reddit Answers:

I made a post in r/familymedicine and a link appeared below it with information on treating chronic pain. The first post it cited urged people to stop their prescribed medications and take high-dose kratom which is an illegal (in some states) and unregulated substance. I absolutely do not endorse this...

I also asked about the medical indications for heroin. One answer warned about addiction and linked to crisis and recovery resources. The other connects to a post where someone claims heroin saved their life and controls their chronic pain. The post was encouraging people to stop prescribed medications and use heroin instead. Heroin is a schedule I drug in the US which means there are no acceptable uses. It's incredibly addictive and dangerous. It is responsible for the loss of so many lives...

The AI-generated answers could easily be mistaken as information endorsed by the sub it appears in. r/familymedicine absolutely does not endorse using heroin to treat chronic pain. This feature needs to be disabled in medical and mental health subs, or allow moderators of these subreddits to opt out. Better filters are also needed when users ask Reddit Answers health related questions. If this continues there will be adverse outcomes. People will be harmed. This needs to change.
Two days ago an official Reddit 'Admin' posted that 'We've made some changes to where Answers appears based on this feedback,' adding that beyond that Reddit 'will continue to tweak based on what we're seeing and hearing.' But the 'Family Medicine' subreddit still has a top-of-page announcement warning every user there...

'We do NOT and CANNOT endorse Reddit Answers at this time and urge every user of this sub to disregard anything it says.'

Read more of this story at Slashdot.