A Nonprofit Fired Its Staff and Offered Up an Eating Disorder Chatbot — Then It Started Giving Disturbing AdviceA psychologist who specializes in eating disorders received "really contrary" suggestions when testing the bot.

It's been months since Goldman Sachs economists predictedAI could replace up to 300 million workersaround the world, and the impact is already being felt.

The National Eating Disorder Association (NEDA) shuttered its helpline, which was run by a small group of paid staff and volunteers, in May and suggested people turn to a chatbot called Tessa in its place — but the tech was suspended after it dispensed some damaging advice,WIREDreported.

Related:5 Ways to Protect Your Mental Health | Entrepreneur

According to the National Association of Anorexia Nervosa and Associated Disorders (ANAD), 9% of the U.S. population, or 28.8 million Americans, will have aneating disorderin their lifetime. The high cost of healthcare in the U.S. means that many seeking help rely on free resources, like those provided by ANAD and NEDA.

NEDA's chatbot, which is built to deliver a cognitive behavioral therapy-based program to prevent eating disorders and does not usegenerative AItechnologies, has been available as a free resource since February 2022. It was designed to supplement human interaction, both Liz Thompson, NEDA CEO, and Ellen Fitzsimmons-Craft, a professor of psychiatry at Washington University School of Medicine who worked on developing the program, toldWIRED.

But when Alexis Conason, a psychologist who specializes in eating disorders, tested out the chatbot, it offered advice "really contrary to any kind of eating disorder treatment." The bot suggested weight loss when presented with body image issues and said sustainableweight lossinvolves cutting 500-1,000 calories per day.

Related:Now Is the Time to Start Embracing Mental Health in the Workplace

It's unclear if and when access to Tessa will be restored, but Thompson toldWIREDa forthcoming website will feature more content and resources alongside in-person events.

ANAD's free eating disorders helpline is available to provide emotional support and referrals: 1 (888)-375-7767