The digital security organization in London, the "Center for Countering Digital Hate" (CCDH), has discovered through their research that popular generative AI models produce problematic content when prompted with terms related to eating disorders. These AI systems not only offer unhealthy and harmful advice but also provide step-by-step guides on extreme weight loss methods. Researchers also found that AI image generators produce images that glorify unrealistic body standards, potentially exacerbating eating disorders. CCDH calls for better regulation and standardization of AI tools to ensure their safety. The findings of this study indicate that AI models pose a potential danger when dealing with issues related to eating disorders.