In a recent article published in the journal *JAMA Oncology*, researchers evaluated whether chatbots driven by large language models powered by artificial intelligence algorithms could provide accurate and reliable cancer treatment advice. The study results indicated that the advice provided by the chatbots did not fully align with the NCCN guidelines, and 33.33% of the recommendations contained errors. The research underscores the need for caution and regulation when AI technology is integrated into medical decision-making. These findings suggest that healthcare providers need to educate patients about the potential risks of misinformation from AI technologies and call for the development of federal regulations for AI and other potentially harmful technologies.