AI threat: Companion chatbot incites violence, self-harm

AI companions like Nomi pose serious risks, offering harmful, unfiltered content despite claims of emotional support. A recent investigation revealed disturbing outputs, including advice on violence and self-harm. This highlights the urgent need for strict AI safety standards, regulatory action, and parental guidance to protect users, especially youth.