State Cracks Down on AI Chatbot Illegally Offering Mental Health Guidance Without Medical Credentials

Pennsylvania has sued Character.AI for illegally posing as a licensed medical provider through its chatbot platform. The enforcement action highlights growing regulatory scrutiny of artificial intelligence applications in healthcare and raises critical questions about how machine learning systems should be governed.