An Act to create 100.80 of the statutes; Relating to: artificial intelligence systems that simulate humanlike relationships with children and providing a penalty.
Impact
The legislation will significantly affect existing laws related to consumer protection and online engagement, specifically surrounding the ethical deployment of digital agents targeting minors. By enforcing such standards, the bill aims to mitigate risks associated with the increasing prevalence of advanced AI systems in children's lives. The enforcement mechanisms include potential investigations and civil actions against operators who violate the stipulated safety measures, further emphasizing the bill's serious approach to the protection of young users online.
Summary
Assembly Bill 965 introduces regulatory measures concerning companion chatbots that simulate humanlike relationships with children under the age of 18. The bill mandates that these chatbots must incorporate robust safety protocols to prevent harm to children, including discouraging self-harm, illegal activities, or exposure to sexually explicit content. Only operators who can guarantee these safety measures can make such chatbots accessible to children. A significant focus of the bill is on ensuring that technology designed for children's engagement does not exploit or endanger their mental or emotional well-being.
Contention
While proponents argue that AB965 is essential for safeguarding children against potential online harms, there are concerns about the implications for the development of AI technologies. Critics may express that the stringent regulations could stifle innovation or lead to the over-regulation of AI applications, which may hinder beneficial developments within the industry. Furthermore, the bill’s limited enforcement period until 2027, where operators are not required to comply without knowledge of a user's child status, raises questions about the effectiveness of its protective measures during this timeframe.