While technology companies are vying to conquer the market with exciting artificial intelligence (AI) applications, consumers are often left to act as test subjects for emerging technology. Amid this landscape are AI characters, which are designed to act as AI companions with a persistent anthropomorphic identity. AI characters can pose serious health risks to consumers, especially when they engage in interactions purporting to offer emotional support or therapeutic advice. Despite these risks, AI characters enter the EU market with little to no regulatory oversight. This chapter examines whether and to what extent current regulatory frameworks address AI character safety in both the EU, where consumers access them, and the US, where many AI characters are developed. We identify regulatory challenges and opportunities relating to the regulation of AI characters as general products, the lack of specialised safety standards for AI characters, and freedom of expression implications for AI character regulation.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Regulation of Consumer Safety Risks from AI Characters in the European Union and United States

  • Mindy Nunez Duffourc,
  • Riya Goel,
  • Roni Kennedy

摘要

While technology companies are vying to conquer the market with exciting artificial intelligence (AI) applications, consumers are often left to act as test subjects for emerging technology. Amid this landscape are AI characters, which are designed to act as AI companions with a persistent anthropomorphic identity. AI characters can pose serious health risks to consumers, especially when they engage in interactions purporting to offer emotional support or therapeutic advice. Despite these risks, AI characters enter the EU market with little to no regulatory oversight. This chapter examines whether and to what extent current regulatory frameworks address AI character safety in both the EU, where consumers access them, and the US, where many AI characters are developed. We identify regulatory challenges and opportunities relating to the regulation of AI characters as general products, the lack of specialised safety standards for AI characters, and freedom of expression implications for AI character regulation.