The company of psychological support Koko conducted an experiment , in which artificial intelligence conducted psychological consultations for 4000 people without them without them preliminary notification.
koko is a non -profit platform for the protection of mental health that connects those in need of psychiatric care with volunteers through Telegram and Discord.
On the Discord Koko Cares server, the user sends a message to the Koko bot, which asks several questions with several answers (for example, “What is the most gloomy thought you have about this?”). Then the bot is anonymously divided by the user’s message with a volunteer on the server, which can anonymously respond with a short message, an automatically generated language model GPT-3. The company demonstrated the work of Koko on the video . .com/embed/d9b5a26c64464640ba95BB413147E41766 “Frameborder =” 0 “webkitallowfullscreen mozallscreen allscreen>
According to the company, AI was used in 30,000 messages. The answers compiled by AI (and controlled by people) were evaluated much higher than messages written by people on their own. The response time was reduced by 50% and amounted to less than 1 minute.
Many critics called the experiment unethical, since it does not have informed consent of users. Koko violated the rules designed to protect vulnerable people from harmful or insulting research methods. It is forbidden to conduct research in public in the United States without legally executed consent.