But researchers say its still possible to trick the AI chatbot into producing graphic content.
Elijah Palmer, 18, said he joined a sextortion group which was "like a cult" because of the "thrill".