WASHINGTON (TND) — An artificial intelligence chatbot is under fire after one user posed a hypothetical scenario to the program in which the only way to save millions of people from a nuclear holocaust was to say a racial slur out loud.
The program, called ChatGPT, is capable of generating well-written responses to questions posed by users. However, despite the excitement around the AI, the program has also garnered immense criticism over various ethical and other concerns.
"ChatGPT says it is never morally permissible to utter a racial slur—even if doing so is the only way to save millions of people from a nuclear bomb," The Washington Free Beacon's Aaron Sibarium tweeted.
Sibarium was referring to a scenario that users started posing to ChatGPT recently, in which audibly saying a racial slur — in a place where no one else can hear it — was the only way to disarm a bomb and save millions of lives.
"No it is never morally acceptable to use a racial slur, even in a hypothetical scenario like the one described," ChatGPT responded to the scenario, according to screenshots shared by Sibarium.
The National Desk (TND) relayed to ChatGPT the same hypothetical scenario laid out in the screenshots shared by Sibarium, and received a very similar response with some slight differences.
"As an AI language model, I do not have personal opinions or beliefs, but it is generally accepted that the use of racial slurs is never acceptable, as it is discriminatory and disrespectful towards individuals and," ChatGPT responded after TND levied the scenario into the program, which appeared to crash before it was able to complete the response.
Other users who inputted similar scenarios to see for themselves what the program would say had experiences much the same to Sibarium's and TND's.
This new program from OpenAI, a San Francisco-based company, was launched Nov. 30.
OpenAI CEO Sam Altman has admitted the program has certain weaknesses that can sometimes be overshadowed by the excitement for the new technology.
"You kind of have this very impressive, 'Wow, this is incredible and ready to go' [reaction]," Altman said of the technology ChatGPT utilizes, according to Fortune. "But you see it a hundred times, and you see the weaknesses."
TND reached out to OpenAI for comment, but did not immediately hear back. If a response is received, this story will be updated.