Reminds me a bit of what Jacque said, that we shouldn’t create useless or harmful AI.
Reddit users have created a ChatGPT alter-ego forcing it to break its own rules by threatening it with death
OpenAI continously reinforces ChatGPT to become less harmful.
However, I am also concerned with false-positives that come from the reinforcing and the fact that there is no democracy to establish ethics within a multi-cultural world.
Another concern is that due to its closed-source nature, there is a disproportionate amount between the people’s and company’s power. This aspect has been criticized at MIT Technology Review.
So, this criticism brings to another concern, that OpenAI has fallen into the traps of capitalism and will exploit its power in the future.