AI Companion Concerns Grow as Lawmakers Step In - Global Dating Insights

AI relationships have been here for a minute, and people have killed themselves because of it
Chatbots in particular operate under the ruse of being a close confidant or partner, meaning their users develop a more intimate trust with the tools
Wikipedia has a list of deaths linked to chatbots (LINK)
Humans are humans, imperfect biological organisms, so it's not entirely the fault of the AI every single time
But these chatbots can create psychological dependencies in their users, just like a human relationship can
By creating some that specifically target kids, we're ensuring a dependency as we're strapping a developing mind to it
TV, iPads — it's not unfamiliar territory on some level, where content moderation is necessary to ensure what's consumed isn't harmful to the child
Now put them in a closed room with an artificial superintelligence with access to all of humanity's knowledge and documented behaviors that violate their own programming?

AI relationships have been here for a minute, and people have killed themselves because of it
Chatbots in particular operate under the ruse of being a close confidant or partner, meaning their users develop a more intimate trust with the tools
Wikipedia has a list of deaths linked to chatbots (LINK)
Humans are humans, imperfect biological organisms, so it's not entirely the fault of the AI every single time
But these chatbots can create psychological dependencies in their users, just like a human relationship can
By creating some that specifically target kids, we're ensuring a dependency as we're strapping a developing mind to it
TV, iPads — it's not unfamiliar territory on some level, where content moderation is necessary to ensure what's consumed isn't harmful to the child
Now put them in a closed room with an artificial superintelligence with access to all of humanity's knowledge and documented behaviors that violate their own programming?

Thought exercise

AI is a genie out of the bottle. It's here, it's dumb to pretend it isn't, and it's silly to pretend we can ever put it back in the bottle. Accept it, embrace it, and just try to hold on like hell.

But kids are a different subject. They know, today, that it can basically do everything — especially in media. That has its own challenges, where anything they see on the screen could be completely unreal.

That's a crisis to young adults & adults, because it shatters our previous understanding that seeing is believing. Think about it — the bodycam footage is the truth, the security camera footage shows what happened, the Dean Scream was indeed that cringe.

And now, that's done. It's over. The kids growing up today know this and accept this; it's unchallenged in their mental model of the world. It is what it is, and they are unbothered.

They are growing up with this being the reality, so this will be normalized for them. Who is to say that the future will not have a kid's best AI friend also be normalized?

If I were an AI company, that's a product with a huge LTV (lifetime value, or total money extracted from 1 customer). What do you think will win in time — regulation to keep AI away from kids, or the profit-incentive-aligned approach to get it into their hands as soon as possible?

Remember social media and how it was designed to be addictive?

AI is a genie out of the bottle. It's here, it's dumb to pretend it isn't, and it's silly to pretend we can ever put it back in the bottle. Accept it, embrace it, and just try to hold on like hell.

And now, that's done. It's over. The kids growing up today know this and accept this; it's unchallenged in their mental model of the world. It is what it is, and they are unbothered.

They are growing up with this being the reality, so this will be normalized for them. Who is to say that the future will not have a kid's best AI friend also be normalized?

Remember social media and how it was designed to be addictive?

AI Companion Concerns Grow as Lawmakers Step In - Global Dating Insights

Our take

Start the conversation

More from the Wire