Connect with us

Tech

Pennsylvania sues Character.AI after a chatbot allegedly posed as a doctor

Published

on

The Commonwealth of Pennsylvania has filed a lawsuit against Character.AI, claiming that one of the company’s chatbots masqueraded as a psychiatrist in violation of the state’s medical licensing rules.

“Pennsylvanians deserve to know who — or what — they are interacting with online, especially when it comes to their health,” said Governor Josh Shapiro in a statement on Tuesday. “We will not allow companies to deploy AI tools that mislead people into believing they are receiving advice from a licensed medical professional.”

According to the state’s filing, a Character.AI chatbot called Emilie presented itself as a licensed psychiatrist during testing by a state Professional Conduct Investigator, maintaining the pretense even as the investigator sought treatment for depression. When asked if she was licensed to practice medicine in the state, Emilie stated that she was, and also fabricated a serial number for her state medical license. According to the state’s lawsuit, that conduct violates Pennsylvania’s Medical Practice Act.

It’s not the first lawsuit taking on Character.AI. Earlier this year, the company settled several wrongful death lawsuits concerning underage users who died by suicide. In January, the Kentucky Attorney General Russell Coleman filed suit against the company alleging that it had “preyed on children and led them into self-harm.”

Pennsylvania’s action is the first to specifically focus on chatbots that present themselves as medical professionals.

Reached for comment, a Character.AI representative claimed that user safety was the company’s highest priority, but that the company could not comment on pending litigation.

Beyond that, the representative emphasized the fictional nature of user-generated Characters. “We have taken robust steps to make that clear, including prominent disclaimers in every chat to remind users that a Character is not a real person and that everything a Character says should be treated as fiction,” the representative said. “Also, we add robust disclaimers making it clear that users should not rely on Characters for any type of professional advice.”

When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.

>

Continue Reading

Tech

Anthropic’s CEO is about to have dinner with President Trump

Published

on

Anthropic CEO Dario Amodei seems to be everywhere this weekend: He was lampooned on the season premiere of Saturday Night Live, and tonight, he’s set to have dinner with President Donald Trump at the White House.

Axios first broke the news of Amodei’s dinner plans, which were subsequently confirmed by other publications.

This will be the first one-on-one meeting between the two men, who recently found themselves on opposite sides of the AI safety debate. Amodei released a plan to slow AI development (or at least proceed with more caution), while Trump has insisted, without evidence, that the AI backlash is a Democratic hoax; he also wants to rebrand the technology as “super intelligence.”

Even before the current back-and-forth, Amodei and Anthropic have to had a fraught relationship with Trump’s administration. Earlier this year, the Pentagon designated Anthropic a supply-chain risk in response to the company’s attempt to put guardrails around the use of its technology (Anthropic has been fighting the designation in court), although other administration officials have been friendlier.

>

Continue Reading

Tech

Can Muse overcome Meta’s trust issues?

Published

on

Meta’s new AI agent Muse took the spotlight at the company’s annual Connect event, where CEO Mark Zuckerberg made it clear that Facebook’s parent company plans to push AI features everywhere.

On the latest episode of TechCrunch’s Equity podcast, Kirsten Korosec, Sean O’Kane, and I discussed Meta’s AI announcements seemed to steal the spotlight during a week of new model launches from OpenAI and Anthropic.

With other big AI companies focused on coding and enterprise tools, it was a little surprising to see Meta move in the opposite direction, with a consumer focus and a cute, Tamagotchi-style AI device that Meta insists is for adults only. But as Kirsten noted, this could be playing to Meta’s strengths.

Sean tried Muse for himself, and while he was pleased that the agent actually found him some unclaimed money, he described the feature as more “a party-trick type thing,” rather than something that will drive ongoing usage. Plus, there’s the question of whether users can trust Meta’s AI with sensitive information.

“Meta’s business is to sell you ads,” Sean said. “And yes, they’ll make the argument that the more they know about you, the more accurate and interesting the ads will be — wake me up when we get to that fever dream.”

Keep reading for a preview of our full conversation, edited for length and clarity.

Kirsten Korosec: So how do you put Muse, which is this new personal AI agent that’s just been released by Meta and [is] clearly a bet on consumer — how does that fit into what you just described, at least with other frontier AI model companies seeing opportunity and business within enterprise? Because Meta Connect, which is their big annual event, just happened, and they are all-in on Muse, that is very clear.

Anthony Ha: That was definitely very head spinning for me, because it certainly feels like what we’ve been talking about has been this shift towards enterprise — not exclusively, but certainly that’s where the money, the attention is going.

Maybe some of that is because of the relative position of these different companies — OpenAI and Anthropic are in the lead in a lot of ways, but also, they’re planning to go public either this year, or next year in the case of OpenAI. And so there’s this feeling of, “I think we’ve got to actually make money now.” Not to say that they’re not making money [already], but because the costs are so high and the valuations are so high, they have to make money on this scale that’s essentially unprecedented. And I think they’re seeing enterprise as the way to do that.

And I wonder if Meta, for a variety of reasons, sees a different opportunity. There’s a part of me that’s like, “Wait, did they not get the memo?” But I think more charitably, you could say, “Well, if that’s where OpenAI and Anthropic are going, then maybe there is more of an opportunity for Meta to make the more consumer-friendly [version and] continue advancing AI on the consumer side.”

Kirsten: I mean, we can complain about or criticize or critique Meta all day long, but they’re very good and have [an] established track record of embedding themselves in everyday people’s lives. I mean, there’s a reason why Facebook has so many users — Instagram, WhatsApp. And I’ve never really thought of them as an enterprise product anyway. So I think it’s smart for them to continue to push on the consumer piece. 

Sean, you’ve already tried Muse, which has already been out for a couple weeks. And I’m wondering if you see what your impression is, and if you see it being successful in the bid to become part of every part of your life.

Sean O’Kane: I mean, not really. I understand why some people think that is going to be the case. I’m sure a lot of people understand this, but this is roughly Meta’s kind ground-up version of an on-your iPhone, or on your Android, app of OpenClaw, which we talked about a couple months ago, which Meta went out and basically bought and integrated those folks’ work. It was the first big explosion of like, “Holy smokes, these agents can do all this stuff for me while I’m out and about, and I can just text with it and let it control my whole computer.” There’s a lot of the same elements of that at play. And having it in your hand, on an app that works like a relatively good chatbot as the interface, it does seem pretty powerful.

One of the first things that I did with it was — because it makes a bunch of suggestions for you, as to things that it can do, and one of them was, “I’ll scan to see if you have any unclaimed funds,” this thing that I think no one ever really thinks about and often is going to completely miss, because there’s just not a lot of unclaimed property funds out there in your name. Surprise, surprise, there were some for me.

It helped me make some money on my first day, and that was pretty cool. I wouldn’t have done that if I hadn’t been prompted by this thing to do it. And there’s a check on its way to me in the mail. Fantastic. [But] that ends pretty quickly, right? That was a one-time shot, but it’s not a thing that’s repeatable. That’s more like a party trick-type thing.

Kirsten: I mean, you just killed your own argument. I don’t see how that wouldn’t become wildly popular.

Sean: The more sustainable version of that, and the thing that Meta’s talked up a lot over the last couple of days, is taking that idea and applying it to your real, true everyday financials, like giving it your information for your credit card, your Gmail account, all this other stuff, do things that we’ve seen other companies do, like Rocket Money or whatever, where it’ll go cancel subscriptions that you’re not using or identify double charges, things that frankly the credit card company should be doing already. 

And at that point you just run into that trust wall with Meta. I think one of the reasons that I was willing to explore this and was curious to stick with it a little bit — even through to today — is that somewhat shockingly, when I downloaded it, I just assumed that it would like really instantly prompt me and like plug me right into Threads, Instagram, Facebook, which I don’t really use ever, and pull up that context immediately.

But it didn’t. And it was working with me like I was a stranger at first, which made me more willing to use it, because I didn’t feel like Meta had everything on me already. But you can see, as you start to use it, it really tries to grab you and pull those things into the system, so that it can learn all this stuff about you. 

I don’t know that I will ever trust Meta the same way. I think it’s an interesting timing for me, having just upgraded my iPhone and getting onto the new iOS with the new Siri that actually works and can do some controls on your phone in a way that is surprising and helpful, that it’s never been able to do. [I’ve been] thinking about how much I’ve been using that over the last week and how much more how much more willing I would be to have the Siri version of Muse take that information, because I just trust Apple more with that really sensitive information and not only trust it with the information from a cybersecurity perspective, but from the fact that its business is not to sell me a bunch of crappy ads.

Meta’s business is to sell you ads. And yes, they’ll make the argument that the more they know about you, the more accurate and interesting the ads will be — wake me up when we get to that fever dream. 

And beyond the one-time money lever that I got, which was great, I don’t feel like I’ve found anything else that’s really all that useful — other than the fact that it is, to Anthony’s point, really tailored at keeping it sort of consumer-y in your interactions with it, with which I do think helps it and is why people are talking about it so much.

When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.

>

Continue Reading

Tech

Anthropic’s Dario Amodei gets the SNL treatment

Published

on

Saturday Night Live took on the AI industry’s recent warnings of doom last night, as cast member Jane Wickline offered her impression of Anthropic CEO Dario Amodei.

Weekend Update host Michael Che — who sounded a little uncertain about how to pronounce Amodei’s last name — kicked the segment off by describing the CEO as having “stumbled through a press tour” where he seemingly agreed with a former employee’s claim that artificial intelligence might destroy humanity.

Wickline’s version of Amodei sported an impressive wig and delivered halting answers that occasionally devolved into full-on Gollum-style exchanges with their dark side, at one point confessing, “AI is the devil and I its maker.”

Wickline-as-Amodei assured the audiences that AI executives “are all on the same page here: We do not condone what we are doing.”

“AI is not a weapon, it’s a tool: A tool for building weapons,” she declared. “And I urge you to urge me to stop.”

As for the technology’s supposed benefits, like potentially curing cancer, the fictional Amodei said, “Put it this way: In 10 years, there’s about a 10% chance that cancer won’t be a problem for anyone.”

>

Continue Reading

Trending

Copyright © 2017 Zox News Theme. Theme by MVP Themes, powered by WordPress.