this post was submitted on 07 Mar 2024
486 points (97.5% liked)
Technology
74319 readers
3087 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
How about taking advice on a medical matter from an LLM? Or asking the appropriate thing to do in a survival situation? Or even seemingly mundane questions like "is it safe to use this [brand name of new model of generator that isn't in the LLM's training data] indoors?" Wrong answers to those questions can kill. If a person thinks the LLM is intelligent, they're more likely to take the bad advice at face value.
If you ask a human about something important that's outside their area of competence, they'll probably refer you to someone they think is knowledgeable. An LLM will happily make something up instead, because it doesn't understand the stakes.
The chance of any given query to an LLM killing someone is, admittedly, extremely low, but given a sufficiently large number of queries, it will happen sooner or later.
Insurance companies are already using AI to make medical decisions. We don't have to speculate about people getting hurt because of AI giving out bad medical advice, it's already happening and multiple companies are being sued over it.
Somehow we went from me saying this technology shouldn't be downplayed to "but it's costing lives already!"
Not really sure how that happened but yeah it's obviously shitty that people are irresponsible shitheads and I think downplaying it or quibbling about whether it's actually AI or not is far from helpful in light of such consequences