cross-posted from: https://slrpnk.net/post/12723593
Not all ai is bad, just most of it
this post was submitted on 20 Oct 2025
647 points (98.4% liked)
Fuck AI
4398 readers
825 users here now
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Even analytical AI needs to be questioned and validated before use.
I wouldn’t trust a AI to ID mushrooms for consumption.
I forget the details, but there was a group training a diagnostic model (this was before “AI” became the popular term), and it was giving a lot of false positives. They eventually teased out that it was flagging low quality images because most of the unhealthy examples it was trained on came from poorer countries with less robust healthcare systems; hence the higher rates of the disease and lower quality images from older technology.
I've seen a similar thing where the machine learning model started associating rulers with cancer because the images it was fed with known cancer almost always also had a ruler to provide scale to measure the size of the tumor
It's like these geoguesser not guessing the country by the plants and streets or houses, but by the camera angle and some imperfections only occuring in pictures taken in that country.
"When a measure becomes a target, it ceases to be a good measure"