@cleoabram: A new study tested AI models vs eye doctors. Here's who won... There were 4 groups: Large language models, groups of expert eye doctors, eye doctors in training, and unspecialized junior doctors. Everyone had to answer 87 questions from a standard test that doctors in the UK need to pass before becoming an eye specialist. Here's how they each did… The intention of this study is NOT to see if any AI tool can replace any doctors. This study just showed that in this one test, one model’s performance was almost as good as experts. We could imagine a world where more generalized doctors who don’t have easy access to a specialist could ask an AI for a second opinion or help make a referral or even help with a diagnosis. It’s one way researchers are exploring how to improve medical care for more people. If you like optimistic science and tech stories, subscribe for more of our show Huge If True. If you want to read the full study, search this: DOI:10.1371/journal.pdig.0000341 #science #sciencefacts #education #study

Cleo Abram
Cleo Abram
Open In TikTok:
Region: US
Friday 31 May 2024 15:47:14 GMT
111263
7751
75
242

Music

Download

Comments

septemberpiano
septemberpiano :
Problem is when it gets things wrong, it get them REALLY wrong. And tends to be unable to correct itself.
2024-06-01 07:52:45
239
safsart
Saf, the Artist :
Is Jennifer Garner your doppelgänger?
2024-06-02 04:06:20
47
exstra
exstraняшка [она/её] :
what AI parameters were used? or did they just use the chat.openai thingy?
2024-08-24 17:06:36
0
thingsrandom987
randomthings :
cool
2024-06-17 05:53:57
10
oshanshan248
oshanshan248 :
for both humans and AI/ML, we still gotta question the internal validity. how well do these tests match doctor performance in practice in the real world?
2024-06-05 21:01:06
25
joshnagel27
Josh Nagel :
this is incredible (early-stage) news! GPT is showing that it's a front runner when it comes to being a tool for more everyday and (potentially) every industry.
2024-05-31 15:59:13
55
imnottellingyou123
I'm not telling you :
Doctors, apart from surgeons, mostly need to just recall information and put pieces together. This is something LLMs would be perfect at. And could lower the amount of medical mistakes.
2024-06-01 12:47:17
16
aaaaaghsh
AAAAAGHSH :
basically it's not a very good test
2024-07-30 10:08:51
0
leonthebleh
Leonthebleh :
Large language models will do that. Some of those terms are rather specific. So it would make sense that gpt4 would have come across something about the subjects. I think machine learning on imaging 1
2024-05-31 17:10:40
31
walterdavis09
Walter Davis :
I am worried about AI and not understanding nuance and exceptions to the rule
2024-05-31 23:05:05
21
natvanvan403
natvanvan403 :
Actual practice (of any profession) is completely different than a silly rote-memorized exam. We need to stop conflating the two.
2024-06-01 21:44:06
3
android_ma
Andy Ma :
Why does the graph show Llama and Palm2 when the latest models are Llama3 and Gemini 1.5? And no Claude3? Is this an old study?
2024-05-31 23:35:35
13
huffer79
Bill Huff :
Thank you. 😎
2024-06-01 18:37:08
0
lux.evilian
Lux Evilian :
again, nice
2024-05-31 19:48:07
0
caylecroddy
Cayle :
I think this is great actually! AI finally having positive usage rather than just feeling like it’s screwing over the artists/writers, but that’s also a different discussion, lol.
2024-05-31 17:08:03
0
skibrdsk8
Ski_Sk8_Brd :
Last year I tried out ChatGPT and asked how to do a salchow figure skating jump. It gave an incorrect answer 4 times. 1st answer wrong, 2-4 wrong after being told previous answer was incorrect.
2024-06-02 04:15:03
2
user5248846698816
Andre :
As an engineer, I use the information from AI models extensively. One prerequisite is that one should approximately know the answer to determine the likely accuracy of the AI model.
2024-06-18 15:52:19
0
lostguyin1914
⚔ :
now imgn if they trained an ai on only doctor related things so it hallucinations are less
2024-06-01 13:41:39
1
craiguntlnyttym
Craig Penfold 🏴󠁧󠁢󠁳󠁣󠁴󠁿 :
scary
2024-06-02 16:36:40
0
acker921
Acker ༽ :
first
2024-05-31 15:53:01
0
mattbdev
mattbdev :
I think that a small language model may be better suited to specialize and help doctors.
2024-05-31 22:28:15
1
melissalem929
melissalem929 :
🥰🥰🥰
2024-07-12 21:16:07
3
xxxlisaxxxx
lisaxxxxxxxxxx :
@Cleo Abram take @ashley with u next time u go discover nasa or any science stuff she's so funny 😂
2024-06-03 02:34:00
0
waasiciye
W :
💚💚💚
2024-05-31 18:07:44
0
To see more videos from user @cleoabram, please go to the Tikwm homepage.

Other Videos


About