In this episode, we introduce large language in healthcare, their potentials and pitfalls. We put AI chatbots like chatGPT to the test, discuss our thoughts on google's Med-PaLM, and dabble in a bit of philosophy of artificial general intelligence.
Dev&Doc is a podcast where doctors and developers deep dive into the potential of AI in healthcare.
👨🏻⚕️Doc - Dr. Joshua Au Yeung - / dr-joshua-auyeung
🤖Dev - Zeljko Kraljevic / zeljkokr
Timestamps:
00:00 Start
00:16 Intro
02:04 ChatGPT, A giant leap for mankind?
04:02 Spending two weeks with ChatGPT as a doctor
07:36 History of Large Language Models (LLMs)
10:15 A top down approach to what is an LLM
17:31 Medical language is a language in itself
18:42 A lot of data, that is just wrong
21:05 self-supervised training LLM
22:05 instruction based fine tuning a LLM
23:52 Doc summarising LLM training
25:48 the clinical shortcomings of instruction based tuning
27:33 Reinforcement learning from Human (clinician) feedback
32:22 Doc summarising LLM , RLHF - A strict vs a progressive parent
34:10 There are still many problems with LLMs, aligning with clinical training data
36:26 Training a LLM on discharge summaries is a bad idea
39:18 garbage in garbage out - data
40:13 context windows
40:43 data cleaning clinical notes
44:31 Bias in scientific domain LLMs PubmedGPT, Galatica
46:31 Data drift in medicine and continual learning
50:01 MedPaLM - instruction tuning to the medical domain
50:23 model benchmarks do not reflect the real world
59:11 LLM emulating human language, but not the brain. Only one piece of the mind
1:01:10 LLMs on headaches and general knowledge
1:03:25 Where does a LLM fit in into the clinical work flow
1:05:50 Are regulations working against safety?
1:08:26 Cooling down LLMs to pass regulations
1:09:50 Why call it a hallucination? It's a false positive
1:13:57 Examples of bias of ChatGPT - A bad santa claus
1:17:00 do LLMs encode true "understanding" ? Can language lead to AGI?
1:20:05 Pregnancy - an acid test for Large Language Models.
1:21:55 training a LLM for the NHS (NHS-LLM)
1:25:25 Tell the model to "think deeply"
1:27:55 Asking ChatGPT to draw a picture of a human O.O
1:31:00 Language is not enough to achieve AGI
1:32:10 what can clinicians do about LLMs? Assisting vs Autonomous
1:39:07 What's next- Forecasting diagnoses with AI
🎞️ Editor-
Dragan Kraljević / dragan_kraljevic
🎨Brand design and art direction -
Ana Grigorovici
https://www.behance.net/anagrigorovic...
Поделиться в:
Доступные форматы для скачивания:
Скачать видео mp4
Информация по загрузке:
Скачать аудио mp3
Похожие видео
array(19) {
["HUkBz-cdB-k"]=>
object(stdClass)#12306 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(11) "HUkBz-cdB-k"
["related_video_title"]=>
string(158) "Теренс Тао: Сложнейшие задачи математики, физики и будущее ИИ | Лекс Фридман Подкаст #472"
["posted_time"]=>
string(27) "5 месяцев назад"
["channelName"]=>
NULL
}
["wjZofJX0v4M"]=>
object(stdClass)#12316 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(11) "wjZofJX0v4M"
["related_video_title"]=>
string(148) "LLM и GPT - как работают большие языковые модели? Визуальное введение в трансформеры"
["posted_time"]=>
string(19) "1 год назад"
["channelName"]=>
NULL
}
["wp7izqZmiWM"]=>
object(stdClass)#12307 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(11) "wp7izqZmiWM"
["related_video_title"]=>
string(130) "«Open AI — это пузырь»! Откровения из Кремниевой долины | Братья Либерманы"
["posted_time"]=>
string(25) "2 недели назад"
["channelName"]=>
NULL
}
["TprZ-83fAiE"]=>
object(stdClass)#12285 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(11) "TprZ-83fAiE"
["related_video_title"]=>
string(150) "Нейробиолог: Как не отупеть к 50 годам. Связь слабоумия и привычек | Владимир Алипов"
["posted_time"]=>
string(19) "1 год назад"
["channelName"]=>
NULL
}
["EIjln5SKwxM"]=>
object(stdClass)#12299 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(11) "EIjln5SKwxM"
["related_video_title"]=>
string(66) "Как стать круче 99% людей с помощью ИИ"
["posted_time"]=>
string(25) "2 недели назад"
["channelName"]=>
NULL
}
["_doSjv_z9xI"]=>
object(stdClass)#12317 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(11) "_doSjv_z9xI"
["related_video_title"]=>
string(131) "«Очень не люблю двуличие» — Наталья Зубаревич об экономике и фатализме"
["posted_time"]=>
string(21) "1 день назад"
["channelName"]=>
NULL
}
["PLOspHqNVtKAAsiohuZj1Bt4XpA3_bkS3c"]=>
object(stdClass)#12296 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(34) "PLOspHqNVtKAAsiohuZj1Bt4XpA3_bkS3c"
["related_video_title"]=>
string(34) "Large Language Models and Chatbots"
["posted_time"]=>
string(0) ""
["channelName"]=>
NULL
}
["A7k088NtfDc"]=>
object(stdClass)#12313 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(11) "A7k088NtfDc"
["related_video_title"]=>
string(113) "США объявили о начале спецоперации / Военные начали вторжение"
["posted_time"]=>
string(23) "6 часов назад"
["channelName"]=>
NULL
}
["zDexGxVrBBM"]=>
object(stdClass)#12301 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(11) "zDexGxVrBBM"
["related_video_title"]=>
string(94) "Как общаться по-настоящему БЕЗОПАСНО | Первый отдел"
["posted_time"]=>
string(23) "1 месяц назад"
["channelName"]=>
NULL
}
["LPZh9BOjkQs"]=>
object(stdClass)#12304 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(11) "LPZh9BOjkQs"
["related_video_title"]=>
string(82) "Краткое объяснение больших языковых моделей"
["posted_time"]=>
string(28) "11 месяцев назад"
["channelName"]=>
NULL
}
["b88FZYNJdIk"]=>
object(stdClass)#12295 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(11) "b88FZYNJdIk"
["related_video_title"]=>
string(86) "Большие языковые модели для здравоохранения 101"
["posted_time"]=>
string(21) "2 года назад"
["channelName"]=>
NULL
}
["aircAruvnKk"]=>
object(stdClass)#12305 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(11) "aircAruvnKk"
["related_video_title"]=>
string(101) "Но что такое нейронная сеть? | Глава 1. Глубокое обучение"
["posted_time"]=>
string(19) "8 лет назад"
["channelName"]=>
NULL
}
["ukRF-iOHkeQ"]=>
object(stdClass)#12300 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(11) "ukRF-iOHkeQ"
["related_video_title"]=>
string(136) "Математическая тревожность, нейросети, задачи тысячелетия / Андрей Коняев"
["posted_time"]=>
string(25) "2 недели назад"
["channelName"]=>
NULL
}
["sn3od2MehJA"]=>
object(stdClass)#12297 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(11) "sn3od2MehJA"
["related_video_title"]=>
string(89) "Testing Deepseek R1 on Complex Medical Tasks. Here's what we found. (DPO, GRPO explainer)"
["posted_time"]=>
string(27) "9 месяцев назад"
["channelName"]=>
NULL
}
["IK8OwJhln5k"]=>
object(stdClass)#12298 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(11) "IK8OwJhln5k"
["related_video_title"]=>
string(112) "Бьёрн Страуструп: История языков программирования на заре С++"
["posted_time"]=>
string(21) "8 дней назад"
["channelName"]=>
NULL
}
["QI7oUwNrQ34"]=>
object(stdClass)#12286 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(11) "QI7oUwNrQ34"
["related_video_title"]=>
string(86) "Цепи Маркова — математика предсказаний [Veritasium]"
["posted_time"]=>
string(23) "1 месяц назад"
["channelName"]=>
NULL
}
["RHxuUQ58yjc"]=>
object(stdClass)#12287 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(11) "RHxuUQ58yjc"
["related_video_title"]=>
string(79) "ЭТИ АЛГОРИТМЫ СДЕЛАЮТ ИЗ ТЕБЯ ПРОГРАММИСТА"
["posted_time"]=>
string(25) "3 недели назад"
["channelName"]=>
NULL
}
["-HzgcbRXUK8"]=>
object(stdClass)#12293 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(11) "-HzgcbRXUK8"
["related_video_title"]=>
string(159) "Демис Хассабис: Будущее ИИ, симуляция реальности, физика, игры | Лекс Фридман Подкаст #475"
["posted_time"]=>
string(25) "3 месяца назад"
["channelName"]=>
NULL
}
["qdBCRE2zoe0"]=>
object(stdClass)#12294 (5) {
["video_id"]=>
int(9999999)
["related_video_id"]=>
string(11) "qdBCRE2zoe0"
["related_video_title"]=>
string(84) "9 Скрытых Фишек ChatGPT о которых никто не говорит"
["posted_time"]=>
string(25) "2 месяца назад"
["channelName"]=>
NULL
}
}