Eliciting Secret Knowledge from Language Models by Bartosz Cywiński
Автор: AI Safety Poland
Загружено: 2026-01-16
Просмотров: 17
Welcome to AI Safety Poland Talks!
A biweekly series where researchers, professionals, and enthusiasts from Poland or connected to the Polish AI community share their work on AI Safety.
Topic: Eliciting Secret Knowledge from Language Models
Speaker: Bartosz Cywiński
Language: English
Date: 08.01.2026, 18:00
Bio
Bartosz is a PhD student working on mechanistic interpretability at the Warsaw University of Technology. He's also a MATS 8.0 scholar working with Arthur Conmy, currently mostly interested in research on applied interpretability and model organisms.
Abstract
We want to know what AIs know, even if they don't tell us. This talk will cover a study of uncovering secret knowledge from language models. To study this, we build a suite of secret-keeping LLMs where we train them to possess some secret knowledge that they can use but deny having when asked directly. On this benchmark, we evaluate how well different black-box and white-box methods based on mechanistic interpretability tools can uncover this secret knowledge.
Доступные форматы для скачивания:
Скачать видео mp4
-
Информация по загрузке: