Популярное

Музыка Кино и Анимация Автомобили Животные Спорт Путешествия Игры Юмор

Интересные видео

2025 Сериалы Трейлеры Новости Как сделать Видеоуроки Diy своими руками

Топ запросов

смотреть а4 schoolboy runaway турецкий сериал смотреть мультфильмы эдисон
dTub
Скачать

Rich Sutton, Toward a better Deep Learning

Автор: Amii

Загружено: 2024-09-29

Просмотров: 12398

Описание:

Artificial intelligence needs better deep learning methods because current algorithms fail in continual learning settings, losing plasticity, forgetting catastrophically, and collapsing in their RL policies. I seek a design for a new class of deep learning methods that are dynamic (changing) at three levels: 1) in their weights, 2) in their per-weight step-size parameters, and 3) in their pattern of interconnection. The first step is distinguishing between the part of the network that is important to its current functioning (the backbone) from the part that does not yet contribute to its functioning (the fringe). This short talk explores new ideas for finding, protecting, and slowly growing the backbone, and new ideas for creating features within the fringe through “imprinting”, “master units”, and “shadow weights”, together with advanced step-size optimization. These are the first steps toward achieving dynamic deep learning.

Rich Sutton, Toward a better Deep Learning

Поделиться в:

Доступные форматы для скачивания:

Скачать видео mp4

  • Информация по загрузке:

Скачать аудио mp3

Похожие видео

array(20) { ["gEbbGyNkR2U"]=> object(stdClass)#5638 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "gEbbGyNkR2U" ["related_video_title"]=> string(91) "Rich Sutton, The OaK Architecture: A Vision of SuperIntelligence from Experience - RLC 2025" ["posted_time"]=> string(25) "2 месяца назад" ["channelName"]=> NULL } ["NvfK1TkXmOQ"]=> object(stdClass)#5663 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "NvfK1TkXmOQ" ["related_video_title"]=> string(90) "Новый путь Рича Саттона к ИИ | Подкаст Approximately Correct" ["posted_time"]=> string(19) "1 год назад" ["channelName"]=> NULL } ["vwO2aDdie0g"]=> object(stdClass)#5639 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "vwO2aDdie0g" ["related_video_title"]=> string(71) "Tea Time Talks 2024: Shang Wang, Reinforcement Learning for Chip Design" ["posted_time"]=> string(19) "1 год назад" ["channelName"]=> NULL } ["75jr5E4OzEE"]=> object(stdClass)#5654 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "75jr5E4OzEE" ["related_video_title"]=> string(38) "Dynamic Deep Learning | Richard Sutton" ["posted_time"]=> string(19) "1 год назад" ["channelName"]=> NULL } ["5QcCeSsNRks"]=> object(stdClass)#5640 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "5QcCeSsNRks" ["related_video_title"]=> string(36) "François Chollet: How We Get To AGI" ["posted_time"]=> string(25) "4 месяца назад" ["channelName"]=> NULL } ["4MvhP2zKozI"]=> object(stdClass)#5658 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "4MvhP2zKozI" ["related_video_title"]=> string(116) "Основные теоремы в теории игр — Алексей Савватеев на ПостНауке" ["posted_time"]=> string(19) "5 лет назад" ["channelName"]=> NULL } ["SmZmBKc7Lrs"]=> object(stdClass)#5646 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "SmZmBKc7Lrs" ["related_video_title"]=> string(77) "Самый важный алгоритм в машинном обучении" ["posted_time"]=> string(19) "1 год назад" ["channelName"]=> NULL } ["He5vAYWtjsY"]=> object(stdClass)#5648 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "He5vAYWtjsY" ["related_video_title"]=> string(62) "Richard S. Sutton, Turing Award Winner | Approximately Correct" ["posted_time"]=> string(27) "7 месяцев назад" ["channelName"]=> NULL } ["qx7hirqgfuU"]=> object(stdClass)#5643 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "qx7hirqgfuU" ["related_video_title"]=> string(67) "Why Deep Learning Works Unreasonably Well [How Models Learn Part 3]" ["posted_time"]=> string(25) "3 месяца назад" ["channelName"]=> NULL } ["KJtZARuO3JY"]=> object(stdClass)#5661 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "KJtZARuO3JY" ["related_video_title"]=> string(70) "Visualizing transformers and attention | Talk for TNG Big Tech Day '24" ["posted_time"]=> string(28) "11 месяцев назад" ["channelName"]=> NULL } ["nuiUXT5UPw8"]=> object(stdClass)#5645 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "nuiUXT5UPw8" ["related_video_title"]=> string(97) "Australia's economy turns a corner, but faces headwinds from global trade war | Close of Business" ["posted_time"]=> string(27) "8 месяцев назад" ["channelName"]=> NULL } ["Hnt-oBA086U"]=> object(stdClass)#5655 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "Hnt-oBA086U" ["related_video_title"]=> string(94) "Value alignment? | Richard Sutton & Blaise Agüera y Arcas | Absolutely Interdisciplinary 2023" ["posted_time"]=> string(21) "2 года назад" ["channelName"]=> NULL } ["4feeUJnrrYg"]=> object(stdClass)#5641 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "4feeUJnrrYg" ["related_video_title"]=> string(25) "I Talked with Rich Sutton" ["posted_time"]=> string(19) "1 год назад" ["channelName"]=> NULL } ["yUmDRxV0krg"]=> object(stdClass)#5629 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "yUmDRxV0krg" ["related_video_title"]=> string(79) "Yann LeCun | Self-Supervised Learning, JEPA, World Models, and the future of AI" ["posted_time"]=> string(23) "1 месяц назад" ["channelName"]=> NULL } ["FLOL2f4iHKA"]=> object(stdClass)#5630 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "FLOL2f4iHKA" ["related_video_title"]=> string(78) "The Era of Experience & The Age of Design: Richard S. Sutton, Upper Bound 2025" ["posted_time"]=> string(25) "4 месяца назад" ["channelName"]=> NULL } ["_NLHFoVNlbg"]=> object(stdClass)#5636 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "_NLHFoVNlbg" ["related_video_title"]=> string(71) "Stanford CS230 | Autumn 2025 | Lecture 1: Introduction to Deep Learning" ["posted_time"]=> string(23) "1 месяц назад" ["channelName"]=> NULL } ["R8a6Tb2lYB0"]=> object(stdClass)#5637 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "R8a6Tb2lYB0" ["related_video_title"]=> string(97) "Леонард Сасскинд — Что такое бозон Хиггса? [Стэнфорд]" ["posted_time"]=> string(21) "4 года назад" ["channelName"]=> NULL } ["21EYKqUsPfg"]=> object(stdClass)#5635 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "21EYKqUsPfg" ["related_video_title"]=> string(58) "Richard Sutton – Father of RL thinks LLMs are a dead end" ["posted_time"]=> string(23) "1 месяц назад" ["channelName"]=> NULL } ["9_PepvnqIfU"]=> object(stdClass)#5633 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "9_PepvnqIfU" ["related_video_title"]=> string(162) "ЛАУРЕАТ ПРЕМИИ ТЬЮРИНГА Ричард С. Саттон беседует с Кэмом Линке | Нет авторитетов в науке" ["posted_time"]=> string(27) "8 месяцев назад" ["channelName"]=> NULL } ["aircAruvnKk"]=> object(stdClass)#5634 (5) { ["video_id"]=> int(9999999) ["related_video_id"]=> string(11) "aircAruvnKk" ["related_video_title"]=> string(101) "Но что такое нейронная сеть? | Глава 1. Глубокое обучение" ["posted_time"]=> string(19) "8 лет назад" ["channelName"]=> NULL } }
Rich Sutton, The OaK Architecture: A Vision of SuperIntelligence from Experience - RLC 2025

Rich Sutton, The OaK Architecture: A Vision of SuperIntelligence from Experience - RLC 2025

Новый путь Рича Саттона к ИИ | Подкаст Approximately Correct

Новый путь Рича Саттона к ИИ | Подкаст Approximately Correct

Tea Time Talks 2024: Shang Wang, Reinforcement Learning for Chip Design

Tea Time Talks 2024: Shang Wang, Reinforcement Learning for Chip Design

Dynamic Deep Learning | Richard Sutton

Dynamic Deep Learning | Richard Sutton

François Chollet: How We Get To AGI

François Chollet: How We Get To AGI

Основные теоремы в теории игр — Алексей Савватеев на ПостНауке

Основные теоремы в теории игр — Алексей Савватеев на ПостНауке

Самый важный алгоритм в машинном обучении

Самый важный алгоритм в машинном обучении

Richard S. Sutton, Turing Award Winner | Approximately Correct

Richard S. Sutton, Turing Award Winner | Approximately Correct

Why Deep Learning Works Unreasonably Well [How Models Learn Part 3]

Why Deep Learning Works Unreasonably Well [How Models Learn Part 3]

Visualizing transformers and attention | Talk for TNG Big Tech Day '24

Visualizing transformers and attention | Talk for TNG Big Tech Day '24

Australia's economy turns a corner, but faces headwinds from global trade war | Close of Business

Australia's economy turns a corner, but faces headwinds from global trade war | Close of Business

Value alignment? | Richard Sutton & Blaise Agüera y Arcas | Absolutely Interdisciplinary 2023

Value alignment? | Richard Sutton & Blaise Agüera y Arcas | Absolutely Interdisciplinary 2023

I Talked with Rich Sutton

I Talked with Rich Sutton

Yann LeCun | Self-Supervised Learning, JEPA, World Models, and the future of AI

Yann LeCun | Self-Supervised Learning, JEPA, World Models, and the future of AI

The Era of Experience & The Age of Design: Richard S. Sutton, Upper Bound 2025

The Era of Experience & The Age of Design: Richard S. Sutton, Upper Bound 2025

Stanford CS230 | Autumn 2025 | Lecture 1: Introduction to Deep Learning

Stanford CS230 | Autumn 2025 | Lecture 1: Introduction to Deep Learning

Леонард Сасскинд — Что такое бозон Хиггса? [Стэнфорд]

Леонард Сасскинд — Что такое бозон Хиггса? [Стэнфорд]

Richard Sutton – Father of RL thinks LLMs are a dead end

Richard Sutton – Father of RL thinks LLMs are a dead end

ЛАУРЕАТ ПРЕМИИ ТЬЮРИНГА Ричард С. Саттон беседует с Кэмом Линке | Нет авторитетов в науке

ЛАУРЕАТ ПРЕМИИ ТЬЮРИНГА Ричард С. Саттон беседует с Кэмом Линке | Нет авторитетов в науке

Но что такое нейронная сеть? | Глава 1. Глубокое обучение

Но что такое нейронная сеть? | Глава 1. Глубокое обучение

© 2025 dtub. Все права защищены.



  • Контакты
  • О нас
  • Политика конфиденциальности



Контакты для правообладателей: [email protected]