Growing neural cellular automata in PyTorch

In this video, I implement the Growing Neural Cellular Automata article. It is a biologically inspired deep learning pipeline that generates update rules that are applied to a grid of pixels. It uses heavily the convolution operation together with multiple other techniques - alive masking and stochastic update.

Implementation from the video: https://github.com/jankrepl/mildlyove...
Original article: https://distill.pub/2020/growing-ca
Youtube tutorial by the author:    • Neural CA from scratch  
Existing PyTorch implementation: https://github.com/chenmingxiang110/G...

00:00 Intro + resources
01:10 Motivation and setup: Game of life
04:12 Learning rules using convolutions
06:04 Article: proposed pipeline
08:35 Model: constructor
11:35 1x1 convolution explained
13:29 Model: constructor continued
14:29 Model: helper methods
17:22 Model: forward pass
18:43 Training script
24:52 Launch training
25:20 Results
25:44 What was not covered
26:01 Outro

If you have any video suggestions or you just wanna chat feel free to join the discord server:   / discord  

Twitter:   / moverfitted  

Credits logo animation
Title: Conjungation · Author: Uncle Milk · Source:   / unclemilk   · License: https://creativecommons.org/licenses/... · Download (9MB): https://auboutdufil.com/?id=600