Your NVIDIA GPU can power a free ChatGPT (Chat with RTX)

Chat with RTX is a ChatGPT-style application that uses Retrieval Augmented Generation (RAG) to allow you to chat with your own data on your own local NVIDIA GPU/PC.

Links mentioned:
Download Chat with RTX - https://www.nvidia.com/en-au/ai-on-rt...
NVIDIA RAG blog post - https://developer.nvidia.com/blog/rag...
My RAG tutorial (code from scratch) -    • Local Retrieval Augmented Generation (RAG)...  

Sign up to NVIDIA GTC 2024 - https://nvda.ws/3GUZygQ

PDF links:
Attention is all you need paper - https://arxiv.org/abs/1706.03762
Embeddings paper - https://vickiboykis.com/what_are_embe...
Math for ML book - https://mml-book.github.io/book/mml-b...
Charlie Walks (my novel) - https://www.charliewalks.com
Nutrition Textbook - https://pressbooks.oer.hawaii.edu/hum...

Other links:
Download Nutrify (my startup) - https://nutrify.app
Learn AI/ML (beginner-friendly course) - https://dbourke.link/ZTMMLcourse
Learn TensorFlow - https://dbourke.link/ZTMTFcourse
Learn PyTorch - https://dbourke.link/ZTMPyTorch
AI/ML courses/books I recommend - https://www.mrdbourke.com/ml-resources/
Read my novel Charlie Walks - https://www.charliewalks.com

Connect elsewhere:
Web - https://dbourke.link/web
X/Twitter -   / mrdbourke  
Twitch -   / mrdbourke  
ArXiv channel (past streams) - https://dbourke.link/archive-channel
Get email updates on my work - https://dbourke.link/newsletter

Timestamps:
0:00 - Intro
0:17 - Chat with RTX requirements
054 - What is Chat with RTX?
1:51 - Downloading Chat with RTX
2:06 - Installing Chat with RTX
2:09 - Make sure to upgrade your NVIDIA Graphics Driver
2:41 - Chat with RTX setup steps
3:04 - What are INT4 models?
3:25 - Opening Chat with RTX
3:48 - Chat with RTX running in the browser
4:33 - Allowing Chat with RTX to work with your own custom data
5:11 - Turning your own custom data into embeddings
6:43 - Question 1: What are embeddings?
7:18 - Question 2: What is the attention mechanism?
7:51 - Question 3: What is matrix multiplication?
8:31 - Question 4: What is Charlie's secret project? (asking a novel)
9:06 - Question 5: What are the macronutrients? And their functions?
10:07 - Outro/NVIDIA GTC

#AI #NVIDIA #GTC24