AI Summarization of Long Text w/ LangChain (Bypass Max Tokens)

In today's tutorial, we highlight a unique technique for summarizing large text documents using Python, LangChain, and Vertex AI's PaLM LLM. Specifically, we leverage a recursive method to process and summarize manageable chunks of text that abide by input token limits for our Large Language Models (LLM).

Demonstration Code and Diagram: https://github.com/nodematiclabs/long...

Free Trial - Our New Diagram Tool: https://softwaresim.com/pricing/ ("YOUTUBE24" for 25% Off)

If you are a cloud, machine learning, or software engineer you’ll probably find our wide range of YouTube tutorials, demonstrations, and walkthroughs useful - please consider subscribing to support the channel.

0:00 Conceptual Overview
2:18 Vertex AI APIs
2:39 LangChain (Python) Code
5:21 Summarization