Streaming is an important part of most LLM apps. Both streaming of individual tokens, as well as streaming of events that happen along the way.
We recently introduced `stream_events` - a new method to make this as easy possible. This video goes over how to use that method, as well as how to best use traditional streaming methods.
This has a particular focus on agents.
General streaming docs: https://python.langchain.com/docs/expression_language/streaming
Agent Executor streaming: https://python.langchain.com/docs/modules/agents/how_to/streaming
LangGraph streaming: https://github.com/langchain-ai/langgraph/blob/main/examples/streaming-tokens.ipynb
Download
0 formats
No download links available.
Streaming Events: Introducing a new `stream_events` method | NatokHD