Generic Functionality

The examples here all address certain “how-to” guides for working with LLMs.

LLM Serialization: A walkthrough of how to serialize LLMs to and from disk.

LLM Caching: Covers different types of caches, and how to use a cache to save results of LLM calls.

Custom LLM: How to create and use a custom LLM class, in case you have an LLM not from one of the standard providers (including one that you host yourself).

Token Usage Tracking: How to track the token usage of various chains/agents/LLM calls.

Fake LLM: How to create and use a fake LLM for testing and debugging purposes.