Document Loaders

Combining language models with your own text data is a powerful way to differentiate them. The first step in doing this is to load the data into “documents” - a fancy way of say some pieces of text. This module is aimed at making this easy.

A primary driver of a lot of this is the Unstructured python package. This package is a great way to transform all types of files - text, powerpoint, images, html, pdf, etc - into text data.

For detailed instructions on how to get set up with Unstructured, see installation guidelines here.

The following sections of documentation are provided:

• Key Concepts: A conceptual guide going over the various concepts related to loading documents.

• How-To Guides: A collection of how-to guides. These highlight different types of loaders.