BaseDataFrameLoader#
- class langchain_community.document_loaders.dataframe.BaseDataFrameLoader(data_frame: Any, *, page_content_column: str = 'text')[source]#
Initialize with dataframe object.
- Parameters:
data_frame (Any) β DataFrame object.
page_content_column (str) β Name of the column containing the page content. Defaults to βtextβ.
Methods
__init__
(data_frame,Β *[,Β page_content_column])Initialize with dataframe object.
A lazy loader for Documents.
aload
()Load data into Document objects.
Lazy load records from dataframe.
load
()Load data into Document objects.
load_and_split
([text_splitter])Load Documents and split into chunks.
- __init__(data_frame: Any, *, page_content_column: str = 'text')[source]#
Initialize with dataframe object.
- Parameters:
data_frame (Any) β DataFrame object.
page_content_column (str) β Name of the column containing the page content. Defaults to βtextβ.
- async alazy_load() AsyncIterator[Document] #
A lazy loader for Documents.
- Return type:
AsyncIterator[Document]
- lazy_load() Iterator[Document] [source]#
Lazy load records from dataframe.
- Return type:
Iterator[Document]
- load_and_split(text_splitter: TextSplitter | None = None) List[Document] #
Load Documents and split into chunks. Chunks are returned as Documents.
Do not override this method. It should be considered to be deprecated!
- Parameters:
text_splitter (Optional[TextSplitter]) β TextSplitter instance to use for splitting documents. Defaults to RecursiveCharacterTextSplitter.
- Returns:
List of Documents.
- Return type:
List[Document]