CoNLLULoader#
- class langchain_community.document_loaders.conllu.CoNLLULoader(file_path: str | Path)[source]#
Load CoNLL-U files.
Initialize with a file path.
Methods
__init__
(file_path)Initialize with a file path.
A lazy loader for Documents.
aload
()Load data into Document objects.
A lazy loader for Documents.
load
()Load from a file path.
load_and_split
([text_splitter])Load Documents and split into chunks.
- Parameters:
file_path (str | Path)
- __init__(file_path: str | Path)[source]#
Initialize with a file path.
- Parameters:
file_path (str | Path)
- async alazy_load() AsyncIterator[Document] #
A lazy loader for Documents.
- Return type:
AsyncIterator[Document]
- load_and_split(text_splitter: TextSplitter | None = None) list[Document] #
Load Documents and split into chunks. Chunks are returned as Documents.
Do not override this method. It should be considered to be deprecated!
- Parameters:
text_splitter (Optional[TextSplitter]) – TextSplitter instance to use for splitting documents. Defaults to RecursiveCharacterTextSplitter.
- Returns:
List of Documents.
- Return type:
list[Document]
Examples using CoNLLULoader