BaiduBOSDirectoryLoader#

class langchain_community.document_loaders.baiducloud_bos_directory.BaiduBOSDirectoryLoader(

conf: Any,

bucket: str,

prefix: str = '',

)[source]#

Load from Baidu BOS directory.

Initialize with BOS config, bucket and prefix. :param conf(BosConfig): BOS config. :param bucket(str): BOS bucket. :param prefix(str): prefix.

Methods

__init__(conf, bucket[, prefix])	Initialize with BOS config, bucket and prefix.
alazy_load()	A lazy loader for Documents.
aload()	Load data into Document objects.
lazy_load()	Load documents.
load()	Load data into Document objects.
load_and_split([text_splitter])	Load Documents and split into chunks.

Parameters:

• conf (Any)

• bucket (str)

• prefix (str)

__init__(

conf: Any,

bucket: str,

prefix: str = '',

)[source]#

Initialize with BOS config, bucket and prefix. :param conf(BosConfig): BOS config. :param bucket(str): BOS bucket. :param prefix(str): prefix.

Parameters:

• conf (Any)

• bucket (str)

• prefix (str)

async alazy_load() → AsyncIterator[Document]#

A lazy loader for Documents.

Return type:

AsyncIterator[Document]

async aload() → list[Document]#

Load data into Document objects.

Return type:

list[Document]

lazy_load() → Iterator[Document][source]#

Load documents.

Return type:

Iterator[Document]

load() → list[Document]#

Load data into Document objects.

Return type:

list[Document]

load_and_split(

text_splitter: TextSplitter | None = None,

) → list[Document]#

Load Documents and split into chunks. Chunks are returned as Documents.

Do not override this method. It should be considered to be deprecated!

Parameters:

text_splitter (Optional[TextSplitter]) – TextSplitter instance to use for splitting documents. Defaults to RecursiveCharacterTextSplitter.

Returns:

List of Documents.

Return type:

list[Document]