langchain_community.document_loaders.baiducloud_bos_directory
.BaiduBOSDirectoryLoader¶
- class langchain_community.document_loaders.baiducloud_bos_directory.BaiduBOSDirectoryLoader(conf: Any, bucket: str, prefix: str = '')[source]¶
Load from Baidu BOS directory.
Initialize with BOS config, bucket and prefix. :param conf(BosConfig): BOS config. :param bucket(str): BOS bucket. :param prefix(str): prefix.
Methods
__init__
(conf, bucket[, prefix])Initialize with BOS config, bucket and prefix.
A lazy loader for Documents.
Load documents.
load
()Load data into Document objects.
load_and_split
([text_splitter])Load Documents and split into chunks.
- Parameters
conf (Any) –
bucket (str) –
prefix (str) –
- __init__(conf: Any, bucket: str, prefix: str = '')[source]¶
Initialize with BOS config, bucket and prefix. :param conf(BosConfig): BOS config. :param bucket(str): BOS bucket. :param prefix(str): prefix.
- Parameters
conf (Any) –
bucket (str) –
prefix (str) –
- async alazy_load() AsyncIterator[Document] ¶
A lazy loader for Documents.
- Return type
AsyncIterator[Document]
- load_and_split(text_splitter: Optional[TextSplitter] = None) List[Document] ¶
Load Documents and split into chunks. Chunks are returned as Documents.
Do not override this method. It should be considered to be deprecated!
- Parameters
text_splitter (Optional[TextSplitter]) – TextSplitter instance to use for splitting documents. Defaults to RecursiveCharacterTextSplitter.
- Returns
List of Documents.
- Return type
List[Document]