langchain_community.document_loaders.lakefs
.UnstructuredLakeFSLoader¶
- class langchain_community.document_loaders.lakefs.UnstructuredLakeFSLoader(url: str, repo: str, ref: str = 'main', path: str = '', presign: bool = True, **unstructured_kwargs: Any)[source]¶
Load from lakeFS as unstructured data.
Initialize UnstructuredLakeFSLoader.
Args:
- Parameters
lakefs_access_key –
lakefs_secret_key –
lakefs_endpoint –
repo –
ref –
Methods
__init__
(url, repo[, ref, path, presign])Initialize UnstructuredLakeFSLoader.
A lazy loader for Documents.
load
()Load file.
load_and_split
([text_splitter])Load Documents and split into chunks.
- __init__(url: str, repo: str, ref: str = 'main', path: str = '', presign: bool = True, **unstructured_kwargs: Any)[source]¶
Initialize UnstructuredLakeFSLoader.
Args:
- Parameters
lakefs_access_key –
lakefs_secret_key –
lakefs_endpoint –
repo –
ref –
- load_and_split(text_splitter: Optional[TextSplitter] = None) List[Document] ¶
Load Documents and split into chunks. Chunks are returned as Documents.
- Parameters
text_splitter – TextSplitter instance to use for splitting documents. Defaults to RecursiveCharacterTextSplitter.
- Returns
List of Documents.