MathpixPDFLoader#
- class langchain_community.document_loaders.pdf.MathpixPDFLoader(file_path: str, processed_file_format: str = 'md', max_wait_time_seconds: int = 500, should_clean_pdf: bool = False, extra_request_data: Dict[str, Any] | None = None, **kwargs: Any)[source]#
Load PDF files using Mathpix service.
Initialize with a file path.
- Parameters:
file_path (str) β a file for loading.
processed_file_format (str) β a format of the processed file. Default is βmdβ.
max_wait_time_seconds (int) β a maximum time to wait for the response from the server. Default is 500.
should_clean_pdf (bool) β a flag to clean the PDF file. Default is False.
extra_request_data (Dict[str, Any] | None) β Additional request data.
**kwargs (Any) β additional keyword arguments.
Attributes
data
source
url
Methods
__init__
(file_path[,Β processed_file_format,Β ...])Initialize with a file path.
A lazy loader for Documents.
aload
()Load data into Document objects.
clean_pdf
(contents)Clean the PDF file.
get_processed_pdf
(pdf_id)A lazy loader for Documents.
load
()Load data into Document objects.
load_and_split
([text_splitter])Load Documents and split into chunks.
send_pdf
()wait_for_processing
(pdf_id)Wait for processing to complete.
- __init__(file_path: str, processed_file_format: str = 'md', max_wait_time_seconds: int = 500, should_clean_pdf: bool = False, extra_request_data: Dict[str, Any] | None = None, **kwargs: Any) None [source]#
Initialize with a file path.
- Parameters:
file_path (str) β a file for loading.
processed_file_format (str) β a format of the processed file. Default is βmdβ.
max_wait_time_seconds (int) β a maximum time to wait for the response from the server. Default is 500.
should_clean_pdf (bool) β a flag to clean the PDF file. Default is False.
extra_request_data (Dict[str, Any] | None) β Additional request data.
**kwargs (Any) β additional keyword arguments.
- Return type:
None
- async alazy_load() AsyncIterator[Document] #
A lazy loader for Documents.
- Return type:
AsyncIterator[Document]
- clean_pdf(contents: str) str [source]#
Clean the PDF file.
- Parameters:
contents (str) β a PDF file contents.
- Return type:
str
Returns:
- load_and_split(text_splitter: TextSplitter | None = None) List[Document] #
Load Documents and split into chunks. Chunks are returned as Documents.
Do not override this method. It should be considered to be deprecated!
- Parameters:
text_splitter (Optional[TextSplitter]) β TextSplitter instance to use for splitting documents. Defaults to RecursiveCharacterTextSplitter.
- Returns:
List of Documents.
- Return type:
List[Document]
Examples using MathpixPDFLoader