DocAIParser#

class langchain_google_community.docai.DocAIParser(*, client: DocumentProcessorServiceClient | None = None, project_id: str | None = None, location: str | None = None, gcs_output_path: str | None = None, processor_name: str | None = None)[source]#

Google Cloud Document AI parser.

For a detailed explanation of Document AI, refer to the product documentation. https://cloud.google.com/document-ai/docs/overview

Initializes the parser.

Parameters:

client (DocumentProcessorServiceClient | None) – a DocumentProcessorServiceClient to use
location (str | None) – a Google Cloud location where a Document AI processor is located
gcs_output_path (str | None) – a path on Google Cloud Storage to store parsing results
processor_name (str | None) – full resource name of a Document AI processor or processor version
project_id (str | None) –

You should provide either a client or location (and then a client: would be instantiated).

Methods

`__init__`(*[, client, project_id, location, ...])	Initializes the parser.
`batch_parse`(blobs[, gcs_output_path, ...])	Parses a list of blobs lazily.
`docai_parse`(blobs, *[, gcs_output_path, ...])	Runs Google Document AI PDF Batch Processing on a list of blobs.
`get_results`(operations)
`is_running`(operations)
`lazy_parse`(blob)	Parses a blob lazily.
`online_process`(blob[, field_mask])	Parses a blob lazily using online processing.
`operations_from_names`(operation_names)	Initializes Long-Running Operations from their names.
`parse`(blob)	Eagerly parse the blob into a document or documents.
`parse_from_results`(results)

Initializes the parser.

Parameters:

client (DocumentProcessorServiceClient | None) – a DocumentProcessorServiceClient to use
location (str | None) – a Google Cloud location where a Document AI processor is located
gcs_output_path (str | None) – a path on Google Cloud Storage to store parsing results
processor_name (str | None) – full resource name of a Document AI processor or processor version
project_id (str | None) –

You should provide either a client or location (and then a client: would be instantiated).

batch_parse(blobs: Sequence[Blob], gcs_output_path: str | None = None, timeout_sec: int = 3600, check_in_interval_sec: int = 60, **process_options_kwargs: Any) → Iterator[Document][source]#

Parses a list of blobs lazily.

Parameters:

blobs (Sequence[Blob]) – a list of blobs to parse.
gcs_output_path (str | None) – a path on Google Cloud Storage to store parsing results.
timeout_sec (int) – a timeout to wait for Document AI to complete, in seconds.
check_in_interval_sec (int) – an interval to wait until next check whether parsing operations have been completed, in seconds.
process_options_kwargs (Any) – optional parameters to pass to the Document AI processors

Return type:

Iterator[Document]

This is a long-running operation. A recommended way is to decouple: parsing from creating LangChain Documents: >>> operations = parser.docai_parse(blobs, gcs_path) >>> parser.is_running(operations) You can get operations names and save them: >>> names = [op.operation.name for op in operations] And when all operations are finished, you can use their results: >>> operations = parser.operations_from_names(operation_names) >>> results = parser.get_results(operations) >>> docs = parser.parse_from_results(results)

docai_parse(blobs: Sequence[Blob], *, gcs_output_path: str | None = None, processor_name: str | None = None, batch_size: int = 1000, field_mask: str | None = None, **process_options_kwargs: Any) → List[Operation][source]#

Runs Google Document AI PDF Batch Processing on a list of blobs.

Parameters:

blobs (Sequence[Blob]) – a list of blobs to be parsed
gcs_output_path (str | None) – a path (folder) on GCS to store results
processor_name (str | None) – name of a Document AI processor.
batch_size (int) – amount of documents per batch
field_mask (str | None) – a comma-separated list of which fields to include in the Document AI response. suggested: “text,pages.pageNumber,pages.layout”
process_options_kwargs (Any) – optional parameters to pass to the Document AI processors

Return type:

List[Operation]

Document AI has a 1000 file limit per batch, so batches larger than that need to be split into multiple requests. Batch processing is an async long-running operation and results are stored in a output GCS bucket.

get_results(operations: List[Operation]) → List[DocAIParsingResults][source]#

Parameters:: operations (List[Operation]) –
Return type:: List[DocAIParsingResults]

is_running(operations: List[Operation]) → bool[source]#

Parameters:: operations (List[Operation]) –
Return type:: bool

lazy_parse(blob: Blob) → Iterator[Document][source]#

Parses a blob lazily.

Parameters:

blobs – a Blob to parse
blob (Blob) –

Return type:

Iterator[Document]

This is a long-running operation. A recommended way is to batch: documents together and use the batch_parse() method.

online_process(blob: Blob, field_mask: str | None = None, **process_options_kwargs: Any) → Iterator[Document][source]#

Parses a blob lazily using online processing.

Parameters:

blob (Blob) – a blob to parse.
field_mask (str | None) – a comma-separated list of which fields to include in the Document AI response. suggested: “text,pages.pageNumber,pages.layout”
process_options_kwargs (Any) – optional parameters to pass to the Document AI processors

Return type:

Iterator[Document]

operations_from_names(operation_names: List[str]) → List[Operation][source]#

Initializes Long-Running Operations from their names.

Parameters:: operation_names (List[str]) –
Return type:: List[Operation]

parse(blob: Blob) → List[Document]#

Eagerly parse the blob into a document or documents.

This is a convenience method for interactive development environment.

Production applications should favor the lazy_parse method instead.

Subclasses should generally not over-ride this parse method.

Parameters:: blob (Blob) – Blob instance
Returns:: List of documents
Return type:: List[Document]

parse_from_results(results: List[DocAIParsingResults]) → Iterator[Document][source]#

Parameters:: results (List[DocAIParsingResults]) –
Return type:: Iterator[Document]