HFContentFormatter#
- class langchain_community.llms.azureml_endpoint.HFContentFormatter[source]#
Content handler for LLMs from the HuggingFace catalog.
Attributes
accepts
The MIME type of the response data returned from the endpoint
content_type
The MIME type of the input data passed to the endpoint
format_error_msg
supported_api_types
Supported APIs for the given formatter.
Methods
escape_special_characters
(prompt)Escapes any special characters in prompt
format_request_payload
(prompt,Β model_kwargs,Β ...)Formats the request body according to the input schema of the model.
format_response_payload
(output,Β api_type)Formats the response body according to the output schema of the model.
- static escape_special_characters(prompt: str) str #
Escapes any special characters in prompt
- Parameters:
prompt (str)
- Return type:
str
- format_request_payload(prompt: str, model_kwargs: Dict, api_type: AzureMLEndpointApiType) bytes [source]#
Formats the request body according to the input schema of the model. Returns bytes or seekable file like object in the format specified in the content_type request header.
- Parameters:
prompt (str)
model_kwargs (Dict)
api_type (AzureMLEndpointApiType)
- Return type:
bytes
- format_response_payload(output: bytes, api_type: AzureMLEndpointApiType) Generation [source]#
Formats the response body according to the output schema of the model. Returns the data type that is received from the response.
- Parameters:
output (bytes)
api_type (AzureMLEndpointApiType)
- Return type: