AzureMLBaseEndpoint#

class langchain_community.llms.azureml_endpoint.AzureMLBaseEndpoint[source]#

Bases: BaseModel

Azure ML Online Endpoint models.

Create a new model by parsing and validating input data from keyword arguments.

Raises ValidationError if the input data cannot be parsed to form a valid model.

param content_formatter: Any = None#

The content formatter that provides an input and output transform function to handle formats between the LLM and the endpoint

param deployment_name: str = ''#

Deployment Name for Endpoint. NOT REQUIRED to call endpoint. Should be passed to constructor or specified as env var AZUREML_DEPLOYMENT_NAME.

param endpoint_api_key: SecretStr = SecretStr('')#

Authentication Key for Endpoint. Should be passed to constructor or specified as env var AZUREML_ENDPOINT_API_KEY.

Constraints:
  • type = string

  • writeOnly = True

  • format = password

param endpoint_api_type: AzureMLEndpointApiType = AzureMLEndpointApiType.dedicated#

Type of the endpoint being consumed. Possible values are serverless for pay-as-you-go and dedicated for dedicated endpoints.

param endpoint_url: str = ''#

URL of pre-existing Endpoint. Should be passed to constructor or specified as env var AZUREML_ENDPOINT_URL.

param max_retries: int = 1#
param model_kwargs: dict | None = None#

Keyword arguments to pass to the model.

param timeout: int = 50#

Request timeout for calls to the endpoint