`langchain_community.llms.azureml_endpoint`.HFContentFormatter¶

class langchain_community.llms.azureml_endpoint.HFContentFormatter[source]¶

Content handler for LLMs from the HuggingFace catalog.

Attributes

`accepts`	The MIME type of the response data returned from the endpoint
`content_type`	The MIME type of the input data passed to the endpoint
`format_error_msg`
`supported_api_types`	Supported APIs for the given formatter.

Methods

`__init__`()
`escape_special_characters`(prompt)	Escapes any special characters in prompt
`format_request_payload`(prompt, model_kwargs, ...)	Formats the request body according to the input schema of the model.
`format_response_payload`(output, api_type)	Formats the response body according to the output schema of the model.

static escape_special_characters(prompt: str) → str¶: Escapes any special characters in prompt

format_request_payload(prompt: str, model_kwargs: Dict, api_type: AzureMLEndpointApiType) → bytes[source]¶: Formats the request body according to the input schema of the model. Returns bytes or seekable file like object in the format specified in the content_type request header.

format_response_payload(output: bytes, api_type: AzureMLEndpointApiType) → Generation[source]¶: Formats the response body according to the output schema of the model. Returns the data type that is received from the response.

langchain_community.llms.azureml_endpoint.HFContentFormatter¶