langchain_community.llms.azureml_endpoint.HFContentFormatter¶

class langchain_community.llms.azureml_endpoint.HFContentFormatter[source]¶

Content handler for LLMs from the HuggingFace catalog.

Attributes

accepts

The MIME type of the response data returned from the endpoint

content_type

The MIME type of the input data passed to the endpoint

format_error_msg

supported_api_types

Supported APIs for the given formatter.

Methods

__init__()

escape_special_characters(prompt)

Escapes any special characters in prompt

format_request_payload(prompt, model_kwargs, ...)

Formats the request body according to the input schema of the model.

format_response_payload(output, api_type)

Formats the response body according to the output schema of the model.
__init__()¶
static escape_special_characters(prompt: str) → str¶

Escapes any special characters in prompt

Parameters

prompt (str) –

Return type

str

format_request_payload(prompt: str, model_kwargs: Dict, api_type: AzureMLEndpointApiType) → bytes[source]¶

Formats the request body according to the input schema of the model. Returns bytes or seekable file like object in the format specified in the content_type request header.

Parameters
Return type

bytes

format_response_payload(output: bytes, api_type: AzureMLEndpointApiType) → Generation[source]¶

Formats the response body according to the output schema of the model. Returns the data type that is received from the response.

Parameters
Return type

Generation