langchain_community.chat_models.azureml_endpoint.LlamaContentFormatter

class langchain_community.chat_models.azureml_endpoint.LlamaContentFormatter

Content formatter for LLaMA.

Attributes

accepts	The MIME type of the response data returned from the endpoint
content_type	The MIME type of the input data passed to the endpoint
format_error_msg
supported_api_types	Supported APIs for the given formatter.

Methods

__init__()
escape_special_characters(prompt)	Escapes any special characters in prompt
format_request_payload(prompt, model_kwargs)	Formats the request body according to the input schema of the model.
format_response_payload(output[, api_type])	Formats the response body according to the output schema of the model.

__init__() → None

Return type

None

static escape_special_characters(prompt: str) → str

Escapes any special characters in prompt

Parameters

prompt (str) –

Return type

str

format_request_payload(prompt: str, model_kwargs: Dict, api_type: AzureMLEndpointApiType = AzureMLEndpointApiType.realtime) → Any

Formats the request body according to the input schema of the model. Returns bytes or seekable file like object in the format specified in the content_type request header.

Parameters

• prompt (str) –

• model_kwargs (Dict) –

• api_type (AzureMLEndpointApiType) –

Return type

Any

abstract format_response_payload(output: bytes, api_type: AzureMLEndpointApiType = AzureMLEndpointApiType.realtime) → Generation

Formats the response body according to the output schema of the model. Returns the data type that is received from the response.

Parameters

• output (bytes) –

• api_type (AzureMLEndpointApiType) –

Return type

Generation

Examples using LlamaContentFormatter

• AzureML Chat Online Endpoint