langchain_community.chat_models.azureml_endpoint.LlamaChatContentFormatter

class langchain_community.chat_models.azureml_endpoint.LlamaChatContentFormatter

Content formatter for LLaMA.

Attributes

SUPPORTED_ROLES
accepts	The MIME type of the response data returned from the endpoint
content_type	The MIME type of the input data passed to the endpoint
format_error_msg
supported_api_types	Supported APIs for the given formatter.

Methods

__init__()
escape_special_characters(prompt)	Escapes any special characters in prompt
format_request_payload(messages, ...)	Formats the request according to the chosen api
format_response_payload(output, api_type)	Formats response

__init__()

static escape_special_characters(prompt: str) → str

Escapes any special characters in prompt

format_request_payload(messages: List[BaseMessage], model_kwargs: Dict, api_type: AzureMLEndpointApiType) → str

Formats the request according to the chosen api

format_response_payload(output: bytes, api_type: AzureMLEndpointApiType) → ChatGeneration

Formats response