langchain_community.llms.azureml_endpoint
.LlamaContentFormatter¶
- class langchain_community.llms.azureml_endpoint.LlamaContentFormatter[source]¶
Content formatter for LLaMa
Attributes
accepts
The MIME type of the response data returned from the endpoint
content_type
The MIME type of the input data passed to the endpoint
format_error_msg
supported_api_types
Supported APIs for the given formatter.
Methods
__init__
()escape_special_characters
(prompt)Escapes any special characters in prompt
format_request_payload
(prompt, model_kwargs, ...)Formats the request according to the chosen api
format_response_payload
(output, api_type)Formats response
- __init__()¶
- static escape_special_characters(prompt: str) str ¶
Escapes any special characters in prompt
- format_request_payload(prompt: str, model_kwargs: Dict, api_type: AzureMLEndpointApiType) bytes [source]¶
Formats the request according to the chosen api
- format_response_payload(output: bytes, api_type: AzureMLEndpointApiType) Generation [source]¶
Formats response