langchain_community.cache.InMemoryCache

class langchain_community.cache.InMemoryCache

Cache that stores things in memory.

Initialize with empty cache.

Methods

__init__()	Initialize with empty cache.
clear(**kwargs)	Clear cache.
lookup(prompt, llm_string)	Look up based on prompt and llm_string.
update(prompt, llm_string, return_val)	Update cache based on prompt and llm_string.

__init__() → None

Initialize with empty cache.

clear(**kwargs: Any) → None

Clear cache.

lookup(prompt: str, llm_string: str) → Optional[Sequence[Generation]]

Look up based on prompt and llm_string.

update(prompt: str, llm_string: str, return_val: Sequence[Generation]) → None

Update cache based on prompt and llm_string.

Examples using InMemoryCache

• LLM Caching integrations