langchain_community.cache.InMemoryCache¶

class langchain_community.cache.InMemoryCache[source]¶

Cache that stores things in memory.

Initialize with empty cache.

Methods

__init__()

Initialize with empty cache.

aclear(**kwargs)

Clear cache.

alookup(prompt, llm_string)

Look up based on prompt and llm_string.

aupdate(prompt, llm_string, return_val)

Update cache based on prompt and llm_string.

clear(**kwargs)

Clear cache.

lookup(prompt, llm_string)

Look up based on prompt and llm_string.

update(prompt, llm_string, return_val)

Update cache based on prompt and llm_string.
__init__() → None[source]¶

Initialize with empty cache.

Return type

None

async aclear(**kwargs: Any) → None[source]¶

Clear cache.

Parameters

kwargs (Any) –

Return type

None

async alookup(prompt: str, llm_string: str) → Optional[Sequence[Generation]][source]¶

Look up based on prompt and llm_string.

Parameters

  • prompt (str) –

  • llm_string (str) –

Return type

Optional[Sequence[Generation]]

async aupdate(prompt: str, llm_string: str, return_val: Sequence[Generation]) → None[source]¶

Update cache based on prompt and llm_string.

Parameters

  • prompt (str) –

  • llm_string (str) –

  • return_val (Sequence[Generation]) –

Return type

None

clear(**kwargs: Any) → None[source]¶

Clear cache.

Parameters

kwargs (Any) –

Return type

None

lookup(prompt: str, llm_string: str) → Optional[Sequence[Generation]][source]¶

Look up based on prompt and llm_string.

Parameters

  • prompt (str) –

  • llm_string (str) –

Return type

Optional[Sequence[Generation]]

update(prompt: str, llm_string: str, return_val: Sequence[Generation]) → None[source]¶

Update cache based on prompt and llm_string.

Parameters

  • prompt (str) –

  • llm_string (str) –

  • return_val (Sequence[Generation]) –

Return type

None

Examples using InMemoryCache¶