InMemoryCache#

class langchain_community.cache.InMemoryCache[source]#

Cache that stores things in memory.

Initialize with empty cache.

Methods

__init__()

Initialize with empty cache.

aclear(**kwargs)

Clear cache.

alookup(prompt, llm_string)

Look up based on prompt and llm_string.

aupdate(prompt, llm_string, return_val)

Update cache based on prompt and llm_string.

clear(**kwargs)

Clear cache.

lookup(prompt, llm_string)

Look up based on prompt and llm_string.

update(prompt, llm_string, return_val)

Update cache based on prompt and llm_string.
__init__() → None[source]#

Initialize with empty cache.

Return type:

None

async aclear(**kwargs: Any) → None[source]#

Clear cache.

Parameters:

kwargs (Any) –

Return type:

None

async alookup(prompt: str, llm_string: str) → Sequence[Generation] | None[source]#

Look up based on prompt and llm_string.

Parameters:

  • prompt (str) –

  • llm_string (str) –

Return type:

Sequence[Generation] | None

async aupdate(prompt: str, llm_string: str, return_val: Sequence[Generation]) → None[source]#

Update cache based on prompt and llm_string.

Parameters:

  • prompt (str) –

  • llm_string (str) –

  • return_val (Sequence[Generation]) –

Return type:

None

clear(**kwargs: Any) → None[source]#

Clear cache.

Parameters:

kwargs (Any) –

Return type:

None

lookup(prompt: str, llm_string: str) → Sequence[Generation] | None[source]#

Look up based on prompt and llm_string.

Parameters:

  • prompt (str) –

  • llm_string (str) –

Return type:

Sequence[Generation] | None

update(prompt: str, llm_string: str, return_val: Sequence[Generation]) → None[source]#

Update cache based on prompt and llm_string.

Parameters:

  • prompt (str) –

  • llm_string (str) –

  • return_val (Sequence[Generation]) –

Return type:

None

Examples using InMemoryCache

On this page