DummyTokenizer

class langchain_mistralai.embeddings.DummyTokenizer

Dummy tokenizer for when tokenizer cannot be accessed (e.g., via Huggingface)

Methods

encode_batch(texts)

static encode_batch(

texts: list[str],

) → list[list[str]]

Parameters:

texts (list[str])

Return type:

list[list[str]]