DummyTokenizer#
- class langchain_mistralai.embeddings.DummyTokenizer[source]#
Dummy tokenizer for when tokenizer cannot be accessed (e.g., via Huggingface).
Methods
encode_batch
(texts)
Dummy tokenizer for when tokenizer cannot be accessed (e.g., via Huggingface).
Methods
|