DummyTokenizer

class langchain_mistralai.embeddings.DummyTokenizer

Dummy tokenizer for when tokenizer cannot be accessed (e.g., via Huggingface)

Methods

encode_batch(texts)

static encode_batch(texts: List[str]) → List[List[str]]

Parameters:

texts (List[str])

Return type:

List[List[str]]