tokenizerModel
Tokenizer model identifier (tokenizer.ggml.model), e.g. "gpt2", "llama", "bert". Used by TokenizerFactory to dispatch to the right tokenizer implementation regardless of file format.
Tokenizer model identifier (tokenizer.ggml.model), e.g. "gpt2", "llama", "bert". Used by TokenizerFactory to dispatch to the right tokenizer implementation regardless of file format.