fromTokenizerJson

Build a tokenizer from a HuggingFace tokenizer.json string.

Dispatches on model.type: "BPE" + byte-level pretokenizer routes to QwenByteLevelBpeTokenizer; "Unigram" (SentencePiece) and "WordPiece" currently throw.