skainet-io-core/sk.ainet.io.tokenizer/TokenizerFactory/fromGguf

fromGguf

@JvmStatic
fun fromGguf(fields: Map<String, Any?>): Tokenizer(source)

Build a tokenizer from a GGUF metadata field map.

Callers typically pass streamingReader.fields or ggufModelMetadata.rawFields — this keeps skainet-io-core free of a dependency on skainet-io-gguf.

Generated by Dokka
© 2026 Copyright