SKaiNET
Toggle table of contents
0.20.0-SNAPSHOT
common
Target filter
common
Switch theme
Search in API
Skip to content
SKaiNET
skainet-io-core
/
sk.ainet.io.tokenizer
/
TekkenTokenizer
/
vocabSize
vocab
Size
open
override
val
vocabSize
:
Int
(
source
)
Number of vocab tokens (excluding special tokens).