maxSeqLen

val maxSeqLen: Int = 0(source)

Maximum sequence length for the KV cache. 0 means use the model's default.