evict

abstract fun evict(fromPos: Int)(source)

Evict all cached tokens from position fromPos onward.

Used for sequence truncation or speculative decoding rollback. After eviction, currentSeqLen becomes fromPos.