isKvShared

fun isKvShared(layerIdx: Int): Boolean(source)

Returns whether the given layer shares its KV cache with another layer. The last kvSharedLayers layers share their KV cache.