Companion

Properties

Link copied to clipboard

Default number of KV shared layers

Link copied to clipboard

Default layer pattern: 4 sliding + 1 global, repeating

Link copied to clipboard
const val DEFAULT_ROPE_BASE_GLOBAL: Float = 1000000.0f

Default global RoPE base frequency

Link copied to clipboard
const val DEFAULT_ROPE_BASE_LOCAL: Float = 10000.0f

Default local RoPE base frequency

Link copied to clipboard
const val DEFAULT_SLIDING_WINDOW: Int = 512

Default sliding window size