skainet-io-safetensors/sk.ainet.io.safetensors/SafeTensorsIndex

SafeTensorsIndex

data class SafeTensorsIndex(val metadata: SafeTensorsIndexMetadata, val weightMap: Map<String, String>)(source)

Represents a parsed model.safetensors.index.json file for sharded SafeTensors models.

The index file maps tensor names to their containing shard files:

{
  "metadata": { "total_size": 14483464192 },
  "weight_map": {
    "model.embed_tokens.weight": "model-00001-of-00003.safetensors",
    "model.layers.0.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
    ...
  }
}

Constructors

SafeTensorsIndex

constructor(metadata: SafeTensorsIndexMetadata, weightMap: Map<String, String>)

Properties

metadata

val metadata: SafeTensorsIndexMetadata

Index metadata (total_size, etc.)

shardCount

val shardCount: Int

Number of shards in this model.

shardFiles

val shardFiles: List<String>

Unique shard filenames derived from the weight map, sorted alphabetically.

tensorCount

val tensorCount: Int

Total number of tensors in this model.

weightMap

val weightMap: Map<String, String>

Mapping from tensor name to shard filename

Functions

getShardForTensor

fun getShardForTensor(tensorName: String): String?

Get the shard filename containing a specific tensor.

getTensorCountPerShard

fun getTensorCountPerShard(): Map<String, Int>

Get tensor count per shard as a map.

getTensorsInShard

fun getTensorsInShard(shardFilename: String): List<String>

Get all tensor names contained in a specific shard.