InferenceBuffers

class InferenceBuffers(val dimension: Int, val hiddenDimension: Int, val vocabularySize: Int, val maxSequenceLength: Int, val kvDimension: Int = dimension)(source)

Constructors

Link copied to clipboard
constructor(dimension: Int, hiddenDimension: Int, vocabularySize: Int, maxSequenceLength: Int, kvDimension: Int = dimension)

Properties

Link copied to clipboard
Link copied to clipboard
Link copied to clipboard
Link copied to clipboard
Link copied to clipboard
Link copied to clipboard
Link copied to clipboard
val k: Tensor
Link copied to clipboard
Link copied to clipboard
Link copied to clipboard
Link copied to clipboard
Link copied to clipboard
val q: Tensor
Link copied to clipboard
Link copied to clipboard
Link copied to clipboard
val up: Tensor
Link copied to clipboard
val v: Tensor
Link copied to clipboard
Link copied to clipboard
val x: Tensor