Kotensor
Toggle table of contents
1.2.0
jvm
Target filter
jvm
Switch theme
Search in API
Skip to content
Kotensor
Kotensor
/
io.kotensor.core
/
InferenceBuffers
Inference
Buffers
class
InferenceBuffers
(
val
dimension
:
Int
,
val
hiddenDimension
:
Int
,
val
vocabularySize
:
Int
,
val
maxSequenceLength
:
Int
,
val
kvDimension
:
Int
=
dimension
)
(
source
)
Members
Constructors
Inference
Buffers
Link copied to clipboard
constructor
(
dimension
:
Int
,
hiddenDimension
:
Int
,
vocabularySize
:
Int
,
maxSequenceLength
:
Int
,
kvDimension
:
Int
=
dimension
)
Properties
attention
Out
Link copied to clipboard
val
attentionOut
:
Tensor
context
Link copied to clipboard
val
context
:
Tensor
dimension
Link copied to clipboard
val
dimension
:
Int
ffn
Out
Link copied to clipboard
val
ffnOut
:
Tensor
gate
Link copied to clipboard
val
gate
:
Tensor
hidden
Dimension
Link copied to clipboard
val
hiddenDimension
:
Int
k
Link copied to clipboard
val
k
:
Tensor
kv
Dimension
Link copied to clipboard
val
kvDimension
:
Int
logits
Link copied to clipboard
val
logits
:
Tensor
max
Sequence
Length
Link copied to clipboard
val
maxSequenceLength
:
Int
normed
Link copied to clipboard
val
normed
:
Tensor
q
Link copied to clipboard
val
q
:
Tensor
scores
Link copied to clipboard
val
scores
:
FloatArray
size
In
Bytes
Link copied to clipboard
val
sizeInBytes
:
Long
up
Link copied to clipboard
val
up
:
Tensor
v
Link copied to clipboard
val
v
:
Tensor
vocabulary
Size
Link copied to clipboard
val
vocabularySize
:
Int
x
Link copied to clipboard
val
x
:
Tensor