RoPE

class RoPE(val dimension: Int, val base: Float = 10000.0f, val scaling: RoPEScaling? = null) : Module(source)

Constructors

Link copied to clipboard
constructor(dimension: Int, base: Float = 10000.0f, scaling: RoPEScaling? = null)

Properties

Link copied to clipboard
val base: Float
Link copied to clipboard
Link copied to clipboard
Link copied to clipboard
Link copied to clipboard

Functions

Link copied to clipboard
fun apply(input: Tensor, startPosition: Int = 0, sequenceLength: Int? = null): Tensor
Link copied to clipboard
fun applyInPlace(token: Tensor, position: Int): Tensor
Link copied to clipboard
fun applyRowsInPlace(rows: Tensor, startPosition: Int): Tensor
Link copied to clipboard
open override fun forward(input: Tensor): Tensor
Link copied to clipboard
open fun forwardInto(input: Tensor, out: Tensor): Tensor
Link copied to clipboard
operator fun invoke(input: Tensor): Tensor
Link copied to clipboard
open override fun parameters(): List<Tensor>