Kotensor
Toggle table of contents
1.2.0
jvm
Target filter
jvm
Switch theme
Search in API
Skip to content
Kotensor
Kotensor
/
io.kotensor.core
/
HuggingFaceModelLoader
/
loadTokenizer
load
Tokenizer
fun
loadTokenizer
(
directory
:
File
)
:
BPETokenizer
(
source
)