tokenizerType

P21075 predicate

Indicates the specific tokenization method or algorithm used to split text into tokens.

Sample triples (1)
Subject Object
GPT-2 Byte Pair Encoding →
Please wait…