Tokenize
POST/tokenize/:reader_id
The tokenization endpoint takes in a text, and returns the tokenized version of the text: the way the text is seen by the model with the path-supplied reader_id. Provide either a single text, or a pair of texts to be tokenized together (as you would a chat template). Does not support batch inputs.
The reader_id
can be found as the model's key in the live_readers
object, returned by the status endpoint.
It can also be supplied at boot time for each model in the config: see here for more information.
Request​
Responses​
- 200
- 400
- 422
- 503
Takes in a JSON payload and returns the response all at once.
Bad request
Malformed request body
The server is not ready to process requests yet.