Skip to main content
Version: 0.21.x

Chat Template

POST 
/chat_template/:reader_id

Chat Template

The reader_id can be found as the model's key in the live_readers object, returned by the status endpoint. It can also be supplied at boot time for each model in the config: see here for more information.

Request​

Path Parameters

    reader_id stringrequired

    The ID of the reader to use for tokenization.

Body

required

    add_generation_prompt booleannullable
    inputs array[]required

Responses​

Takes in a JSON payload and returns the response all at once.

Schema

    add_generation_prompt booleannullable
    inputs array[]required
Loading...