Status

GET 
/status

Status

Proxy for status endpoint on inference API, returns all information about the app and its current status.

Responses

200

Server is running, backend configuration is returned in body

application/json

Schema

Schema

config

object

required

The app configuration

allow_remote_images booleanrequired

body_size_limit_bytes integerrequired

Default value: 2097152

echo booleanrequired

enable_metrics booleanrequired

Default value: true

heartbeat_check_interval int64required

Default value: 1

internal_port int32required

Default value: 3005

management_port int32required

Default value: 3001

max_prompt_string_bytes integerrequired

Default value: 150000

max_user_batch_size integerrequired

Default value: 1000

openai_port int32required

Default value: 3003

port int32required

Default value: 3000

reader_message_timeout_ms int64required

Default value: 500

repository_path stringrequired

Default value: /path/to/home/artefacts

reserved_consumers stringrequired

Default value: primary

snowflake_port int32required

Default value: 3004

vertex_port int32required

Default value: 3002

status

object

nullable

dead_readers

object

required

property name*

ReaderInfo

consumer_groups string[]required

consumer_name stringrequired

device stringrequired

model_name stringrequired

model_type stringrequired

pids int32[]required

last_heartbeat

object

required

property name*

LastHeartbeat

heartbeat_timestamp int64required

heartbeat_wait_interval int64required

live_readers

object

required

property name*

ReaderInfo

consumer_groups string[]required

consumer_name stringrequired

device stringrequired

model_name stringrequired

model_type stringrequired

pids int32[]required

loading_readers

object

required

property name*

ReaderInfo

consumer_groups string[]required

consumer_name stringrequired

device stringrequired

model_name stringrequired

model_type stringrequired

pids int32[]required

reserved_consumers string[]required

Example (from schema)

{
  "config": {
    "allow_remote_images": false,
    "body_size_limit_bytes": 2097152,
    "echo": false,
    "enable_metrics": true,
    "heartbeat_check_interval": 1,
    "internal_port": 3005,
    "management_port": 3001,
    "max_prompt_string_bytes": 150000,
    "max_user_batch_size": 1000,
    "openai_port": 3003,
    "port": 3000,
    "reader_message_timeout_ms": 500,
    "repository_path": "/path/to/home/artefacts",
    "reserved_consumers": "primary",
    "snowflake_port": 3004,
    "vertex_port": 3002
  },
  "status": {
    "dead_readers": {},
    "last_heartbeat": {},
    "live_readers": {},
    "loading_readers": {},
    "reserved_consumers": [
      "string"
    ]
  }
}

503

Server is not available

Loading...