Container Deployments
The Takeoff Engine is a Docker container which can be deployed in any environment with a docker compatible engine installed. If you are using a different platform and want a know how to deploy Takeoff there get in touch with us. If you are looking for a production ready deployment for LLM APIs check out The Takeoff Stack.
🐳 The Takeoff Engine is a single container solution that can be run on any machine with Docker/compatible engine installed. Once downloaded to the node is easily spun up and down for fast prototyping.
🚀 Best in class inference latency and throughput. We benchmark again vLLM and TGI.
📊 Container metrics are available via dashboard and can be scraped from an endpoint.
📄️ AWS Sagemaker
How to deploy LLMs with Takeoff on AWS Sagemaker
📄️ GCP Vertex
How to deploy LLMs with Takeoff on GCP Vertex AI
📄️ AWS EC2
How to deploy LLMs with Takeoff on EC2
📄️ Google Cloud Run
How to deploy LLMs with Takeoff on Google Cloud Run
📄️ Snowflake
How to deploy LLMs with Takeoff on Snowpark Container Service
📄️ Kubernetes from Scratch
How to build a Kubernetes deployment with Takeoff from scratch