Skip to main content

0.13.0

  • Support for inline images in image to text models. You can now supply an image to the image_generate (and image_generate_stream) endpoint in the form: <image:https://url.com/image.jpg>.
  • Debug script for diagnosing issues with takeoff deployments.
  • Support for Jina's long context embedding models.
  • Support for Mistral based embedding models
  • Support for API based (openAI) model calls from takeoff.
  • Changes to default memory usage parameters to reduce the likelihood of OOM errors.
  • Fix a bug where model downloading was not properly atomic. This means that a failed model download will no longer cause issues for subsequent launches.
  • Fix a bug where the CPU container was larger than it should have been
  • Assorted performance improvements and bugfixes
  • Remove the ability to manually specify the backend that's used by takeoff.