Skip to main content

0.20.0

  • Support for outlines as a json decoding backend - use the constrained_decoding_backend generation parameter.
  • Fixed a bug with concurrent requests with different generation parameters.