⚠️ [BREAKING CHANGE] ⚠️
- The fixed parameters of the
Query content
in the text generation application have been removed. Users can freely add any variables in the prompt, instead of appending the content of the query content at the end. - The
query
parameter in thePOST /v1/completion-messages
endpoint of the App OpenAPI is expected to be completely removed in 3 months. Currently, it's optional and the parameter in API documentation has already been removed.
To ensure that the previous applications can still function properly after removing the fixed parameters in the query content of the text generation application, we need to execute a command to fix the data:
Migration Guide
-
Enter the Docker Container: Before running the migration script, you need to enter the Docker container where your application is running. Use the following command:
docker exec -it docker-api-1 bash
-
Run the Migration Script: Once inside the container, execute the following migration command. The migration script can be executed multiple times without side effects:
# --batch-size: Specifies the number of records migrated per batch, default is 500 flask update_app_model_configs --batch-size=500
What's Changed
- feat: support optional query content by @iamjoel in #1097
- fix: in log page not show user query by @iamjoel in #1140
- fix: log page compatible old query by @iamjoel in #1141
- fix: remove the deprecated depends_on.condition format by @takatost in #1142
- feat: cache huggingface gpt2 tokenizer files by @takatost in #1138
- feat: set transformers offline default true by @takatost in #1143
- fix: TRANSFORMERS_OFFLINE orders in Dockerfile by @takatost in #1144
- feat: bump version to 0.3.21 by @takatost in #1145
Full Changelog: 0.3.20...0.3.21