App
Added
- Added partial support for fastapi
Request
annotation inconfigure_api
handlers (#16047) - Added a nicer UI with URL and examples for the autoscaler component (#16063)
- Enabled users to have more control over scaling out/in intervals (#16093)
- Added more datatypes to the serving component (#16018)
- Added
work.delete
method to delete the work (#16103) - Added
display_name
property to LightningWork for the cloud (#16095) - Added
ColdStartProxy
to the AutoScaler (#16094) - Added status endpoint, enable
ready
(#16075) - Implemented
ready
for components (#16129)
Changed
- The default
start_method
for creating Work processes locally on macOS is now 'spawn' (previously 'fork') (#16089) - The utility
lightning.app.utilities.cloud.is_running_in_cloud
now returnsTrue
during the loading of the app locally when running with--cloud
(#16045) - Updated Multinode Warning (#16091)
- Updated app testing (#16000)
- Changed overwrite to
True
(#16009) - Simplified messaging in cloud dispatch (#16160)
- Added annotations endpoint (#16159)
Fixed
- Fixed
PythonServer
messaging "Your app has started" (#15989) - Fixed auto-batching to enable batching for requests coming even after the batch interval but is in the queue (#16110)
- Fixed a bug where
AutoScaler
would fail with min_replica=0 (#16092 - Fixed a non-thread safe deepcopy in the scheduler (#16114)
- Fixed HTTP Queue sleeping for 1 sec by default if no delta was found (#16114)
- Fixed the endpoint info tab not showing up in the
AutoScaler
UI (#16128) - Fixed an issue where an exception would be raised in the logs when using a recent version of
streamlit
(#16139) - Fixed e2e tests (#16146)
Full Changelog: 1.8.5.post0...1.8.6