🌈 What's New?
Core Inference
- Capture exit code in model status by @Suresh-Nakkeran in #2290
- Added support for loading models with custom name by @Suresh-Nakkeran in #2252
- Support Knative rollout duration annotation by @andyi2it in #2300
- Allows to make Istio and VirtualServices optional by @Suresh-Nakkeran in #2380
- Pass request headers to predict method (#2284) by @andyi2it in #2360
- add prometheus metrics for kserve model server by @alexagriffith in #2425
- adding prometheus port configs for aggregating metrics in queue proxy by @alexagriffith in #2459
- Fix cluster local label InferenceService by @TimKleinloog in #2101
- FastAPI: Separate model server and data plane by @sukumargaonkar @xfu83 in #2444
- Agriffith96/add queue proxy ext by @alexagriffith in #2478
- Restoring init container support. by @rachitchauhan43 in #2475
- Make webhook port number configurable by @sel in #2498
- Make aix use default image only if no image is provided by @andyi2it in #2503
- Support V2 GRPC for KServe Model Server by @Suresh-Nakkeran in #2415
- Change cluster-local label to networking.knative.dev/visibility by @tenzen-y in #2518
- Update with dry-run before diffing deployments by @cmaddalozzo in #2490
Serving Runtimes
- add labels and annotations to ServingRuntimePodSpec by @lizzzcai in #2440
- Add ImagePullSecrets to ServingRuntimePodSpec by @lizzzcai in #2443
- Bump torchserve version by @jagadeeshi2i in #2530
Advanced Inference
- Propagating IG headers to it's nodes. by @rachitchauhan43 in #2396
Storage Provider
- AWS IRSA S3 Support by @matty-rose in #2373
- storage-initializer: Let boto3 decide the endpoint for S3 by @dimara in #2377
- Retrieve SAS token for Azure storage by @tjandy98 in #2418
- Supports more authentication approaches on Azure in Storage Initializer by @laozc in #2014
- Supports more authentication approaches on Azure in Storage Initializer - Build fix by @Suresh-Nakkeran in #2481
What's Changed
- Cleanup InferenceService configmap for ML framework related fields by @Suresh-Nakkeran in #2225
Version Upgrade
- Update quick install to use 0.9.0 by @yuzisun in #2362
- update ray to 2.0.0 by @park12sj in #2410
- Go 1.18 upgrade by @yuzisun in #2420
- Reduce numpy version constraints by @alembiewski in #2424
- update quick install knative version to 1.7.0 by @alexagriffith in #2431
- Update quick install to use Istio 1.15 by @yuzisun in #2446
- Updated yq version (v4.28.1) by @Suresh-Nakkeran in #2480
Project SDLC
- Regenerate the Go client by code-generator by @tenzen-y in #2458
- Code coverage by @andyi2it in #2351
- remove pytorchserver dead code by @alexagriffith in #2453
- Update KServe generated client code by @yuzisun in #2492
- Added a pytest ini to register the markers by @andyi2it in #2505
- Add security vulnerabilities reporting process by @yuzisun in #2523
- Add openssf best practice badge by @yuzisun in #2525
- Updated docker build to use a cpu only version of torchvision by @andyi2it in #2515
- Adding new manifests for 0.10.0 by @rachitchauhan43 in #2544
- Update configmap for helm chart v0.10.0-rc0 by @yuzisun in #2545
- Fix kserve annotation constants by @ddelange in #2491
- removed arch dependency for multiarc support by @pranavpandit1 in #2476
- Fixing indentation bug in image patch config by @rachitchauhan43 in #2539
Security Patches
- Optimize docker image builds by @andyi2it in #2319
- Update versions for art-explainer to resolve several critical CVEs by @MessKon in #2272
- Vulnerability fixes for kserve and model images by @andyi2it in #2320
- Patch fixed critical CVEs in kserve/alibi-explainer by @MessKon in #2270
- aix-explainer: update versions to fix CVEs by @MessKon in #2364
Documentation Update
- fix: torchserve-grpc client by @jagadeeshi2i in #2353
- Update KServe main page README by @yuzisun in #2375
- Fix typos in main README by @rafvasq in #2384
- Update python/kserve dependency and art example by @yuzisun in #2391
- fix: update torchserve readme links by @jagadeeshi2i in #2394
- Add script to identify broken links by @ckadner in #2423
- Update CIFAR-10 Outlier Detector sample by @rafvasq in #2472
- Add an example of Lime text explainer from AIX360 toolkit by @C1berwiz in #2355
- Update sample YAMLs for s3 secrets to use right annotation by @dilverse in #2528
- Copy-edit torchserve readme by @rafvasq in #2531
New Contributors
- @MessKon made their first contribution in #2272
- @rafvasq made their first contribution in #2384
- @dimara made their first contribution in #2377
- @park12sj made their first contribution in #2410
- @alembiewski made their first contribution in #2424
- @ckadner made their first contribution in #2423
- @alexagriffith made their first contribution in #2431
- @lizzzcai made their first contribution in #2440
- @tenzen-y made their first contribution in #2458
- @tjandy98 made their first contribution in #2418
- @TimKleinloog made their first contribution in #2101
- @C1berwiz made their first contribution in #2355
- @rachitchauhan43 made their first contribution in #2396
- @sel made their first contribution in #2498
- @pranavpandit1 made their first contribution in #2476
- @dilverse made their first contribution in #2528
- @cmaddalozzo made their first contribution in #2490
Full Changelog: v0.9.0...v0.10.0-rc0