🌟 Summary
This release, v8.3.85
, focuses on improving TensorRT export functionality and refining ONNX segmentation examples for better performance and usability. 🚀
📊 Key Changes
TensorRT Updates (Main Focus of Release):
- Fixed
max_shape
Calculation Bug: Resolved inconsistent calculations during TensorRT export with non-zero workspace values. - Improved Default Behavior: Ensured workspace settings default to
0
when not specified.
ONNX Segmentation Example Enhancements:
- Streamlined Preprocessing/Postprocessing: Simplified the example to use a more efficient and flexible implementation, including key parameters like
iou
,imgsz
, andconf
. - Unified Confidence Threshold: Updated ONNX example to align with YOLO conventions for clarity (
conf
,iou
). - Optimized Mask Handling: Enhanced segmentation mask functionality for better accuracy and resource efficiency.
- Adaptive Backend Setup: Integrated GPU support automatically when available, improving ease of use.
🎯 Purpose & Impact
-
For TensorRT Users:
- Purpose: Addressed critical bugs in TensorRT export needed for high-performance inference engines.
- Impact: Accurate shape calculation ensures smoother deployments of dynamic models with TensorRT, preventing crashes or incorrect behavior. Users exporting YOLO models into
.engine
format, especially with non-zero workspaces, will experience stable exports.
-
For ONNX Developers:
- Purpose: Simplify, optimize, and enhance usability of segmentation examples using ONNX Runtime.
- Impact: Developers using ONNX Runtime benefit from faster setup, more intuitive parameter usage, and reliable mask-based object segmentation results.
-
General Improvements:
- These updates improve the overall developer experience and model deployment across various inference backends, enabling seamless workflows for cutting-edge scenarios.
This update primarily strengthens export and inference capabilities 🎯, while making the process more robust for advanced and typical users alike.
What's Changed
- Cleanup and fix ONNX segment example by @Y-T-G in #19551
ultralytics 8.3.85
TensoRT exportmax_shape
fix by @Y-T-G in #19541
Full Changelog: v8.3.84...v8.3.85