Build changes
- Allow Python to be build on Mac with GPU support
Bazel changes
- Adds an empty skeleton project for iOS docgen.
- Remove pinned versions from deps
- Added files for the Language Detector C API and tests
- Add OnCameraBoundListener and support for landscape orientation to CameraXPreviewHelper
- Removed language_detection_result and moved the necessary containers to language_detector.h
- Detection postprocessing support quantized tensor.
- Adding vector versions of input calls to TS GraphRunner API
- Introduce AlignHandToPoseInWorldCalculator
- Add check to avoid doing illegal memory access from an invalid iterator from std::prev()
- GPU_ORIGIN configurable through base options proto.
- Introduce FixGraphBackEdges utils function.
- Migrate ParseTagAndName to use absl::string_view
- Plumb an optional default Executor and set of input side packets
- Add implementation and tests for Image Classifier C API
- Allow GPU Origin Proto to be build by Maven
- Add a field to GPUBuffer C struct so FFIGen can handle it
- Add scaling support to surface view renderer.
- Remove objc_library from Python build path for Mac GPU build
- Fix internal incensistency in parsing code
- Add CPU tests for TensorsToSegmentationCalculator
- Speed up Python build by only building binary graph
- Don't drop status message in ConvertFromImageFrame
- Use designated initializers for TensorsToSegmentationCalculator tests.
- Adding two new immutable texture GpuBufferFormat types
- TensorsToDetectionsCalculator supports multi clasees for a bbox.
- Move filtering logic of score to ConvertToDetection.
- Add video and live stream processing and tests for Image Classifier C API
- Upgrade to use Gradle 8.4
- Add AT_FIRST_TICK processing to SidePacketToStreamCalculator.
MediaPipe Tasks update
This section should highlight the changes that are done specifically for any platform and don't propagate to
other platforms.
Android
- Add GPU Origin proto to Java Tasks Library
iOS
- Added iOS Pose Landmarker result, options and helpers
- Added iOS language detector options, results, and helpers
- Added property to get labels from iOS Image Segmenter
- Added a test for getting labels from iOS image segmenter
- Updated iOS Image Segmenter documentation to use Swift names
- Added pose landmarker result helpers
- Added iOS pose landmarks connections
- Added iOS pose landmarker header
- Updated documentation
- Added language detector result helpers
- Added iOS language detector implementation
- Fixed extra condition check in iOS Image Segmenter Result Helper
- Added iOS Image Segmenter to CocoaPods build
- Fixed deletion of iOS output MPImage buffer in MPImage Utils
- Added GPU support
Javascript
- Add drawCategoryMask() to our public API
- Creates GpuBuffers around pre-allocated AHardware_Buffer objects.
- Allow OffscreenCanvas to be used by DrawingUtils
Python
- Added files for Face Stylizer Unit Tests
- Allow Mac to use GPU Delegate
- Use mp.ImageFormat instead of just ImageFormat
- Support 3-channel RGB images for Mac Python
- Added GPU support on Mac and Linux
Dependency changes
- Update WASM files for 0.10.8 relese