Major Features and Improvements
- Released MediaPipe Solutions APIs for Java, Python and Web that offer advanced end-to-end solutions for end-to-end on-device ML.
Bug Fixes and Other Changes
Bazel changes
- Updated bazelrc with required config
Framework and core calculator improvements
- Added Language Detector Python API and fixed a typo in Interactive Segmenter Options' docstring, Update CalculatorOptions to encourage proto3 options
- Updated roi not allowed check in ios vision task runner
- Updated normalized rect calculation for some angles in MPPVisionTaskRunner
- Added shell script for building cocoapods archive
- Added more pose landmarker tests and updated face landmarker tests to cover all the results
- Added Language Detector Python API and fixed a typo in Interactive Segmenter Options' docstring
- Add nullable annotation to AudioDataProducer#setAudioConsumer
- Add a default_applicable_licenses to model_maker/python/vision/core
- Added podspec for CommonObjects and Vision tasks
- Add customizable face stylizer module in MediaPipe model maker
- Add custom metadata for object detection model with out-of-graph nms
- Update MPImage to use containers
- Update the face stylizer config to match the latest encoder and detector config
- Add nose in facemesh drawing
- Added config for fat simulator builds
- Added http_archive to download opencv sources
- Added config settings to select building iOS xcframework from source for certain configs
- Updated BUILD files to use the open sourced Language Detector model
- Add the TFLite conversion API to BlazeFaceStylizer in model maker
- Add the "FACE_ALIGNMENT" output stream to the face stylizer graph
- Add an extra op to rescale face stylizer generation output from [-1, 1] to [0, 1]
- Add TransformerParameters proto
- Updated docuemntation of MPPObjectDetector
- Added hash implementation for iOS normalized keypoint
- Updated wait time for object detector tests
- Updated pixel format types in object detector
- Added flow limiter calculator and conditionally selected xcframework in iOS framework targets
- Added conditional building of opencv xc framework to test targets
- Update CalculatorOptions to encourage proto3 options
- Add support for single-channel images to MPImage
MediaPipe solutions update
Android
- Move Java Connections arrays to Task class
iOS
- Updated roi not allowed check in iOS vision task runner
- Removed roi apis from iOS object detector
- Added iOS Object Detector Objective D tests
- Removed detect in image with region of interest api from iOS Object Detector
- Updated iOS tests to reflect the new orientation calculation
- Updated iOS Image Classifier to reflect new calculation for normalized rect
- Updated build rules for iOS frameworks to duplicate symbols
- Updated iOS cocoapods build script
- Updated iOS framework names
- Added build file for iOS opencv from sources
- Updated iOS object detector to use delegates instead of callbacks for async calls
- Added hash implementation for iOS normalized keypoint
- Added flow limiter calculator and conditionally selected xcframework in iOS framework targets
- Updated deps names in iOS test targets
- Added iOS task text cocoapods podspec
- Added targets for iOS text frameworks
- Added method for creating unique dispatch queue names in MPPVisionTaskRunner
Javascript
- Add scribble support to InteractiveSegmenter Web API
- Update WASM files for Alpha 14
- Add .close() method to ImageSegmenterResult/InteractiveSegmenterResult/PoseLandmarkerResult
- Update FaceStylizer, ImageSegmenter, InteractiveSegmenter, PoseLandmarker to return MPImage
Python
- Added the PoseLandmarker Python API and a simple test
- Populate labels using model metadata for the ImageSegmenter Python API
- Added the Face Aligner Python API
- Expose PoseLandmarker as a public MediaPipe Tasks Python API
- Expose FaceAligner and LanguageDetector to be public MediaPipe Tasks Python API
- Add image_segmenter_metadata_schema and object_detector_metadata_schema python files to the mediapipe python wheels
- Add HAND_CONNECTIONS to HandLandmarker and GestureRecognizer
MediaPipe Dependencies
- Aded version of dependency to podspec template
- Updated common dependencies to link in helpers