Build changes
- Add libtext and libvision build rules
- Add lib targets for all C vision tasks
Framework and core calculator improvements
- Added files for the Image Embedder C API and tests
- Pass Model Asset Buffer as byte array + length
- Drop default arguments in C API
- Updated the Image Embedder C API and added tests for cosine similarity
- Drop default arguments in Image Embedder C API
- Remove const from input types of C API
- Resolved issues and added a common header to hold all the necessary structures for the vision tasks
- Refactor OpenCV path out of TensorsToSegmentationCalculator main file.
- Add some convenience getters to EglManager.
- Added files for the Object Detector C Tasks API
- Explicitly delete some copy operations to improve compile errors.
- Extract CPU conversion methods into a separate library & add test
- Updated components and their tests in the C Tasks API
- Ensure that releaseGl() is called if prepapreGl throws
- Adding a GpuTestWithParamBase test class to support value parameterized tests
- Added Gesture Recognizer C API and tests
- Holistic Landmarker C++ Graph
- Revised Gesture Recognizer API implementation and associated tests
- Added FreeMemory test for GestureRecognizerResult
- Refactor GestureRecognizerResult conversion for default initialization
- Move LanguageDetectorResult converter to LanguageDetector task
- Add TensorsToSegmentationCalculator test utilities.
- Added Hand Landmarker C Tasks API and tests
- Export java package for hand_roi_refinement_graph_options.
- Fix naming in different files
- Create an explicit GlRuntimeException class
MediaPipe Tasks update
This section should highlight the changes that are done specifically for any platform and don't propagate to
other platforms.
Android
- Create shared utilities to construct category lists
- Create shared utilities to construct landmark lists
- Add the result class for the HolisticLandmarker Java API
- HolisticLandmarker Java API
- Add dependency on hand_roi_refinement_graph_options_proto
- Use Java Proto Lite Target for Hand ROI Refinement proto
- Move hand_roi_refinement_graph_options_java_proto_lite to vision lib
iOS
- Added iOS MPPPoseLandmarker.mm
- Added null check for segmentation masks in pose landmarker helper initializer
- Added pose landmarker protobuf utils
- Fixed graph name in iOS language detector
- Added iOS language detector tests
- Added iOS Objective C Pose Landmarker Tests
- Added iOS interactive segmenter options
- Added iOS region of interest
- Added iOS region of interest helpers
- Updated iOS vision/core to add methods for processing region of interest
- Added iOS interactive segmenter header
Javascript
- Creates GpuBuffers around pre-allocated AHardware_Buffer objects.
- Add drawConfidenceMask() to our public API
- Use gl.LINEAR interpolation for confidence masks
- Add missing export declarations to DrawingUtils
Python
- Example updated for mp.Image in documentation
- Added image classifier benchmark
- Updated copyright
- Documented the return value and added percentile to argparser
- Allowed a default value for the model argument
- Added more benchmark scripts for the Tasks Python API
- Code cleanup and revised benchmarking API
- Removed unused param
Model Maker changes
- Add option to omit the checkpoint callback in text classifier.
- Add BinaryAUC metric and Best Checkpoint callback to Text Classifier
- Remove batch dimension from the output of tflite_with_tokenizer in text classifier.