google-ai-edge/mediapipe v0.10.7

MediaPipe v0.10.7

on GitHub

Framework and core calculator improvements

• Fix win32 build break in mediapipe.
• Remove 'awaiting' labels when user issue/PR updated.
• Fix glScalerCalculator not clearing background in FIT mode
• Add cc_binary target for C Libraries
• Only recreate immutable texture when necessary for Android TensorsToSegmentationCalculator.
• Update PackMediaSequenceCalculator to support index feature inputs on the CLIP_MEDIA_ input tag.
• Added concatenate stream, get_vector_item stream, landmarks_to_tensor stream, tensor_to_joints stream utility function.
• Introduce TensorToJointsCalculator and LandmarksTransformationCalculator
• smoothing stream utility function.
• Don't convert nullptr to std::string in C layer
• Fix memory access issue in C layer
• segmentation smoothing stream utility function.
• Populate the classification result output param instead of a copy
• Add tests for C API containers
• Add unit tests for C layer for the input types of Text Classifier
• Add End to End test for Text Classifier C API
• Add error handling to C API
• Added files for the TextEmbedder C API and tests
• See memory of freed result to nullptr
• Smooth pose landmarks
• GlSurfaceViewRenderer: Capture graph output texture
• Prefix status macro implementation with MP_.
• Introduce CombineJointsCalculator and SetJointsVisibilityCalculator
• Add stream API presence utils.
• Fixed some issues with documentation
• Add stream API merge utils.
• Update glog to latest commit

MediaPipe Tasks update

This section should highlight the changes that are done specifically for any platform and don't propagate to
other platforms.

Android

• Do not convert milliseconds to microseconds twice
• Fix bug missing SHOW_RESULT in image generator
• Fix depth condition bug when only depth condition is configured.

iOS

• Added iOS face stylizer result, options and header
• Added iOS MPPFileInfo for tests
• Added new initializers for iOS MPPImage in test utils
• Added iOS MPPMask test utils
• Added iOS image segmenter basic Objective C tests
• Updated multiply function in iOS Image Segmenter tests to use C++ vectors
• Fixed premature deallocation of C++ masks in iOS Image Segmenter
• Updated interface of iOS image segmenter
• Added selfie segmentation and running mode tests to image segmenter
• Uncommented live stream test in iOS image segmenter tests
• Updated iOS Face Detector Objective C API names
• Updated iOS Face Landmarker,hand landmarker,Object Detector Objective C API names
• Added iOS Image Segmenter tests for methods with completion handlers
• Added methods to create iOS MPImage with source type UIImage from a C++ image.
• Changed de-allocation method in data provider release callback
• Fixed error messages
• Updated error messages in MPPImage Utils

Javascript

• Add helper to create Connection array
• Add export declaration for FaceDetector
• Add export declaration to FaceDetector.detect()
• Do not use full filename when FileLocator decides which asset to load

Bug fixes

Fixed Pose Landmarker jittering issue

Model Maker changes

Add export_model_with_tokenizer to Text Classifier API.

MediaPipe Dependencies

Update WASM files for 0.10.7 release