Bazel changes
- Add
@to all references to files inWORKSPACE.bazel
Framework and core calculator improvements
- Added MPPTextEmbedderOptions, MPPTextEmbedderOptionsHelpers, MPPImageClassifierOptions
- Added volume_gain_db option into AudioToTensorCalculator
- Added MPPEmbedding, MPPEmbeddingResult, MPPTextEmbedderResult
- Added iOS text embedder result files
- Update test to reflect the recommended graph construction style:
- Add FrameBuffer format
- Updated documentation of embedding containers
- Add YuvImage as a GpuBuffer storage backend
- Updated to types of float and quantized embedding
- Add Text Embedder tests for text with different themes
- Added MPPEmbeddingHelpers, MPPEmbeddingResultHelpers, MPPTextEmbedderOptionsHelpers, MPPTextEmbedderResultHelpers, MPPTextEmbedder
- Add "noasan" to MPPTextClassifierObjcTest
- Added MPPCosineSimilarity and cosine similarity to MPPTextEmbedder
- Added text embedder objective c tests
- Add ViewProvider to YuvImage storage backend
- Update MP Tasks to observe timestamp bounds
- Updated swift name for ImageSource Type
- Updated list of designated initializers
- Update TensorFlow to latest
- Add more filtering methods to detection filter calculator
- Update WASM files for 0.1.0-alpha-4 release
- Updated the Begin/EndLoopCalculator to be able to handle mediapipe::Tensor
- Add location info in registry (debug mode only)
- Added vision task runner
- Added designated initializer in vision task runner
- Updated MPPImageUtils with methods to create image frame
- Updated MPPVisionTaskRunner
- Add mediapipe tasks face blendshapes graph
- Add "java_package" and "java_outer_classname" to ImageTransformationCalculatorOptions
- Updated method name in MPPVisionPacketCreator
- Update MediaPipe TFLite code to use generic "shim" symbols and headers
- Update detection result to include optional keypoints
- Update face detector graph for downstream face landmarks graph
- Add Bitmap image capture capability to GlSurfaceViewRenderer
- Update ImageSegmenter API for image/video mode to have both callback API and returned result API
- Small fixes to TensorsToImageCalculator
- Add optional face blendshapes to face landmarks detector graph
- Add a CHECK for the cases when null service is accessed unconditionally
- Add FaceLandmarkerResult for FaceLandmarker API
- Add ViewProvider for ImageFrame in GpuBufferStorageYuvImage
- Add GetInputImageTensorSpecs into BaseVisionTaskApi for tasks api users to get input image tensor specifications
- Add custom metadata in metadata_schema
- Add FaceDetectorResult
- Add volume_gain_db option to TensorsToAudioCalculator
- Add build system for Halide and expose FrameBufferUtils
- Add requiredInputBufferSize as an input argument of createAudioRecord
- Update ImageFrameToGpuBufferCalculator to use api2 and GpuBuffer conversions
- Add Empty Packet support to GraphRunner
- Add support for [xmin, ymin, xmax, ymax] style of bbox output
- Add TensorsToFaceLandmarksGraph to support two types of face mesh models
MediaPipe solutions update
This section should highlight the changes that are done specifically for any platform and don't propagate to
other platforms.
Android
- Remove usage of var for ImageSegmenter.java
- When "--define=MEDIAPIPE_NO_JNI=1" used in compilation, no implementation in libandroid.so is used
iOS
- Added iOS text embedder result files
- Added iOS test for different themes in text embedder
- Added iOS test for quantized embedding
- Added a note about swift test coverage in iOS text embedder tests
- Added MPPTaskImage for iOS vision tasks
- Open visibility of iOS TextClassifier & TextEmbedder
- Solve Linking error for Hello World iOS example
- Added swift tests for text embedder
Javascript
- Fix incorrect uint8 -> int8 conversion in JS cosine similarity
- Add MediaPipe Image Segmenter task for Web
Python
- Enable Python Audio Classifier & Embedder on Windows
Bug fixes
- Bug fixes in MPPImage
- Ssd anchors calculator add fixed anchors
MediaPipe Dependencies
- Bump Halide version from 14.0.0 to 15.0.0 and add MacOS Halide dependency