We're excited to announce react-native-executorch v0.3.0. Packed with powerful new features to enhance your on-device AI experience 🎉
What's New
🗣️ Speech to Text– Transcribe your audio using Whisper and Moonshine
🎮 Speech to Text example - See how to integrate Speech to Text into your app
📖 OCR– Optical Character Recognition for extracting text from images
🚀 MPS Support – Optimized execution on iOS using Metal Performance Shaders
⚡ Hookless API – Run models outside of React components for greater flexibility
🧠 LLM Message History – Provide your LLMs with some context
⬇️ Background Model Downloads – Fetch models seamlessly in the background
📊 Benchmarks – Gain performance insights into AI models
🧪 vertical OCR - Experimental Optical Character Recognition for extracting vertical text from images
What's Changed
- docs: fix typo by @NorbertKlockiewicz in #70
- docs: correct title casing and minor typos by @chmjkb in #71
- docs: Add matching details section in the docs by @jakmro in #72
- fix: issue with isModelGenerating when switching between multiple models by @NorbertKlockiewicz in #73
- docs: Add landing page by @jakmro in #78
- docs: Improvements by @jakmro in #79
- Add video clip to README by @darthez in #85
- Update admonitions colors by @jakmro in #86
- chore: Add lefthook back by @chmjkb in #88
- fix typo tokenizer -> tokenizerSource by @mkopcins in #89
- feat: Hookless API by @jakmro in #82
- docs: Add a quickstart guide for Llama by @chmjkb in #91
- docs: Benchmarks by @jakmro in #92
- fix: Correct link in ExecuTorch bindings documentation by @jakmro in #93
- feat: Add MPS support by @jakmro in #102
- Use expo-file-system and expo-asset to fetch files by @jakmro in #97
- feat: Make third-party/ExecuTorchLib's forward() accept multiple inputs by @chmjkb in #83
- feat: Whisper by @chmjkb in #101
- fix: Remove duplicated native function in ArrayUtils.kt by @chmjkb in #106
- feat: ocr(ios) by @NorbertKlockiewicz in #84
- feat: LLM message history by @jakmro in #104
- feat: implemented vertical ocr by @NorbertKlockiewicz in #109
- design: change design of displaying ocr results by @NorbertKlockiewicz in #112
- feat: moonshine and whisper streaming by @mkopcins in #110
- docs: Add v0.3.0 documentation by @jakmro in #114
- changed isModelReady to isReady by @mkopcins in #115
New Contributors
Full Changelog: v0.2.0...v0.3.0