SnapLaunch is a Flutter-based utility app that intelligently bridges image recognition, machine learning, and app automation.
It helps users perform actions directly from screenshots — whether it's navigating to a place or calculating a math expression — without manually typing anything.
- Upload a Google Maps screenshot from your gallery.
- The app uses Google ML Kit to extract the location text.
- Tap “Open with Google Maps” and the app will:
- Automatically open the Google Maps app.
- Navigate to the detected location (approximate based on extracted text).
Example Use Case:
You receive a location screenshot on WhatsApp — just upload it and it instantly opens it in Google Maps.
- Upload a calculator screenshot containing a mathematical expression.
- SnapLaunch extracts the equation using Google ML Kit.
- Tap “Open with Calculator” and the app will:
- Request Accessibility permission (to automate calculator input).
- Open the Google Calculator app.
- Automatically type and display the same calculation.
Example Use Case:
Have a photo of a long equation? Upload it, and it instantly opens your calculator and performs the same calculation — no typing required.
- Powered by Google ML Kit’s Text Recognition, ensuring:
- High accuracy in text extraction.
- Support for different fonts and resolutions.
- Real-time optimization for common app UIs (Maps and Calculator).
- The system is designed to work seamlessly with cropped calculator screenshots, where only the equation portion is provided for optimal OCR accuracy.
- A custom machine learning model is being trained to automatically classify uploaded images as either:
- Google Maps screenshots, or
- Calculator screenshots.
- Once integrated, this feature will allow SnapLaunch to automatically detect the image type and perform the correct action — without needing user input.
- Designed to integrate seamlessly with:
- Google Maps
- Google Calculator
- Uses Flutter’s platform channels and accessibility services for precise automation.
- Requires Gallery Access to select screenshots.
- Requires Accessibility Permission only for calculator automation.
- No data is sent to external servers — all processing happens locally on the device.
Component | Technology |
---|---|
Framework | Flutter |
Language | Dart |
OCR Engine | Google ML Kit (Text Recognition) |
App Automation | Android Accessibility Service |
Integration | Google Maps API, Google Calculator |
- 🔹 Integrate the trained ML model for automatic image-type detection (Maps vs. Calculator).
- 🔹 Support for more calculator apps (beyond Google Calculator).
- 🔹 Expand recognition for other app types (e.g., Notes, URLs, Contact Cards, etc.).
- 🔹 Improve mapping accuracy for Google Maps by refining OCR-based location parsing.
- 🔹 Allow full screenshot support for calculator images through smarter region detection.