Skip to content

mdgspace/SnapLaunch-Flutter

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 
 
 
 
 
 
 
 
 
 
 

SnapLaunch Project (by MDG Space)

SnapLaunch is a Flutter-based utility app that intelligently bridges image recognition, machine learning, and app automation.
It helps users perform actions directly from screenshots — whether it's navigating to a place or calculating a math expression — without manually typing anything.


Core Features

1. Google Maps Screenshot Recognition

  • Upload a Google Maps screenshot from your gallery.
  • The app uses Google ML Kit to extract the location text.
  • Tap “Open with Google Maps” and the app will:
    • Automatically open the Google Maps app.
    • Navigate to the detected location (approximate based on extracted text).

Example Use Case:

You receive a location screenshot on WhatsApp — just upload it and it instantly opens it in Google Maps.


2. Calculator Screenshot Automation

  • Upload a calculator screenshot containing a mathematical expression.
  • SnapLaunch extracts the equation using Google ML Kit.
  • Tap “Open with Calculator” and the app will:
    • Request Accessibility permission (to automate calculator input).
    • Open the Google Calculator app.
    • Automatically type and display the same calculation.

Example Use Case:

Have a photo of a long equation? Upload it, and it instantly opens your calculator and performs the same calculation — no typing required.


3. Intelligent Text Recognition

  • Powered by Google ML Kit’s Text Recognition, ensuring:
    • High accuracy in text extraction.
    • Support for different fonts and resolutions.
    • Real-time optimization for common app UIs (Maps and Calculator).
  • The system is designed to work seamlessly with cropped calculator screenshots, where only the equation portion is provided for optimal OCR accuracy.

4. Smart Image Classification (Under Development)

  • A custom machine learning model is being trained to automatically classify uploaded images as either:
    • Google Maps screenshots, or
    • Calculator screenshots.
  • Once integrated, this feature will allow SnapLaunch to automatically detect the image type and perform the correct action — without needing user input.

5. Smooth App Integration

  • Designed to integrate seamlessly with:
    • Google Maps
    • Google Calculator
  • Uses Flutter’s platform channels and accessibility services for precise automation.

6. Privacy and Permissions

  • Requires Gallery Access to select screenshots.
  • Requires Accessibility Permission only for calculator automation.
  • No data is sent to external servers — all processing happens locally on the device.

Tech Stack

Component Technology
Framework Flutter
Language Dart
OCR Engine Google ML Kit (Text Recognition)
App Automation Android Accessibility Service
Integration Google Maps API, Google Calculator

Future Enhancements

  • 🔹 Integrate the trained ML model for automatic image-type detection (Maps vs. Calculator).
  • 🔹 Support for more calculator apps (beyond Google Calculator).
  • 🔹 Expand recognition for other app types (e.g., Notes, URLs, Contact Cards, etc.).
  • 🔹 Improve mapping accuracy for Google Maps by refining OCR-based location parsing.
  • 🔹 Allow full screenshot support for calculator images through smarter region detection.

Acknowledgements


About

No description, website, or topics provided.

Resources

License

Code of conduct

Contributing

Security policy

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 2

  •  
  •