Sign2Text is an open-source American Sign Language (ASL) translation application that uses machine learning to convert sign language gestures into text in real-time. Built with Flutter and powered by PyTorch, it provides an accessible way for users to translate ASL signs through their mobile device's camera.
Currently, Sign2Text can only translate ASL Alphabet gestures.
Developed by the team below, sponsored by Yeterly Software, YeterlyAI division through the University of California, Santa Cruz.
- Aman, Maz - Product Owner
- Amudhasagaran, Rahul - Machine Learning Engineer
- Nguy, Megan - Frontend Engineer
- Tiwari, Akshat - Machine Learning Engineer
- Tran, Dylan - Machine Learning Engineer
- Real-time ASL gesture recognition
- Image capture and processing
- User authentication and profile management
- Dark/Light theme support
- Responsive design for various screen sizes
- Data collection module for continuous improvement
- Frontend: Flutter/Dart
- Backend: Python (FastAPI, Flask)
- ML Framework: PyTorch
- Authentication: Firebase
- Cloud Infrastructure: Google Cloud Run
- CI/CD: GitHub Actions
-
Flutter Mobile Application
- Cross-platform mobile and Web client (Android, Browser)
- Real-time ASL translation
- User authentication and data collection features
- Responsive design with dark/light theme support
-
Authentication & Data Collection Server (Flask)
- User management and authentication
- Training data collection and storage
- Firebase integration for data persistence
-
ML Inference Server (FastAPI)
- Real-time ASL gesture recognition
- Optimized for low-latency predictions
- Scalable containerized deployment
[Flutter App]
│
├──► [Authentication Service]
│
├──► [ML Inference Service]
│
└──► [Data Management Service]
This repository contains documentation and demonstrations of the Sign2Text application. To request access to the APK for evaluation or research purposes, please contact:
Email: [email protected]
Please include:
- Your name and organization
- Intended use case
- Research/Development purpose
- Android 6.0 (API level 23) or higher
- Camera permission
- Internet connection for full functionality
- 100MB free storage
- Download the APK from the releases page
- Enable installation from unknown sources in your device settings
- Install the APK
- Grant required permissions when prompted
While this is a demo version of a larger project, we welcome feedback and suggestions through issues.
Copyright (c) 2024 Yeterly Software
This repository ("Software") and its documentation are protected by copyright law and international treaties. The Software is licensed, not sold, and is intended for demonstration and educational purposes only.
Users are permitted to:
- View and study the public documentation
- Fork this repository for personal study
- Request access to the application binary (APK) through proper channels
Unless explicitly authorized in writing, users may not:
- Redistribute any part of the Software
- Create derivative works based on the Software
- Reverse engineer, decompile, or disassemble the Software
- Use the Software for commercial purposes
- Access or attempt to access the application binary without permission
- The application binary (APK) is available only through direct request
- Access is granted on a case-by-case basis
- Usage terms will be provided with approved access
- Additional agreements may be required for APK access
- All intellectual property rights are retained by Yeterly Software
- No license to patents, trademarks, or other rights is granted by this document
- The Software's machine learning models and algorithms remain proprietary
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT.
IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
For permissions, access requests, or questions: Email: [email protected]
Yeterly Software reserves the right to terminate any access or permission granted under this license at any time and for any reason.
This license is subject to change without notice. Continued use of the Software constitutes acceptance of such changes.