Project Overview

  • Project Name: Sign Saathi
  • Purpose:
    • Innovative application for learning and practicing Pakistan Sign Language (PSL).
    • Uses AI-driven avatar animations and machine learning models.
    • Translates text, audio, and image inputs into sign language gestures.
    • Provides an interactive practice mode and real-time feedback to enhance proficiency.

Target Audience

  • Deaf or Hard-of-Hearing Individuals:
    • Facilitate effective communication using PSL.
  • Sign Language Learners:
    • Students, educators, and enthusiasts interested in PSL.
  • Teachers and Trainers:
    • For educational use in training environments.
  • Family and Friends of Deaf Individuals:
    • To improve communication with loved ones.
  • Organizations:
    • Educational institutions and non-profits supporting accessibility.

Project Objectives

  1. Develop a sign language translation system for converting text, audio, and images into PSL gestures using an animated avatar.
  2. Implement a practice mode for users to practice PSL gestures with computer vision and receive real-time feedback.
  3. Provide personalized learning pathways through structured courses and quizzes tailored to individual learning needs.
  4. Ensure cross-platform availability on both Android and iOS.
  5. Integrate progress tracking and analytics for monitoring user learning.

Scope Statement

Inclusions

  • Multi-modal Input Translation:
    • Users can input text, audio, or images for PSL translation.
  • Animated Avatar:
    • Utilizes Unity engine to display accurate PSL gestures.
  • Real-Time Practice Mode:
    • Enables users to practice and get AI-driven feedback.
  • Personalized Learning Modules:
    • Courses and quizzes customized to proficiency levels.
  • User Profile Management:
    • Features secure login and progress tracking.
  • Data Storage & Analytics:
    • Stores learning history and offers performance reports.
  • Offline Access:
    • Downloadable modules for offline learning.

Exclusions

  • Initial release will not support non-PSL sign languages (e.g., ASL, BSL).
  • No human-to-human real-time sign language interpretation.
  • Limited offline functionality; some features need internet access.

Project Deliverables

  • Functional Application:
    • A working PSL learning mobile application.
  • AI-Driven Avatar System:
    • Avatar performing PSL gestures built on Unity.
  • User Authentication System:
    • Ensures secure login and personalized experience.
  • Progress Tracking and Analytics Module:
    • Stores and evaluates user performance.
  • Offline Learning Feature:
    • Lessons available for download for limited connectivity.
  • User Documentation:
    • Guides and tutorials for onboarding users.

Constraints and Assumptions

Constraints

  • Hardware Limitations:
    • Requires mobile devices with camera and microphone capabilities.
  • Performance Considerations:
    • Real-time processing limitations on low-end devices.
  • Internet Dependency:
    • Features like AI-driven feedback require an active internet connection.

Assumptions

  • Users have smartphones with functional cameras for gesture recognition.
  • Availability of internet connectivity for cloud processing.
  • Continuous support for the Unity engine for avatar animations.

Project Timeline

PhaseTasksEstimated Completion
PlanningDefine scope, requirements gatheringWeek 1
DesignUI/UX design, avatar creationWeek 2-3
DevelopmentBackend & frontend implementationWeek 4-8
TestingUnit testing, user feedback incorporationWeek 9-10
DeploymentApp launch and documentationWeek 11
Post-LaunchBug fixes, updatesOngoing

Acceptance Criteria

  • Accurate translation of text, audio, and images into PSL gestures.
  • High accuracy of avatar in performing PSL gestures.
  • Effective evaluation of user gestures in the practice mode with AI feedback.
  • User profiles with progress tracking and customized learning experiences.
  • Secure user authentication and data protection ensured.
  • Smooth performance of the application on both Android and iOS.

Document Formatting Guidelines

  • Proper structure for headings and subheadings.
  • Use clear and concise language.
  • Utilize tables and bullet points for readability.
  • Maintain consistent font and formatting.
  • Include page numbers and a title page for organization.

Conclusion

  • Sign Saathi is a revolutionary AI-powered application for PSL learning, utilizing multi-modal translation and interactive practice modes. This scope document serves as a roadmap to ensure efficient project execution while meeting user needs and accessibility standards.