Sensemo: An Affective Learning System based on Real TimeEmotion Recognition with Smartwatch

Background
In educational settings, both online and offline, monitoring and responding to students' emotional states can significantly enhance learning outcomes. Traditional approaches rely heavily on subjective observations by teachers, which can be inconsistent and limited by human perception and attention. In online environments, the challenge is even greater due to the physical separation between students and instructors, making it difficult to gauge engagement and emotional responses accurately. Existing methods often lack real-time adaptability and fail to provide personalized interventions, thereby affecting the overall efficacy of the learning experience. Additionally, the need for specially designed teaching materials and prerecorded content to accommodate emotional responses adds complexity and resource demands. These limitations highlight the necessity for more sophisticated, real-time emotion-sensing technologies that can seamlessly integrate into both online and offline educational frameworks.
Technology
Sensemo is designed for both online and offline learning environments, utilizing smartwatches to collect real-time physiological signal data from students. This data is transmitted to a server via an Android app for further processing. In online learning, the system adapts the learning experience by adjusting the speed or content based on the student's emotional responses, either automatically or through teacher intervention. Teachers can monitor and override the system's actions as needed, using specially designed teaching materials and prerecorded lecture segments. In classroom settings, lecturers use the emotional feedback to engage in interactive learning, aiming to maintain positive emotional responses among the majority while addressing individual needs.
Advantages
Real-time Emotion Monitoring - Adaptation of Learning Material - Teacher Override Capability - Interactive Classroom Learning - Unified Online and Offline Application - Physiological Data Utilization - Enhanced Student Engagement
Application
The system monitors individual students' emotional responses in real-time and adjusts the speed or content of the lesson to enhance engagement and learning outcomes. Lecturers can use real-time emotional feedback from students to tailor their teaching methods, ensuring a positive emotional response from the majority and addressing the needs of less engaged individuals.
Inventors
Shan Lin, Assistant Professor, Electrical Engineering
Licensing Potential
Development partner - Commercial partner - Licensing
Licensing Status
Available for licensing
Licensing Contact
James Martino, Licensing Specialist, Intellectual Property Partners, james.martino@stonybrook.edu,
Patent Status
No patent
Stage of Development
Tech ID
050-9215