Project
| # | Title | Team Members | TA | Documents | Sponsor |
|---|---|---|---|---|---|
| 15 | Emotionally Intelligent Mirror |
Aishwarya Rajesh Apurva Chanda Tala Aoun |
Akshatkumar Sanatbhai Sanghvi | design_document1.pdf final_paper1.pdf photo1.jpg photo2.png proposal1.pdf video1.mp4 |
|
| # Emotionally Intelligent Mirror Team Members: - Aishwarya Rajesh (arajesh4) - Apurva Chanda (apurvac2) - Tala Aoun (taoun2) # Problem These past few years have highlighted the need for strategies alleviating mental and physical health issues especially during Covid-19. In particular, many who live alone face loneliness and seek comfort/companionship. A potential solution to provide accessible technology to all is a smart mirror that can understand your emotions in real-time and communicate with you. The mirror should also be able to track a user’s emotions on a long-term basis to see if any improvements or deteriorations are occurring. # Solution The mirror will be able to understand the user’s emotions such as happiness, anger, sadness and neutral and respond accordingly to each emotion by reciting comforting words, playing music and sympathizing with the user. On a long term basis, the mirror will store information about a user’s mental health that has been gathered from facial expressions and emotions to track a user’s progress and see if any improvements or deteriorations are occurring. If a user’s emotions are obviously getting worse in the long term, the mirror would be able to provide resources like crisis hotlines or telehealth to help the user. In regards to privacy issues, the mirror will be password protected so that each user can have their own profile and data. # Solution Components ## User Detection System The components in the user detection system will be used together to detect a subject in the space (the user). The depth sensor will be able to distinguish the user from their surroundings. Then the camera will evaluate their facial features using the Viola-Jones framework, which will compare the user’s facial features among set standards (generally the Haar features) to determine their emotion. The microphone and speaker will be used so that the mirror can communicate with the user. - Depth Sensor (Lens Board OV5647 or TeraRanger Evo Mini) - Camera (Digikey IMX219 Camera Sensor NVIDIA Jetson Nano) - Microphone (3.55 mm pc microphone) - Speakers (Portable Speaker JBL GO) ## Power - To power the project, we are planning on utilizing power from a wall source. A combination of regulators, AC to DC converter, and USB port will be used to power all the components - Regulators (Switching and/or Linear Voltage Regulator) - USB port (Depends on the chosen microcontroller) - AC to DC converter (3.3 V, 5 V, 12 V – Standard values that will be helpful) - External Supply (Wall 130 V AC Source) ## Display In order to display all the information and interface with the user, there will be a monitor attached on a wall. To reduce overall power consumption from the external wall source, we will include LED lighting to better see and receive visual input from the user. - Monitor/TV (LCD TV, Mid-Size Mirror) - LED Lighting (LED Strip Lighting) ## Integration All the components will be integrated using the brain of our overall system. The microcontroller will facilitate communication (such as I2C and UART) and inputs (such as microphone) coming in between the microcomputer and other components. - Microcontroller (ATmega328p, Attiny85, or Raspberry Pi) - Microcomputer (ATmega32 series, Arduino Y) # Criterion For Success - Camera detects a person looking into the mirror and greets them based on the sensor system correctly identifying whether the person is feeling a negative, positive or neutral emotion - After identifying if an emotion is negative, positive or neutral, the mirror will be able to recognize which emotion the person is feeling (joy, sadness, anger, fear, disgust, and surprise). It will be able to identify the six basic human emotions. - The microcomputer will store data about each person who uses the mirror and it will store the amount of negative and positive emotions they experience over a period of time (i.e. a month) and recommend resources if a negative trend is detected. - Emotion profiles will be password-protected so each user can only see their own data. |
|||||