ECE 110/120 Honors Lab Section : I Can Hear You

Statement of Purpose

Our project’s purpose is to detect human speech and position indicated by a LED light. Students are often exposed to dangerous places at night and we want to solve this problem by using the “I Can Hear You” device. It allows the person to know the location of another person by the human’s sound frequency. 

Background Research

The main sensor we are using is a microphone. We found an article about how they made a robot that can differentiate a human's voice from any other noise, and then turn to the direction where the voice is coming from. We are using two microphones, and each of them will detect different magnitudes of sound depending on its location relative to the sound source. The system recognizes speech and determines the location via time difference of arrival (TDOA). We are using a generalized cross correlation method to implement the sound source localization. A generalized cross correlation, GCC, allows measuring the time difference between two sensors, specifically microphones. 

Block Diagram / Flow Chart

System Overview

The microphone amplifier will receive sound which will then be filtered through the bandpass filter depending on its frequency. The arduino then analyzes the data and detects the location of the sound. One of the LEDs will light depending on the location. 

Parts

Possible Challenges

• Building a band pass filter that is narrow enough to not pick up everything

• Communicating information between the sensor and the action

• More complex coding 

References

C. Scola and M. Ortega, Diva-portal.org, 2021. [Online]. Available: http://www.diva-portal.org/smash/get/diva2:830430/FULLTEXT01.pdf. [Accessed: 15- Oct- 2021].

J. Wang, M. Zhang, Z. Pan and H. Li, 2021. [Online]. Available: https://www.researchgate.net/profile/Jiadong-Wang-7/publication/354983550_GCC-PHAT_with_Speech-oriented_Attention_for_Robotic_Sound_Source_Localization/links/61567c6f4a82eb7cb5d81096/GCC-PHAT-with-Speech-oriented-Attention-for-Robotic-Sound-Source-Localization.pdf. [Accessed: 15- Oct- 2021].

M. Liaquat, H. Munawar, A. Rahman, Z. Qadir, A. Z. Kouzani and M. Mahmud, Mdpi.com, 2021. [Online]. Available: https://www.mdpi.com/1996-1073/14/12/3446/pdf#:~:text=Sound%20localization%20microphone%20arrays%20utilize,of%20sound%20waves%20%5B8%5D.&text=This%20process%20of%20sound%20source,on%20time%20delay%20%5B4%5D. [Accessed: 08- Oct- 2021].

Pavleski, M., 2021. DIY Ultra Sensitive EMF Detector. [online] Arduino Project Hub. Available at: <https://create.arduino.cc/projecthub/mircemk/diy-ultra-sensitive-emf-detector-4be895> [Accessed 20 September 2021].

X. Danga and H. Zhu, "A feature-based data association method for multiple acoustic source localization in a distributed microphone array", The Journal of the Acoustical Society of America, 2020. [Online]. Available: https://asa.scitation.org/doi/full/10.1121/10.0003333. [Accessed: 15- Oct- 2021].