ECE 110/120 Honors Lab Section : Interactive LED Board

Statement of Purpose

We want to make an interactive LED Board which can map a person in front of the camera onto the LED board. We think putting an interactive LED board in public spaces gives people a chance to express themselves and get a laugh from seeing themselves. To accomplish our project, we decided to use an Arduino UNO R3, an infrared camera and a 32*32 LED board.

Background Research

The idea was inspired by a Disney project. The project displayed people as Disney characters whenever they would walk in from of the board. Besides the Disney example, the next closest thing to our idea is any of the several dancing games, such as Just Dance on Xbox.

Block Diagram / Flow Chart

System Overview

Our overall system runs on Arduino to divided the image we get from the infrared camera into blocks and map them onto the pixels on the LED board.

Parts

Possible Challenges

Maximum distance that Infrared Camera can detect.

Image on the LED board might include something else rather than person.

References

Arducam. 2021. 1.3MP MT9M001 - Arducam. [online] Available at: <https://www.arducam.com/docs/camera-breakout-board/1-3mp-mt9m001/> [Accessed 20 September 2021].

List all references you used in your proposal. This is important, you do not want to be blamed for plagiarism. IEEE citation format is highly recommended. You can use citethisforme.com's IEEE citation generator to painlessly generate your references in this style.

Camera References

Start code for USB camera shield: https://github.com/ArduCAM/ArduCAM_USB_Camera_Shield

Pin out: https://www.arducam.com/docs/camera-breakout-board/1-3mp-mt9m001/hardware-guide/

https://github.com/ArduCAM/Arduino

Infrared project references from GitHub

LED Board References

Demo files: https://github.com/hzeller/rpi-rgb-led-matrix

Implementation of the color-to-thermal image translation: https://github.com/vlkniaz/ThermalGAN

Arduino sketches that show how to output temperature data from the MLX90640 sensor: https://github.com/sparkfun/SparkFun_MLX90640_Arduino_Example

Feature-based person detection project: https://github.com/YuriyKozhev/ThermalPeopleDetection/blob/master/Article_Reviews/Mikhaylova-Eugenia/%D1%81%D1%82%D0%B0%D1%82%D1%8C%D1%8F_Feature_based_person_detection.pdf

Arduino IDE Download/Tutorial: https://www.elegoo.com/pages/arduino-kits-support-files

Arduino Project Tutorial(Simplified Chinese): https://www.jianshu.com/nb/28037324

• LED lattice screen Example: https://www.jianshu.com/p/7848f0b14881
• Set up camera on Arduino: https://www.yiboard.com/thread-1168-1-1.html