Project

# Title Team Members TA Documents Sponsor
59 Gesture Controlled Surveillance Robot
 Kushl Saboo
Roshni Mathew
Suvid Singh
 Argyrios Gerogiannis photo1.jpeg
photo2.jpeg
photo3.jpeg
video
# Gesture Controlled Surveillance Robot

Team Members:
- Roshni Mathew (roshnim3)
- Kushl Saboo (kushls2)
- Suvid Singh (suvids2)

# Problem
In disaster and rescue scenarios (collapsed structures, smoke-filled buildings, unstable debris fields), responders often need quick situational awareness without putting people at additional risk. Small ground robots can provide remote surveillance, but many are controlled using joysticks or complex interfaces that require training and constant fine-grained input. In high-stress environments, precise manual control becomes a liability as it increases cognitive load, slows down deployment, and makes it harder for responders to focus on interpreting the scene and coordinating rescue actions. The result is that existing teleoperated robots can be underutilized or difficult to operate effectively when time and attention are limited.

# Solution
We will build a rescue surveillance robot with an intuitive gesture-based control interface that translates simple hand motions into high-level movement commands, paired with onboard safety behaviors to reduce operator burden. The operator wears a gesture device (IMU-based glove or wrist module) that detects orientation/motion and wirelessly transmits commands such as move forward, turn, stop, rotate/scan, and return. The robot executes these commands while enforcing safety constraints (slowing/stopping near obstacles), and provides real-time situational awareness through video streaming and sensor feedback. This enables faster, more natural control than a traditional remote controller, allowing responders to deploy the robot quickly and maintain attention on the environment rather than micromanaging the robot’s motion.

# Solution Components

## Subsystem 1
We want to make a glove that would recognize the different gestures made and transmit the corresponding motion to the robot. The motions we want the glove to recognize are forward/backward, turn left/right, and stop. Additional features, if we have time, would include “come back” and “spin/dance”.

Base System - Custom PCB
1. IMU
2. Bluetooth Transmitter/Receiver
3. 3-4 Flex sensors (1 for each finger)
4. 1 MCU (think Raspberry Pi chip)
5. Buttons to control the mode and turn on
6. Battery (PSU)

Additional System:
1. 1 Haptic Feedback Module

With the base system, the purpose of the IMU would be to detect pitch and roll because these motions would correspond with directions. Then the flex sensors would be used to detect stop and come back. We would have an MCU on the glove that will detect the different movements and send commands to the robot.

For the bonus features, we would like to have a receiver that recognizes it for our bonus feature of obstacle avoidance. When the robot has detected an obstacle and has stopped, it lets the user know through haptic feedback that it cannot move in that direction. Another bonus feature would have the glove be in different modes where it can control either the camera move (spin to see different areas).

## Subsystem 2
We want to build a system on the robot. The robot will be receiving the commands from the glove and then moving in the corresponding direction. Here are the components that will be required:

Base System - not PCB
1. Bluetooth Transmitter/Receiver
2. Motors
3. Caterpillar Track (For multi-terrain compatibility)
4. Raspberry Pi Board

Additional System
1. Camera for surveillance
2. TOF(Lidar) sensors
3. Heat/Night vision camera? (Better at looking through debris?)(Maybe too expensive?)

The robot base system will accept commands from the glove and then move accordingly. We have a caterpillar track for multi-train capability. We will use a Raspberry Pi board for receiving and executing the commands. The purpose of the board is so that we can easily add other modules for the additional system features.

The additional system will include a camera that will transmit the camera data to an external laptop. Then we will have Lidar sensors for obstacle avoidance so that if you give an instruction to the robot but it will hit an obstacle to do the command it will stop and transmit that back to the arm.

# Criterion For Success

The project will be considered successful if the following functional and performance objectives are met:

## 1. Reliable Gesture Recognition (Glove Subsystem)

The glove must accurately detect user gestures using IMU orientation (pitch and roll) and finger flex sensor inputs. The system must correctly classify and generate control commands corresponding to:

- Move forward
- Move backward
- Turn left
- Turn right
- Stop

## 2. Wireless Communication
The glove subsystem must transmit gesture commands to the robot wirelessly using Bluetooth (BLE).

## 3. Robot Motion Execution
The robot subsystem must correctly interpret received commands and translate them into motion, reliably performing:
- Forward and backward motion
- Left and right turns
- A 360° surveillance spin

## Stretch Goals (Advanced Success Criteria)
### 1. Safety Through Obstacle Avoidance
The robot must integrate onboard distance sensing (ToF/LiDAR) to prevent unsafe movements. The robot must stop before impact. The system must override unsafe commands in real time.


### 2. Haptic Feedback to User (Closed-Loop System)
When the robot is unable to execute a command due to an obstacle, haptic feedback must be sent to the glove to notify the user.
### 3. Camera/visual feedback
We will add a camera or thermal/infrared sensing method to detect human presence in low-visibility environments and provide easy remote control.

Modularized Electronic Locker

Jack Davis, Joshua Nolan, Jake Pu

Modularized Electronic Locker

Featured Project

Group Member: Jianhao (Jake) Pu [jpu3], Joshua Nolan [jtnolan2], John (Jack) Davis [johnhd4]

Problem:

Students living off campus without a packaging station are affected by stolen packages all the time. As a result of privacy concerns and inconsistent deployment, public cameras in Champaign and around the world cannot always be relied upon. Therefore, it can be very difficult for victims to gather evidence for a police report. Most of the time, the value of stolen items is small and they are usually compensated by the sellers (Amazon and Apple are very understanding). However, not all deliveries are insured and many people are suffering from stolen food deliveries during the COVID-19 crisis. We need a low-cost solution that can protect deliveries from all vendors.

Solution Overview:

Our solution is similar to Amazon Hub Apartment Locker and Luxer One. Like these services, our product will securely enclose the package until the owners claim the contents inside. The owner of the contents can claim it using a phone number or a unique user identification code generated and managed by a cloud service.

The first difference we want to make from these competitors is cost. According to an article, the cost of a single locker is from $6000 - $20000. We want to minimize such costs so that we can replace the traditional mailbox. We talked to a Chinese manufacturer and got a hardware quote of $3000. We can squeeze this cost if we just design our own control module on ESP32 microcontrollers.

The second difference we want to make is modularity. We will have a sensor module, a control module, a power module and any number of storage units for hardware. We want to make standardized storage units that can be stacked into any configuration, and these storage units can be connected to a control module through a communication bus. The control module houses the hardware to open or close all of the individual lockers. A household can purchase a single locker and a control module just for one family while apartment buildings can stack them into the lockers we see at Amazon Hub. I think the hardware connection will be a challenge but it will be very effective at lowering the cost once we can massively manufacture these unit lockers.

Solution Components:

Storage Unit

Basic units that provide a locker feature. Each storage unit will have a cheap microcontroller to work as a slave on the communication bus and control its electronic lock (12V 36W). It has four connectors on top, bottom, left, and right sides for stackable configuration.

Control Unit

Should have the same dimension as one of the storage units so that it could be stacked with them. Houses ESP32 microcontroller to run control logics on all storage units and uses the built-in WiFi to upload data to a cloud server. If sensor units are detected, it should activate more security features accordingly.

Power Unit

Power from the wall or from a backup battery power supply and the associated controls to deliver power to the system. Able to sustain high current in a short time (36W for each electronic lock). It should also have protection against overvoltage and overcurrent.

Sensor Modules

Sensors such as cameras, motion sensors, and gyroscopes will parlay any scandalous activities to the control unit and will be able to capture a photo to report to authorities. Sensors will also have modularity for increased security capabilities.

Cloud Support

Runs a database that keeps user identification information and the security images. Pushes notification to end-users.

Criterion for Success:

Deliverers (Fedex, Amazon, Uber Eats, etc.) are able to open the locker using a touchscreen and a use- provided code to place their package inside. Once the package is inside of the locker, a message will be sent to the locker owner that their delivery has arrived. Locker owners are able to open the locker using a touchscreen interface. Owners are also able to change the passcode at any time for security reasons. The locker must be difficult to break into and offer theft protection after multiple incorrect password attempts.

Project Videos