Project

# Title Team Members TA Documents Sponsor
9 Smart Person-Following Luggage System
Jai Anchalia
Shubham Gupta
Varun Singhal
 Abhisheka Mathur Sekar design_document1.pdf
design_document2.pdf
final_paper1.pdf
other1.pdf
photo1.jpeg
photo2.jpeg
presentation1.pdf
proposal1.pdf
video
video
# Smart Luggage System with Triangulation and Directional Control via UWB- Request for Approval (RFA)

Team Members:
- Varun Singhal (varuns7)
- Shubham Gupta (sg49)
- Jai Anchalia (jaia2)

# Problem
Imagine traveling with 2 - 50 lb check-in items of luggage and a carry-on bag along with a bag pack all ALONE. It can be a hassle, especially in an airport environment when the passenger is stressing about where to go for their next flight. Even if there is a cart available, it is inconvenient to carry it around everywhere due to its size.

# Solution
To address the problem, we propose the development of a Smart Person-following Luggage System. This system employs four DW1000 sensors (ultra wide band) for triangulation, ultrasonic sensors for collision avoidance, an ESP32 microcontroller for control, and a specialized motorized system for precise movement.

Our proposed solution is a luggage system that autonomously follows the user while avoiding obstacles and adjusting its direction as needed. The four DW1000 sensors will provide triangulation data for accurate positioning via the ultra wide band tranreciver technology. These four sensors would be on the luggage system and are called "anchors". We will have a tag that the user will carry. This tag would be another ESP32 along with a DW1000 sensor. Now, the anchors along with the tag can accurately create a local positioning system. Ultrasonic sensors will detect obstacles, including people, while the ESP32 microcontroller processes sensor data and calculates the optimal path. The motorized system comprises two motors (differential drive) and two 360-degree wheels as support.

# Solution Components
## Luggage Sensors
The use of four DW1000 sensors enables triangulation for precise angle resolution. These sensors use Time of Flight (ToF) to get distances up to 10cm accuracy upon which we can calculate the vector. Note: This is the same tech in Apple's Air Tag.

## Luggage Tag
This tag will be carried by the person. The tag comprises an ESP32, DW1000, and a rechargeable battery pack. The luggage system will follow this tag.

## Ultrasonic Sensors
Ultrasonic sensors detect obstacles and trigger collision avoidance actions.

## ESP32 Microcontroller
The ESP32 microcontroller processes data from DW1000 sensors and ultrasonic sensors, coordinating the luggage's movement and path planning.

## Motorized System
The luggage will be equipped with two DC gear motors and two 360-degree wheels for support. The microcontroller will adjust the motor speeds for optimal movement. It will be a differential drive.

# Criterion For Success
Required task for demo:

Luggage will follow person through 2nd floor of ECEB at an average distance of 1 meter +/- 0.5 meters.


Project Overall Requirements:
1. The system accurately tracks the user's location using four DW1000 sensors and maintains a safe following distance.
2. Ultrasonic sensors detect obstacles and prompt appropriate collision avoidance maneuvers.
3. The ESP32 microcontroller effectively processes sensor data and coordinates movement, ensuring the luggage follows the user and avoids collisions.
4. The motorized system provides smooth and precise directional control, allowing the luggage to navigate through various environments.

Bracelet Aid for deaf people/hard of hearing

Aarushi Biswas, Yash Gupta, Anit Kapoor

Bracelet Aid for deaf people/hard of hearing

Featured Project

# PROJECT TITLE: Bracelet Aid for deaf people/hard of hearing

# TEAM MEMBERS:

- Aarushi Biswas (abiswas7)

- Anit Kapoor (anityak3)

- Yash Gupta (yashg3)

# PROBLEM

We are constantly hearing sounds around us that notify us of events occurring, such as doorbells, fire alarms, phone calls, alarms, or vehicle horns. These sounds are not enough to catch the attention of a d/Deaf person and sometimes can be serious (emergency/fire alarms) and would require the instant attention of the person. In addition, there are several other small sounds produced by devices in our everyday lives such as washing machines, stoves, microwaves, ovens, etc. that cannot be identified by d/Deaf people unless they are observing these machines constantly.

Many people in the d/Deaf community combat some of these problems such as the doorbell by installing devices that will cause the light in a room to flicker. However, these devices are generally not installed in all rooms and will also obviously not be able to notify people if they are asleep. Another common solution is purchasing devices like smartwatches that can interact with their mobile phones to notify them of their surroundings, however, these smartwatches are usually expensive, do not fulfill all their needs, and require nightly charging cycles that diminish their usefulness in the face of the aforementioned issues.

# SOLUTION

A low-cost bracelet aid with the ability to convert sounds into haptic feedback in the form of vibrations will be able to give d/Deaf people the independence of recognizing notification sounds around them. The bracelet will recognize some of these sounds and create different vibration patterns to catch the attention of the wearer as well as inform them of the cause of the notification. Additionally, there will be a visual component to the bracelet in the form of an OLED display which will provide visual cues in the form of emojis. The bracelet will also have buttons for the purpose of stopping the vibration and showing the battery on the OLED.

For instance, when the doorbell rings, the bracelet will pick up the doorbell sound after filtering out any other unnecessary background noise. On recognizing the doorbell sound, the bracelet will vibrate with the pattern associated with the sound in question which might be something like alternating between strong vibrations and pauses. The OLED display will also additionally show a house emoji to denote that the house doorbell is ringing.

# SOLUTION COMPONENTS

Based on this solution we have identified that we need the following components:

- INMP441 (Microphone Component)

- Brushed ERM (Vibration Motor)

- Powerboost 1000 (Power subsystem)

- 1000 mAh LiPo battery x 2 (hot swappable)

- SSD1306 (OLED display)

## SUBSYSTEM 1 → SOUND DETECTION SUBSYSTEM

This subsystem will consist of a microphone and will be responsible for picking up sounds from the environment and conducting a real-time FFT on them. After this, we will filter out lower frequencies and use a frequency-matching algorithm to infer if a pre-programmed sound was picked up by the microphone. This inference will be outputted to the main control unit in real-time.

## SUBSYSTEM 2 → VIBRATION SUBSYSTEM

This subsystem will be responsible for vibrating the bracelet on the wearer’s wrist. Using the vibration motor mentioned above, we should have a frequency range of 30Hz~500Hz, which should allow for the generation of a variety of distinguishable patterns. This subsystem will be responsible for the generation of the patterns and control of the motor, as well as prompting the Display subsystem to visualize the type of notification detected.

## SUBSYSTEM 3 → DISPLAY SUBSYSTEM

The Display subsystem will act as a set of visual cues in addition to the vibrations, as well as a visual feedback system for user interactions. This system should not draw a lot of power as it will be active only when prompted by user interaction or by a recognized sound. Both of these scenarios are relatively uncommon over the course of a day, which means that the average power draw for our device should still remain low.

## SUBSYSTEM 4 → USER INTERACTION SUBSYSTEM

This subsystem is responsible for the interaction of the user with the bracelet. This subsystem will include a set of buttons for tasks such as checking the charge left on the battery or turning off a notification. Checking the charge will also display the charge on the OLED display thus interacting and controlling the display subsystem as well.

## SUBSYSTEM 5 → POWER SUBSYSTEM

This subsystem is responsible for powering the device. One of our success criteria is that we want long battery life and low downtime. In order to achieve this we will be using a power boost circuit in conjunction with two rechargeable 1000 mAh batteries. While one is charging the other can be used so the user doesn’t have to go without the device for more than a few seconds at a time. We are expecting our device to use anywhere from 20-50mA which would mean we get an effective use time of more than a day. The power boost circuit and LiPo battery’s JST connector allow the user to secure and quick battery swaps as well.

# CRITERION FOR SUCCESS

- The bracelet should accurately identify only the crucial sounds in the wearer’s environment with each type of sound having a fixed unique vibration + LED pattern associated with it

- The vibration patterns should be distinctly recognizable by the wearer

- Should be relatively low cost

- Should have prolonged battery life (so the power should focus on only the use case of converting sound to vibration)

- Should have a small profile and a sleek form factor

Project Videos