Project

# Title Team Members TA Documents Sponsor
14 Audio Augmented Reality Glasses (AARG)
 Evan Chong
Nikita Vasilyev
Sunny Chen
 Aishee Mondal design_document1.pdf
final_paper1.pdf
grading_sheet1.pdf
proposal1.pdf
video
# Audio Augmented Reality Glasses (AARG)

Team Members:
- Sunny Chen (sunnyc3)
- Nikita Vasilyev (nvasi2)
- Evan Chong (eschong2)

# Problem
Have you ever seen a plant in nature or an animal in the wild that piqued your interest, but you didn’t have an efficient way of researching what it was? Repeatedly searching online to identify the subject can be a lengthy and tedious task, and this is the problem we seek to address. Our solution is meant to enlighten our user of unknown plants, animals, or objects in any setting they are observing.

# Solution
Our project idea stems from the surge of AR prototype glasses being introduced over the past year. We are planning to create our own glasses but in contrast to those on the market, ours will focus on the audio experience of the user. These glasses will have the explicit capability of capturing images of objects and relaying this information to an application that will process these images in the backend. The application will then send an explanation of the object back to an audio device on the glasses (either a speaker or bone-conducting device). The glasses will essentially work as a digital tour guide, with the explanation of the object being auditory rather than visual. The use case we have decided to tackle is a botanical tour guide, but the purpose is to create a platform that other applications can utilize for their objectives.

The subsystems we have broken down the device into are power, peripheral, communication, physical, and application. They are divided such that each subsystem has a designated purpose working towards the goal of full functionality.

# Solution Components

## Power System
The power system consists of the battery powering the device and the supporting charging circuit to replenish the battery once out of power. Some candidates for batteries are PCIFR18650-1500 from ZEUS Battery and ASR00011 from TinyCircuits.

## Peripheral System
The peripheral system focuses on the aspects of the glasses that interact with the outside world. This includes the camera, microphone, speaker, and interact button. These external components will interface with the microcontroller, provide crucial information to the application, and play audio to the user. For the moment we have the following components for each peripheral:
Camera: ESP32-CAM (Comes with development board and camera)
Microphone: CMA-4544PF-W
Speaker: ADS01008MR-LW100-R
Interact Button: B3U-1100P

## Communication System
The communication system consists of a microcontroller and Bluetooth Low Energy interface. This subsystem should create an interface that can be used by applications connected through Bluetooth. This interface allows for all the sensor data to be collected, processed, and sent to the application when requested. The component we plan to use for this system is the ESP32-WROOM-DA-N8 which contains an ESP32 microcontroller with a built-in PCB antenna for Bluetooth.

## Physical System
The physical system consists of the glass frame design and the mounting system for the PCB and hardware components. The frame design will be 3D printed. The goal would be to use premeasured plastic mounting points and screws to mount all components within the hollow frame.

## Application System
The application system consists of image processing, audio transfer, and user interface. The image will be processed, the plant will be identified, and then have audio transferred back to the speaker in the peripheral system. We will develop this application for iOS and interact with the glasses via Bluetooth.

# Criterion For Success

The following goals are fundamental to the success of our project:

- Successful User Flow - The user should be able to look at a plant, press the interact button, and then wait for the system to return the audio of the plant description.
- Accuracy - The final prototype should be able to correctly identify plants 75% of the time.
- Strong Bluetooth Connection - There should be an uninterrupted Bluetooth connection between the glasses and the mobile - device. Additionally, the glasses should be fully operational within a 15-foot range of the mobile device.

The goals below are considered reach goals, and if not accomplished would not hinder the success of our project:

- Bone Conduction Audio - An alternative way of relaying the audio to the user that involves transmitting sound vibrations through the bones.
- Adjustable Audio Volume Level - Within the application system the user will be able to adjust the volume.
- Voice Activation - In addition to the push button, users have the ability to speak to begin the system process.
- Heads-up Display - A display on the glass lenses to aid in relaying the information to the user.

Resonant Cavity Field Profiler

Salaj Ganesh, Max Goin, Furkan Yazici

Resonant Cavity Field Profiler

Featured Project

# Team Members:

- Max Goin (jgoin2)

- Furkan Yazici (fyazici2)

- Salaj Ganesh (salajg2)

# Problem

We are interested in completing the project proposal submitted by Starfire for designing a device to tune Resonant Cavity Particle Accelerators. We are working with Tom Houlahan, the engineer responsible for the project, and have met with him to discuss the project already.

Resonant Cavity Particle Accelerators require fine control and characterization of their electric field to function correctly. This can be accomplished by pulling a metal bead through the cavities displacing empty volume occupied by the field, resulting in measurable changes to its operation. This is typically done manually, which is very time-consuming (can take up to 2 days).

# Solution

We intend on massively speeding up this process by designing an apparatus to automate the process using a microcontroller and stepper motor driver. This device will move the bead through all 4 cavities of the accelerator while simultaneously making measurements to estimate the current field conditions in response to the bead. This will help technicians properly tune the cavities to obtain optimum performance.

# Solution Components

## MCU:

STM32Fxxx (depending on availability)

Supplies drive signals to a stepper motor to step the metal bead through the 4 quadrants of the RF cavity. Controls a front panel to indicate the current state of the system. Communicates to an external computer to allow the user to set operating conditions and to log position and field intensity data for further analysis.

An MCU with a decent onboard ADC and DAC would be preferred to keep design complexity minimum. Otherwise, high MIPS performance isn’t critical.

## Frequency-Lock Circuitry:

Maintains a drive frequency that is equal to the resonant frequency. A series of op-amps will filter and form a control loop from output signals from the RF front end before sampling by the ADCs. 2 Op-Amps will be required for this task with no specific performance requirements.

## AC/DC Conversion & Regulation:

Takes an AC voltage(120V, 60Hz) from the wall and supplies a stable DC voltage to power MCU and motor driver. Ripple output must meet minimum specifications as stated in the selected MCU datasheet.

## Stepper Drive:

IC to control a stepper motor. There are many options available, for example, a Trinamic TMC2100. Any stepper driver with a decent resolution will work just fine. The stepper motor will not experience large loading, so the part choice can be very flexible.

## ADC/DAC:

Samples feedback signals from the RF front end and outputs the digital signal to MCU. This component may also be built into the MCU.

## Front Panel Indicator:

Displays the system's current state, most likely a couple of LEDs indicating progress/completion of tuning.

## USB Interface:

Establishes communication between the MCU and computer. This component may also be built into the MCU.

## Software:

Logs the data gathered by the MCU for future use over the USB connection. The position of the metal ball and phase shift will be recorded for analysis.

## Test Bed:

We will have a small (~ 1 foot) proof of concept accelerator for the purposes of testing. It will be supplied by Starfire with the required hardware for testing. This can be left in the lab for us to use as needed. The final demonstration will be with a full-size accelerator.

# Criterion For Success:

- Demonstrate successful field characterization within the resonant cavities on a full-sized accelerator.

- Data will be logged on a PC for later use.

- Characterization completion will be faster than current methods.

- The device would not need any input from an operator until completion.

Project Videos