Project

# Title Team Members TA Documents Sponsor
61 Automated Wildlife watcher
Edwin Lu
Kelvin Chen
Xu Gao
Abhisheka Mathur Sekar design_document1.pdf
final_paper2.pdf
photo1.jpg
photo3.png
photo5.jpg
presentation1.pptx
proposal2.pdf
video1.mp4
video
# Title
Automated Wildlife watcher

Team Members:
- Kelvin Chen (kelvin3)
- Edwin Lu (jiajun3)
- Xu Gao (xugao2)

# Problem

Despite interests and concern over climate change and human development, there is actually very little data available about both the diversity and distribution of wildlife insects or avian pollinators. This is especially concerning when considering the myriad number of species that are poorly understood. How many are there? How do they live? What do they eat? What can be done to help further their numbers or have the least negative impact.

It typically takes a lot of time and effort to survey wildlife populations, a more popular approach is to citizen science. By setting up feeding stations or flowering plants in private residences and documenting visiting species, we can gather a more complete picture of the ecological distribution and possible human impact on the local species. But this too is a limited approach as it depends on observers spending time outside and physically observing and document what they saw, a costly and arguably, ineffective method of data collection.


# Solution

Our proposed solution is an automated camera system that keeps watch of a specific location, such as a backyard or a patch of flowers, for a prolonged period of time and captures photos or videos of wildlife that enters its view.

Because of the proposed size of the area and the smaller relative size of the bird/insect, the camera must be placed on a self-adjustable gimbal that will angle the camera to the bird/insect and so the camera can zoom onto it for a more clear image. This will create a feedback loop of detecting motion, adjusting to the movement, and capturing the movement.


# Solution Components

## Subsystem 1: Camera module

Camera module with a motion sensing algorithm reacts to dynamic objects (birds, insects, etc.). It has software implemented that is trained to recognize the objects in different directions. When a moving object is detected, the camera module will align and focus on a small area around the moving object and try to follow it using object tracking algorithms like YOLO, Faster R-CNN.


## Subsystem 2: Gimbal stand

A gimbal is connected to the camera to stabilize and support it. Once the camera identifies the target object, the motor will turn the camera so that the target will stay within the camera range.


## Subsystem 3: Microcontrolller on a PCB
The microcontroller on the customized PCB will be able to receive the data from the camera module and send a signal to the mechanical system.


## Subsystem 4: Power system

A power system will be connected to the other subsystems. A voltage converter may be needed to supply the electric energy for the camera module and the gimbal.


# Criterion For Success

- Camera can detect object entering its field of vision
- Gimbal can adjust and follow the object that is moving
- The software will zooming the object and capture a photo or video

Musical Hand

Ramsey Foote, Thomas MacDonald, Michelle Zhang

Musical Hand

Featured Project

# Musical Hand

Team Members:

- Ramesey Foote (rgfoote2)

- Michelle Zhang (mz32)

- Thomas MacDonald (tcm5)

# Problem

Musical instruments come in all shapes and sizes; however, transporting instruments often involves bulky and heavy cases. Not only can transporting instruments be a hassle, but the initial purchase and maintenance of an instrument can be very expensive. We would like to solve this problem by creating an instrument that is lightweight, compact, and low maintenance.

# Solution

Our project involves a wearable system on the chest and both hands. The left hand will be used to dictate the pitches of three “strings” using relative angles between the palm and fingers. For example, from a flat horizontal hand a small dip in one finger is associated with a low frequency. A greater dip corresponds to a higher frequency pitch. The right hand will modulate the generated sound by adding effects such as vibrato through lateral motion. Finally, the brains of the project will be the central unit, a wearable, chest-mounted subsystem responsible for the audio synthesis and output.

Our solution would provide an instrument that is lightweight and easy to transport. We will be utilizing accelerometers instead of flex sensors to limit wear and tear, which would solve the issue of expensive maintenance typical of more physical synthesis methods.

# Solution Components

The overall solution has three subsystems; a right hand, left hand, and a central unit.

## Subsystem 1 - Left Hand

The left hand subsystem will use four digital accelerometers total: three on the fingers and one on the back of the hand. These sensors will be used to determine the angle between the back of the hand and each of the three fingers (ring, middle, and index) being used for synthesis. Each angle will correspond to an analog signal for pitch with a low frequency corresponding to a completely straight finger and a high frequency corresponding to a completely bent finger. To filter out AC noise, bypass capacitors and possibly resistors will be used when sending the accelerometer signals to the central unit.

## Subsystem 2 - Right Hand

The right subsystem will use one accelerometer to determine the broad movement of the hand. This information will be used to determine how much of a vibrato there is in the output sound. This system will need the accelerometer, bypass capacitors (.1uF), and possibly some resistors if they are needed for the communication scheme used (SPI or I2C).

## Subsystem 3 - Central Unit

The central subsystem utilizes data from the gloves to determine and generate the correct audio. To do this, two microcontrollers from the STM32F3 series will be used. The left and right hand subunits will be connected to the central unit through cabling. One of the microcontrollers will receive information from the sensors on both gloves and use it to calculate the correct frequencies. The other microcontroller uses these frequencies to generate the actual audio. The use of two separate microcontrollers allows for the logic to take longer, accounting for slower human response time, while meeting needs for quicker audio updates. At the output, there will be a second order multiple feedback filter. This will get rid of any switching noise while also allowing us to set a gain. This will be done using an LM358 Op amp along with the necessary resistors and capacitors to generate the filter and gain. This output will then go to an audio jack that will go to a speaker. In addition, bypass capacitors, pull up resistors, pull down resistors, and the necessary programming circuits will be implemented on this board.

# Criterion For Success

The minimum viable product will consist of two wearable gloves and a central unit that will be connected together via cords. The user will be able to adjust three separate notes that will be played simultaneously using the left hand, and will be able to apply a sound effect using the right hand. The output audio should be able to be heard audibly from a speaker.

Project Videos