Project :: ECE 445 - Senior Design Laboratory

Project

#	Title	Team Members	TA	Documents	Sponsor
93	Dynamic Violin Fingerboard Attachment	Adrian Ignaci Kamil Waz Sophia Wilhelm	Manvi Jha	proposal1.pdf
	# Dynamic Violin Fingerboard Attachment Team Members: - Kamil Waz (kwaz2) - Sophia Wilhelm (sophia16) - Adrian Ignaci (aigna3) # Problem Most people would like to learn an instrument, however not only are the instruments expensive, but the lessons are just as (if not more) costly. This also assumes lessons are even available where they live. For this reason, many people try to teach themselves how to play, either through experimentation or online resources. However, this path has a distinct lack of feedback that would help correct poor habits or otherwise incorrect playing. # Solution Our project seeks to give those self-learning an instrument, specifically a violin, an extra source of feedback with respect to finger placement (creating the notes) as well as the rhythm played. A dynamic LED display laid on top of the fingerboard would allow learners to better understand proper finger placement in addition to its relation to the specific note’s duration. Furthermore, by using linear/membrane potentiometers we could accurately measure the position of a finger placed along any of the 4 paths (strings) on the fingerboard. This allows us to also to also collect information on how accurate the placement is, rather than a simple yes or no as to whether they play the right note. To encourage building good habits and continuous practice, we would like to allow users to upload pieces they would like to learn. Thus users will be allowed to upload files (MIDI) that can then be used on the fingerboard along with an adjustable tempo. This, paired with individual settings for full piece playthroughs and learning (only playing the next note after the user plays it) will help encourage good, accurate playing whilst making it fun. # Solution Components ## Fingerboard overlay This subsystem is the main source of feedback to and from the user. It will contain an array of individually addressable LEDs (1528-1196-ND) which will display appropriate fingerings at the appropriate moment in a piece and membrane potentiometers (SEN-08680) which will give the processor feedback as to the user’s accuracy. ## Microcontroller The microcontroller will be responsible for a number of key operations, including: File uploading and reading Control of the display User input validation and data collection We will use the ESP32 (tentative, as using an RP2040 would be easier, but that would also be bulkier and remove a lot of the designing). Additionally, an LCD display (16x2 most likely, no specific part as they’re all pretty generic) can be controlled to display piece statistics to the user. ## Piece Play Configuration This component controls the aforementioned various settings regarding what style of playing the user wants. Specifically, this will control not only the tempo the pieces are played, but also when the piece progresses. There will be a setting to simply go through the entire piece while tracking statistics in addition to a setting dedicated to learning the piece, which pauses until each fingering is properly performed. The most straightforward implementation of this (strictly) would only require a potentiometer (COM-09939) or two buttons (such as TS02-66-70-BK-100-LCR-D) for tempo and a switch (OS102011MS2QN1). ##Power A pair of standard AA batteries should be sufficient for our needs (would need the 36-2463-ND enclosure to hold them). However we would like to consider 3.7 V Lithium-Ion Battery Rechargeable (1528-1839-ND) with the associated charger (TI BQ24074) and regulator (TI TPS62840). The rechargeable battery is a potentially dangerous option as it could endanger the instrument itself (it’s a more risky fire hazard than an easily removable AA battery), therefore it will not be implemented unless there has been extensive testing of the rest of the system within the time frame of this project. ##Case/Enclosure There will be two parts, one for the fingerboard components and one for everything else. The fingerboard overlay will consist of the components surrounded by a sort of envelope made of ~0.3mm transparent silicon rubber (allowing for clarity for the LEDs without compromising the membrane potentiometers). The second part will be a plastic enclosure that must fit either under the fingerboard or body (better for weight distribution) of a full size violin without significant weight. It will contain the power supply, microcontroller, and configuration modules. # Criterion For Success Unit is easy to attach to a standard violin. The attachment must accurately display and detect note fingerings from a user specified piece at an adjustable tempo. User accuracy will be displayed real-time through use of LEDs on the microcontroller, and an accuracy summary will be displayed at the end of the piece. In addition (though less quantifiable), it must not impede the physical way a user must play the instrument. Note on expertise: Kamil plays violin and knows a number of other violinists. They will be consulted on the physical design.

Title

Team Members

Documents

Sponsor

Dynamic Violin Fingerboard Attachment

Adrian Ignaci
Kamil Waz
Sophia Wilhelm

Manvi Jha

proposal1.pdf

# Dynamic Violin Fingerboard Attachment

Team Members:
- Kamil Waz (kwaz2)
- Sophia Wilhelm (sophia16)
- Adrian Ignaci (aigna3)

# Problem

Most people would like to learn an instrument, however not only are the instruments expensive, but the lessons are just as (if not more) costly. This also assumes lessons are even available where they live. For this reason, many people try to teach themselves how to play, either through experimentation or online resources. However, this path has a distinct lack of feedback that would help correct poor habits or otherwise incorrect playing.

# Solution

Our project seeks to give those self-learning an instrument, specifically a violin, an extra source of feedback with respect to finger placement (creating the notes) as well as the rhythm played. A dynamic LED display laid on top of the fingerboard would allow learners to better understand proper finger placement in addition to its relation to the specific note’s duration.
Furthermore, by using linear/membrane potentiometers we could accurately measure the position of a finger placed along any of the 4 paths (strings) on the fingerboard. This allows us to also to also collect information on how accurate the placement is, rather than a simple yes or no as to whether they play the right note.
To encourage building good habits and continuous practice, we would like to allow users to upload pieces they would like to learn. Thus users will be allowed to upload files (MIDI) that can then be used on the fingerboard along with an adjustable tempo. This, paired with individual settings for full piece playthroughs and learning (only playing the next note after the user plays it) will help encourage good, accurate playing whilst making it fun.

# Solution Components

## Fingerboard overlay

This subsystem is the main source of feedback to and from the user. It will contain an array of individually addressable LEDs (1528-1196-ND) which will display appropriate fingerings at the appropriate moment in a piece and membrane potentiometers (SEN-08680) which will give the processor feedback as to the user’s accuracy.

## Microcontroller
The microcontroller will be responsible for a number of key operations, including:
File uploading and reading
Control of the display
User input validation and data collection
We will use the ESP32 (tentative, as using an RP2040 would be easier, but that would also be bulkier and remove a lot of the designing). Additionally, an LCD display (16x2 most likely, no specific part as they’re all pretty generic) can be controlled to display piece statistics to the user.

## Piece Play Configuration
This component controls the aforementioned various settings regarding what style of playing the user wants. Specifically, this will control not only the tempo the pieces are played, but also when the piece progresses. There will be a setting to simply go through the entire piece while tracking statistics in addition to a setting dedicated to learning the piece, which pauses until each fingering is properly performed.
The most straightforward implementation of this (strictly) would only require a potentiometer (COM-09939) or two buttons (such as TS02-66-70-BK-100-LCR-D) for tempo and a switch (OS102011MS2QN1).

##Power
A pair of standard AA batteries should be sufficient for our needs (would need the 36-2463-ND enclosure to hold them).
However we would like to consider 3.7 V Lithium-Ion Battery Rechargeable (1528-1839-ND) with the associated charger (TI BQ24074) and regulator (TI TPS62840). The rechargeable battery is a potentially dangerous option as it could endanger the instrument itself (it’s a more risky fire hazard than an easily removable AA battery), therefore it will not be implemented unless there has been extensive testing of the rest of the system within the time frame of this project.

##Case/Enclosure
There will be two parts, one for the fingerboard components and one for everything else.
The fingerboard overlay will consist of the components surrounded by a sort of envelope made of ~0.3mm transparent silicon rubber (allowing for clarity for the LEDs without compromising the membrane potentiometers).
The second part will be a plastic enclosure that must fit either under the fingerboard or body (better for weight distribution) of a full size violin without significant weight. It will contain the power supply, microcontroller, and configuration modules.

# Criterion For Success

Unit is easy to attach to a standard violin. The attachment must accurately display and detect note fingerings from a user specified piece at an adjustable tempo. User accuracy will be displayed real-time through use of LEDs on the microcontroller, and an accuracy summary will be displayed at the end of the piece. In addition (though less quantifiable), it must not impede the physical way a user must play the instrument.

Note on expertise: Kamil plays violin and knows a number of other violinists. They will be consulted on the physical design.

Featured Project

# Musical Hand

Team Members:

- Ramesey Foote (rgfoote2)

- Michelle Zhang (mz32)

- Thomas MacDonald (tcm5)

# Problem

Musical instruments come in all shapes and sizes; however, transporting instruments often involves bulky and heavy cases. Not only can transporting instruments be a hassle, but the initial purchase and maintenance of an instrument can be very expensive. We would like to solve this problem by creating an instrument that is lightweight, compact, and low maintenance.

# Solution

Our project involves a wearable system on the chest and both hands. The left hand will be used to dictate the pitches of three “strings” using relative angles between the palm and fingers. For example, from a flat horizontal hand a small dip in one finger is associated with a low frequency. A greater dip corresponds to a higher frequency pitch. The right hand will modulate the generated sound by adding effects such as vibrato through lateral motion. Finally, the brains of the project will be the central unit, a wearable, chest-mounted subsystem responsible for the audio synthesis and output.

Our solution would provide an instrument that is lightweight and easy to transport. We will be utilizing accelerometers instead of flex sensors to limit wear and tear, which would solve the issue of expensive maintenance typical of more physical synthesis methods.

# Solution Components

The overall solution has three subsystems; a right hand, left hand, and a central unit.

## Subsystem 1 - Left Hand

The left hand subsystem will use four digital accelerometers total: three on the fingers and one on the back of the hand. These sensors will be used to determine the angle between the back of the hand and each of the three fingers (ring, middle, and index) being used for synthesis. Each angle will correspond to an analog signal for pitch with a low frequency corresponding to a completely straight finger and a high frequency corresponding to a completely bent finger. To filter out AC noise, bypass capacitors and possibly resistors will be used when sending the accelerometer signals to the central unit.

## Subsystem 2 - Right Hand

The right subsystem will use one accelerometer to determine the broad movement of the hand. This information will be used to determine how much of a vibrato there is in the output sound. This system will need the accelerometer, bypass capacitors (.1uF), and possibly some resistors if they are needed for the communication scheme used (SPI or I2C).

## Subsystem 3 - Central Unit

The central subsystem utilizes data from the gloves to determine and generate the correct audio. To do this, two microcontrollers from the STM32F3 series will be used. The left and right hand subunits will be connected to the central unit through cabling. One of the microcontrollers will receive information from the sensors on both gloves and use it to calculate the correct frequencies. The other microcontroller uses these frequencies to generate the actual audio. The use of two separate microcontrollers allows for the logic to take longer, accounting for slower human response time, while meeting needs for quicker audio updates. At the output, there will be a second order multiple feedback filter. This will get rid of any switching noise while also allowing us to set a gain. This will be done using an LM358 Op amp along with the necessary resistors and capacitors to generate the filter and gain. This output will then go to an audio jack that will go to a speaker. In addition, bypass capacitors, pull up resistors, pull down resistors, and the necessary programming circuits will be implemented on this board.

# Criterion For Success

The minimum viable product will consist of two wearable gloves and a central unit that will be connected together via cords. The user will be able to adjust three separate notes that will be played simultaneously using the left hand, and will be able to apply a sound effect using the right hand. The output audio should be able to be heard audibly from a speaker.

Project Videos

Musical Hand Demo