Project

# Title Team Members TA Documents Sponsor
38 MassageMate: Smart Robot Masseur
 Jack Bai
Ke Xu
Wentao Yao
Xiuyuan Zhou
 Yutao Zhuang design_document1.pdf
final_paper2.pdf
proposal1.pdf
 Liangjing Yang
# Team Members

+ Ke Xu [kex5]
+ Hao Bai [haob2]
+ Wentao Yao [wentaoy4]
+ Xiuyuan Zhou [xiuyuan5]

# PROBLEM

+ High-intensity work tends to cause fatigue in people’s neck and waist, so they need massage to relax their shoulders and neck, but frequent visits to massage parlors cost quite time and are expensive.

+ With the growing need of massage, the quantity and quality of human massagers are hard to meet the demand, especially personalized customization.

+ Some customers may not want to be touched by an unfamiliar person (i.e. a real human Masseur), or they have some body privacy that hope to be hidden from others, then a Robotic Masseur can help.

# SOLUTION OVERVIEW

+ The proposed solution involves utilizing a high-resolution Automatic Speech Recognition (ASR) module to accurately convert speech to text. The resulting text will be structured and analyzed using Codex, with the Code4Struct methodology proposed by Xingyao W. et. al. applied for enhanced understanding.

+ Task slots will be generated through slot filling, a method commonly used in task-oriented dialog systems, allowing for seamless integration with OpenCR, a powerful platform for robotics. OpenCR will be utilized to instantiate the robot tasks, with each task assigned to a Resp Pi device.

+ Finally, the Resp Pi device will be leveraged to physically activate the robot, enabling it to move and perform the assigned tasks. This comprehensive solution offers a professional and efficient method for integrating ASR technology and robotics for enhanced performance and automation.

# SOLUTION COMPONENTS

## SUBSYSTEM I: MECHANICAL SYSTEM

+ OpenManipulator Robotic Arm

+ Customed Robotic Hands for specific needs of Massage

## SUBSYSTEM II: CONTROL SYSTEM

+ Resp Pi/Control panel that is Compatible with Robotic Arm
+ PC with GPT-3 key

## CRITERION FOR SUCCESS

+ The robotic arm can doing massage in appropriate strength and location under the control of certain instructions.
+ Build a phone APP that can monitor the current massage status, including force, frequence, position, etc.
+ Successfully parse the natural language given by the human into structured dialog state and further into natural language

# DISTRIBUTION OF WORK

+ Ke Xu: hardware (Resp Pi & OpenCR)
+ Wentao Yao: hardware-software interfaces (Resp Pi & OpenCR)
+ Hao Bai: slot filling, dialog management (API layer, Python strategies)
+ Xiuyuan Zhou: hardware (Robotic)

Drum Tutor Lite

Featured Project

Team: Yuanheng Yan, Zhen Qin, Xun Yu

Vision: Rhythm games such as guitar hero are much easier than playing the actual drums. We want to make a drum tutor that makes playing drums as easy as guitar hero. The player is not required to read a sheet music.

Description: We will build a drum add-on that will tutor people how to play the drums. We will make a panel for visual queue of the drum and beats in a form similar to guitar hero game. The panel can be a N*10 (N varying with the drum kit) led bar array. Each horizontal bar will be a beat and each horizontal line above the bottom line will represent the upcoming beats.

There will be sensors on each drum that will fire when the drum heads is hit. The drums will be affixed with ring of light that provides the timing and accuracy of the player according to the sensors.

Of course with a flip of a switch, the drum could be a simple light up drum: when the player hits the drum, that particular drum will light up giving cool effects.

The system will be on a microprocessor. Or for more versatile uses, it could be connected to the computer. And a app will be written for the tutor.