Taiqing Ling, taiqing2 (ECE110)

Yiyang Nan, yiyangn2 (ECE110)

Chenghao Lu, clu19 (ECE120)



Introduction

Propose:

  • Designing and building a hand gesture controlled robot, which is wireless and will be able to follow at least four hand-gesture instructions to move freely in the four directions of the horizontal plane. The user will basically wear a glove on their intructing hand, on which an accelerometer will read the gesture instuctions and then through wireless connection, signals are sent to the motor driver to drive the robot.
  • Trying to add a mechanical arm, which is also wireless and  will copy exactly the same movement as the controller's arm.


Background Research

  • Motion sensing is more  and more widley used in video games, like the famous Xbox and Wii. The idea of making a hand gesture controlled robot is partially inspired from our love of motion sensing games. Another stimiulus for this idea is that in the past we saw a video of bionic hand on Youtube, in which the mechanic hand could could perfectly imitate the motion of a person's hand. To make it more practial to us, we simplify the gesture control to a chassis, unlike a bionic hand, instead of analog reading the degree of inflxion in each finger, we just have to test True/False of a motion. And for the part of mechanic arm, we will only need two servos to control the arthosis, the shoulder and elbow, which makes the project not that time costing as the bionic hand. In the future, our idea can be extended to make the chassis  a real "puppet", that is a human figured robot, which will be really cool.


Design

System overview

  • Accelerometer ADXL335:            being placed on the controller's hand to detect the gestures
  • flex sensor:                                  to detect the gesture given by the controller's arm, also to meet the ECE 110 requirement
  • Arduino uno:                                logics will be added to the anolog data read from the accelerometer to give instructions
  • RF 433M Module:                        for wireless connection bettwen the arduino and the robot
  • decoder:                                      to decode the data recerived from the RF receiver and give order to the robot, also to meet the ECE120 requirement


Flow Chart


Sample gestures

STOP

Move Forward

Move Backward

Turn Right

Turn Left


Part list:

wheels

DC motors

H bridge

servo

accelerometer ADXL335

flex sensor

Arduino UNO

RF 433MHz

2:4 decoder


Challenges:

Encoding and decoding of the gesture instructions

Wireless conncection

Relactive calculation about the logic on intepreting the flex sensor


References

https://create.arduino.cc/projecthub/user206876468/hand-gesture-controlled-robot-4d7587






Attachments:

屏幕快照 2018-02-15 下午5.39.00.png (image/png)
屏幕快照 2018-02-15 下午5.49.03.png (image/png)
IMG_1036.JPG (image/jpeg)
IMG_1037.JPG (image/jpeg)
IMG_1038.JPG (image/jpeg)
IMG_1039.JPG (image/jpeg)
IMG_1040.JPG (image/jpeg)

Comments:

Can you all outline more clearly what your hand controls are? How does the user move their hand to get the robot to move?

Posted by atmarsh3 at Feb 16, 2018 17:23

I just posted five basic gesture for the motor driver. Gestures for the mechanical arm are not yet decided, it depends on the type of accelerometer and flex sensor we use.

Posted by taiqing2 at Feb 16, 2018 23:28

Like them a lot!

Posted by atmarsh3 at Feb 18, 2018 13:04

Looking good! Sounds like a cool project. Approved.

Posted by chorn4 at Feb 21, 2018 17:39

Cool idea!  Nice incorporation of logic and sensor components.  Make sure you talk to the machine shop early if you need any machine design/production help because they get busy with senior projects later in the semester.

Posted by mnwilso2 at Feb 22, 2018 00:26

Will do, tks!

Posted by taiqing2 at Mar 01, 2018 19:21