Course Overview

Welcome to ECE 445/ME470 Senior Design ZJUI Spring 2022!

Welcome to the class! If you've looked at the course Calendar, you've probably already noticed that this class is quite different from most other classes in the department. The class only meets as a whole for the first four weeks of the semester. During these lectures you will meet the Course Staff, learn about specific requirements, resources, and project choices for the course, and have a chance to meet other students. These are some of the most important weeks for the class since the decisions you make during this time will determine what you'll get out of this class and, in many ways, how much you'll enjoy it.

In this course, you will form teams and propose projects that solve an engineering problem in a unique way. The projects generally involve a device that you will design, build, and demonstrate. We are excited to see what projects you create with this semester! In the midst of an ever changing learning environment, we want to encourage you to think, create, design, and build exemplary projects. We want to ensure that your experience in 445 demonstrates your potential as an engineer graduating from the University of Illinois.

This course is taught hybridly for ME and ECE students, and some projects are mentored by ZJUI faculty. Here are a few items that you will need to consider as we enter into this semester.

Remote Driving System

Bo Pang, Jiahao Wei, Kangyu Zhu

Featured Project

#### TEAM MEMBERS

Jiahao Wei (jiahaow4)

Bo Pang (bopang5)

Kangyu Zhu (Kangyuz2)

## REMOTE DRIVING SYSTEM

#### PROBLEM:

In daily life, people might not be able to drive due to factors like fatigue and alcohol. In this case, remote chauffeur can act as the driver to make the driving safe and reduce the incidence of traffic accidents. Remote chauffeuring can improve the convenience of driving. In the case of urban traffic congestion and parking difficulties, remote chauffeurs allow drivers to park their vehicles in parking lots away from the city center and then deliver them to their destination via remote control.

#### SOLUTION OVERVIEW:

The remote driving system is designed to provide real-time feedback of the car's external environment and internal movement information to the remote chauffeurs. Through the use of advanced technologies, the remote chauffeurs can remotely operate the car's movement using various devices. This system is capable of monitoring the car's speed, distance from obstacles, and battery life, and transmitting this information to the remote chauffeurs in a clear and easy-to-understand format.

#### SOLUTION COMPONENTS:

##### Modules on TurtleBot3 :

- The mechanical control system: to achieve the basic motion functions of the TurtleBot3 car.

- The distance sensing system used for monitoring the surrounding environment: Using LiDAR to detect the distance of the car in different directions.

- The system used for monitoring the vehicle's status: real-time monitoring the car's battery power, speed, etc., and uploading the data to the PC server in real-time.

##### Server Modules:

- The transmission system used to remotely control the car: implemented using Arduino IDE.

- The system used to build an AR-based information interaction system: implemented using Unity.

- The system used to output specific car motion commands: implemented using ROS to control the car.

##### HRI modules:

- The gesture recognition system used to recognize gestures given by people and feed back to the central PC server.

- The device used for interaction between the car and people: transmitting real-time surrounding information of the car to the Hololens 2 glasses in video form.

#### CRITERION FOR SUCCESS:

- Functionality: The remote driving system needs to be able to facilitate interaction between the user and the vehicle, enabling the user to remotely control the vehicle's steering, acceleration, and deceleration functions.

- User experience: The user can obtain real-time information about the surrounding environment while driving the vehicle through the glasses, and control the vehicle's movement through gestures.

- Environmental parameter detection: The vehicle can obtain distance information about the environment and its own real-time information.

- Durability and stability: The server needs to maintain a stable connection between the vehicle and the user.

#### DISTRIBUTION OF WORK:

- ECE STUDENT PANG BO:

Implementing the ROS interaction with the PC, using the ROS platform to control the car's speed and direction.

- ECE STUDENT WEI JIAHAO:

Building the car, implementing environmental monitoring and video transmission, ensuring stable transmission of environmental information to the user.

Implementing speed measurement, obstacle distance detection, and battery level monitoring for the car.

- EE STUDENT ZHU KANGYU:

Designing the AR interaction, issuing AR information prompts when the car is overspeeding or approaching obstacles.

Implementing hand gesture recognition for interaction between hololens2 and PC.