Featured Project

#### TEAM MEMBERS

Jiahao Wei (jiahaow4)

Bo Pang (bopang5)

Kangyu Zhu (Kangyuz2)

## REMOTE DRIVING SYSTEM

#### PROBLEM:

In daily life, people might not be able to drive due to factors like fatigue and alcohol. In this case, remote chauffeur can act as the driver to make the driving safe and reduce the incidence of traffic accidents. Remote chauffeuring can improve the convenience of driving. In the case of urban traffic congestion and parking difficulties, remote chauffeurs allow drivers to park their vehicles in parking lots away from the city center and then deliver them to their destination via remote control.

#### SOLUTION OVERVIEW:

The remote driving system is designed to provide real-time feedback of the car's external environment and internal movement information to the remote chauffeurs. Through the use of advanced technologies, the remote chauffeurs can remotely operate the car's movement using various devices. This system is capable of monitoring the car's speed, distance from obstacles, and battery life, and transmitting this information to the remote chauffeurs in a clear and easy-to-understand format.

#### SOLUTION COMPONENTS:

##### Modules on TurtleBot3 :

- The mechanical control system: to achieve the basic motion functions of the TurtleBot3 car.

- The distance sensing system used for monitoring the surrounding environment: Using LiDAR to detect the distance of the car in different directions.

- The system used for monitoring the vehicle's status: real-time monitoring the car's battery power, speed, etc., and uploading the data to the PC server in real-time.

##### Server Modules:

- The transmission system used to remotely control the car: implemented using Arduino IDE.

- The system used to build an AR-based information interaction system: implemented using Unity.

- The system used to output specific car motion commands: implemented using ROS to control the car.

##### HRI modules:

- The gesture recognition system used to recognize gestures given by people and feed back to the central PC server.

- The device used for interaction between the car and people: transmitting real-time surrounding information of the car to the Hololens 2 glasses in video form.

#### CRITERION FOR SUCCESS:

- Functionality: The remote driving system needs to be able to facilitate interaction between the user and the vehicle, enabling the user to remotely control the vehicle's steering, acceleration, and deceleration functions.

- User experience: The user can obtain real-time information about the surrounding environment while driving the vehicle through the glasses, and control the vehicle's movement through gestures.

- Environmental parameter detection: The vehicle can obtain distance information about the environment and its own real-time information.

- Durability and stability: The server needs to maintain a stable connection between the vehicle and the user.

#### DISTRIBUTION OF WORK:

- ECE STUDENT PANG BO:

Implementing the ROS interaction with the PC, using the ROS platform to control the car's speed and direction.

- ECE STUDENT WEI JIAHAO:

Building the car, implementing environmental monitoring and video transmission, ensuring stable transmission of environmental information to the user.

Implementing speed measurement, obstacle distance detection, and battery level monitoring for the car.

- EE STUDENT ZHU KANGYU:

Designing the AR interaction, issuing AR information prompts when the car is overspeeding or approaching obstacles.

Implementing hand gesture recognition for interaction between hololens2 and PC.