Project

# Title Team Members TA Documents Sponsor
43 Cyber Guandan Tabletop Assistant with Real-Time Game Display and Event Monitoring
Fan Zhang
Wendao Yao
Yushang Yang
Zihan Zhou
design_document1.pdf
final_paper1.pdf
other1.pdf
Yushi Cheng
## 1. Problem Definition and Motivation

Physical card games such as Guandan are highly interactive and enjoyable, but they usually do not provide real-time information support for players or spectators. During a fast-paced game, it can be difficult to keep track of scores, tribute status, and recent game history. This problem becomes more obvious for new players, audiences, or demonstration settings where the game needs to be easier to follow.

In addition, traditional tabletop games do not provide a convenient way to monitor unusual card events. If a card unexpectedly appears in or disappears from the active play region, it may be difficult to notice immediately or review afterward.

To address this problem, this project aims to develop a vision-based Guandan tabletop assistant that can monitor a predefined play region and display useful game information in real time. By combining overhead vision with an assistant display, the system can help users better understand the game process while also providing basic event monitoring and replay capability.

The success of this project will be evaluated based on the following criteria:

- The system can detect card appearance or disappearance in a predefined tabletop region.
- The system can display score, tribute status, and recent game history in real time.
- The system can detect unexpected card events in the monitored region.
- The system can provide an alert and a short replay clip when such an event is detected.
- The system can operate as a stable tabletop demo with minimal manual setup.

## 2. Solution Overview

The proposed solution integrates vision-based monitoring and real-time game display into a unified tabletop assistant system. An overhead camera captures the game area, and an embedded processing unit analyzes the monitored region to detect card changes and selected game events.

Once a card event is detected, the system updates the assistant display with related game information such as scores, tribute reminders, and recent history. This allows both players and spectators to follow the game more easily. In addition, the system monitors the active play region for unexpected card appearance or disappearance events. When such an event occurs, the system issues an alert and provides a short replay clip for review.

Compared with a normal physical card table, the proposed system adds real-time information support and event review while preserving the original gameplay experience. Compared with a more complex projection-based design, the proposed solution is more practical and easier to implement for a reliable classroom demonstration.

## 3. System Architecture and Components

### Vision Module
The vision module captures the tabletop scene using an overhead camera and monitors a predefined play region. Its main function is to detect card appearance and disappearance events and provide visual input for later processing.

### Game Information Module
This module maintains selected game information such as scores, tribute status, and recent play history. It updates the displayed information based on the recognized tabletop events.

### Assistant Display Module
The assistant display module presents useful information on a separate screen instead of projecting directly onto the table. It shows scores, tribute status, recent history, system alerts, and replay output.

### Event Monitoring and Replay Module
This module determines whether an unexpected card event has occurred in the monitored region. When such an event is detected, it generates an alert and saves a short replay clip for review.

### Embedded Control Module
The embedded control module coordinates the camera, processing unit, and display subsystem. It is responsible for overall system operation and stable demo startup.

## 4. Criteria of Success

Our project will be considered successful if it satisfies the following goals:

- The system can correctly detect card appearance or disappearance events in the predefined play region under controlled lighting conditions.
- The assistant display can update score, tribute status, and recent history with low visible delay.
- The system can detect at least one or two predefined unexpected card event types and provide an alert within a short time.
- The system can save and display a short replay clip of about 3 to 5 seconds for detected events.
- The full system can run continuously for at least 20 minutes as a stable demonstration without major manual adjustment.

Remote Driving System

Bo Pang, Jiahao Wei, Kangyu Zhu

Featured Project

#### TEAM MEMBERS

Jiahao Wei (jiahaow4)

Bo Pang (bopang5)

Kangyu Zhu (Kangyuz2)

## REMOTE DRIVING SYSTEM

#### PROBLEM:

In daily life, people might not be able to drive due to factors like fatigue and alcohol. In this case, remote chauffeur can act as the driver to make the driving safe and reduce the incidence of traffic accidents. Remote chauffeuring can improve the convenience of driving. In the case of urban traffic congestion and parking difficulties, remote chauffeurs allow drivers to park their vehicles in parking lots away from the city center and then deliver them to their destination via remote control.

#### SOLUTION OVERVIEW:

The remote driving system is designed to provide real-time feedback of the car's external environment and internal movement information to the remote chauffeurs. Through the use of advanced technologies, the remote chauffeurs can remotely operate the car's movement using various devices. This system is capable of monitoring the car's speed, distance from obstacles, and battery life, and transmitting this information to the remote chauffeurs in a clear and easy-to-understand format.

#### SOLUTION COMPONENTS:

##### Modules on TurtleBot3 :

- The mechanical control system: to achieve the basic motion functions of the TurtleBot3 car.

- The distance sensing system used for monitoring the surrounding environment: Using LiDAR to detect the distance of the car in different directions.

- The system used for monitoring the vehicle's status: real-time monitoring the car's battery power, speed, etc., and uploading the data to the PC server in real-time.

##### Server Modules:

- The transmission system used to remotely control the car: implemented using Arduino IDE.

- The system used to build an AR-based information interaction system: implemented using Unity.

- The system used to output specific car motion commands: implemented using ROS to control the car.

##### HRI modules:

- The gesture recognition system used to recognize gestures given by people and feed back to the central PC server.

- The device used for interaction between the car and people: transmitting real-time surrounding information of the car to the Hololens 2 glasses in video form.

#### CRITERION FOR SUCCESS:

- Functionality: The remote driving system needs to be able to facilitate interaction between the user and the vehicle, enabling the user to remotely control the vehicle's steering, acceleration, and deceleration functions.

- User experience: The user can obtain real-time information about the surrounding environment while driving the vehicle through the glasses, and control the vehicle's movement through gestures.

- Environmental parameter detection: The vehicle can obtain distance information about the environment and its own real-time information.

- Durability and stability: The server needs to maintain a stable connection between the vehicle and the user.

#### DISTRIBUTION OF WORK:

- ECE STUDENT PANG BO:

Implementing the ROS interaction with the PC, using the ROS platform to control the car's speed and direction.

- ECE STUDENT WEI JIAHAO:

Building the car, implementing environmental monitoring and video transmission, ensuring stable transmission of environmental information to the user.

Implementing speed measurement, obstacle distance detection, and battery level monitoring for the car.

- EE STUDENT ZHU KANGYU:

Designing the AR interaction, issuing AR information prompts when the car is overspeeding or approaching obstacles.

Implementing hand gesture recognition for interaction between hololens2 and PC.