Project :: ECE 445 - Senior Design Laboratory

#	Title	Team Members	TA	Documents	Sponsor
14	SoftBot: Jellyfish-Inspired Bionic Soft Robot with Visual Perception	Junwei Zhang Shuran Yan Wangjie Xu Yinliang Gan		design_document1.pdf final_paper1.pdf final_paper2.pdf final_paper3.pdf other1.pdf proposal1.pdf	Shi Ye
	This project aims to develop a soft robotic actuator system inspired by the efficiency and structure of jellyfish. The new actuator combines dielectric elastomers and dielectric liquids to create a robust, efficient, and adaptable actuator capable of mimicking muscle-like movements. By overcoming the limitations of existing actuators like soft pneumatic actuators (SFAs), dielectric elastomer actuators (DEAs), and HASEL actuators, this design will provide enhanced force feedback while maintaining stability, flexibility, and portability. The system will integrate visual perception through a neural network-based vision module, and reinforcement learning or (PID) control for optimized movement and trajectory tracking.

Featured Project

## Team Members

- [Yuhao Ge], [yuhaoge2],

- [Hao Chen], [haoc8],

- [Junyan Li], [junyanl3],

- [Han Yang], [hany6].

## Project Title

Remote Robot Car Control System with RGBD Camera for 3D Reconstruction

## Problem

We aim to build a user-friendly control system for assisting users to remotely control a robot car equipped with an RGBD camera in complex indoor environments. The car should be able to build the environment based on the point cloud scanned by the camera, and the remote computer will reconstruct the point cloud to gain the map of the environment.

## Solution Overview

Our solution consists of a Robot Car Subsystem, Camera Subsystem, Remote Control Subsystem, and Human-Robot Interaction Interface. The Robot Car Subsystem includes a robot car and a rotating base for the RGBD camera. The Camera Subsystem captures RGBD images of the surrounding environment and performs real-time 3D reconstruction. The Remote Control Subsystem allows users to control the robot car remotely via a joystick. The Human-Robot Interaction Interface provides a third-person perspective view of the reconstructed environment and allows users to interact with the robot car in real-time.

## Solution Components

- Robot Car Subsystem: Includes a robot car and a rotating base for the RGBD camera.

- Camera Subsystem: Captures RGBD images of the surrounding environment and performs real-time 3D reconstruction using image signal processing software.

- Remote Control Subsystem: Allows users to control the robot car remotely via a joystick.

- Human-Robot Interaction Interface: Provides a third-person perspective view of the reconstructed environment and allows users to interact with the robot car in real-time.

## Criterion for Success

- The remote robot car control system can navigate and avoid obstacles in complex indoor environments.

- The Camera Subsystem can perform real-time 3D reconstruction with high accuracy and reliability.

- The Remote Control Subsystem provides a smooth and responsive control experience for the user.

- The Human-Robot Interaction Interface provides an intuitive and user-friendly way for users to interact with the robot car and view the reconstructed environment.

## Distribution of Work

- Han Yang (EE): Camera Subsystem design and implementation

- Hao Chen (ECE): Remote Control Subsystem design and implementation

- Junyan Li (ECE): Human-Robot Interaction Interface design and implementation

- Yuhao GE (ECE): Robot Car Subsystem design and implementation

## Justification of Complexity

We believe that our team has the necessary skills and knowledge to handle the mechanical and electrical complexity of our project.

Specifically, Han Yang has experience in image signal processing and Hao Chen has experience in remote control systems. Junyan Li has experience in human-robot interaction design, and Yuhao Ge has experience in robotics and mechanical design. Additionally, we plan to use readily available off-the-shelf components and design our system in a modular and scalable way to minimize the complexity and facilitate the development process.