ECE/CS 598: Mobile Sensing and Sensor Fusion

Spring 17: ECE 598RR: Mobile Sensing and Sensor Fusion

sensing

Course Description: This course exposes students to ongoing research in mobile sensing, i.e., techniques, algorithms, and systems that leverage the sensors in smartphones, smartwatches, drones, and IoT devices, to deliver real-world applications. Topics include:

GPS and related outdoor applications
Indoor positioning systems
Activity and gesture recognition
Sensor data analytics in sports, vehicular, and smart environments
Vibration sensing and acoustics
Drone motion tracking
Sensor data leakage and inference: security and privacy
Augmented Reality

The course will teach students some popular/useful analytical techniques and then show the application of these techniques to real systems. Examples techniques are Trilateration, 3D Dead Reckoning, Orientation tracking, HMM, Viterbi Decoding, Doppler, Maximum Likelihood. Example applications are listed above. Overall, the course will take a systems/practical approach, helping students to:

Understand the state of the art in mobile sensing and computing
Understand how to initiate/engage in mobile computing research.
Develop good research taste in general, and approach design-questions systematically (via a semester-long research project)

Prerequisites: Probability, linear algebra, and programming maturity (any one of MATLAB, R, Python, or Java/C). The course will start with some mathematical refreshers and basic introduction to signal processing and data analytics. An Android tutorial may also be presented. Experience on mobile programming (Android/iOS) is a plus, but not necessary.

Course project: Students will propose their own project ideas (as a function of their interest & background); instructor will offer guidance.

Course Load: Read and submit reviews for ~25 research papers (~1 per class), present once in the semester, 1 final project.

Grading: Reviews (30%), Class presentation (15%), Final Project (55%)

Time and Location:   M/W 3 to 4:20pm @ 2013 ECE Building
Instructor:                  Romit Roy Choudhury (croy@illinois.edu)
Office hours:              M/W 4:20 to 5:00pm

Course TA:                Sheng Shen <sshen19@illinois.edu>

Reference books:       (1) Introduction to Linear Algebra, Gilbert Strang (MIT)
                                    (2) Understanding Digital Signal Processing, Richard Lyons (UCSC)
                                    (3) Mathematical Foundations of Computer Networking, Srinivasan Keshav (University of Waterloo)
                                    (4) A Top Down Approach to Computer Networking, James Kurose (UMass)
                                    (5) Data Analytics, David Forsyth (UIUC)

Tentative Course Calendar (subject to change)

Introductions	1.1 Course overview, logistics, and expectations [ppt]	Romit
Refreshers [notes1] [notes2] [notes3] [notes4]	1.2 Linear algebra refresher 2.1 Signal processing basics and refresher 2.2 Probability refresher	Romit Romit Romit
Location Sensing via GPS	3.1 Basics: GPS trilateration, Carrier phase, Diff. GPS: SafetyNet [ppt] [due Wed Feb 1] 3.2 Application: Coin GPS [ppt] + Relative GPS [both due Mon Feb 6] Optional readings (no need to submit review): Relative GPS 2	Romit Coin: Romit Relative: Doyoun, James
Location Sensing via RF [notes1, notes2]	4.1 Basics: Intro to comm. (AM, FM, QAM), multipath, CSI, OFDM 4.2 Basics: WiFi and beamforming 5.1 Application: RADAR, Place Labs [both due Web Feb 15] 5.2 Application: EZ, ArrayTrack [both due Mon Feb 20] Optional readings (no need to submit review): DecaLoc and use of chinese remainder theorem	Romit Romit Romit [Mon Feb 20] EZ: Varun, Kartik Array: Xianze, Xuewei
Location Sensing via IMU [notes]	6.1 IMU basics: discuss MEMS, Google video on IMU, analyzing time series data from sensors, bias in compass, sensor noise properties, averaging, dead reckoning. 6.2 Application: SurroundSense, UnLoc, WalkCompass [all due Mon Feb 27]	Romit Romit
Motion Tracking via IMU Vibration Sensing [notes]	7.1 Basics: 3D orientation, rotation, sensor fusion. 7.2 Basics: Probabilistic graphical models, HMMs, Viterbi, Kalman filters, Particle filters 8.1 Applications: A3, ArmTrak [both due Wed Mar 8] 8.2 Applications: MoLe [due Mon Mar 13] 9.1 Applications: Zee, MagLoc [due Wed Mar 15] 10.1 Basics: Vibra motors, ringing, resonance 10.2 Applications: Ripple 2 [due Wed Mar 29] 11.1 Application: Sports Analytics [due Mon Apr 3] Project Discussion	Romit Romit [Wed Mar 8] A3: Alex, Greg Arm: Romit [Mon Mar 13] MoLe: Cathy, Shrey [Wed Mar 15] Zee: Jesse, Liyi [Wed Mar 29] MagLoc: Xuanyao, Jinwen Vibration: Nirupam [Mon Apr 3] Sports: Romit
Motion Tracking via RF [notes]	12.1 Basics: Doppler, FFT points, classification, DTW 12.2 Applications: WiSee, WiTrack [both due Mon Apr 10]	Romit [Mon Apr 10] 12.2.WiSee: Yishuo, You 12.2.WiTrack: Anadi, Zicheng
Sensor Security, Privacy	13.1 VibraPhone [due Wed Apr 12], BackDoor 13.2 Project Discussion 13.3 GyroPhone, Inferring Secrets from Android Public Sensor Data [both due Wed Apr 19]	Romit Romit [Wed Apr 19] 13.3.Gyro:Dengfeng, Wing 13.3.Secrets:Ben, Michael
Time Permitting: Wide survey of various ideas and applications from recent research	14.1 Survey: RFID and backscatter: Passive, Active devices and battery-free communication RF Shield: Protecting pacemakers from Bluetooth attack RF and acoustic imaging: Shape of a room from sound, WiFi and 60GHz imaging Spyrometer: Lung characteristics from smartphone microphones Theft detection and recovery from motion tracking Accelprint: Fingerprinting accelerometer and IMU devices Object Positioning: Structure from motion and joint location/3D image estimation ACE: Correlation graphs across activities for energy optimization Other reading material: 3D Mouse, Snooping keyboard, Capacitive touch, Gesture authentication, Tagoram, DecaWave, Heartrate, Emotion recognition	Romit

Final Presentation Date: 8am, May 8 (Monday), 2013 ECEB
Final Report Due: 5pm, May 12 (Friday)