CS/ECE 434: Mobile Computing Algorithms and Applications
 

Banner


 Instructor URL:       Romit Roy Choudhury
 Email:                        croy@illinois.edu
 Office hours:             After class

 Location:                   Zoom link, password: 2021
 Time:                         M/W 10-11:20am

 Course TA:               Liz Li
                                    ziyueli3@illinois.edu
 TA office hours:        Mondays 3-4pm, Zoom

 Prerequisites:            Linear Algebra, Probability,
                                     Programming (Py or Matlab)

Course Links:             Piazza, Gradescope

Course Topics:
 
• Math Foundations for data science (we will start from first principles)

      Linear Algebra, Probability, Data/Signal Processing, Machine learning and Convex optimization --> Data Science

       We will introduce and revisit these concepts through the various applications discussed in the course.
 

• GPS, WiFi, Localization, Sensor Fusion

      Algorithms: Triangulation, Trilateration, Clustering, SLAM, Kalman filter

       Applications: Outdoor and indoor localization, mapping, IoT
 

• IMU Sensors, Motion Tracking

      Algorithms: Dead reckoning, PCA, Hidden Markov Models (HMM), Kalman Filters

      Applications: Activity tracking, Gesture recognition, Sports analytics, wearable computing
 

• Microphone, Speakers

      Algorithms: SVD, Noise Cancellation, Dynamic Time Warping, Gradient Descent

      Applications: Acoustic Sensing, Voice Assistants, Earphone computing, AR/VR
 

• Camera, Light

      Algorithms: SIFT/SURF, Wavelets, 3D Point clouds, Structure from motion (SfM)

      Applications: Augmented reality, Visual Communication, Shadow sensing
 

• Wireless Radios (WiFi, BLE, 5G)

      Algorithms: Beamforming, Time of Flight (ToF), Clock synchronization, FMCW, Doppler

      Applications: Presence detection, Liquid identification, Bio-monitoring, Digital agriculture

 

• Security and Privacy

      Algorithms: Classification, Non-linearity, Viterbi decoding, MLE, Stochastic gradient descent

      Applications: Fingerprinting, side channel, inference
 

• Emerging areas: Edge computing, battery-free devices, Earable computing, autonomous cars, …

   Grading Information:
    - Homework, Assignments(2-3):   20%
    - Paper reviews (5-8):                    10%
    - Machine problems (5-6):             40%  (best of N-1 MPs)
    - 1 mid-term exam (Apr 21st):      30%
    - 4 credit students:                         Will need to do all N MPs

Course Calendar (subject to change)
Lecture Module Algorithms/Techniques Topics and applications / case study Notes/slides Optional materials to read, watch. HW and MP
1. video Introduction -- - Course logistics and overview slides    
2. video Foundations - Linear Algebra (1/2) - Vector spaces, solving Ax = b, Rank ... notes Browse articles listed at the bottom  
3. video   - Linear Algebra (2/2) - Null spaces and orthogonal relations between
- Column, Row, and Null spaces ...
notes

 Linear Algebra Book (by G. Strang)

HW1 released (Due Tue
Feb 16th 5pm on Gradescope)

4. video   - Linear Algebra (3/2) - Properties, Least squares, Eigen decomposition ... notes    
5. video  Foundations - Signal Processing (1/3) - Time and frequency basis, Fourier transform, IDFT ... notes    
6. video   - Signal Processing (2/3) - DFT magnitude, phase, resolution, real signals ...
- Complex signals, bandwidth, negative frequency ...
- Intuitions, examples.
pre-notes
post-notes
Digital Signal Processing Book
(by Richard Lyons)
MP1: visualize data
(Due Wed Feb 24th 5pm)
mp1_python.zip (Recommended)
mp1_matlab.zip
Intro to Python/Jupyter
7. video   - Signal Processing (3/3) - Spectrogram, Properties, Nyquist sampling theorem pre-notes
post-notes
 

HW2 released
(Due Sun Feb28th 11:59pm)

8. video1
    video2
Localization
(outdoor)
- GPS introduction
 
- Trilateration, clock synchronization, pseudorange ...
- Auto-correlation, cross-correlation.
pre-notes
post-notes

- See GPS linearize technique video
- Read Sec. 1, 2 of CO-GPS paper
- Read Rethinking GPS

 

9. video1
    video2
 Localization
(indoor)
- WiFi localization
- Wireless channel
- RSSI, fingerprinting, KNN
- Convolution, filters, Time-to-freq., multipath ...
post-notes1
post-notes2
 RADAR paper (read)  MP2: WiFi fingerprint
(Due Sun Mar. 14th 11:59pm)
mp2_python.zip
 10. video   - Channel fingerprinting


- Beamforming
- Angle of arrival (AoA)
- LoS power and multipath separation


- Introduction to triangulation
pre-notes1
post-notes1

pre-notes2
post-notes2
   
 11.
video
  - AoA + triangulation - Delay sum beamforming , steering matix, nulling.
- AoA spectrum, cross-correlation.
pre-notes
post-notes
   
 12.
video



Motion tracking
 
- Subspace methods (MUSIC)


- Foundations of IMU (1/2)
- WiFi triangulation (ArrayTrack)


- Accelerometer, gyroscope, magnetometer ...
- Track objects (humans, basket balls, drones ...)
pre-notes1
post-notes1

pre-notes2
post-notes2
  ArrayTrack (paper review)
Due Mar. 17th 11:59PM
>> Review guideline
>> Review template
 13.
video
  - Foundations of IMU (2/2)



- Motion tracking w/o training
- 3D orientation matrix, orientation tracking,
- 3D dead reckoning.


- Human movement and course correction
pre-notes1
post-notes1


pre-notes2
post-notes2
IMU tutorial (watch)
[Paper] on ball tracking with IMUs
MP3: Acoustic AoA
(Due Mar. 28th, 11:59pm)
mp3_python.zip

UnLoc (paper review)
Due Mar 22 11:59pm
 14.
video
Foundations
 
- Probability review
 
- Bayes' Rule, Conditional prob., marginalization,
posterior, likelihood, chain rule, joint distributions ...
pre-notes
post-notes
   
 15.
video
Sensor Fusion - Bayesian filtering (1/2)
 
- Formulate Hidden Markov Models (HMM)
 
pre-notes
post-notes
   
 16.
video
  - Bayesian filtering (2/2) - HMM (forward and backward), dynamic program.
- Other applications
pre-notes
post-notes
Viterbi Decoding video (watch)  
17.
video
  - Applications of HMM - Auto-correct in keyboards, swipe keyboards
- Speech recognition
- Gesture recognition: Arm motion tracking
 
pre-notes
post-notes
slides
MUSE (read) ArmTrak (paper review)
Due April 7, 11:59pm

MP4: IMU PDR
Due April 13, 11:59pm
MP4-release.zip
 18.
video


 
- Guest seminar (1 hour)


- Applications of HMM
- Sensing with Pervasive Wireless Infrastructure (Elahe S.)


- SLAM, Particle filters basics
seminar
video


post-notes


 
 
19.
video


Foundations
- Applications of HMM

- Convex optimization basics

 
- Particle filters (PF), SLAM (just intuitions)

- Grad and Hessian, vector differentiation, convexity
- Convex functions, convexity test
 
pre-notes1
post-notes1

pre-notes2
post-notes2
- Particle Filter (PF) video (watch)
- Another PF video (watch)
 
20.
video



Acoustics
- Convex optimization basics


- Adaptive filtering
- Gradient descent, step size, convergence.


- MMSE and LMS methods
- Active Noise cancellation (ANC)
pre-notes
post-notes

 
  MUTE (review)
Due Apr 19, 11:59pm
 21.
video
  - Wireless + ANC



- Mid-term review
- Application to Active Noise Cancellation (ANC)

 
post-notes
pre-slides
post-slides

midterm
 

HW3 Released
Due Apr 22, 11:59pm

MP5 HMM
Due May 5, 11:59pm
MP5-release.zip

 22.
video
Inaudible
vibrations and
acoustics
- Vibration + acoustics

- Signal mixing
- Project backdoor
- Encoding data bits into vibrations

- Applications in security
- Breaking Alexa
post-slides    
  Mid-term          
23.
video
  - Dynamic time warping
 
- matching signals as time series data pre-notes
post-notes
  MP6 DTW
Due May 14, 11:59pm
MP6-release.zip
MP6-EC-release.zip
24.
video
Assorted ideas
and applications
- Camera + WiFi + IMU
- FMCW
- UWB ToF
- Digital agriculture
- RFID
- Privacy preserving communication
- Device free localization and tracking
- Liquid sensing
- Sensing farm lands with RF and sensors
- Backscatter and full duplex
post-notes
Insight
CAT and WiTrack
LiquID
Strobe, FarmBeats
Ambient backscatter
 
26.
video
Assorted ideas
and applications




Recap
- Side channels
- Sensing and Control
- Resonance attacks
- Motion side channels
- Earable Computing

- All topics
- Next steps and courses
- Decoding physical keys from sounds
- Software defined cooking
- Attacking drone gyroscopes with sound guns
- Inferring typing from IMU motion
- cross-disciplinary
post-notes
SpiKey
SDC
MEMS-Gyrosocpe-attack
MoLe
Earable computing
 
 
Reading list from lecture 2:

- Indoor Navigation Works Where GPS Can’t (browse)
- Is Your WiFi a Sensor (browse)
- Household Radar Can Know Your Feeling (browse)
- IoT platforms for sports analytics (browse)
- VR for Ears: 3D Audio Is Coming Soon (browse)
- We Reverse Engineered the  “Sonic” Attack (browse)
- Accelerating Autonomous Vehicle Technology (browse)
- Opinion: Science in the age of selfies (browse)