Course Links: Piazza, Gradescope |
Course Topics: Grading Information: |
Course Calendar (subject to change)
Lecture | Module | Algorithms/Techniques | Topics and applications / case study | Notes/slides | Optional materials to read, watch. | HW and MP |
1. video | Introduction | -- | - Course logistics and overview | slides | ||
2. video | Foundations | - Linear Algebra (1/2) | - Vector spaces, solving Ax = b, Rank ... | notes | Browse articles listed at the bottom | |
3. video | - Linear Algebra (2/2) | - Null spaces and
orthogonal relations between - Column, Row, and Null spaces ... |
notes |
Linear Algebra Book (by G. Strang) |
HW1
released (Due Tue |
|
4. video | - Linear Algebra (3/2) | - Properties, Least squares, Eigen decomposition ... | notes | |||
5. video | Foundations | - Signal Processing (1/3) | - Time and frequency basis, Fourier transform, IDFT ... | notes | ||
6. video | - Signal Processing (2/3) | - DFT magnitude, phase,
resolution, real signals ... - Complex signals, bandwidth, negative frequency ... - Intuitions, examples. |
pre-notes post-notes |
Digital
Signal Processing Book (by Richard Lyons) |
MP1: visualize data (Due Wed Feb 24th 5pm) mp1_python.zip (Recommended) mp1_matlab.zip Intro to Python/Jupyter |
|
7. video | - Signal Processing (3/3) | - Spectrogram, Properties, Nyquist sampling theorem | pre-notes post-notes |
HW2 released |
||
8. video1 video2 |
Localization (outdoor) |
- GPS introduction |
- Trilateration, clock
synchronization, pseudorange ... - Auto-correlation, cross-correlation. |
pre-notes post-notes |
- See GPS
linearize technique video |
|
9. video1 video2 |
Localization (indoor) |
- WiFi localization - Wireless channel |
- RSSI, fingerprinting,
KNN - Convolution, filters, Time-to-freq., multipath ... |
post-notes1 post-notes2 |
RADAR paper (read) | MP2: WiFi
fingerprint (Due Sun Mar. 14th 11:59pm) mp2_python.zip |
10. video | - Channel
fingerprinting - Beamforming - Angle of arrival (AoA) |
- LoS power and
multipath separation - Introduction to triangulation |
pre-notes1 post-notes1 pre-notes2 post-notes2 |
|||
11. video |
- AoA + triangulation | - Delay sum beamforming
, steering matix, nulling. - AoA spectrum, cross-correlation. |
pre-notes post-notes |
|||
12. video |
Motion tracking |
- Subspace methods
(MUSIC) - Foundations of IMU (1/2) |
- WiFi triangulation
(ArrayTrack) - Accelerometer, gyroscope, magnetometer ... - Track objects (humans, basket balls, drones ...) |
pre-notes1 post-notes1 pre-notes2 post-notes2 |
ArrayTrack
(paper review) Due Mar. 17th 11:59PM >> Review guideline >> Review template |
|
13. video |
- Foundations of IMU
(2/2) - Motion tracking w/o training |
- 3D orientation
matrix, orientation tracking, - 3D dead reckoning. - Human movement and course correction |
pre-notes1 post-notes1 pre-notes2 post-notes2 |
IMU
tutorial (watch) [Paper] on ball tracking with IMUs |
MP3: Acoustic AoA (Due Mar. 28th, 11:59pm) mp3_python.zip UnLoc (paper review) Due Mar 22 11:59pm |
|
14. video |
Foundations |
- Probability review |
- Bayes' Rule,
Conditional prob., marginalization, posterior, likelihood, chain rule, joint distributions ... |
pre-notes post-notes |
||
15. video |
Sensor Fusion | - Bayesian filtering
(1/2) |
- Formulate Hidden
Markov Models (HMM) |
pre-notes post-notes |
||
16. video |
- Bayesian filtering (2/2) | - HMM (forward and
backward), dynamic program. - Other applications |
pre-notes post-notes |
Viterbi Decoding video (watch) | ||
17. video |
- Applications of HMM | - Auto-correct in
keyboards, swipe keyboards - Speech recognition - Gesture recognition: Arm motion tracking |
pre-notes post-notes slides |
MUSE (read) | ArmTrak
(paper review) Due April 7, 11:59pm MP4: IMU PDR Due April 13, 11:59pm MP4-release.zip |
|
18. video |
- Guest seminar (1
hour) - Applications of HMM |
- Sensing with
Pervasive Wireless Infrastructure (Elahe S.) - SLAM, Particle filters basics |
seminar video post-notes |
|||
19. video |
Foundations |
- Applications of HMM - Convex optimization basics |
- Particle filters
(PF), SLAM (just intuitions) - Grad and Hessian, vector differentiation, convexity - Convex functions, convexity test |
pre-notes1 post-notes1 pre-notes2 post-notes2 |
- Particle
Filter (PF) video (watch) - Another PF video (watch) |
|
20. video |
Acoustics |
- Convex optimization
basics - Adaptive filtering |
- Gradient descent,
step size, convergence. - MMSE and LMS methods - Active Noise cancellation (ANC) |
pre-notes post-notes |
MUTE
(review) Due Apr 19, 11:59pm |
|
21. video |
- Wireless + ANC - Mid-term review |
- Application to Active
Noise Cancellation (ANC) |
post-notes pre-slides post-slides midterm |
HW3 Released MP5 HMM |
||
22. video |
Inaudible vibrations and acoustics |
- Vibration + acoustics - Signal mixing - Project backdoor |
- Encoding data bits
into vibrations - Applications in security - Breaking Alexa |
post-slides | ||
Mid-term | ||||||
23. video |
- Dynamic time warping |
- matching signals as time series data | pre-notes post-notes |
MP6 DTW Due May 14, 11:59pm MP6-release.zip MP6-EC-release.zip |
||
24. video |
Assorted ideas and applications |
- Camera + WiFi + IMU - FMCW - UWB ToF - Digital agriculture - RFID |
- Privacy preserving
communication - Device free localization and tracking - Liquid sensing - Sensing farm lands with RF and sensors - Backscatter and full duplex |
post-notes |
Insight
CAT and WiTrack LiquID Strobe, FarmBeats Ambient backscatter |
|
26. video |
Assorted ideas and applications Recap |
- Side channels - Sensing and Control - Resonance attacks - Motion side channels - Earable Computing - All topics - Next steps and courses |
- Decoding physical
keys from sounds - Software defined cooking - Attacking drone gyroscopes with sound guns - Inferring typing from IMU motion - cross-disciplinary |
post-notes |
SpiKey SDC MEMS-Gyrosocpe-attack MoLe Earable computing |
Reading list from lecture 2:
- Indoor Navigation Works Where GPS Cant (browse)
- Is Your WiFi a Sensor (browse)
- Household Radar Can Know Your Feeling (browse)
- IoT platforms for sports analytics (browse)
- VR for Ears: 3D Audio Is Coming Soon (browse)
- We Reverse Engineered the Sonic Attack (browse)
- Accelerating Autonomous Vehicle Technology (browse)
- Opinion: Science in the age of selfies (browse)