GCT & MV 623 Spring 2025
Interaction Sensing Principle & Application
This course will educate core principles of 3D & Physical sensing adopted for human-computer interaction. We will cover basic optics for 3D sensing and basic knowledge of each component for physical sensing. Also, we will look at applications where 3D & physical sensing is combined to provide interaction.
Course Staff
Instructor: Prof. Sang Ho Yoon, Prof. Jae Sang Hyun
Office Hours: By Appointment
TAs: Changhyeon Park (KAIST)
Office Hours: By Appointment
Office Hours: By Appointment
TAs: Changhyeon Park (KAIST)
Office Hours: By Appointment
Course Info
Time: 14:30-16:00 Tue/Thu
Location: Zoom (N5#2332 for offline presentations)
Assignment Submission & Grading: KLMS
Discussion and Q&A: Email to instructors
Location: Zoom (N5#2332 for offline presentations)
Assignment Submission & Grading: KLMS
Discussion and Q&A: Email to instructors
Announcement
▪ 3/4Class Starts!
▪ 3/4Course Sign-up due 3/4 11:59pm
▪ 3/4Course Sign-up due 3/4 11:59pm
Schedule
* Blue box indicates activity related lectures (team project, paper seminar, ML lecture)
| Week | Date | Topic | Note | Due |
|---|---|---|---|---|
| 1 | 2/25 | No Class | ||
| 2/27 | No Class | |||
| 2 | 3/4 | Introduction & Course Overview | ||
| 3/6 | Introduction to 3D Sensor | |||
| 3 | 3/11 | Project Workshop |  Li et al. "Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlation", CVPR, 2012 | ▪ RR due by 3/14 (Thu) 11:59pm |
| 3/13 | Vision-based Sensor: Stereo Vision I | |||
| 4 | 3/18 | Vision-based Sensor: Stereo Vision II | HW#1 Handout (KLMS) | |
| 3/20 | Vision-based Sensor: Structured light Sensor | |||
| 5 | 3/25 | Topic Presentation #1 | Individual Team Meeting | |
| 3/27 | Project Proposal Q&A | Proposal Presentation Schedule | ▪ HW#1 due by 3/27 (Thu) 11:59pm ▪ Proposal Presentation Slides due by 3/31 (Mon) 11:59pm (All Teams) | |
| 6 | 4/1 | Project Proposal Presentation | Chen et al. "Comparative study on 3D optical sensors for short range applications", Optics and Lasers in Engineering, 2022 | |
| 4/3 | Digital Fringe Projection (1): Pinhole | HW#2 Handout (KLMS) | ▪ RR(Group A) due by 4/3 (Thu) 11:59pm | |
| 7 | 4/8 | Topic Presentation #2 Digital Fringe Projection (2): Phase | An et al. 'Pixel-wise absolute phase unwrapping using geometric constraints of structured light system', Optics Express, 2016 | |
| 4/10 | Digital Fringe Projection (3): Phase unwrapping method & 3D reconstruction | ▪ HW#2 due by 4/10 (Thu) 11:59pm ▪ RR(Group B) due by 4/10 (Thu) 11:59pm | ||
| 8 | 4/15 | Topic Presentation #3 Digital Fringe Projection (4): 3D Data compression with phase | Downsampled depth encoding for enhanced 3D range geometry compression, Applied Optics, 2022 HW#3 Handout (KLMS) | |
| 4/17 | No Class (Midterm) | ▪ RR(Group A) due by 4/17 (Thu) 11:59pm | ||
| 9 | 4/22 | Introduction to Physical Sensing | Grosse-Puppendahl et al. "Finding Common Ground: A Survey of Capacitive Sensing in Human-Computer Interaction", CHI 2017 | |
| 4/24 | Topic Presentation #4 Project Progress Q&A | ▪ HW#3 due by 4/24 (Thu) 11:59pm | ||
| 10 | 4/29 | Project Progress Presentation | Presentation Schedule | ▪ Progress Presentation Slides due by 4/28 (Mon) 11:59pm (All Teams) |
| 5/1 | Project Progress Feedback | Feedback Schedule | ||
| 11 | 5/6 | No Class (National Holiday) | ▪ RR(Group A & B) due by 5/6 (Mon) 11:59pm | |
| 5/8 | Pressure/Touch Sensor I | HW#4 Handout (KLMS) | ▪ Progress Report due by 5/11 (Sun) 11:59pm | |
| 12 | 5/13 | Pressure/Touch Sensor II Topic Presentation #5 | Xu et al. "Enabling Hand Gesture Customization on Wrist-Worn Devices", CHI 2022 | |
| 5/15 | Inertial Measurement Unit Sensor | ▪ HW#4 due by 5/15 (Thu) 11:59pm ▪ RR (Group B) due by 5/15 (Thu) 11:59pm | ||
| 13 | 5/20 | No Class (Admission Interview Day) | Laput et al. "ViBand: High-Fidelity Bio-Acoustic Sensing Using Commodity Smartwatch Accelerometers", UIST 2016 Substitute with CT Scape Participation on 5/30 | |
| 5/22 | Topic Presentation #6 Bioacoustic Sensing | Eddy et al. "A Framework and Call to Action for the Future Development of EMG-Based Input in HCI", CHI 2023 HW#5 Handout (KLMS) | ▪ RR (Group A) due by 5/22 (Thu) 11:59pm | |
| 14 | 5/27 | Topic Presentation #7 Physiological Sensing | ▪ RR (Group B) due by 5/27 (Mon) 11:59pm | |
| 5/29 | Topic Presentation #8 | ▪ HW#5 due by 5/29 (Thu) 11:59pm | ||
| 15 | 6/3 | Final Presentation Preparation Q&A | ||
| 6/5 | Final Presentation | Presentation Schedule | ▪ Final Presentation Slides due by 6/4 (Wed) 11:59pm | |
| 16 | 6/10 | Final Presentation Feedback | ||
| 6/12 | No Class | ▪ Presentation Audience Evaluation due by 6/12 (Thu) 11:59pm ▪ Final Report & Peer Evaluation due by 6/12 (Thu) 11:59pm ▪ Final Video due by 6/12 (Thu) 11:59pm ▪ Video Audience Evaluation due by 6/16 (Mon) 12pm |