GCT623/MV623 Spring 2024
Interaction Sensing Principle & Application



This course will educate core principles of 3D & Physical sensing adopted for human-computer interaction. We will cover basic optics for 3D sensing and basic knowledge of each component for physical sensing. Also, we will look at applications where 3D & physical sensing is combined to provide interaction.
Course Staff
Instructor: Prof. Sang Ho Yoon
            Prof. Jae Sang Hyun

      Office Hours: By Appointment

TAs: Jina Kim (KAIST)
         Office Hours: By Appointment
Course Info
Time: 9:00-10:20am Mon/Wed
Location: Zoom (N5#2332 for offline presentations)
Assignment Submission & Grading: KLMS
Discussion and Q&A: Email to instructors
Announcement
▪ 3/4    Class Starts!
▪ 3/4    Course Sign-up due 3/6 11:59pm
▪ 3/25  Proposal Presentation Slides due 3/26 11:59pm (All Teams)
▪ 4/21   Submit Progress Presentation Slides to KLMS due by 4/28(Sun) 11:59pm
▪ 4/21   Progress Presentation on 4/29 will be held in N25 #3229 & Zoom.
Schedule

      * Blue box indicates team project related lectures
Week Date Topic Note Due
1 2/26 No Class
2/28 No Class
2 3/4 Introduction & Course Overview
3/6 Introduction to Physical Sensing
3 3/11 Project Workshop Grosse-Puppendahl et al. "Finding Common Ground: A Survey of Capacitive Sensing in Human-Computer Interaction", CHI 2017 RR due by 3/14(Thu) 11:59pm
3/13 Pressure/Touch Sensor HW#1 Handout (KLMS)
4 3/18 Pressure/Touch Sensor
3/20 Topic Presentation #1 Xu et al. "Enabling Hand Gesture Customization on Wrist-Worn Devices", CHI 2022 HW#1 due by 3/22(Fri) 11:59pm
5 3/25 Project Proposal Q&A Individual Team Meeting
3/27 Project Proposal Presentation Proposal Presentation Schedule Proposal Presentation Slides
due by 3/26(Tue) 11:59pm (All Teams)
6 4/1 Project Proposal Feedback Individual Team Meeting RR due by 4/1(Mon) 11:59pm
4/3 Inertial Measurement Unit Sensor (Recorded Video) HW#2 Handout (KLMS)
7 4/8 Topic Presentation #2
Bioacoustic Sensing
Laput et al. "ViBand: High-Fidelity Bio-Acoustic Sensing Using Commodity Smartwatch Accelerometers", UIST 2016
4/10 No Class HW#2 due by 4/10(Wed) 11:59pm
RR due by 4/11(Thu) 11:59pm
8 4/15 No class (Midterms Week)
4/17 No class (Midterms Week) HW#3 Handout (KLMS) RR due by 4/18(Thu) 11:59pm
9 4/22 Topic Presentation#3
Physiological Sensing
Eddy et al. "A Framework and Call to Action for the Future Development of EMG-Based Input in HCI", CHI 2023
4/24 Introduction to 3D Sensor
10 4/29 Project Progress Presentation Presentation Schedule Progress Presentation Slides due by 4/28(Sun) 11:59pm (All Teams)
HW#3 due by 4/28(Sun) 11:59pm
5/1 Project Progress Feedback Feedback Schedule
11 5/6 Vision-based Sensor: Stereo Vision I HW#4 Handout (KLMS)
Li et al. "Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlation", CVPR, 2012
RR due by 5/6(Mon) 11:59pm
5/8 Topic Presentation#4
Vision-based Sensor: Stereo Vision II
Chen et al. "Comparative study on 3D optical sensors for short range applications", Optics and Lasers in Engineering, 2022 Progress Report due by 5/12(Sun) 11:59pm
12 5/13 Vision-based Sensor: Structured light Sensor
5/15 No Class
13 5/20 Digital Fringe Projection (1): Pinhole HW#5 Handout (KLMS)
An et al. "Pixel-wise absolute phase unwrapping using geometric constraints of structured light system", Optics Express, 2016
RR due by 5/20(Mon) 11:59pm
5/22 Topic Presentation#5
Digital Fringe Projection (2): Phase
14 5/27 Digital Fringe Projection (3): phase unwrapping method & 3D reconstruction "Downsampled depth encoding for enhanced 3D range geometry compression", Applied Optics, 2022 RR due by 5/27(Mon) 11:59pm
5/29 Topic Presentation#6
Digital Fringe Projection (4): 3D Data compression with phase
Final Project Q&A
15 6/3 Final Project Preparation HW#5 due by 6/2(Sun) 11:59pm
6/5 Final Presentation Presentation Schedule Final Presentation Slides due by 6/4(Tue) 11:59pm
16 6/10 Final Presentation (Finals Week) Feedback Schedule Presentation Audience Evaluation due by 6/10(Mon) 11:59pm
Final Report & Peer Evaluation due by 6/13(Wed) 11:59pm
Final Video due by 6/13(Wed) 11:59pm
6/12 Final Presentation Feedback (Finals Week) Video Audience Evaluation due by 6/15(Fri) 12pm