CTP445 Spring 2024
Augmented Reality



The interactive experience with digital context has been evolved in the past few decades from desktop/mobile environment to virtual reality (VR). Whereas VR places a user inside a completely computer-generated environment, AR goes beyond this scope by bridging the gap between the virtual and real world seamlessly. This course will introduce theories and applications related to augmented reality technology. Students will also learn basic skills to develop augmented reality applications and content.
Course Staff
Instructor: Prof. Sang Ho Yoon
Office Hours: By Appointment

TAs: Youjin Sung, Hyuckjin Jang, Min-yung Kim
Office Hours: By Appointment
Course Info
Time: 1:00-2:30pm Mon/Wed
Location: N25 #3229
Assignment Submission & Grading: KLMS
Discussion and Q&A: Email to instructors
Announcement
4/21Submit Progress Presentation Slides to KLMS due by 4/28(Sun) 11:59pm.
4/21Progress Presentation on 4/29 & 5/1 will be held in N25 #3229.
2/26Class Starts!
3/25Proposal Presentation Slides due 3/26 11:59pm (All Teams).
Schedule

   * Blue box indicates activity related lectures (team project, paper seminar, ML lecture)
WeekDateTopicNoteDue
12/26Course Overview Sign up Form due by 2/29(Thu) 11:59pm
2/28Introduction to Augmented RealityRonald T. Azuma, A Survey of Augmented Reality
Paul Milgram et al., Augmented reality: a class of displays on the reality-virtuality continuum
23/4Team Formation ActivityTeam Formation Activity Reading Group Announcement
Topic Presentation Team Announcement
Reading Response (RR) due by 3/7(Thu) 11:59pm
3/6AR Toolkit IntroductionAR Toolkit Introduction (KLMS)
HW#1 & Extra Credit Task Handout (KLMS)
Get started with Unity Tutorial
Extra Credit Task due by 3/11(Mon) 11:59pm
33/11Visual System and DisplayPausch et al. "Quantifying immersion in virtual reality." SIGGRAPH, 1997
Chang et al. "Toward the next-generation VR/AR optics: a review of holographic near-eye displays from a human-centric perspective." Optica, 2020
Group AR Project Sign Up due 3/11 11:59pm
RR Group A due by 3/11(Mon) 11:59pm
3/13TrackingNewman et al. "Ubiquitous tracking for augmented reality" ISMAR 2004
Feiner et al. "Windows on the world: 2D windows for 3D augmented reality" UIST 1993
Huo et al. "SynchronizAR: Instant Synchronization for Spontaneous and Spatial Collaborations in Augmented Reality" UIST 2018
Topic Presentation #1
43/18AR Toolkit #2HW#2 Handout (KLMS) HW #1 due by 3/18(Mon) 11:59pm
RR Group B due by 3/18(Mon) 11:59pm
3/20Computer Vision for ARReitmayr et al. "Simultaneous localization and mapping for augmented reality" 2010
Rublee et al. "Orb-slam2: An open-source slam system for monocular, stereo, and rgb-d cameras" IEEE Trans. Robot, 2017
Ma et al. "Sparse-to-Dense: Depth Prediction from Sparse Depth Samples and a Single Image" ICRA, 2018
Topic Presentation #2
53/25Project Feedback Meetings (Individual Team)Feedback Meeting Schedule Proposal Presentation Slides due by 3/26(Tue) 11:59pm (All Teams)
3/27Project Proposal PresentationPresentation Schedule RR Group A due by 3/28(Thu) 11:59pm
HW #2 due by 3/31(Sun) 11:59pm
64/1Calibration and RegistrationZhang, 'A flexible new technique for camera calibration' TPAMI, 2000
Tuceryan et al., 'Single-point active alignment method (SPAAM) for optical see-through HMD calibration for augmented reality' Presence: Teleoperators & Virtual Environments, 2002
Plopski et al., 'Corneal-Imaging Calibration for Optical See-Through Head-Mounted Displays' TVCG, 2015
Topic Presentation #3
RR Group B due by 4/1(Mon) 11:59pm
4/3Project Feedback & Discussion
AR Toolkit Q&A
Feedback Meeting Schedule
HW#3 Handout (KLMS)
74/8Visual CoherenceBreen et al., 'Interactive Occlusion and Automatic Object Placement for Augmented Reality' Computer Graphics Forum, 1996
Kan et al., 'High-quality reflections, refractions, and caustics in augmented reality and their contribution to visual coherence' ISMAR, 2012
Fischer et al., 'Stylized augmented reality for improved immersion' IEEE VR, 2005
Topic Presentation #4
4/10No class HW#3 due by 4/10(Wed) 11:59pm
84/15No class (Midterms Week)
4/17No class (Midterms Week) RR Group A due by 4/18(Thu) 11:59pm
94/22Situated VisualizationHW#4 Handout (KLMS)
White et al., 'SiteLens: Situated visualization techniques for urban site visits' CHI, 2009
Willet et al., 'Embedded data representations' TVCG, 2016
Lin et al., 'Towards an Understanding of Situated AR Visualization for Basketball Free-Throw Training' CHI, 2021
Topic Presentation #5
RR Group B (Interaction) due by 4/22(Mon) 11:59pm
4/24InteractionIshii et al., 'Tangible bits: towards seamless interfaces between people, bits and atoms' CHI, 1997
Du et al., 'DepthLab: Real-time 3D interaction with depth maps for mobile augmented reality' UIST, 2020
Harrison et al., 'OmniTouch: wearable multitouch interaction everywhere' UIST, 2011
Topic Presentation #6
104/29Project Progress PresentationPresentation Schedule Progress Presentation Slides due by 4/28(Sun) 11:59pm
5/1Project Progress PresentationPresentation Schedule
115/6No classProject Feedback Meeting HW#4 due by 5/5(Sun) 11:59pm
RR Group A (Modeling & Annotation) due by 5/6(Mon) 11:59pm
5/8Modeling & AnnotationNewcombe et al., 'Kinectfusion: Real-time dense surface mapping and tracking' ISMAR, 2011
Nuernberger et al., 'Interpreting 2d gesture annotations in 3d augmented reality' 3DUI, 2016
Topic Presentation #7
Progress Report due by 5/12(Sun) 11:59pm
125/13User Study (Recorded Video) RR Group B (Authoring) due by 5/16(Thu) 11:59pm
5/15No Class CTSCAPE (SymCT) Registration
135/20AuthoringLee et al., 'Immersive authoring: What you experience is what you get' Communications of the ACM, 2005
Villanueva et al., 'Meta-AR-app: an authoring platform for collaborative augmented reality in STEM classrooms' CHI, 2020
Wang et al., 'GesturAR: An Authoring System for Creating Freehand Interactive Augmented Reality Applications' UIST, 2021
Topic Presentation #8
RR Group A (Navigation) due by 5/23(Thu) 11:59pm
5/22CTScape Participation on 5/31 (Make-up Class)CTScape Registration
145/27NavigationMulloni et al., 'Indoor positioning and navigation with camera phones' IEEE Pervasive Computing, 2009
Sukan et al., 'Parafrustum: Visualization techniques for guiding a user to a constrained set of viewing positions and orientations' UIST, 2014
Bae et al., 'Computational Rephotography' ACM Transactions on Graphics, 2010
Topic Presentation #9
RR Group B (Collaboration) due by 5/27(Mon) 11:59pm
5/29CollaborationLukosch et al., 'Collaboration in Augmented Reality' CSCW, 2015
Benko et al., 'Dyadic Projected Spatial Augmented Reality' UIST, 2014
Villanueva et al., 'ColabAR: A Toolkit for Remote Collaboration in Tangible Augmented Reality Laboratories' CSCW, 2022
Topic Presentation #10
156/3Final PresentationPresentation Schedule Final Presentation Slides due by 6/2 11:59pm
6/5Final PresentationPresentation Schedule Final Presentation Audience Evaluation due by 6/5(Wed) 11:59pm
166/10No class (Finals Week)
6/12No class (Finals Week) Final Report & Video due by 6/11(Tue) 11:59pm
Audience Evaluation (Final Video) due by 6/13(Thu) 11:59pm