CTP445 Spring 2024
Augmented Reality



The interactive experience with digital context has been evolved in the past few decades from desktop/mobile environment to virtual reality (VR). Whereas VR places a user inside a completely computer-generated environment, AR goes beyond this scope by bridging the gap between the virtual and real world seamlessly. This course will introduce theories and applications related to augmented reality technology. Students will also learn basic skills to develop augmented reality applications and content.
Course Staff
Instructor: Prof. Sang Ho Yoon
      Office Hours: By Appointment

TAs: Youjin Sung
      Hyuckjin Jang
      Min-yung Kim
      Office Hours: By Appointment
Course Info
Time: 10:30am-12:00pm Mon/Wed
Location: N25 #3229
Assignment Submission & Grading: KLMS
Discussion and Q&A: Email to instructors
Announcement
▪ 4/21 Submit Progress Presentation Slides to KLMS due by 4/28(Sun) 11:59pm
▪ 4/21 Progress Presentation on 4/29 & 5/1 will be held in N25 #3229.
▪ 2/26   Class Starts!
▪ 3/25  Proposal Presentation Slides due 3/26 11:59pm (All Teams)
Schedule

      * Blue box indicates activity related lectures (project presentation, toolkit lectures)
Week Date Topic Material Note
1 2/26 Course overview Sign up Form due by 2/29(Thu) 11:59pm
2/28 Introduction to Augmented Reality Ronald T. Azuma, A Survey of Augmented RealityPresence: Teleoperators and Virtual Environments (1997) 6 (4): 355–385.
Paul Milgram et al., Augmented reality: a class of displays on the reality-virtuality continuum Vol. 2351. International Society for Optics and Photonics, 1995.
2 3/4 Team Formation Activity Team Formation Activity Reading Group Announcement
Topic Presentation Team Announcement
Reading Response (RR) due by 3/7(Thu) 11:59pm
3/6 AR Toolkit Introduction ▪ AR Toolkit Introduction (KLMS)
▪ HW#1 & Extra Credit Task Handout (KLMS)
Get started with Unity Tutorial
Extra Credit Task due by 3/11(Mon) 11:59pm
3 3/11 Visual System and Display Pausch et al. "Quantifying immersion in virtual reality." SIGGRAPH, 1997
Chang et al. "Toward the next-generation VR/AR optics: a review of holographic near-eye displays from a human-centric perspective." Optica, 2020
Group AR Project Sign Up due 3/11 11:59pm
RR Group A due by 3/11(Mon) 11:59pm
3/13 Tracking Newman et al. "Ubiquitous tracking for augmented reality" ISMAR 2004
Feiner et al. "Windows on the world: 2D windows for 3D augmented reality" UIST 1993
Huo et al. "SynchronizAR: Instant Synchronization for Spontaneous and Spatial Collaborations in Augmented Reality" UIST 2018
▪ Topic Presentation #1
4 3/18 AR Toolkit #2 HW#2 Handout (KLMS) HW #1 due by 3/18(Mon) 11:59pm
RR Group B due by 3/18(Mon) 11:59pm
3/20 Computer Vision for AR Reitmayr et al. "Simultaneous localization and mapping for augmented reality" 2010
Rublee et al. "Orb-slam2: An open-source slam system for monocular, stereo, and rgb-d cameras" IEEE Trans. Robot, 2017
Ma et al. "Sparse-to-Dense: Depth Prediction from Sparse Depth Samples and a Single Image" ICRA, 2018
▪ Topic Presentation #2
5 3/25 Project Feedback Meetings (Individual Team) Feedback Meeting Schedule Proposal Presentation Slides
due by 3/26(Tue) 11:59pm (All Teams)
3/27 Project Proposal Presentation Presentation Schedule RR Group A due by 3/28(Thu) 11:59pm
HW #2 due by 3/31(Sun) 11:59pm
6 4/1 Calibration and Registration Zhang "A flexible new technique for camera calibration" TPAMI, 2000
Tuceryan et al. "Single-point active alignment method (SPAAM) for optical see-through HMD calibration for augmented reality" Presence: Teleoperators & Virtual Environments, 2002
Plopski et al. "Corneal-Imaging Calibration for Optical See-Through Head-Mounted Displays" TVCG, 2015
▪ Topic Presentation #3
RR Group B due by 4/1(Mon) 11:59pm
4/3 Project Feedback & Discussion
AR Toolkit Q&A
Feedback Meeting Schedule
▪ HW#3 Handout (KLMS)
7 4/8 Visual Coherence Breen et al. "Interactive Occlusion and Automatic Object Placement for Augmented Reality" Computer Graphics Forum, 1996
Kan et al. "High-quality reflections, refractions, and caustics in augmented reality and their contribution to visual coherence" ISMAR, 2012
Fischer et al. "Stylized augmented reality for improved immersion" IEEE VR, 2005
▪ Topic Presentation #4
4/10 No class ▪ HW#3 due by 4/10(Wed) 11:59pm
8 4/15 No class (Midterms Week)
4/17 No class (Midterms Week) RR Group A due by 4/18(Thu) 11:59pm
9 4/22 Situated Visualization HW#4 Handout (KLMS)
White et al. "SiteLens: situated visualization techniques for urban site visits" CHI, 2009
Willet et al. Embedded data representations" TVCG, 2016
Lin et al. "Towards an Understanding of Situated AR Visualization for Basketball Free-Throw Training" CHI, 2021
▪ Topic Presentation #5
RR Group B (Interaction) due by 4/22(Mon) 11:59pm
4/24 Interaction Ishii et al. "Tangible bits: towards seamless interfaces between people, bits and atoms CHI, 1997
Du et al. "DepthLab: Real-time 3D interaction with depth maps for mobile augmented reality" UIST, 2020
Harrison et al. "OmniTouch: wearable multitouch interaction everywhere" UIST, 2011
▪ Topic Presentation #6
10 4/29 Project Progress Presentation Presentation Schedule Progress Presentation Slides due by 4/28(Sun) 11:59pm
5/1 Project Progress Presentation Presentation Schedule
11 5/6 No class Project Feedback Meeting ▪ HW#4 due by 5/5(Sun) 11:59pm
RR Group A (Modeling & Annotation) due by 5/6(Mon) 11:59pm
5/8 Modeling & Annotation Newcombe et al. "Kinectfusion: Real-time dense surface mapping and tracking" ISMAR, 2011
Nuernberger et al. "Interpreting 2d gesture annotations in 3d augmented reality" 3DUI, 2016
▪ Topic Presentation #7
Progress Report due by 5/12(Sun) 11:59pm
12 5/13 User Study(Recorded Video) RR Group B (Authoring) due by 5/16(Thu) 11:59pm
5/15 No Class ▪ CTSCAPE (SymCT) Registration
13 5/20 Authoring Lee et al. "Immersive authoring: What you experience is what you get" Communications of the ACM, 2005
Villanueva et al. "Meta-AR-app: an authoring platform for collaborative augmented reality in STEM classrooms" CHI, 2020
Wang et al. "GesturAR: An Authoring System for Creating Freehand Interactive Augmented Reality Applications" UIST, 2021
▪ Topic Presentation #8
RR Group A (Navigation) due by 5/23(Thu) 11:59pm
5/22 CTScape Participation on 5/31 (Make-up Class) CTScape Registration
14 5/27 Navigation Mulloni et al. "Indoor positioning and navigation with camera phones" IEEE Pervasive Computing, 2009
Sukan et al. "Parafrustum: Visualization techniques for guiding a user to a constrained set of viewing positions and orientations" UIST, 2014
Bae et al. "Computational Rephotography" ACM Transactions on Graphics, 2010
▪ Topic Presentation #9
RR Group B (Collaboration) due by 5/27(Mon) 11:59pm
5/29 Collaboration Lukosch et al. "Collaboration in Augmented Reality" Computer Supported Cooperative Work (CSCW), 2015
Benko et al. "Dyadic Projected Spatial Augmented Reality" UIST, 2014
VILLANUEVA et al. "ColabAR: A Toolkit for Remote Collaboration in Tangible Augmented Reality Laboratories" CSCW, 2022
▪ Topic Presentation #10
15 6/3 Final Presentation Presentation Schedule Final Presentation Slides due by 6/2 11:59pm
6/5 Final Presentation Presentation Schedule Final Presentation Audience Evaluation due by 6/5(Wed) 11:59pm
16 6/10 No class (Finals Week)
6/12 No class (Finals Week) Final Report & Video due by 6/11(Tue) 11:59pm
Audience Evaluation (Final Video) due by 6/13(Thu) 11:59pm