ETH Zurich :
Computer Science :
Pervasive Computing :
Distributed Systems :
Education :
DS FS2013
Distributed Systems Seminar FS2013
Interaction in Intelligent Environments: Non-Traditional Displays, Sensors, and Interaction Technologies
Tuesdays, 11:15 - 12:45, Room CAB H 52
Otmar Hilliges, Friedemann Mattern
All seminar topics have been assigned. Students who are interested in the seminar but have no topic assigned can still participate but cannot gain credit points for the course.
Topic: Interaction in Intelligent Environments
Recent progress in sensor and wireless communication technologies as well as advancements in distributed and embedded systems have made intelligent environments more of a reality than a distant vision. We see more and more objects that are enhanced with sensing, computing and sometimes also display capabilities. These range from small appliances such as smart TVs, fridges or medical devices to larger, more complex structures such as cars, entire buildings, and transport infrastructure. As smart objects, mobile devices, and network infrastructure are getting integrated more and more seamlessly, a vast amount of information is available to and about users of intelligent environments. Traditional forms of interaction with digital information such as mouse and keyboard are unsuited in this context given the mobile, unstructured and varied nature of everyday interactions of humans in and with these environments. Furthermore, different types of data and hence data representations become important in this setting including 3D graphics and in particular information that is linked to the physical environment.
This seminar will provide an overview on the state of the art and the open research questions around interaction in intelligent environments. Of particular interest are technologies that allow interaction to expand from the screen, keyboard and mouse into our everyday life. Ultimately, all aspects of everyday life (e.g., explicit interactions such as gestures or implicit interactions such as temporal activities or location) can become the media of interaction. New kinds of user interfaces, whereby the user can interact with the computer in various ways (multi-modal interaction), will be discussed.
The first part of the seminar introduces the vision of intelligent environments and discusses specific topics such as pervasive displays and multi-user interactive systems. In the second part we will discuss mobile and projector-based augmented reality systems that directly embed visual information in our everyday environment. In the third part we will discuss technologies, algorithms and systems that enable sensing of human activities in such environments in novel ways. The next and biggest part is on emerging display technologies (such as stereoscopic, volumetric, transparent and flexible displays) that go beyond the flat, 2D desktop display. Topics in this block will also include interactive systems that make use of these emerging display technologies and allow for more direct and natural interaction with virtual information. The final block of topics will cover wearable computing platforms for interaction while the user is on the move.
Goal
The goal of the seminar is not only to familiarize students with exciting new research topics, but also to teach basic scientific writing and oral presentation skills
Organization
The seminar consists of talks given by students on selected topics and discussions led by the instructors. A tentative schedule (still subject to changes) is provided below. A maximum of 10 students will be admitted to the seminar. Priority will be given to Master students who have sufficient background knowledge in the topic but the seminar is generally open to Bachelor and Doctoral students as well.
Seminar attendees select a specific topic within the broader context of current interaction research and prepare an oral presentation. As a starting point, the students are assigned 3-4 important papers in their topic but they have to collect complementary materials and compile them together. Oral presentations must be planned for 45 minutes. Each presentation will be followed by a technical discussion as well as a short feedback session on the quality/style of the presentation.
Each student also has to write a short essay on the selected topic. Essays must be composed using a given template and must be of length 5-8 pages (including figures, tables, and references). The essay is due in 3 weeks after the presentation. The quality of this essay will be evaluated and considered for the final grade. Essays should summarize and elaborate on the assigned topic while presentations should focus on one specific paper among those provided, as indicated by the instructor.
Each student will have a tutor (typically a research assistant of the Distributed Systems Group) assigned with whom they can discuss their papers in detail and receive preliminary feedback on their presentation and their essay.
The seminar will be held in English. Presentations and reports must be in English. Attendees are required to participate in all sessions.
A list of possible reading assigments is provided below.
Templates
Please use the following templates for your presentation and for your report.
Grading
The final grade is based on:
- the quality of the presentation;
- the quality of the essay;
- participation in discussions and feedback sessions after each presentation.
Students who succesfully complete the seminar will be awarded 2 credit points (ECTS).
Contact
For further information please contact Gabor Soros or Marian George.
Schedule
(tentative, to be discussed)
# |
Date |
Topic |
Speaker(s) |
Materials |
Supervisor |
0. |
19.02.2013 |
Administratives Topic assignment |
Friedemann Mattern Gabor Soros |
|
|
1. |
05.03.2013 |
Introduction to the seminar topic How to give a talk |
Otmar Hilliges Friedemann Mattern |
- slides |
|
2. |
12.03.2013 |
1/A) Pervasive Displays |
Reto Achermann |
slides report |
Gabor Soros |
3. |
19.03.2013 |
1/B) Multi-user Systems |
Alexander Grest |
slides report |
Gabor Soros |
4. |
26.03.2013 |
2/A) Handheld Augmented Reality |
Reto Lindegger |
slides report |
Marian George |
|
02.04.2013 |
EASTER HOLIDAYS |
|
|
|
5. |
09.04.2013 |
3/A) Capturing Full Body Motion |
Antoine Kaufmann |
slides report |
Marian George |
6. |
16.04.2013 |
2/B) Projection-based Augmented Reality |
Alexander Cebulla |
slides report |
Otmar Hilliges |
7. |
23.04.2013 |
3/B) Capturing Gestures |
Adrian Kundig |
slides report |
Otmar Hilliges |
8. |
30.04.2013 |
3/C) Touch Technologies |
Sara Kilcher |
slides videos report |
Otmar Hilliges |
9. |
07.05.2013 CANCELED |
4/A) Projection Displays |
Manuel Eichelberger |
- |
Gabor Soros |
10. |
14.05.2013 |
4/B) Interactive 3D Displays |
Shaban Shabani |
slides report |
Otmar Hilliges |
11. |
21.05.2013 |
5/A) Assistive Wearable Technology |
Stephan Koster |
slides report |
Marian George |
12. |
28.05.2013 |
5/B) Head-worn Cameras Closing session with discussion |
Claudio Follmi Otmar Hilliges |
slides report |
Otmar Hilliges |
Reading list
Papers are accessible from the ETH network for free.
1/A) Pervasive displays
- [Davies2012]
Nigel Davies, Marc Langheinrich, Rui Jose, Albrecht Schmidt
Open Display Networks: A Communications Medium for the 21st Century
IEEE Computer, Volume 45, Issue 5, Pages 58-64, 2012.
- [Alt2011]
Florian Alt et al.
Designing Shared Public Display Networks: Implications from Today's Paper-Based Notice Areas
Proceedings of the 9th international conference on Pervasive computing (Pervasive'11), Pages 258-275, San Francisco, CA, USA, 2011.
- [Boring2010]
Sebastian Boring, Dominikus Baur, Andreas Butz, Sean Gustafson, Patrick Baudisch
TouchProjector: Mobile interaction through video
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'10), Pages 2287-2296, Atlanta, GA, USA, 2010.
- [Hardy2010]
Robert Hardy, Enrico Rukzio, Paul Holleis, Matthias Wagner
Mobile interaction with static and dynamic NFC-based displays
Proceedings of the 12th international conference on Human computer interaction with mobile devices and services (MobileHCI'10), Pages 123-132, Lisboa, Portugal, 2010.
- [Pinhanez2001]
Claudio S. Pinhanez
The Everywhere Displays Projector
Proceedings of the International Conference on Ubiquitous Computing (UbiComp'01), Pages 215-331, Atlanta, Georgia, USA, 2001.
- [Soros2011]
Gabor Soros, Peter Rautek, Hartmut Seichter, Eduard Groller
Augmented visualization with natural feature tracking
Proceedings of the 10th ACM Conference on Mobile and Ubiquitous Multimedia (MUM'11), Beijing, China, 2011.
1/B) Multi-user systems
- [Gross2003]
Markus Gross, Stephan Wurmlin, Martin Naef, Edouard Lamboray, Christian Spagno, Andreas Kunz, Esther Koller-Meier, Tomas Svoboda, Luc Van Gool, Silke Lang, Kai Strehlke, Andrew Vande Moere, Oliver Staadt
blue-c: a spatially immersive display and 3D video portal for telepresence
Proceedings of ACM SIGGRAPH'03, Pages 819-827, San Diego, CA, USA, 2003.
- [Roman2010]
Pablo Roman, Maxim Lazarov, Aditi Majumder
A scalable distributed paradigm for multi-user interaction with tiled rear projection display walls
In IEEE Transactions on Visualization and Computer Graphics, Vol.16, No.6, 2010.
- [Kulik2011]
Alexander Kulik, Andre Kunert, Stephan Beck, Roman Reichel, Roland Blach, Armin Zink, Bernd Froehlich
C1x6: a stereoscopic six-user display for co-located collaboration in shared virtual environments
Proceedings of ACM SIGGRAPH Asia '11, Hong Kong, 2011.
- [Karnik2012]
Abhijit Karnik, Walterio Mayol-Cuevas, Sriram Subramanian
MUSTARD: a multi user see through AR display
Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI'12), Pages 2541-2550, Austin, TX, USA, 2012.
- [Favalora2005]
Gregg E. Favalora
Volumetric 3D Displays and Application Infrastructure
IEEE Computer, Vol. 38, No. 8, Pages 37-44, August 2005.
- [Jones2009]
Andrew Jones, Magnus Lang, Graham Fyffe, Xueming Yu, Jay Busch, Ian McDowall, Mark Bolas, Paul Debevec
Achieving Eye Contact in a One-to-Many 3D Video Teleconferencing System
Proceedings of ACM SIGGRAPH'09, Article No. 64, New Orleans, LA, USA, 2009.
- [Izadi2003]
Shahram Izadi, Harry Brignull, Tom Rodden, Yvonne Rogers, Mia Underwood
Dynamo: a public interactive surface supporting the cooperative sharing and exchange of media
Proceedings of the 16th annual ACM symposium on User interface software and technology (UIST'03), Pages 159-168, Vancouver, BC, Canada, 2003.
Other related projects:
2/A) Handheld augmented reality
- [Mulloni2011]
Alessandro Mulloni, Hartmut Seichter, Dieter Schmalstieg
Handheld augmented reality indoor navigation with activity-based instructions
Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI'11), Pages 211-220, Stockholm, Sweden, 2011.
- [White2009]
Sean White, Steven Feinery
SiteLens: situated visualization techniques for urban site visits
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'09), Pages 1117-1120, Boston, USA, 2009.
- [Izadi2011]
Shahram Izadi, Richard A. Newcombe, David Kim, Otmar Hilliges, David Molyneaux, Steve Hodges, Pushmeet Kohli, Jamie Shotton, Andrew J. Davison, Andrew Fitzgibbon
KinectFusion: real-time dynamic 3D surface reconstruction and interaction using a moving depth camera
Proceedings of the 24th annual ACM symposium on User interface software and technology (UIST'11), Pages 559-568, Santa Barbara, CA, USA, 2011.
- [Joshi2012]
Neel Joshi, Abhishek Kar, Michael Cohen
Looking at You: fused gyro and face tracking for viewing large imagery on mobile devices
Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI'12), Pages 2211-2220, Austin, TX, USA, 2012.
2/B) Projection-based augmented reality
- [Bimber2003]
Oliver Bimber, L. Miguel Encarnacao, Dieter Schmalstieg
The virtual showcase as a new platform for augmented reality digital storytelling
Proceedings of the Workshop on Virtual environments (EGVE'03), Pages 87-95, 2003.
- [Raskar2003]
Ramesh Raskar, Jeroen van Baar, Paul Beardsley, Thomas Willwacher, Srinivas Rao, Clifton Forlines
iLamps: geometrically aware and self-configuring projectors
Proceedings of ACM SIGGRAPH (SIGGRAPH'03), Pages 809-818, San Diego, USA, 2003.
- [Molyneaux2012]
David Molyneaux, Shahram Izadi, David Kim, Otmar Hilliges, Steve Hodges, Xiang Cao, Alex Butler, Hans Gellersen
Interactive environment-aware handheld projectors for pervasive computing
Proceedings of the International Conference on Pervasive Computing (Pervasive'12), Pages 197-215 , Newcastle, UK, 2012.
- [Wilson2012]
Andrew Wilson, Hrvoje Benko, Shahram Izadi, Otmar Hilliges
Steerable augmented reality with the beamatron
Proceedings of the Annual ACM Symposium on User Interface Software and Technology (UIST'12), Pages 413-422, Cambridge, MA, USA, 2012.
3/A) Capturing full body motion
- [Cohn2012]
Gabe Cohn, Daniel Morris, Shwetak Patel, Desney Tan
Humantenna: using the body as an antenna for real-time whole-body interaction
Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI'12), Pages 1901-1910, Austin, TX, USA, 2012.
- [Raskar2007]
Ramesh Raskar, Hideaki Nii, Bert de Decker, Yuki Hashimoto, Jay Summet, Dylan Moore, Yong Zhao, Jonathan Westhues, Paul Dietz, John Barnwell, Shree Nayar, Masahiko Inami, Philippe Bekaert, Michael Noland, Vlad Branzoi, Erich Bruns
Prakash: lighting aware motion capture using photosensing markers and multiplexed illuminators
Proceedings of ACM SIGGRAPH'07, San Diego, CA, USA, 2007.
- [Shiratori2011]
Takaaki Shiratori, Hyun Soo Park, Leonid Sigal, Yaser Sheikh, Jessica K. Hodgins
Motion Capture from Body-Mounted Cameras
Proceedings of ACM SIGGRAPH'11, Vancouver, Canada, 2011.
3/B) Capturing gestures
- [Rekimoto2001] Jun Rekimoto
GestureWrist and GesturePad: Unobtrusive Wearable Interaction Devices
Proceedings of the 5th IEEE International Symposium on Wearable Computers (ISWC'01), Page 21, Zurich, Switzerland, 2001.
- [Kim2007] Jungsoo Kim, Jiasheng He, Kent Lyons, Thad Starner
The Gesture Watch: A Wireless Contact-free Gesture based Wrist Interface
Proceedings of the 11th IEEE International Symposium on Wearable Computers (ISWC'07), Pages 1-8, Boston, MA, USA, 2007.
- [Saponas2009] T. Scott Saponas, Desney S. Tan, Dan Morris, Ravin Balakrishnan, Jim Turner, James A. Landay
Enabling always-available input with muscle-computer interfaces
Proceedings of the 22nd Annual ACM symposium on User Interface Software and Technology (UIST'09), Pages 167-176, VICTORIA, BC, CANADA, 2009.
- [Fukui2011] Rui Fukui, Masahiko Watanabe, Tomoaki Gyota, Masamichi Shimosaka, Tomomasa Sato
Hand shape classification with a wrist contour sensor: development of a prototype device
Proceedings of the 13th international conference on Ubiquitous computing (UbiComp'11), Pages 311-314, Beijing, China, 2011.
- [Gupta2012]
Sidhant Gupta, Daniel Morris, Shwetak Patel, Desney Tan
SoundWave: using the doppler effect to sense gestures
Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI'12), Pages 1911-1914, Austin, TX, USA, 2012.
- [Kim2012] David Kim, Otmar Hilliges, Shahram Izadi, Alex D. Butler, Jiawen Chen, Iason Oikonomidis, Patrick Olivier
Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor
Proceedings of the Annual ACM Symposium on User Interface Software and Technology (UIST '12), Pages 167-176, Cambridge, MA, USA, 2012.
3/C) Touch technologies
- [Hachet2011]
Martin Hachet, Benoit Bossavit, Aurelie Cohe, Jean-Baptiste de la Riviere
Toucheo: multitouch and stereo combined in a seamless workspace
Proceedings of the 24th annual ACM Symposium on User Interface Software and Technology (UIST'11), Santa Barbara, CA, USA, 2011.
- [Harrison2011a] Chris Harrison, Hrvoje Benko, Andrew D. Wilson
OmniTouch: wearable multitouch interaction everywhere
Proceedings of the Annual ACM Symposium on User Interface Software and Technology (UIST'11), Pages 441-450, Santa Barbara, CA, USA, 2011.
- [Harrison2011b] Chris Harrison, Desney Tan, Dan Morris
Skinput: appropriating the skin as an interactive canvas
ACM Communications, Volume 54, Issue 8, Pages 111-118, August 2011.
4/A) Projection displays
- [Bimber2005]
Oliver Bimber
Embedded Entertainment with Smart Projectors
IEEE Computer, vol.38, no.1, pp.48-55, 2005
- [Rukzio2012]
Enrico Rukzio, Paul Holleis, Hans Gellersen
Personal Projectors for Pervasive Computing
IEEE Pervasive Computing, Vol. 11, No. 2, Pages 30-37, April 2012
- [Olwal2005]
Alex Olwal, Christoffer Lindfors, Jonny Gustafsson, Torsten Kjellberg, Lars Mattsson
ASTOR: An Autostereoscopic Optical See-through Augmented Reality System
Proceedings of the 4th IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR'05), Pages 24-27, Santa Barbara, CA, USA, 2005.
- [Willis2011]
Karl D.D. Willis, Ivan Poupyrev, Scott E. Hudson, Moshe Mahler
SideBySide: ad-hoc multi-user interaction with handheld projectors
Proceedings of the Annual ACM Symposium on User Interface Software and Technology (UIST'11), Pages 431-440, Santa Barbara, CA, USA, 2011.
- [Cao2006]
Xiang Cao, Ravin Balakrishnan
Interacting with dynamically defined information spaces using a handheld projector and a pen
Proceedings of the Annual ACM Symposium on User Interface Software and Technology (UIST'06), Pages 225-234, Montreux, Switzerland, 2006.
- [Cao2007]
Xiang Cao, Clifton Forlines, Ravin Balakrishnan
Multi-user interaction using handheld projectors
Proceedings of the Annual ACM Symposium on User Interface Software and Technology (UIST'07), Pages 43-52, Newport, RI, USA, 2007.
4/B) Interactive 3D displays
- [Hirsch2009]
Matthew Hirsch, Douglas Lanman, Henry Holtzman, Ramesh Raskar
BiDi screen: a thin, depth-sensing LCD for 3D interaction using light fields
Proceedings of ACM SIGGRAPH Asia '09, Yokohama, Japan, 2009.
- [Wilson2010]
Andrew D. Wilson, Hrvoje Benko
Combining multiple depth cameras and projectors for interactions on, above and between surfaces
Proceedings of the 23nd annual ACM symposium on User interface software and technology (UIST'10), Pages 273-282, New York City, NY, USA, 2010.
- [Butler2011]
Alex Butler, Otmar Hilliges, Shahram Izadi, Steve Hodges, David Molyneaux, David Kim, Danny Kong
Vermeer: direct interaction with a 360° viewable 3D display
Proceedings of the 24th annual ACM Symposium on User Interface Software and Technology (UIST'11), Santa Barbara, CA, USA, 2011.
- [Hilliges2012]
Otmar Hilliges, David Kim, Shahram Izadi, Malte Weiss, Andrew Wilson
HoloDesk: direct 3d interactions with a situated see-through display
Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI'12), Pages 2421-2430, Austin, TX, USA, 2012.
Other related projects:
5/A) Assistive wearable technology
- [Hutterer2005]
Asim Smailagic, Holger Kenn
New Advances in Wearable Computing
IEEE Journal on Pervasive Computing, Pages 96-100, April 2011.
- [Tessendorf2011]
Bernd Tessendorf, Andreas Bulling, Daniel Roggen, Thomas Stiefmeier, Manuela Feilner, Peter Derleth, and Gerhard Troster
Recognition of Hearing Needs from Body and Eye Movements to Improve Hearing Instruments
Proceedings of the 9th international conference on Pervasive computing (Pervasive'11), Pages 314-331, San Francisco, CA, USA, 2011.
- [Stiefmeier2008]
Thomas Stiefmeier, Daniel Roggen, Georg Ogris, Paul Lukowicz, Gerhard Troster
Wearable Activity Tracking in Car Manufacturing
IEEE Journal on Pervasive Computing, Pages 42-50, April 2008.
- [Bulling2009]
Andreas Bulling, Daniel Roggen, Gerhard Troster
Wearable EOG goggles: Seamless sensing and context-awareness in everyday environments
Proceedings of the CHI Conference on Extended Abstracts on Human Factors in Computing Systems (CHI EA'09), Pages 3259-3264, Boston, USA, 2009.
5/B) Head-worn cameras
- [Mann2012] Steve Mann
Through the Glass, lightly
IEEE Technology and Society, Vol. 31, No. 3, Pages 10-14, 2012
- [Mann2004] Steve Mann
Continuous lifelong capture of personal experience with EyeTap
keynote address, ACM International Multimedia Conference, Proceedings of the 1st ACM workshop on Continuous archival and retrieval of personal experiences (CARPE 2004), p.1 - 21, New York, NY, USA, 2004.
- History and technology behind Eyetap, Oculus Rift, Vuzix, Google Glass, Valve's wearable computer
Recommended books and links
- [Bimber2007]
Oliver Bimber, Ramesh Raskar
Spatial augmented reality: merging real and virtual worlds
A.K.Peters/CRC Press, 2005.
- [Majumder2007]
Aditi Majumder, Michael S. Brown
Practical Multi-Projector Display Design
A.K. Peters, 2007.
- [Lepetit2005]
Vincent Lepetit, Pascal Fua
Monocular model-based 3D tracking of rigid objects
Foundations and Trends in Computer Graphics and Vision, Vol.1, No.1, 2005.
- [Krumm2010]
John Krumm
Ubiquitous Computing Fundamentals
CRC Press, 2010.
- [Mann2013]
Steve Mann
Wearable Computing
In: Soegaard, Mads and Dam, Rikke Friis (eds.). "The Encyclopedia of Human-Computer Interaction, 2nd Ed.". Aarhus, Denmark: The Interaction Design Foundation. (online)
- [Howto1]
John Krumm, Patrick Baudisch, Richard Szeliski, Mary Czerwinski
How to give a great research talk
- [Howto2]
Simon Peyton Jones
How to give a great research talk
|