Non-Traditional User Interfaces

Harvey Mudd College CS124 Fall 2007

Welcome

Basic Information

Policies

Schedule

Course Content 

    Reading

    Responses

    Presentations

    Investigations

Course Content: Reading 

Wednesy, Sept 5: Introduction
Interaction Design, Chapter 1 & Chapter 6

Monday, Sept 10: The Psychopathology of Everyday Things
The Design of Everyday Things, Chapter 1

Wednesday, Sept 12: Who's Going to Use It...
Interaction Design, Chapter 9
The Design of Everday Things, Chapter 2

Monday, Sept 17: ... And what will they do with it?
Interaction Design, Chapters 10.1-10.4, 10.6-10.7, 7.6
[Hu94] Moving Out of the Control Room: Ethnography in System Design.  J. Hughes, V. King, T. Rodden, and H. Andersen. Proc. of CSCW '94.

Wednesday, Sept 19: Where's the Knowledge?
The Design of Everday Things, Chapters 3-4

Monday, Sept 24: Evolutionary Design and Development
The Design of Everday Things, Chapter 6
[Go87] The 1984 Olympic Message System: a test of behavioral principles of system design. Gould, J. D., Boies, S. J., Levy, S., Richards, J. T., and Schoonard, J.. Commun. ACM 30, 9 (Sep. 1987), 758-769, 1987.

Wednesday, Sept 26: Prototyping
Iteraction Design, Chapter 11
[Re94]  Prototyping for tiny fingers. Rettig, M.Commun. ACM 37, 4 (Apr. 1994), 21-27, 1994.

Monday, Oct 1 : Evaluation
Interaction Design, Chapter 12.1-12.3, 14.1-14.2

Wednesday, Oct 3: Paper Prototyping Day
None

Monday, Oct 8: Reading an Engineering Research Paper
[Gris] How to Read an Engineering Research Paper, by William Griswold, UCSD
TBA

Wednesday, Oct 10: Recognition in UIs
[Rh90] Recognition-based user interfaces. Rhyne, J.R., and Wolf, C.G. In Hartson, H.R., and Hix, D. (Eds.), Advances in Human-Computer Interaction Vol. 4, Ablex, Norwood, NJ, 1993, 191-250. 
[Co96] Chapter 1: Spoken Language Input (sections 1.1, 1.2, and 1.8).  Cole, R. and Zue, V. (Eds.).  Survey of the State of the Art in Human Language Technology, 1996. 

Optional: Read the remainder of Ch1: Spoken Language Input

Monday, Oct 15: Speech-based UIs
[La97] Medspeak: report creation with continuous speech recognition.  Lai, J. and Vergo, J. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI-97), 1997.
[Fe04] Using confidence scores to improve hands-free speech based navigation in continuous dictation systems. Feng, J. and Sears, A. ACM Trans. Comput.-Hum. Interact. 11, 4 (Dec. 2004), 329-356

OptionalPatterns of entry and correction in large vocabulary continuous speech recognition systems Karat, C., Halverson, C., Horn, D., and Karat, J. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: the CHI Is the Limit (CHI-99), 1999.

Wednesday, Oct 17: Natural Language UIs
[To05] Towards efficient human machine speech communication: The speech graffiti project. Tomko, S., Harris, T. K., Toth, A., Sanders, J., Rudnicky, A., and Rosenfeld, R. ACM Trans. Speech Lang. Process. 2, 1 (Feb. 2005).
[Li07] Livingston, K. and Riesbeck, C. K. 2007. Knowledge acquisition from simplified text. In Proceedings of the 12th international Conference on intelligent User interfaces (Honolulu, Hawaii, USA, January 28 - 31, 2007). IUI '07. ACM Press, New York, NY, 198-205.

Optional
[Ly04] Augmenting conversations using dual-purpose speech. Lyons, K., Skeels, C., Starner, T., Snoeck, C. M., Wong, B. A., and Ashbrook, D. In Proceedings of the 17th Annual ACM Symposium on User interface Software and Technology (UIST '04). ACM Press, New York, NY, 237-246. 2004.
[Zu00] JUPlTER: a telephone-based conversational interface for weather information, Zue, V.; Seneff, S.; Glass, J.R.; Polifroni, J.; Pao, C.; Hazen, T.J.; Hetherington, L. Speech and Audio Processing, IEEE Transactions on , vol.8, no.1pp.85-96, Jan 2000

Wednesday, Oct 24: Evaluating Speech/NL Interfaces
[Da93] Wizard of Oz studies: why and how. Dahlbäck, N., Jönsson, A., and Ahrenberg, L. In Proceedings of the 1st international Conference on intelligent User interfaces (Orlando, Florida, United States, January 04 - 07, 1993), IUI '93, 193-200.
[Kl00] Suede: a Wizard of Oz prototyping tool for speech user interfaces. Klemmer, S. R., Sinha, A. K., Chen, J., Landay, J. A., Aboobaker, N., and Wang, A. In Proceedings of the 13th Annual ACM Symposium on User interface Software and Technology (UIST '00), 2000. 

Monday, Oct 29: Intro to Agents
Optional: [Br97] Introduction to Software Agents, Jeffrey Bradshaw, in "Software Agents", AAAI Press/The MIT Press, 1997.

Wednesday, Oct 31: Agents we love to hate
[Ch91] Bayesian networks without tears. Charniak, E. AI Magazine, 12(4), Winter 1991, 50-63.  NOTE: This reading is optional if you are already familiar with Bayesian Networks
[Ho97] The Lumiere Project: Bayesian User Modeling for Inferring Goals and Needs of Software Users.  Horowitz, E., Breese, J., Heckerman, D., Hovel, D., Rommelse, K. In Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence, Madison, WI, July 1998, pages 256-265.
[Ng05] An agent-based approach to dialogue management in personal assistants. Nguyen, A. and Wobcke, W. In Proceedings of the 10th international Conference on intelligent User interfaces (San Diego, California, USA, January 10 - 13, 2005). IUI '05. ACM Press, New York, NY, 137-144.

Optional: [Ba97] Lifelike Computer Characters: The Persona Project at Microsoft Research. Gene Ball, Dan Ling, David Kurlander, John Miller, David Pugh, Tim Skelly, Andy Stankosky, David Thiel, Maarten Van Dantzich, Trace Wax. In Software Agents, edited by Jeffrey M. Bradshaw, AAAI Press/The MIT Press, pp. 191-222. 1997.

Monday, Nov 5: HRI
[Br04] Cynthia Breazeal.  2004.  Social interactions in HRI: the robot view.  ACM Transactions on Systems, Man and Cybernetics, Part C: Applications and Reviews. Vol 34, Num 2, May 2004.
[Fo07] Forlizzi, J. 2007. How robotic products become social products: an ethnographic study of cleaning in the home. In Proceeding of the ACM/IEEE international Conference on Human-Robot interaction (Arlington, Virginia, USA, March 10 - 12, 2007). HRI '07. ACM Press, New York, NY, 129-136.

Wednesday, Nov 7: Intro to Ubicomp
[Wei91] Mark Weiser, "The Computer for the Twenty-First Century," Scientific American, pp. 94-10, September 1991
[Wei93] Mark Weiser, "Some Computer Science Problems in Ubiquitous Computing," Communications of the ACM, July 1993. (reprinted as "Ubiquitous Computing". Nikkei Electronics; December 6, 1993; pp. 137-143.)

Monday, Nov 12: Ubicomp
[Elr92] Elrod, S., Bruce, R., Gold, R., Goldberg, D., Halasz, F., Janssen, W., Lee, D., McCall, K., Pedersen, E., Pier, K., Tang, J., and Welch, B. 1992. Liveboard: a large interactive display supporting group meetings, presentations, and remote collaboration. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems.  599-607.
[Abo98] Abowd, G. D., Atkeson, C. G., Brotherton, J., Enqvist, T., Gulley, P., and LeMon, J. 1998. Investigating the capture, integration and access problem of ubiquitous computing in an educational setting. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Los Angeles, California, United States, April 18 - 23, 1998). 

Wednesday, Nov 14: Activity-Based Computing
[Ba07] Jacob Bardram and Henrik Bærbak Christensen:
Pervasive Computing Support for Hospitals: An Overview of the Activity-Based Computing Project  in Pervasive Computing Vol. 6, No. 1 January-March 2007
[Ra07] Rattenbury, T. and Canny, J. "CAAD: An Automatic Task Support System," in Proceedings of SIGCHI. ACM Press, 2007.

Monday, Nov 19: Tangible UIs
[Ish97] Hiroshi Ishii and Brygg Ullmer.  Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms.  In Proceedings of CHI 97
[Rek01] Jun Rekimoto, Brygg Ullmer, and Haro Oba, DataTiles: A Modular Platform for Mixed Physical and Graphical Interactions , CHI 2001

Wednesday, Nov 21: Intro to Pen-based UIs
LaViola, J. J. 2007. Welcome and introduction. In ACM SIGGRAPH 2007 Courses (San Diego, California, August 05 - 09, 2007). SIGGRAPH '07. ACM Press, New York, NY, 1.

Monday, Nov 26: Novel Pen-Based Interactions
[Api04] Apitz, G. and Guimbretière, F. 2004. CrossY: a crossing-based drawing application. In Proceedings of the 17th Annual ACM Symposium on User interface Software and Technology (Santa Fe, NM, USA, October 24 - 27, 2004). UIST '04. ACM Press, New York, NY, 3-12
[For06] Forlines, C., Vogel, D., and Balakrishnan, R. 2006. HybridPointing: fluid switching between absolute and relative pointing with a direct input device. In Proceedings of the 19th Annual ACM Symposium on User interface Software and Technology (Montreux, Switzerland, October 15 - 18, 2006). UIST '06. ACM Press, New York, NY, 211-220.

Optional: [La05] Edward Lank and Eric Saund, "Sloppy Selection: Providing an Accurate Interpretation of Imprecise Stylus Selection Gestures", Computers and Graphic 29:4, August 2005, pp. 490 - 500.

Wednesday, Nov 28: Sketching and Recognition
[LaV04] LaViola, J. and Zeleznik, R. "MathPad2: A System for the Creation and Exploration of Mathematical Sketches", ACM Transactions on Graphics (Proceedings of SIGGRAPH 2004), 23(3):432-440, August 2004.
[Lee07] Newton's Pen - A Pen-based Tutoring System for Statics.
WeeSan, Lee, Ruwanee de Silva, Eric J. Peterson, Robert C. Calfee, and Thomas F. Stahovich.  In Proceedings of the Fourth Eurographics Workshop on Sketch Based Interfaces and Modeling (SBIM07), 2007.  (available on Sakai site under resources)

Optional: 
[Lin00] Lin, J., Newman, M. W., Hong, J. I., and Landay, J. A. 2000. DENIM: finding a tighter fit between tools and practice for Web site design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (The Hague, The Netherlands, April 01 - 06, 2000). CHI '00. ACM Press, New York, NY, 510-517. 

Monday, Dec 3: Evaluating Pen-based UIs
[Da07] Richard C. Davis, T. Scott Saponas, Michael Shilman, and James A. Landay. “SketchWizard: Wizard of Oz Prototyping of Pen-based User Interfaces.” In Proceedings UIST 2007: ACM Symposium on User Interface Software and Technology, Newport, RI, Oct. 2007.
[Wa07] Designing a Sketch Recognition Front-End: User Perception of Interface Elements. Paul Wais, Aaron Wolin and Christine Alvarado. In Proc. of Eurographics Workshop on Sketch-Based Interfaces and Modeling (SBIM). Riverside, CA. 2007.

Wednesday, Dec 5: Multi-modal interfaces I
[Bol80] Bolt, R. A. 1980. “Put-that-there”: Voice and gesture at the graphics interface. In Proceedings of the 7th Annual Conference on Computer Graphics and interactive Techniques (Seattle, Washington, United States, July 14 - 18, 1980). SIGGRAPH '80. ACM Press, New York, NY, 262-270.
[Ovi00] Oviatt, S.L. & Cohen, P.R.. "Multimodal Interfaces That Process What Comes Naturally" Communications of the ACM, Vol. 43, No. 3, March, 2000, pp. 45-53.

Monday, Dec 10: Multi-modal interfaces II
[Mor04] Morency, L. and Darrell, T. 2004. From conversational tooltips to grounded discourse: head pose Tracking in interactive dialog systems. In Proceedings of the 6th international Conference on Multimodal interfaces (State College, PA, USA, October 13 - 15, 2004). ICMI '04. ACM Press, New York, NY, 32-37.
[Kaz06] Kazutaka Kurihara, Masataka Goto, Jun Ogata and Takeo Igarashi, "Speech Pen: Predictive Handwriting based on Ambient Multimodal Recognition," Proc. of ACM SIGCHI Conference on Human Factors in Computing Systems(CHI'06), pp.851-860, 2006.

Wednesday, Dec 12: Wrap up
None