User Interface Design

Harvey Mudd College CS124/CS182 Spring 2010

Welcome

Basic Information

Policies

Schedule

Course Content 

    Reading

    Responses

    Presentations

    Investigations

Course Content: Reading 

Wednesday, Jan 20: Introduction

• Interaction Design, Chapter 1 & Chapter 6

Monday, Jan 25: Norman's Design Principles

• The Design of Everyday Things, Chapter 1 & Chapter 4

Wednesday, Jan 27: Knowing your User

• Interaction Design, Chapter 3.3 (3.2 optional)
• The Design of Everday Things, Chapter 2 & Chapter 3

Monday, Feb 1: Understanding Users' Needs

• Interaction Design, Chapter 7, Chapter 10.1-10.4, 10.6-10.7
• Optional: Moving Out of the Control Room: Ethnography in System Design.  J. Hughes, V. King, T. Rodden, and H. Andersen. Proc. of CSCW '94.
• Optional: Suchman, L. A. 1983. Office procedure as practical action: models of work and system design. ACM Trans. Inf. Syst. 1, 4 (Oct. 1983), 320-328.

Wednesday, Feb 3: Evolutionary Design and Development

• Interaction Design, Chapters 9.1-9.3
• The 1984 Olympic Message System: a test of behavioral principles of system design. Gould, J. D., Boies, S. J., Levy, S., Richards, J. T., and Schoonard, J.. Commun. ACM 30, 9 (Sep. 1987), 758-769, 1987.
• Optional: The Design of Everyday Things, Chapter 6 
  

Monday, Feb 8: Storyboarding

• Interaction Design, Chapter 11

Wednesday, Feb 10: Prototyping

• Prototyping for tiny fingers. Rettig, M.Commun. ACM 37, 4 (Apr. 1994), 21-27, 1994.

Monday, Feb 15 : Evaluation

• Interaction Design, Chapter 12.1-12.3, 14.1-14.2

Wednesday, Feb 17: Paper Prototyping Day (LAST DAY OF CS 182: Basics of UI Design)

None

Monday, Feb 22: Reading an Engineering Research Paper

• How to Read an Engineering Research Paper, by William Griswold, UCSD
• Interactive sketching for the early stages of user interface design. Landay, J. A. and Myers, B. A. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Denver, Colorado, United States, May 07 - 11, 1995).

Wednesday, Feb 24: Speech-based UIs

• Medspeak: report creation with continuous speech recognition.  Lai, J. and Vergo, J. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI-97), 1997.
• Augmenting conversations using dual-purpose speech. Lyons, K., Skeels, C., Starner, T., Snoeck, C. M., Wong, B. A., and Ashbrook, D. In Proceedings of the 17th Annual ACM Symposium on User interface Software and Technology (UIST '04). ACM Press, New York, NY, 237-246. 2004.
• Optional: [Fe04] Using confidence scores to improve hands-free speech based navigation in continuous dictation systems. Feng, J. and Sears, A. ACM Trans. Comput.-Hum. Interact. 11, 4 (Dec. 2004), 329-356
• Optional: Patterns of entry and correction in large vocabulary continuous speech recognition systems Karat, C., Halverson, C., Horn, D., and Karat, J. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: the CHI Is the Limit (CHI-99), 1999.

Monday, Mar 1: Voice-based UIs for people with disabilities

• Löhr, A. and Brügge, B. 2008. Mixed-initiative dialog management for speech-based interaction with graphical user interfaces. In Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy, April 05 - 10, 2008).  
• Harada, S., Landay, J. A., Malkin, J., Li, X., and Bilmes, J. A. 2006. The vocal joystick:: evaluation of voice-based cursor control techniques. In Proceedings of the 8th international ACM SIGACCESS Conference on Computers and Accessibility (Portland, Oregon, USA, October 23 - 25, 2006). Assets '06. ACM, New York, NY, 197-204.

Wednesday, Mar 3: Wizard of Oz Evaluation

• Suede: a Wizard of Oz prototyping tool for speech user interfaces. Klemmer, S. R., Sinha, A. K., Chen, J., Landay, J. A., Aboobaker, N., and Wang, A. In Proceedings of the 13th Annual ACM Symposium on User interface Software and Technology (UIST '00), 2000. 
• Richard C. Davis, T. Scott Saponas, Michael Shilman, and James A. Landay. “SketchWizard: Wizard of Oz Prototyping of Pen-based User Interfaces.” In Proceedings UIST 2007: ACM Symposium on User Interface Software and Technology, Newport, RI, Oct. 2007.
• Optional (but encouraged): Wizard of Oz studies: why and how. Dahlbäck, N., Jönsson, A., and Ahrenberg, L. In Proceedings of the 1st international Conference on intelligent User interfaces (Orlando, Florida, United States, January 04 - 07, 1993), IUI '93, 193-200.

Monday, Mar 8: Intro Pen and Multi-Modal Interfaces

• Zeleznik, R. C., Bragdon, A., Liu, C., and Forsberg, A. 2008. Lineogrammer: creating diagrams by drawing. In Proceedings of the 21st Annual ACM Symposium on User interface Software and Technology (Monterey, CA, USA, October 19 - 22, 2008). UIST '08. ACM, New York, NY, 161-170.
• Newton's Pen - A Pen-based Tutoring System for Statics. WeeSan Lee, Ruwanee de Silva, Eric J. Peterson, Robert C. Calfee, and Thomas F. Stahovich. Computers & Graphics, 32(5):511-524, October 2008. (available on Sakai site under resources)
• Optional (background): LaViola, J. J. 2007. Welcome and introduction. In ACM SIGGRAPH 2007 Courses (San Diego, California, August 05 - 09, 2007). SIGGRAPH '07. ACM Press, New York, NY, 1.

Wednesday, Mar 10: No Class

Monday, Mar 22: Novel Pen-Based Interactions

• Apitz, G. and Guimbretière, F. 2004. CrossY: a crossing-based drawing application. In Proceedings of the 17th Annual ACM Symposium on User interface Software and Technology (Santa Fe, NM, USA, October 24 - 27, 2004). UIST '04. ACM Press, New York, NY, 3-12
• Grossman, T., Hinckley, K., Baudisch, P., Agrawala, M., and Balakrishnan, R. 2006. Hover widgets: using the tracking state to extend the capabilities of pen-operated devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Montréal, Québec, Canada, April 22 - 27, 2006).
• Optional: Hinckley, K., Baudisch, P., Ramos, G., and Guimbretiere, F. 2005. Design and analysis of delimiters for selection-action pen gesture phrases in scriboli. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Portland, Oregon, USA, April 02 - 07, 2005). CHI '05.

Wednesday, Mar 24: Multi-modal interfaces

• Wang, J., Zhai, S., and Su, H. 2001. Chinese input with keyboard and eye-tracking: an anatomical study. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Seattle, Washington, United States). CHI '01. ACM, New York, NY, 349-356. 
• Kazutaka Kurihara, Masataka Goto, Jun Ogata and Takeo Igarashi, "Speech Pen: Predictive Handwriting based on Ambient Multimodal Recognition," Proc. of ACM SIGCHI Conference on Human Factors in Computing Systems(CHI'06), pp.851-860, 2006.
• Optional: Bolt, R. A. 1980. “Put-that-there”: Voice and gesture at the graphics interface. In Proceedings of the 7th Annual Conference on Computer Graphics and interactive Techniques (Seattle, Washington, United States, July 14 - 18, 1980). SIGGRAPH '80. ACM Press, New York, NY, 262-270.

Monday, Mar 29: Intro to Ubicomp

• Mark Weiser, "The Computer for the Twenty-First Century," Scientific American, pp. 94-10, September 1991
• Mark Weiser, "Some Computer Science Problems in Ubiquitous Computing," Communications of the ACM, July 1993. (reprinted as "Ubiquitous Computing". Nikkei Electronics; December 6, 1993; pp. 137-143.)

Wednesday, Mar 31: Ubicomp

• Elrod, S., Bruce, R., Gold, R., Goldberg, D., Halasz, F., Janssen, W., Lee, D., McCall, K., Pedersen, E., Pier, K., Tang, J., and Welch, B. 1992. Liveboard: a large interactive display supporting group meetings, presentations, and remote collaboration. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems.  599-607.
• Abowd, G. D., Atkeson, C. G., Brotherton, J., Enqvist, T., Gulley, P., and LeMon, J. 1998. Investigating the capture, integration and access problem of ubiquitous computing in an educational setting. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Los Angeles, California, United States, April 18 - 23, 1998). 

Monday, Apr 5: Ambient Interfaces 

• Heiner, J. M., Hudson, S. E., and Tanaka, K. 1999. The information percolator: ambient information display in a decorative object. In Proceedings of the 12th Annual ACM Symposium on User interface Software and Technology (Asheville, North Carolina, United States, November 07 - 10, 1999). UIST '99.
• Mynatt, E. D., Rowan, J., Craighill, S., and Jacobs, A. 2001. Digital family portraits: supporting peace of mind for extended family members. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Seattle, Washington, United States). CHI '01.
• Optional: Poupyrev, I., Maruyama, S., and Rekimoto, J. 2002. Ambient touch: designing tactile interfaces for handheld devices. In Proceedings of the 15th Annual ACM Symposium on User interface Software and Technology (Paris, France, October 27 - 30, 2002). UIST '02.

Wednesday, Apr 7: Touch-Based Interfaces

• Moscovich, T. 2009. Contact area interaction with sliding widgets. In Proceedings of the 22nd Annual ACM Symposium on User interface Software and Technology (Victoria, BC, Canada, October 04 - 07, 2009). UIST '09. ACM, New York, NY, 13-22. 
• Wigdor, D., Forlines, C., Baudisch, P., Barnwell, J., and Shen, C. 2007. Lucid touch: a see-through mobile device. In Proceedings of the 20th Annual ACM Symposium on User interface Software and Technology (Newport, Rhode Island, USA, October 07 - 10, 2007). UIST '07.
• Optional: Wigdor, D., Williams, S., Cronin, M., Levy, R., White, K., Mazeev, M., and Benko, H. 2009. Ripples: utilizing per-contact visualizations to improve user interaction with touch displays. In Proceedings of the 22nd Annual ACM Symposium on User interface Software and Technology (Victoria, BC, Canada, October 04 - 07, 2009). UIST '09. ACM, New York, NY, 3-12. 
• Optional: Wang, F., Cao, X., Ren, X., and Irani, P. 2009. Detecting and leveraging finger orientation for interaction with direct-touch surfaces. In Proceedings of the 22nd Annual ACM Symposium on User interface Software and Technology (Victoria, BC, Canada, October 04 - 07, 2009). UIST '09. ACM, New York, NY, 23-32. 
• Related work:
• Manual Decksterity (an interface combining touch and pen)

Monday, Apr 12: Mixed-Reality/Tangible Interfaces

• Sato, T., Mamiya, H., Koike, H., and Fukuchi, K. 2009. PhotoelasticTouch: transparent rubbery tangible interface using an LCD and photoelasticity. In Proceedings of the 22nd Annual ACM Symposium on User interface Software and Technology (Victoria, BC, Canada, October 04 - 07, 2009). UIST '09. ACM, New York, NY, 43-50. 
• Weiss, M., Wagner, J., Jansen, Y., Jennings, R., Khoshabeh, R., Hollan, J. D., and Borchers, J. 2009. SLAP widgets: bridging the gap between virtual and physical controls on tabletops. In Proceedings of the 27th international Conference on Human Factors in Computing Systems (Boston, MA, USA, April 04 - 09, 2009). CHI '09. ACM, New York, NY, 481-490. DOI= http://doi.acm.org.ezproxy.libraries.claremont.edu/10.1145/1518701.1518779
• Optional but Highly Recommended: Hiroshi Ishii and Brygg Ullmer.  Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms.  In Proceedings of CHI 97. 
• Optional: Jun Rekimoto, Brygg Ullmer, and Haro Oba, DataTiles: A Modular Platform for Mixed Physical and Graphical Interactions , CHI 2001
• Related Videos:
• Touch-Display Keyboards
• iCons
• Lumino

Wednesday, Apr 14: Very Large Interfaces

• Forlines, C., Vogel, D., and Balakrishnan, R. 2006. HybridPointing: fluid switching between absolute and relative pointing with a direct input device. In Proceedings of the 19th Annual ACM Symposium on User interface Software and Technology (Montreux, Switzerland, October 15 - 18, 2006). UIST '06. ACM Press, New York, NY, 211-220.
• Kobayashi, M. and Igarashi, T. 2008. Ninja cursors: using multiple cursors to assist target acquisition on large screens. In Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy, April 05 - 10, 2008). CHI '08. ACM, New York, NY, 949-958.  [Come on, with a name like "Ninja Cursors" we couldn't NOT read this paper!]

Monday, Apr 19: Introduction to New Inteface Paradigms

• None

Wednesday, Apr 21: HRI

• Cory D. Kidd, Cynthia Breazeal. 2008. Robots at home: Understanding long-term human-robot interaction. In Proceedings of Intelligent Robots and Systems, 2008.
• Mutlu, B. and Forlizzi, J. 2008. Robots in organizations: the role of workflow, social, and environmental factors in human-robot interaction. In Proceedings of the 3rd ACM/IEEE international Conference on Human Robot interaction (Amsterdam, The Netherlands, March 12 - 15, 2008). HRI '08.
• Optional: Yamazaki, A., Yamazaki, K., Kuno, Y., Burdelski, M., Kawashima, M., and Kuzuoka, H. 2008. Precision timing in human-robot interaction: coordination of head movement and utterance. In Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy, April 05 - 10, 2008). CHI '08.

Monday, Apr 26: Biological Intefaces

• Saponas, T. S., Tan, D. S., Morris, D., Balakrishnan, R., Turner, J., and Landay, J. A. 2009. Enabling always-available input with muscle-computer interfaces. In Proceedings of the 22nd Annual ACM Symposium on User interface Software and Technology (Victoria, BC, Canada, October 04 - 07, 2009). UIST '09. ACM, New York, NY, 167-176. 
• Solovey, E. T., Girouard, A., Chauncey, K., Hirshfield, L. M., Sassaroli, A., Zheng, F., Fantini, S., and Jacob, R. J. 2009. Using fNIRS brain sensing in realistic HCI settings: experiments and guidelines. In Proceedings of the 22nd Annual ACM Symposium on User interface Software and Technology (Victoria, BC, Canada, October 04 - 07, 2009). UIST '09. ACM, New York, NY, 157-166. 

Wednesday, Apr 28: Wrap up
        None

Christine Alvarado (alvarado@cs.hmc.edu)