Non-Traditional User Interfaces

Harvey Mudd College CS182-1 Spring 2006

Welcome

Basic Information

Policies

Schedule

Course Content 

    Reading

    Responses

    Presentations

    Investigations

Course Content: Reading

This list will be expanded as the semester progresses.
(RR) indicates reading response required.

Tuesday, Jan 17
Interaction Design, Chapter 1

Thursday, Jan 19
The Design (Psychology) of Everyday Things, Chapter 1

Tuesday, Jan 24
Interaction Design, Chapter 6
The Design (Psychology) of Everday Things, Chapter 2

Thursday, Jan 26
Interaction Design, Chapters 7.1-7.3, 7.6-7.7, 9.4
[Hu94] Moving Out of the Control Room: Ethnography in System Design.  J. Hughes, V. King, T. Rodden, and H. Andersen. Proc. of CSCW '94.

Tuesday, Jan 31
The Design (Philosophy) of Everday Things, Chapters 3-4

Thursday, Feb 2
The Design (Philosophy) of Everday Things, Chapter 6
[Go87] The 1984 Olympic Message System: a test of behavioral principles of system design. Gould, J. D., Boies, S. J., Levy, S., Richards, J. T., and Schoonard, J.. Commun. ACM 30, 9 (Sep. 1987), 758-769, 1987.

Tuesday, Feb 7
Iteraction Design, Chapter 8.1-8.2
[Re94]  Prototyping for tiny fingers. Rettig, M.Commun. ACM 37, 4 (Apr. 1994), 21-27, 1994.

Thursday, Feb 9
Interaction Design, Chapter 14.5
[Ca80]  The keystroke-level model for user performance time with interactive systems. Card, S. K., Moran, T. P., and Newell, A. Commun. ACM 23, 7 (Jul. 1980), 396-410, 1980.

Tuesday, Feb 14
None

Thursday, Feb 16
[Gris] How to Read an Engineering Research Paper, by William Griswold, UCSD
[Dra04] Combining crossing-based and paper-based interaction paradigms for dragging and dropping between overlapping windows.  P. Dragicevic, In Proceedings of the 17th Annual ACM Symposium on User interface Software and Technology (Santa Fe, NM, USA, October 24 - 27, 2004). UIST '04.

Tuesday, Feb 21
[Rh90] Recognition-based user interfaces. Rhyne, J.R., and Wolf, C.G. In Hartson, H.R., and Hix, D. (Eds.), Advances in Human-Computer Interaction Vol. 4, Ablex, Norwood, NJ, 1993, 191-250. 
[Co96] Chapter 1: Spoken Language Input (sections 1.1, 1.2, and 1.8).  Cole, R. and Zue, V. (Eds.).  Survey of the State of the Art in Human Language Technology, 1996. 

Optional: Read the remainder of Ch1: Spoken Language Input

Thursday, Feb 23
 [La97] Medspeak: report creation with continuous speech recognition.  Lai, J. and Vergo, J. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI-97), 1997.
[Se03] Hands-Free, Speech-Based Navigation During Dictation: Difficulties, Consequences, and Solutions, Sears, A., Feng, J., Oseitutu, K., Karat, C-M. In Human Computer Interaction, 18, 2003.

OptionalPatterns of entry and correction in large vocabulary continuous speech recognition systems Karat, C., Halverson, C., Horn, D., and Karat, J. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: the CHI Is the Limit (CHI-99), 1999.

Tuesday, Feb 28
[Zu00] JUPlTER: a telephone-based conversational interface for weather information, Zue, V.; Seneff, S.; Glass, J.R.; Polifroni, J.; Pao, C.; Hazen, T.J.; Hetherington, L. Speech and Audio Processing, IEEE Transactions on , vol.8, no.1pp.85-96, Jan 2000
[Ly04] Augmenting conversations using dual-purpose speech. Lyons, K., Skeels, C., Starner, T., Snoeck, C. M., Wong, B. A., and Ashbrook, D. In Proceedings of the 17th Annual ACM Symposium on User interface Software and Technology (UIST '04). ACM Press, New York, NY, 237-246. 2004.

OptionalTowards efficient human machine speech communication: The speech graffiti project. Tomko, S., Harris, T. K., Toth, A., Sanders, J., Rudnicky, A., and Rosenfeld, R. ACM Trans. Speech Lang. Process. 2, 1 (Feb. 2005).

Thursday, Mar 2
[Da93] Wizard of Oz studies: why and how. Dahlbäck, N., Jönsson, A., and Ahrenberg, L. In Proceedings of the 1st international Conference on intelligent User interfaces (Orlando, Florida, United States, January 04 - 07, 1993), IUI '93, 193-200.
[Kl00] Suede: a Wizard of Oz prototyping tool for speech user interfaces. Klemmer, S. R., Sinha, A. K., Chen, J., Landay, J. A., Aboobaker, N., and Wang, A. In Proceedings of the 13th Annual ACM Symposium on User interface Software and Technology (UIST '00), 2000. 

Tuesday, Mar 7
Optional: [Br97] Introduction to Software Agents, Jeffrey Bradshaw, in "Software Agents" ,AAAI Press/The MIT Press, 1997.

Thursday, Mar 9
[Ch91] Bayesian networks without tears. Charniak, E. AI Magazine, 12(4), Winter 1991, 50-63.  NOTE: This reading is optional if you are already familiar with Bayesian Networks
[Ho97] The Lumiere Project: Bayesian User Modeling for Inferring Goals and Needs of Software Users.  Horowitz, E., Breese, J., Heckerman, D., Hovel, D., Rommelse, K. In Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence, Madison, WI, July 1998, pages 256-265.
[Ba97] Lifelike Computer Characters: The Persona Project at Microsoft Research. Gene Ball, Dan Ling, David Kurlander, John Miller, David Pugh, Tim Skelly, Andy Stankosky, David Thiel, Maarten Van Dantzich, Trace Wax. In Software Agents, edited by Jeffrey M. Bradshaw, AAAI Press/The MIT Press, pp. 191-222. 1997.

Tuesday, Mar 21
[Shn97]   Shneiderman, B. and Maes, P. 1997.  Direct manipulation vs. interface agents. interactions 4, 6 (Nov. 1997), 42-61.
[Hor99] Horvitz, E. 1999. Principles of mixed-initiative user interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: the CHI Is the Limit (Pittsburgh, Pennsylvania, United States, May 15 - 20, 1999). CHI '99. ACM Press, New York, NY, 159-166.

Thursday, Mar 23
[Wei91] Mark Weiser, "The Computer for the Twenty-First Century," Scientific American, pp. 94-10, September 1991
[Wei93] Mark Weiser, "Some Computer Science Problems in Ubiquitous Computing," Communications of the ACM, July 1993. (reprinted as "Ubiquitous Computing". Nikkei Electronics; December 6, 1993; pp. 137-143.)

Tuesday, Mar 28
[Elr92] Elrod, S., Bruce, R., Gold, R., Goldberg, D., Halasz, F., Janssen, W., Lee, D., McCall, K., Pedersen, E., Pier, K., Tang, J., and Welch, B. 1992. Liveboard: a large interactive display supporting group meetings, presentations, and remote collaboration. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems.  599-607.
[Abo98] Abowd, G. D., Atkeson, C. G., Brotherton, J., Enqvist, T., Gulley, P., and LeMon, J. 1998. Investigating the capture, integration and access problem of ubiquitous computing in an educational setting. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Los Angeles, California, United States, April 18 - 23, 1998). 

Thursday, Mar 30
[Sal99] Salber, D., Dey, A. K., and Abowd, G. D. 1999. The context toolkit: aiding the development of context-enabled applications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: the CHI Is the Limit (Pittsburgh, Pennsylvania, United States, May 15 - 20, 1999). CHI '99. ACM Press, New York, NY, 434-441.
[Koi03] Kimberle Koile, Konrad Tollmar, David Demirdjian, Howard Shrobe, and Trevor Darrell. Activity Zones for Context-Aware Computing. In Ubicomp 2003 Proceedings (forthcoming). 2003.

Tuesday, Apr 4
[Ish97] Hiroshi Ishii and Brygg Ullmer.  Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms.  In Proceedings of CHI 97
[Rek01] Jun Rekimoto, Brygg Ullmer, and Haro Oba, DataTiles: A Modular Platform for Mixed Physical and Graphical Interactions , CHI 2001

Thursday, Apr 6
[Rho97] Bradley Rhodes.  The Wearable Rememberance Agent: A System for Augmented Memory. in Personal Technologies Journal Special Issue on Wearable Computing , Personal Technologies (1997) 1:218-224.
[Mar03] D. Marculescu, R. Marculescu, N.H. Zamora, P. Stanley-Marbell, P.K. Khosla, S. Park, S. Jayaraman, S. Jung, C. Lauterbach, W. Weber, T. Kirstein, D. Cottet, J. Grzyb, G. Troester, "Electronic Textiles: A Platform for Pervasive Computing," in Proceedings of IEEE, vol.91, No.12, Dec. 2003.

Tuesday, Apr 11
Marti Hearst.  Sketching Intelligent Systems.  In IEEE Intelligent Systems and their Applications, 13(3), 1998, 10-19.

Thursday, Apr 13
[Sau03] Saund, E., Fleet, D., Larner, D., and Mahoney, J. 2003. Perceptually-supported image editing of text and graphics. In Proceedings of the 16th Annual ACM Symposium on User interface Software and Technology (Vancouver, Canada, November 02 - 05, 2003). UIST '03. ACM Press, New York, NY, 183-192.
[Api04] Apitz, G. and Guimbretière, F. 2004. CrossY: a crossing-based drawing application. In Proceedings of the 17th Annual ACM Symposium on User interface Software and Technology (Santa Fe, NM, USA, October 24 - 27, 2004). UIST '04. ACM Press, New York, NY, 3-12

Tuesday, Apr 18
[Lin00] Lin, J., Newman, M. W., Hong, J. I., and Landay, J. A. 2000. DENIM: finding a tighter fit between tools and practice for Web site design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (The Hague, The Netherlands, April 01 - 06, 2000). CHI '00. ACM Press, New York, NY, 510-517. 
[Alv04] Alvarado, C. and Davis, R. 2004. SketchREAD: a multi-domain sketch recognition engine. In Proceedings of the 17th Annual ACM Symposium on User interface Software and Technology (Santa Fe, NM, USA, October 24 - 27, 2004). UIST '04. ACM Press, New York, NY, 23-32.

Optional:
[New03] Mark W. Newman, James Lin, Jason I. Hong, and James A. Landay. DENIM: An Informal Web Site Design Tool Inspired by Observations of PracticeHuman Computer Interaction 18(3). 2003. 

Thursday, Apr 20
[Bol80] Bolt, R. A. 1980. “Put-that-there”: Voice and gesture at the graphics interface. In Proceedings of the 7th Annual Conference on Computer Graphics and interactive Techniques (Seattle, Washington, United States, July 14 - 18, 1980). SIGGRAPH '80. ACM Press, New York, NY, 262-270.
[Ovi00] Oviatt, S.L. & Cohen, P.R.. "Multimodal Interfaces That Process What Comes Naturally" Communications of the ACM, Vol. 43, No. 3, March, 2000, pp. 45-53.

Tuesday, Apr 25
[Mor04] Morency, L. and Darrell, T. 2004. From conversational tooltips to grounded discourse: head poseTracking in interactive dialog systems. In Proceedings of the 6th international Conference on Multimodal interfaces (State College, PA, USA, October 13 - 15, 2004). ICMI '04. ACM Press, New York, NY, 32-37.
[Bar05] Barthelmess, P., Kaiser, E., Huang, X., and Demirdjian, D. 2005. Distributed pointing for multimodal collaboration over sketched diagrams. In Proceedings of the 7th international Conference on Multimodal interfaces (Torento, Italy, October 04 - 06, 2005). ICMI '05. ACM Press, New York, NY, 10-17.

Thursday, Apr 27
None