Pen Based Computing Reading List

Computer Science 182-2: Pen-Based Computing (Spring 2008)

Mon/Wed, 1:15-2:30pm, Beckmans B100
Christine's office hours (Olin 1241): Tu 4-5pm, W 3:30-4:30pm and by appointment
alvarado@cs.hmc.edu

Schedule * Syllabus * Reading List * Assignments * Resources

This list is a selection from the major literature in pen-based computing. It does not include all works, and there are more papers here than we will have time to cover in the term. As a class we will determine which papers to read to solve the assigned problems.

Download All Abstracts [PDF]

History

Blackwell, F. W. and Anderson, R. H. 1969. An on-line symbolic mathematics system using hand-printed two-dimensional notation. In Proceedings of the 1969 24th National Conference (August 26 - 28, 1969). ACM, New York, NY, 551-557.
Herot, C. F. 1976. Graphical input through machine recognition of sketches. In Proceedings of the 3rd Annual Conference on Computer Graphics and interactive Techniques (Philadelphia, Pennsylvania, July 14 - 16, 1976). SIGGRAPH '76. ACM, New York, NY, 97-102.
Sutherland, I. E. 1964. Sketch pad a man-machine graphical communication system. In Proceedings of the SHARE Design Automation Workshop DAC '64. ACM, New York, NY, 6.329-6.346.

Stroke smoothing/corner finding/beautification

Abam, M. A., de Berg, M., Hachenberger, P., and Zarei, A. 2007. Streaming algorithms for line simplification. In Proceedings of the Twenty-Third Annual Symposium on Computational Geometry (Gyeongju, South Korea, June 06 - 08, 2007). SCG '07. ACM, New York, NY, 175-183.
Bartolo A., Camilleri K.P., Fabri S. G., Borg J.C., Farrugia P.J (2007), "Scribbles to Vectors: Preparation of Scribble Drawings for CAD Interpretation", in Proceedings of the EUROGRAPHICS Workshop on Sketch-Based Interfaces and Modeling 2007, California, USA.
Wacef Guerfali and Rejean Plamandon. Normalizing and Restoring On-Line Handwriting. In Pattern Recognition. Vol. 26, No. 3, pp. 419-431, 1993.
Helose Hse, Michael Shilman, and A. Richard Newton. Robust Sketched Symbol Fragmentation using Templates. International Conference on Intelligent User Interfaces, Jan. 2004, Madeira, Portugal. pp. 156-160
Takeo Igarashi, Satoshi Matsuoka, Sachiko Kawachiya, Hidehiko Tanaka "Interactive Beautification: A Technique for Rapid Geometric Design", UIST'97 ( ACM Annual Symposium on User Interface Software and Technology) Banff, Canada, 14-17 October, 1997, pp.105-114.
Dae Hyun Kim and Myoung-Jun Kim. A curvature estimation for pen input segmentation in sketch-based modeling. In Computer-Aided Design, Volume 38, Issue 3, March 2006, Pages 238-248.
Pu, J. and Ramani, K (2007), "Implicit Geometric Constraint Detection in Sketches using Relative Shape Histogram", in Proceedings of the EUROGRAPHICS Workshop on Sketch-Based Interfaces and Modeling 2007, California, USA.
Tevfik Metin Sezgin and Randall Davis. Handling Overtraced Strokes in Hand-Drawn Sketches. In Making Pen-Based Interaction Intelligent and Natural . 2004.
Tevfik Metin Sezgin and Randall Davis. Scale-space Based Feature Point Detection for Digital Ink. In Making Pen-Based Interaction Intelligent and Natural . 2004.
Tevfik Metin Sezgin, Thomas Stahovich, and Randall Davis. Sketch Based Interfaces: Early Processing for Sketch Understanding. Workshop on Perceptive User Interfaces, Orlando FL . 2001.
Yu, B. and Cai, S. 2003. A domain-independent system for sketch recognition. In Proceedings of the 1st international Conference on Computer Graphics and interactive Techniques in Australasia and South East Asia (Melbourne, Australia, February 11 - 14, 2003). GRAPHITE '03. ACM, New York, NY, 141-146

Gesture recognition/handwriting recognition/shape recognition

Scott D. Connell and Anil K. Jain, Template-based online character recognition, Pattern RecognitionVolume 34, Issue 1, , January 2001, Pages 1-14.
Hammond, Tracy and Davis, Randall (2004). Automatically Transforming Symbolic Shape Descriptions for Use in Sketch Recognition The Nineteenth National Conference on Artifical Intelligence (AAAI-04), July 2004.
Hse, H.; Newton, A.R., "Sketched symbol recognition using Zernike moments," Pattern Recognition, 2004. ICPR 2004. Proceedings of the 17th International Conference on , vol.1, no., pp. 367-370 Vol.1, 23-26 Aug. 2004
Levent Burak Kara, Thomas F. Stahovich (2005). An Image-Based, Trainable Symbol Recognizer for Hand-drawn Sketches. Computers & Graphics 29(4): 501-517 2005.
LaViola Jr., Joseph J.; Zeleznik, Robert C., "A Practical Approach for Writer-Dependent Symbol Recognition Using a Writer-Independent Symbol Recognizer," Transactions on Pattern Analysis and Machine Intelligence , vol.29, no.11, pp.1917-1926, Nov. 2007
WeeSan Lee, Levent Burak Kara, Thomas F. Stahovich (2006). An Efficient Graph-Based Symbol Recognizer. In Eurographics Workshop on Sketch-Based Interfaces and Modeling 2006.
Long, A. C., Landay, J. A., Rowe, L. A., and Michiels, J. 2000. Visual similarity of pen gestures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (The Hague, The Netherlands, April 01 - 06, 2000). CHI '00. ACM, New York, NY, 360-367.
Erik Miller, Nicholas Matsakis, and Paul Viola. Learning from One Example Through Shared Densities on Transforms. In Proceedings IEEE Conf. on Computer Vision and Pattern Recognition, 2000.
Patel, R., B. Plimmer, J. Grundy, and R. Ihaka. Ink Features for Diagram Recognition, Proccedings of the 2007 Eurographics Workshop on Sketch-based Interfaces and Modeling, August, 2007.
Rubine, D. 1991. Specifying gestures by example. SIGGRAPH Comput. Graph. 25, 4 (Jul. 1991), 329-337.
Dana Sharon and Michiel van de Panne. Constellation Models for Sketch Recognition
EG SBIM 2006: Eurographics Workshop on Sketch Based Interfaces and Modeling
Michael Shilman, Hanna M. Pasula, Stuart Russell, and Richard Newton, Statistical Visual Language Models for Ink Parsing. In Proc. AAAI Spring Symposium on Sketch Understanding, Stanford, March 2002.
Wobbrock, J. O., Wilson, A. D., and Li, Y. 2007. Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes. In Proceedings of the 20th Annual ACM Symposium on User interface Software and Technology (Newport, Rhode Island, USA, October 07 - 10, 2007). UIST '07. ACM, New York, NY, 159-168.

Free-sketch recognition/math recognition/recognition systems

Alvarado, Christine; and Davis, Randall. Dynamically Constructed Bayes Nets for Multi-Domain Sketch Understanding. Proceedings of the International Joint Conference on Artificial Intelligence, 2005.
Alvarado, Christine and Davis, Randall (2001). Resolving ambiguities to create a natural sketch based interface. Proceedings of IJCAI-2001, August 2001.
Bishop, C. M., M. Svensen, and G. E. Hinton (2004). Distinguishing text from graphics in on-line handwritten ink. In F. Kimura and H. Fujisawa (Eds.), Proceedings Ninth International Workshop on Frontiers in Handwriting Recognition, IWFHR-9, Tokyo, Japan, pp. 142–147.
Hammond, Tracy and Davis, Randall (2005). LADDER, a sketching language for user interface developers Elsevier, Computers and Graphics 29 (2005) 518-532,
Leslie Gennari, Levent Burak Kara, Thomas F. Stahovich (2005). Combining Geometry and Domain Knowledge to Interpret Hand-Drawn Diagrams. Computers & Graphics 29(4): 547-562 2005.
Levent Burak Kara, Thomas F. Stahovich (2004). Hierarchical Parsing and Recognition of Hand-Sketched Diagrams. In 17th ACM User Interface Software Technology (UIST) 2004.
LaViola, J. and Zeleznik, R. "MathPad2: A System for the Creation and Exploration of Mathematical Sketches", ACM Transactions on Graphics (Proceedings of SIGGRAPH 2004), 23(3):432-440, August 2004.
Percy Liang, Mukund Narasimhan, Michael Shilman and Paul Viola. Efficient Geometric Algorithms for Parsing in Two Dimensions. In Proceedings of International Conference on Document Analysis and Recognition (ICDAR) 2005.
Michael Oltmans. Envisioning Sketch Recognition: A Local Feature Based Approach to Recognizing Informal Sketches. Ph.D Thesis for Massachusetts Institute of Technology. Cambridge, MA, May 2007.
Stephen Pearce, Maher Ahmed, "An Evolutionary Algorithm for General Symbol Segmentation," icdar, p. 726, Seventh International Conference on Document Analysis and Recognition (ICDAR'03) - Volume 2, 2003
Yuan Qi, Martin Szummer, Thomas P. Minka. Diagram Structure Recognition by Bayesian Conditional Random Fields 2005 Proc Comp. Vision Pattern Recogn. (CVPR) C. Schmid and S. Soatto and C. Tomasi 191--196
Tevfik Metin Sezgin and Randall Davis. Sketch Interpretation Using Multiscale Models of Temporal Patterns.In IEEE Journal of Computer Graphics and Applications,Volume: 27, Issue: 1, pp: 28-37, 2007.
Michael Shilman and Paul Viola. Spatial Recognition and Grouping of Text and Graphics. In Proceedings of Eurographics Workshop on Sketch Based Interfaces and Modeling (SBIM) 2004.
Xin Wang, Michael Shilman, and Sashi Raghupathy. Parsing Ink Annotations on Heterogeneous Documents.
Eurographics Workshop on Sketch-Based Interfaces and Modeling (SBIM) 2006

3D Sketching Interfaces

Takeo Igarashi, Satoshi Matsuoka, Hidehiko Tanaka, "Teddy: A Sketching Interface for 3D Freeform Design" ACM SIGGRAPH'99, Los Angels, 1999, pp.409-416.
Andrew Nealen, Takeo Igarashi, Olga Sorkine and Marc Alexa. FiberMesh: Designing Freeform Surfaces with 3D Curves, ACM SIGGRAPH 2007 conference proceedings. 2007.
Hyunyoung Song, François Guimbretière, Hod Lipson and Chang Hu. Capturing Freehand Annotations and Edits on Physical 3D Models. Proceedings of UIST’06, pp 13 - 22,
Robert C. Zeleznik and Kenneth P. Herndon and John F. Hughes. "SKETCH: An Interface for Sketching 3D Scenes". In Computer Graphics, Proceedings of Siggraph 1996, pp. 163--170, 1996.

Interaction styles/UI design

Alvarado, Christine and Lazzareschi, Michael. Properties of Real World Digital Logic Diagrams. Proceedings of 1st International Workshop on Pen-based Learning Technologies. 2007.
Apitz, Georg. and François Guimbretière. CrossY: A Crossing-Based Drawing Application. Proceedings of UIST'04, pp. 3 – 12.
Richard C. Davis, T. Scott Saponas, Michael Shilman, and James A. Landay. SketchWizard: Wizard of Oz Prototyping of Pen-based User Interfaces. Proceedings of UIST'07. Newport, RI, October 7-10, 2007, pp. 119-128.
Grossman, T., Hinckley, K. Baudisch, P., Agrawala, M., Balakrishnan, R. Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices. In Proceedings of CHI 2006, Montreal, Canada, April 2006, pp. 861-870.
Ken Hinckley, Patrick Baudisch, Gonzalo Ramos and François Guimbretière. Design and Analysis of Delimiters for Selection-Action Pen Gesture Phrases in Scriboli. Proceedings of CHI’05, pp. 453 – 460.
Edward Lank and Eric Saund, "Sloppy Selection: Providing an Accurate Interpretation of Imprecise Stylus Selection Gestures", Computers and Graphic 29:4, August 2005, pp. 490 - 500.
LaViola, J. "An Initial Evaluation of a Pen-Based Tool for Creating Dynamic Mathematical Illustrations", In the proceedings of the Eurographics Workshop on Sketch-Based Interfaces and Modeling 2006, 157-164, September 2006.
Saund, E., Mahoney, J., Fleet, D., Larner, D., and Lank, E.
"Perceptual Organization as a Foundation for Intelligent Sketch Editing,", pp. 118-125
2002 AAAI Spring Symposium on Sketch Understanding
Michael Shilman, Desney Tan, Patrice Simard. CueTIP: A Mixed-Initiative Interface for Correcting Handwriting Errors. In Proceedings of ACM Symposium on User Interface Software and Technology (UIST) 2006
Paul Wais, Aaron Wolin and Christine Alvarado. Designing a Sketch Recognition Front-End: User Perception of Interface Elements. In Proc. of Eurographics Workshop on Sketch-Based Interfaces and Modeling (SBIM). Riverside, CA. 2007.