Crystal Lee (she/她)

Readings in human-computer interaction & data visualization

Published on

Huge thanks to Arvind Satyanarayan for putting together this incredibly fun and exciting list with me.

Human-Computer Interaction

Historical foundations

Bush, Vannevar. 1945. “As We May Think.” The Atlantic Monthly, July 1945.

Engelbart, Douglas C. 1962. “Augmenting Human Intellect: A Conceptual Framework.” Summary Report AFOSR-3223. SRI Project Number 3578. Washington, D.C.: Director of Information Sciences, Air Force Office of Scientific Research.

Engelbart, Douglas C. 1968. “The Mother of All Demos.” presented at the ACM/IEEE Fall Joint Computer Conference, San Francisco, CA, December 9. http://www.dougengelbart.org/content/view/374/464/.

Horvitz, Eric, Jack Breese, David Heckerman, David Hovel, and Koos Rommelse. 1998. “The Lumière Project: Bayesian User Modeling for Inferring the Goals and Needs of Software Users.” In Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence, 256–265. UAI’98. San Francisco, CA, USA: Morgan Kaufmann Publishers Inc. http://dl.acm.org/citation.cfm?id=2074094.2074124.

Hutchins, Edwin L, James D Hollan, and Donald A Norman. 1985. “Direct Manipulation Interfaces.” Human-Computer Interaction 1: 311–338.

Kay, Alan C. 1972. “A Personal Computer for Children of All Ages.” In Proceedings of the ACM Annual Conference - Volume 1. ACM ’72. New York, NY, USA: ACM. https://doi.org/10.1145/800193.1971922.

Licklider, J.C.R. 1960. “Man-Computer Symbiosis.” IEEE Transactions on Human Factors in Electronics, March, 4–11.

Mackenzie, I. Scott. 1992. “Fitt’s Law as Research and Design Tool in Human-Computer Interaction.” Human-Computer Interaction 7: 91–139.

Norman, Donald A. 1983. “Design Principles for Human-Computer Interfaces.” In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 1–10. CHI ’83. New York, NY, USA: ACM. https://doi.org/10.1145/800045.801571.

Input

Buxton, Bill. 2007. “Multi-Touch Systems That I Have Known and Loved.” Bill Buxton. January 12, 2007. http://www.billbuxton.com/multitouchOverview.html.

Card, Stuart K., and Thomas P. Moran. 1986. “User Technology: From Pointing to Pondering.” In ACM Conference on the History of Personal Workstations, 183–98.

Hinckley, Ken, Koji Yatani, Michel Pahud, Nicole Coddington, Jenny Rodenhouse, Andy Wilson, Hrvoje Benko, and Bill Buxton. 2010. “Pen + Touch = New Tools.” In Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology - UIST ’10, 27. New York, NY: ACM Press. https://doi.org/10.1145/1866029.1866036.

Models

Card, Stuart K., Jock D. Mackinlay, and George G. Robertson. 1991. “A Morphological Analysis of the Design Space of Input Devices.” ACM Transactions on Information Systems 9 (2): 99–122. https://doi.org/10.1145/123078.128726.

Pirolli, Peter. 2003. “Exploring and Finding Information.” In HCI Models, Theories, and Frameworks: Toward a Multidisciplinary Science, edited by John M. Carroll. Amsterdam; Boston: Morgan Kaufmann.

Research

Simon, Herbert A. 1988. “The Science of Design: Creating the Artificial.” Design Issues 4 (1/2): 67. https://doi.org/10.2307/1511391.

Stokes, Donald E. 1997. “Transforming the Paradigm.” In Pasteur’s Quadrant: Basic Science and Technological Innovation, 58–89. Washington, D.C.: Brookings Institution Press.

Ubiquitous computing

Klemmer, Scott R., Björn Hartmann, and Leila Takayama. 2006. “How Bodies Matter: Five Themes for Interaction Design.” In Proceedings of the 6th ACM Conference on Designing Interactive Systems - DIS ’06, 140. University Park, PA, USA: ACM Press. https://doi.org/10.1145/1142405.1142429.

Weiser, Mark. 1999. “The Computer for the 21st Century.” SIGMOBILE Mobile Computing and Communications Review 3 (3): 3–11. https://doi.org/10.1145/329124.329126.

Interfaces

Hill, William C., James D. Hollan, Dave Wroblewski, and Tim McCandless. 1992. “Edit Wear and Read Wear.” In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 3–9. CHI ’92. New York, NY: ACM. https://doi.org/10.1145/142750.142751.

Horvitz, Eric. 1999. “Principles of Mixed-Initiative User Interfaces.” In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems the CHI Is the Limit - CHI ’99, 159–66. Pittsburgh, Pennsylvania, United States: ACM Press. https://doi.org/10.1145/302979.303030.

Myers, Brad, Scott E Hudson, and Randy Pausch. 2000. “Past, Present and Future of User Interface Software Tools.” ACM Transactions on Computer-Human Interaction, March, 3–28.

Patel, Neil, Deepti Chittamuru, Anupam Jain, Paresh Dave, and Tapan S. Parikh. 2010. “Avaaj Otalo — A Field Study of an Interactive Voice Forum for Small Farmers in Rural India.” In Proceedings of the Conference on Human Factors in Computing Systems – CHI 2010. Atlanta, GA.

Interaction

Amershi, Saleema, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, Eric Horvitz, Dan Weld, Mihaela Vorvoreanu, et al. 2019. “Guidelines for Human-AI Interaction.” In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI ’19, 1–13. Glasgow, Scotland Uk: ACM Press. https://doi.org/10.1145/3290605.3300233.

Beaudouin-Lafon, Michel. 2000. “Instrumental Interaction: An Interaction Model for Designing Post-WIMP User Interfaces.” In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 446–453. CHI ’00. New York, NY, USA: ACM. https://doi.org/10.1145/332040.332473.

Sutherland, Ivan Edward. 1963. “Sketchpad: A Man-Machine Graphical Communication System.” Doctoral Thesis, Cambridge, MA: Massachusetts Institute of Technology.

Gesture

Wigdor, Daniel, and Dennis Wixon. 2011. “Touch versus In-Air Gestures.” In Brave NUI World: Designing Natural User Interfaces for Touch and Gesture, 97–103. Amsterdam: Morgan Kaufmann Publishers.

Wobbrock, Jacob O., Meredith Ringel Morris, and Andrew D. Wilson. 2009. “User-Defined Gestures for Surface Computing.” In Proceedings of the 27th International Conference on Human Factors in Computing Systems - CHI 09, 1083. Boston, MA, USA: ACM Press. https://doi.org/10.1145/1518701.1518866.

Krzysztof Z. Gajos, Jacob O. Wobbrock, and Daniel S. Weld, “Improving the Performance of Motor-Impaired Users with Automatically-Generated, Ability-Based Interfaces,” in Proceedings of the Twenty-Sixth Annual Chi Conference on Human Factors in Computing Systems - CHI ’08 (Proceedings of the twenty-sixth annual CHI conference, ACM Press, 2008), 1257, https://doi.org/10.1145/1357054.1357250.

Design and prototyping

Dow, Steven P., Alana Glassco, Jonathan Kass, Melissa Schwarz, Daniel L. Schwartz, and Scott R. Klemmer. 2010. “Parallel Prototyping Leads to Better Design Results, More Divergence, and Increased Self-Efficacy.” ACM Transactions on Computer-Human Interaction 17 (4): 1–24. https://doi.org/10.1145/1879831.1879836.

Fallman, Daniel. 2003. “Design-Oriented Human-Computer Interaction.” In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 225–232. CHI ’03. New York, NY, USA: ACM. https://doi.org/10.1145/642611.642652.

Houde, Stephanie, and Charles Hill. 1997. “What Do Prototypes Prototype?” In Handbook of Human-Computer Interaction, edited by Martin G. Helander, Thomas K. Landauer, and Prasad V. Prabhu, 2nd edition, 367–82. Amsterdam, Netherlands: Elsevier.

Kraut, Robert E., and Paul Resnick. 2012. “Evidence-Based Social Design: Introduction.” In Evidence-Based Social Design: Mining the Social Sciences to Build Online Communities. Cambridge, MA: MIT Press. https://doi.org/10.7551/mitpress/8472.001.0001.

Kumar, Ranjitha, Jerry O. Talton, Salman Ahmad, and Scott R. Klemmer. 2012. “Data-Driven Web Design.” In Proceedings of the 29 Th International Conference on Machine Learning, 2. Edinburgh, Scotland.

Tohidi, Maryam, William Buxton, Ronald Baecker, and Abigail Sellen. 2006. “Getting the Right Design and the Design Right.” In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 1243–1252. CHI ’06. New York, NY, USA: ACM. https://doi.org/10.1145/1124772.1124960.

User experiments

Dourish, Paul. 2006. “Implications for Design.” In CHI Conference on Human Factors in Computing Systems, 541–50. Montreal, Canada.

Friedman, Batya, Peter H. Kahn, and Alan Borning. 2006. “Value Sensitive Design and Information Systems.” In Human-Computer Interaction and Management Information Systems: Foundations, edited by Ping Zhang and Dennis F. Galletta, 27. Advances in Management. New York, NY: Routledge.

Hutchinson, Hilary, Wendy Mackay, Bo Westerlund, Benjamin B. Bederson, Allison Druin, Catherine Plaisant, Michel Beaudouin-Lafon, et al. 2003. “Technology Probes: Inspiring Design for and with Families.” In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 17–24. CHI ’03. New York, NY, USA: ACM. https://doi.org/10.1145/642611.642616.

Sedlmair, Michael, Miriah Meyer, and Tamara Munzner. 2012. “Design Study Methodology: Reflections from the Trenches and the Stacks.” IEEE Transactions on Visualization and Computer Graphics 18 (12): 2431–40. https://doi.org/10.1109/TVCG.2012.213.

User experience

Hollan, Jim, and Scott Stornetta. 1992. “Beyond Being There.” In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 119–125. CHI ’92. New York, NY, USA: ACM. https://doi.org/10.1145/142750.142769.

Kirsh, David, and Paul Maglio. 1994. “On Distinguishing Epistemic from Pragmatic Action.” Cognitive Science 18 (4): 513–49. https://doi.org/10.1207/s15516709cog1804_1.

Ophir, Eyal, Clifford Nass, and Anthony D. Wagner. 2009. “Cognitive Control in Media Multitaskers.” Proceedings of the National Academy of Sciences 106 (37): 15583–87. https://doi.org/10.1073/pnas.0903620106.

Methods

McGrath, Joseph E. 1995. “Methodology Matters: Doing Research in the Behavioral and Social Sciences.” In Readings in Human-Computer Interaction: Toward the Year 2000, edited by Ronald M. Baecker, Jonathan Grudin, Bill Buxton, and Saul Greenberg, 2nd edition, 152–69. San Francisco, CA: Morgan Kaufmann. https://doi.org/10.1016/B978-0-08-051574-8.50019-4.

Kahneman, Daniel, Alan B. Krueger, David A. Schkade, Norbert Schwarz, and Arthur A. Stone. 2004. “A Survey Method for Characterizing Daily Life Experience: The Day Reconstruction Method.” Science 306 (5702): 1776–80. https://doi.org/10.1126/science.1103572.

Evaluation

Olson, Judith S., and Wendy Kellogg, eds. 2014. Ways of Knowing in HCI. New York: Springer. Selected chapters: Dourish, "Reading and Interpreting Ethnography,” Hayes, "Knowing by Doing: Action Research as an Approach to HCI,” Hudson, "Concepts, Values, and Methods for Technical Human-Computer Interaction Research."

Searching and sorting

Brandt, Joel, Mira Dontcheva, Marcos Weskamp, and Scott R. Klemmer. 2010. “Example-Centric Programming: Integrating Web Search into the Development Environment.” In Proceedings of the 28th International Conference on Human Factors in Computing Systems - CHI ’10, 513. Atlanta, Georgia, USA: ACM Press. https://doi.org/10.1145/1753326.1753402.

Hearst, Marti. 2009a. “Chapter 10: Information Visualization for Search Interfaces.” In Search User Interfaces. Cambridge, UK: Cambridge University Press. http://searchuserinterfaces.com/book/sui_ch10_visualization.html.

———. 2009b. “Chapter 11: Information Visualization for Text Analysis.” In Search User Interfaces. Cambridge, UK: Cambridge University Press.

Kery, M. Beth, and B. A. Myers. “Exploring Exploratory Programming.” In 2017 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), 25–29, 2017. https://doi.org/10.1109/VLHCC.2017.8103446.

Rule, Adam, Aurélien Tabard, and James D. Hollan. “Exploration and Explanation in Computational Notebooks.” In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 32:1–32:12. CHI ’18. New York, NY, USA: ACM, 2018. https://doi.org/10.1145/3173574.3173606.

Crowdsourcing

Alkhatib, Ali and Michael Bernstein, “Street-Level Algorithms: A Theory at the Gaps Between Policy and Decisions,” in Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI ’19 (the 2019 CHI Conference, ACM Press, 2019), 1–13.

Bernstein, Michael S., Greg Little, Robert C. Miller, Björn Hartmann, Mark S. Ackerman, David R. Karger, David Crowell, and Katrina Panovich. 2010. “Soylent: A Word Processor with a Crowd Inside.” In Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology, 313–322. New York, NY: ACM.

Kittur, Aniket, and Robert E. Kraut. 2008. “Harnessing the Wisdom of Crowds in Wikipedia: Quality Through Coordination.” In Proceedings of the 2008 ACM Conference on Computer Supported Cooperative Work, 37–46. CSCW ’08. New York, NY, USA: ACM. https://doi.org/10.1145/1460563.1460572.

Retelny, Daniela, Sébastien Robaszkiewicz, Alexandra To, Walter S. Lasecki, Jay Patel, Negar Rahmati, Tulsee Doshi, Melissa Valentine, and Michael S. Bernstein. 2014. “Expert Crowdsourcing with Flash Teams.” In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology - UIST ’14, 75–85. Honolulu, Hawaii, USA: ACM Press. https://doi.org/10.1145/2642918.2647409.

Data Visualization

Data and image models

Mackinlay, Jock. 1986. “Automating the Design of Graphical Presentations of Relational Information.” ACM Transactions on Graphics 5 (2): 110–41. https://doi.org/10.1145/22949.22950.

Nielsen, Michael. 2014. “Reinventing Explanation.” Michael Nielsen. January 2014. http://michaelnielsen.org/reinventing_explanation/.

Sarikaya, Alper, and Michael Gleicher. 2018. “Scatterplots: Tasks, Data, and Designs.” IEEE Transactions on Visualization and Computer Graphics 24 (1): 402–12. https://doi.org/10.1109/TVCG.2017.2744184.

Exploratory data analysis

Bertin, Jacques. 1981. “Postmortem of An Example.” In Graphics and Graphic Information-Processing, translated by William J. Berg and Paul Scott, Reprint 2011. Berlin, Germany: De Gruyter. https://doi.org/10.1515/9783110854688.

Kandel, Sean, Andreas Paepcke, Joseph M. Hellerstein, and Jeffrey Heer. “Enterprise Data Analysis and Visualization: An Interview Study.” IEEE Transactions on Visualization and Computer Graphics 18, no. 12 (December 2012): 2917–26. https://doi.org/10.1109/TVCG.2012.219.

Stolte, Chris, Diane Tang, and Pat Hanrahan. 2003. “Multiscale Visualization Using Data Cubes.” IEEE Transactions on Visualization and Computer Graphics 9 (2): 176–187. https://doi.org/10.1109/TVCG.2003.1196005.

Bret Victor, “Up and Down the Ladder of Abstraction,” Bret Victor, October 2011, http://worrydream.com/LadderOfAbstraction/.

Encoding

Kim, Younghoon, and Jeffrey Heer. 2018. “Assessing Effects of Task and Data Distribution on the Effectiveness of Visual Encodings.” Computer Graphics Forum 37 (3): 157–67. https://doi.org/10.1111/cgf.13409.

Munzner, Tamara. 2009. “A Nested Model for Visualization Design and Validation.” IEEE Transactions on Visualization and Computer Graphics 15 (6): 921–928. https://doi.org/10.1109/TVCG.2009.111.

Visualization tools

Blackwell, A. F., C. Britton, A. Cox, T. R. G. Green, C. Gurr, G. Kadoda, M. S. Kutar, et al. 2001. “Cognitive Dimensions of Notations: Design Tools for Cognitive Technology.” In Cognitive Technology: Instruments of Mind, edited by Meurig Beynon, Chrystopher L. Nehaniv, and Kerstin Dautenhahn, 2117:325–41. Berlin, Heidelberg: Springer Berlin Heidelberg. https://doi.org/10.1007/3-540-44617-6_31.

Bostock, M., V. Ogievetsky, and J. Heer. 2011. “D3 Data-Driven Documents.” IEEE Transactions on Visualization and Computer Graphics 17 (12): 2301–9. https://doi.org/10.1109/TVCG.2011.185.

Satyanarayan, A., D. Moritz, K. Wongsuphasawat, and J. Heer. 2017. “Vega-Lite: A Grammar of Interactive Graphics.” IEEE Transactions on Visualization and Computer Graphics 23 (1): 341–50. https://doi.org/10.1109/TVCG.2016.2599030.

Perception and color

Brewer, Cynthia A. 1999. “Color Use Guidelines for Data Representation.” In Proceedings of the Section on Statistical Graphics, American Statistical Association, 55–60. Alexandria, VA.

Healey, Christopher G., and James T. Enns. 2012. “Attention and Visual Memory in Visualization and Computer Graphics.” IEEE Transactions on Visualization and Computer Graphics 18 (7): 1170–88. https://doi.org/10.1109/TVCG.2011.127.

Heer, Jeffrey, and Michael Bostock. 2010. “Crowdsourcing Graphical Perception: Using Mechanical Turk to Assess Visualization Design.” In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 203–212. CHI ’10. New York, NY: ACM. https://doi.org/10.1145/1753326.1753357.

Animation

Tversky, Barbara, Julie Bauer Morrison, and Mireille Betrancourt. “Animation: Can It Facilitate?” International Journal of Human-Computer Studies 57, no. 4 (October 2002): 247–62. https://doi.org/10.1006/ijhc.2002.1017.

Robertson, G., R. Fernandez, D. Fisher, B. Lee, and J. Stasko. “Effectiveness of Animation in Trend Visualization.” IEEE Transactions on Visualization and Computer Graphics 14, no. 6 (November 2008): 1325–32. https://doi.org/10.1109/TVCG.2008.125.

Uncertainty

Hullman, Jessica, Xiaoli Qiao, Michael Correll, Alex Kale, and Matthew Kay. “In Pursuit of Error: A Survey of Uncertainty Visualization Evaluation.” IEEE Transactions on Visualization and Computer Graphics 25, no. 1 (January 2019): 903–13. https://doi.org/10.1109/TVCG.2018.2864889.

Narratives

Hullman, J., and N. Diakopoulos. 2011. “Visualization Rhetoric: Framing Effects in Narrative Visualization.” IEEE Transactions on Visualization and Computer Graphics 17 (12): 2231–40. https://doi.org/10.1109/TVCG.2011.255.

Abstraction

Benyon, David, and Milton Keynes. “Domain Models for User Interface Design,” n.d., 16.

Carroll, John M., and Mary Beth Rosson. “Getting Around the Task-Artifact Cycle: How to Make Claims and Design by Scenario.” ACM Transactions on Information Systems 10, no. 2 (April 1, 1992): 181–212. https://doi.org/10.1145/146802.146834.

Rogers, Yvonne. “HCI Theory: Classical, Modern, and Contemporary.” Synthesis Lectures on Human-Centered Informatics 5, no. 2 (May 23, 2012): 1–129. https://doi.org/10.2200/S00418ED1V01Y201205HCI014.

———. “New Theoretical Approaches for Human-Computer Interaction.” Annual Review of Information Science and Technology 38, no. 1 (September 22, 2005): 87–143. https://doi.org/10.1002/aris.1440380103.

**N.B.: I think this piece should be required reading — it does _such _a good job of synthesizing so much literature. It’s like the SparkNotes of HCI. **

Shapiro, Dan. “The Limits of Ethnography: Combining Social Sciences for CSCW.” In Proceedings of the 1994 ACM Conference on Computer Supported Cooperative Work, 417–428. CSCW ’94. New York, NY, USA: ACM, 1994. https://doi.org/10.1145/192844.193064.

Additional resources

Main references

HCI syllabi

Data visualization syllabi

Computer science

Architecture