SCIENTIA SINICA Informationis, Volume 48, Issue 4: 406-418(2018) https://doi.org/10.1360/N112017-00217

Interaction paradigm in intelligent systems

More info
  • ReceivedNov 2, 2017
  • AcceptedJan 29, 2018
  • PublishedApr 8, 2018


This paper discusses the user interface design paradigm for intelligent systems. We first introduce the concepts of paradigm in science and human-computer interaction (HCI). After discussing the WIMP (windows, icons, menus, a pointing device) paradigm, the most influential user interface design paradigm in HCI, we summarize the major components a user interface paradigm usually takes into consideration, and based on this summarization, we analyze the features as well as limitations of the user interfaces of some intelligent systems currently available on the market. We also propose a user interface design paradigm, RMCP (role, modal, commands, and presentation style), for intelligent systems, which emphasizes the consideration of the role(s) that an intelligent system plays in a user's life and work, the interaction modal(s) that the system can accommodate, the commands that the system supports, and the presentation style(s) that the system adopts for information outputs.

Funded by






[1] Shi L, Deng C Z, Dai G Z. Implementation of PGIS: a type of Post-WIMP user interface. J Image Graph, 2010, 15: 985--992. Google Scholar

[2] El-Assady M, Sevastjanova R, Sperrle F, et al. Progressive learning of topic modeling parameters: a visual analytics framework. IEEE Trans Visual Comput Graph, 2017, 24: 382--391. Google Scholar

[3] Kuhn T S. The Structure of Scientific Revolutions. 1st ed. Chicago: University of Chicago Press, 1962. Google Scholar

[4] Kuhn T S. The Structure of Scientific Revolutions. In: Jin W L, Hu X H, eds. Beijing: Peking University Press, 2004. Google Scholar

[5] Gray J. eScience: a transformed scientific method. In: The fourth Paradigm: Data-Intensive Scientific Discovery. 2009. https://www.microsoft.com/en-us/research/publication/fourth-paradigm-data-intensive-scientific-discovery/. Google Scholar

[6] Harrison S, Sengers P, Tatar D. Making epistemological trouble: Third-paradigm HCI as successor science. Interacting Comput, 2011, 23: 385-392 CrossRef Google Scholar

[7] Card S, Moran T, Newell A. The Psychology of Human-Computer Interaction. Mahwah: Lawrence Erlbaum, Associates, 1983. Google Scholar

[8] Carroll J M. HUMAN-COMPUTER INTERACTION: Psychology as a Science of Design. Annu Rev Psychol, 1997, 48: 61-83 CrossRef Google Scholar

[9] Dong S H, Chen M, Luo J, et al. The model, method and instance of multimodal user interface. Acta Sci Nat Univ Pekinensis, 1998, 34: 231--239. Google Scholar

[10] Dai G Z, Tian F. Pen-based User Interface. Heifei: China Science and Technology University Press, 2014. Google Scholar

[11] Green M, Jacob R. SIGGRAPH '90 Workshop report: software architectures and metaphors for non-WIMP user interfaces. SIGGRAPH Comput Graph, 1991, 25: 229-235 CrossRef Google Scholar

[12] Nielsen J. Noncommand user interfaces. Commun ACM, 1993, 36: 83--99. Google Scholar

[13] James J. Word 2007: lessons on usability. http://www.techrepublic.com/article/word-2007-lessons-on-usability/. Google Scholar

[14] Norman D A. The Psychology of Everyday Things. New York: Basic Books, 1998. Google Scholar

[15] Gibson J J. The Ecological Approach to Visual Perception. Boston: Houghton Mifflin, 1979. Google Scholar

[16] Liu Z X. Interpretation of the theory of metaphor. J Anhui Univ Technol (Soc Sci), 2007, 24: 126--127. Google Scholar

[17] Wang M. An exploratory study of the understanding of user interface metaphors: the case of metaphoric icons. Dissertation for Master Degree. Wuhan: Central China University of Science and Technology, 2011. Google Scholar

[18] Lakoff G, Johnson M. Metaphors We Live by. Chicago: University of Chicago Press, 1981. Google Scholar

[19] Carroll J M. Human computer interaction — brief intro. In: the Encyclopedia of Human-Computer Interaction. 2nd ed. https://www.interaction-design.org/literature/book/the-encyclopedia-of-human-computer-interaction-2nd-ed. Google Scholar

[20] Szabó K. Metaphors and the user interface. 1995. http://www.katalinszabo.com/metaphor.htm. Google Scholar

[21] Ark W, Dryer D, Selker T, et al. Representation matters: the effect of 3D objects and a spatial metaphor in a graphical user interface. In: People and Computers XIII. Longdon: Springer, 1998. Google Scholar

[22] Lyu F, Tian F. Reality-Based Interaction: Method and Practice. Beijing: Electronic Industry Press, 2017. Google Scholar

[23] Shneiderman B. Designing the User Interface: Strategies for Effective Human-Computer Interaction. 2nd ed. Boston: Addison-Wesley, 1992. Google Scholar

[24] Dam A V. Post-wimp user interfaces. Commun ACM, 1997, 40: 63--67. Google Scholar

[25] Jacob R J K, Girouard A, Hirshfield L M, et al. Reality-based interaction: a framework for post-wimp interfaces. In: Proceeding of the 26th ACM SIGCHI Conference on Human Factors in Computing Systems, Florence, 2008. 201--210. Google Scholar

[26] Yuanchun Shi , Weikai Xie , Guangyou Xu . The smart classroom: merging technologies for seamless tele-education. IEEE Pervasive Comput, 2003, 2: 47-55 CrossRef Google Scholar

[27] Aldrich F K. Smart homes: past, present and future. In: Inside the Smart Home. London: Springer, 2003, 17--39. Google Scholar

[28] Davies C, White J, McAllister A, et al. A toolkit for building collaborative immersive multi-surface applications. In: Proceedings of the 2016 ACM on Interactive Surfaces and Spaces (ISS'16), Niagara Falls, 2016. 485--488. Google Scholar

[29] Hall E T. The Hidden Dimension. 2nd ed. New York: Anchor Press, 1990. Google Scholar

[30] Cohen M A, Horowitz T S, Wolfe J M. Auditory recognition memory is inferior to visual recognition memory. Proc Natl Acad Sci USA, 2009, 106: 6008-6010 CrossRef PubMed ADS Google Scholar

[31] Grice H P. Logic and conversation. In: Syntax and Semantics III: Speech Acts. New York: Academic Press, 1975. Google Scholar

[32] Dumas B, Lalanne D, Oviatt S. Multimodal interfaces: a survey of principles, models and frameworks. In: Human Machine Interaction. Berlin: Springer, 2009. Google Scholar

Copyright 2019 Science China Press Co., Ltd. 《中国科学》杂志社有限责任公司 版权所有