SCIENTIA SINICA Informationis, Volume 48, Issue 4: 466-474(2018) https://doi.org/10.1360/N112017-00214

A model for natural human-computer interaction based on semiotic triangle

More info
  • ReceivedOct 31, 2017
  • AcceptedFeb 2, 2018
  • PublishedApr 11, 2018


In the development and application of cognitive science and ubiquitous computing, the method of building and evaluating a natural user interface has become increasingly important. In this paper, based on the definition of natural human-computer interaction, we highlight the necessity of the use of natural language between user and computers and its comprehension. Moreover, based on the semiotic triangle model of linguistics, we propose a model for natural human-computer interaction. The model can provide an explanation of how information is transmitted between the user and computers and understood. Finally, we present an approach for evaluating the user interface based on interaction naturalness, continuity, and learnability.

Funded by


重点研发计划项目(项目编号: 2017YFB1002805)


[1] Shneiderman . Direct Manipulation: A Step Beyond Programming Languages. Computer, 1983, 16: 57-69 CrossRef Google Scholar

[2] D'Amico G, Bimbo A D, Dini F, et al. Natural human-computer interaction. In: Multimedia Interaction and Intelligent User Interfaces. Berlin: Springer, 2010. 85--106. Google Scholar

[3] Wang H A, Tian F. Natural and efficient human computer interaction. In: 10000 Selected Problems in Sciences. Beijing: Science Press, 2011. 625--627. Google Scholar

[4] Cao X. What is the natural characteristics of natural user interface. Commun China Comput Federation, 2011, 11: 14--18. Google Scholar

[5] Orgden C K, Richards I A. The Meaning of Meaning: a Study of the Influence of Thought and of the Science of Symbolism. Orlando: Harcourt Brace Jovanovich Publishers, 1923. Google Scholar

[6] Peirce C S. Collected Papers of Charles Sanders Peirce. Cambridge: Harvard University Press, 1974. Google Scholar

[7] Frege G, Long P, White R. Posthumous writings. Philos Rhetoric, 1981, 14: 196--197. Google Scholar

[8] Persson G. Meanings, Models, and Metaphors: a Study in Lexical Semantics in English. London: Coronet Books Inc, 1990. Google Scholar

[9] Picca D, Gliozzo A M, Gangemi A. LMM: an OWL-DL metamodel to represent heterogeneous lexical knowledge. In: Proceedings of the International Conference on Language Resources and Evaluation, Marrakech, 2008. 2413--2419. Google Scholar

[10] Tian F, Dai G Z, Chen Y D, et al. Specification and structure design of 3D interaction tasks. J Softw, 2002, 13: 2099--2105. Google Scholar

Copyright 2019 Science China Press Co., Ltd. 《中国科学》杂志社有限责任公司 版权所有