SCIENTIA SINICA Informationis, Volume 46 , Issue 12 : 1737-1747(2016) https://doi.org/10.1360/N112016-00249

Composition of virtual-real worlds and intelligence integration ofhuman-computer in mixed reality

More info
  • ReceivedOct 20, 2016
  • AcceptedNov 27, 2016
  • PublishedDec 22, 2016


Recent rapid developments in mixed reality and virtual reality have attracted worldwide attention. This technology has prospective uses in education, medicine, video games and other fields. Mixed reality is the composite of a virtual world and the real world, typically with virtual objects incorporated into a view-dependent visual scene. A wearable head-mounted display provides a basic tool for immersion in mixed reality scenes, and a computer provides virtual scenes that coordinate with the real world. The composition of virtual and real scenes is essentially the inter-embedding of different temporal and spatial scenes, and depends on interactions with spatial geometry and illumination of the environment, namely geometrical consistency and illumination consistency. In the sociological sense, the composition must also follow the law of human sociology and psychology, that is, behavioral consistency. Mixed reality provides a natural and intuitive interface between users and real and virtual worlds. Mixed reality, through the understanding of human action and behavior, intuitively connects the virtual and real world. Humans can understand the world through the observation of the composition of the virtual and real scenes, and immediately influence the virtual world through natural interaction, receiving intelligent feedback from the computer. Thus, immersive interaction and deep interaction between humans and computers can be realized. Technological improvements from non-wearable to wearable devices have allowed mixed reality to gain immersion; in advancing from static scenes to dynamic scenes, mixed reality gained social attributes; and progressing from specific virtual scenes to semantic analysis and visualization of big data, mixed reality becomes a platform for the integration of human and computer intelligence.

Funded by

国家重点基础研究发展计划 (973计划)(2015CB352500)



本专题的特约编辑和匿名审稿人提出了有价值的建设性意见, 作者对此表示衷心的感谢. 感谢作者的合作者们在相关研究中的进展带来的思想. 特别感谢浙江大学CAD$\&$CG国家重点实验室彭群生教授和鲍虎军研究员, 在合作和研讨中不断给予极具启发性的思路, 对本文核心思想的形成产生了重要影响.