Abstract
In this research, we have constructed a dialog environment between human and computers, and proposed and verified the method of operating the information which unified the verbal information represented using the voice and the non-verbal information and a pointing action. Now, the interface environment of information equipments such as a computer does not change with the former one. For example, elderly people cannot use it very easily. In Japan, if the interconnection of various apparatus is carried out with the arrival of ubiquitous network society and new various functions are available in addition to the conventional functions, it is thought that products which need the complicated operations will be developed. It is expected that even people who can use the functions will feel it difficult to use new ones while growing older. Then, dialog environment which permits both a system and a user to use much easier operations is desired. In this research, the environment is constructed witch allows a user to communicate using a voice and gesture with the personification agent who is a salesman in a virtual store selling fountain pens. The specification using a pointing action and voice such as ‘Would you show me this pen?’ will make it possible foe user to specify the pen he wants to buy from fountain pens in a showcase. If the distance between his fingertip and the pen is distant, it may be difficult for the agent to infer which pen the user wants. This needs the further communication using voice and pointing action to make his intent clear.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Ministry of Economy, Trade and Industry, Society (e-Life strategy society) basic strategy report concerning strategy of making to market of information appliances - e-Life initiative (2003)
Abe, N., Tsuji, S.: A consulting system which detects and undoes erroneous operations by novices. In: Proc. of SPIE, October 1986, pp. 352–358 (1986)
Abe, N., Amano, T., Tanaka, K., Zheng, J.Y., He, S., Taki, H.: A Training System for Detecting Novice’s Erroneous Operation in Repairing Virtual Machines. ICAT, 224–229 (1997)
Abe, N., Zheng, J.Y., Tanaka, K., Taki, H.: A training System using Virtual Machines for Teaching Assembling/Disassembling Operations to Novices. In: International Conference on System, Man and Cybernetics, pp. 2096–2101 (1996)
Tanaka, K., Ozaki, T., Abe, N., Taki, H.: Verbal/Nonverbal communication between Man and Avatar in Virtual Mechanical Assembly Training System. In: Proc. VARI, pp. 202–207 (2002)
Ozaki, T.: Verbal and Non-Verbal Comunication Using Virtual Reality, Kyusyu Institute of Technology, Master Thesis (2001)
Sugiyama, S., Abe, N., Tanaka, K., Taki, H.: Construction of Dialog System Using Virtual Human, JCEEE-Kyushu, 12-1A-14 (2003)
Systran Co, Systran-Product-SCRAMNet+ Network, http://www.systran.com/scmain.html
Nishimura, K., Abe, N., Tanaka, K., Taki, H.: Research on the Verbal and Nonverbal Communication using Virtual Reality. In: The eighth time of Japanese virtual reality society rally proceeding collection, pp. 509–512 (2003)
Speech recognition software Julius, http://julius.sourceforge.jp/
Kyushu of society related to electricity in Koichi Nishimura, Hiroshi of Abe, Kazuaki Tanaka, Hirokazu Taki, Research on speech recognition in interactive agent, JCEEEKyushu, 12-1A-13 (2003)
Touch panel systems Ltd., general specification of product UniTouch, http://www.tps.co.jp/products/unitouch.htm
Roppongi, T.: Pointing with retina chip camera and CCD camera and identification of the object, Kyushu Institute of Technology, Master Thesis (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Watanabe, Y. et al. (2004). Man and Machine Bidirectional Communication Interface Using Voice and Pointing Action. In: Yang, L.T., Guo, M., Gao, G.R., Jha, N.K. (eds) Embedded and Ubiquitous Computing. EUC 2004. Lecture Notes in Computer Science, vol 3207. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30121-9_59
Download citation
DOI: https://doi.org/10.1007/978-3-540-30121-9_59
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22906-3
Online ISBN: 978-3-540-30121-9
eBook Packages: Springer Book Archive