|
Vol: 60(74) No: 1 / March 2015 Fractional Fourier Transform Application in Human-Robot Multimodal Communication Improvement Csaba Szász Technical University of Cluj, Department of Electrical Machines and Drives, Cluj, Romania, e-mail: Csaba.Szasz@edr.utcluj.ro Éva H. Dulf Technical University of Cluj, Department of Electrical Machines and Drives, Cluj, Romania, e-mail: Eva.Dulf@aut.utcluj.ro Keywords: human-robot multimodal communication, Fractional Fourier transform, NI SbRIO-9631 mobile robot, speech recognition, voice signals recognition algorithm Abstract As it is well known, human-robot multimodal communication improvement represents a challenging task for researchers involved in intelligent robotic systems development and implementation. In the last around two decades a great amount of high quality research is done worldwide in this topic to engineer novel robotic systems, with more and more intelligence for human gestures or speech recognition abilities enhancements embedded within them. Following these efforts this paper deals with the idea of implementing a Fractional Fourier transform-based (FrFT) strategy for multimodal communication abilities improvement of pervasive mobile robots. For this reason a versatile NI SbRIO-9631 mobile robot configuration has been developed embedding a special architecture hardware structure. By using this hardware framework, a novel voice signals recognition algorithm has been tested and implemented using FrFT concepts. The experiments prove that the pervasive mobile robot endowed with these additional voice signals analyzing abilities displays more intelligence and cooperativeness in its environment significantly improving human-robot multimodal communication. References R. Bischoff, V. Graefe, “Dependable multimodal communication and interaction with robotic assistant,” 11th IEEE RHIC Int. Workshop, pp. 300-305, 2002. [2] D. Feil-Seifer, M. Mataric, “A Multi-modal Approach to Selective Interaction in Assistive Domains,” IEEE Proc. RO-MAN Conference, pp. 416-421, 2005. [3] M. Giuliani, M. Kasecher, et al., MuDiS – “A multimodal dialogue system for human-robot interaction,” Proc. International Workshop on Cognition for Technical Systems, 2008. [4] R. Mead, J. Weinberg, M. Mataric, “An Ontology-based Multimodal Communication System for Human-robot Interaction in Socially Assistive Domains,” IEEE Workshop ICRA, 2010. [5] M. Giuliani, A. Knoll, “Evaluating supportive and instructive robot roles in human-robot interaction,” Proc. Int. Conf. on Social Robotics, 2011. [6] A. Gaschler, K. Huth, M. Giuliani, I. Kesser, J. Ruiter, A. Knoll, “modeling state of interaction from head poses for social human-robot interaction,” ACM/IEEE Conf. of Human-Robot Interaction, 2012. [7] S. Lackley, D. Barber, L. Reinerman, “Defining Next Generation Multi-modal Communication in Human Robot Interaction,” Proc. Human Factors and Ergonomics Society, vol. 55, no. 1, pp. 461-464, 2011. [8] R.C. Luo, S. Chang, C. Huang, Y. Yang, “Human robot interactions using speech synthesis and recognition with lip synchronization,” IECON 2011, pp. 171-176, 2011. [9] N. Kirchner, A. Alempievic, G. Dissanayke, “Nonverbal robot-group interaction using an imitated gaze cue,” ACM/IEEE Int. Conf. on Human Robot Interaction, pp 1-8, 2011. [10] C. A. Monje, Y.Q. Chen, B. M. Vinagre, D. Xue, V. Feliu, “Fractional-order Systems and Controls”, DOI 10.1007/978-1-84996-335-0, Springer Verlag, 2010. [11] D. Mendlovic, H.M. Ozaktas, “Fractional Fourier transforms and their optical implementation I,” Journal of the Optical Society of America A, 10(9), 1875–1881, 1993. [12] D. Mendlovic, H.M. Ozaktas, “Fractional Fourier transforms and their optical implementation II,”. Journal of the Optical Society of America A, 10(9), 2522–2531, 1993. [13] L.B. Almeida, “The fractional Fourier transform and time–frequency representations,” IEEE Transactions on Signal Processing 42 (11), 3084–3091, 1994. [14] G. Cariolaro, T. Erseghe, P. Kraniauskas, N. Laurenti, “A unified framework for the fractional Fourier transform,” IEEE Transactions on Signal Processing 46 (12), 3206–3219, 1998. [15] B. Borden, “The fractional Fourier transform and ISAR imaging,” Inverse Problems Letters, IOP, 16(2), 5–8, 2000. [16] Y. Zhang, Z. Dong, L. Wu, S. Wang, “A hybrid method for MRI brain image classification,” Expert Systems with Applications, 38 (8), 10049-10053, 2011. [17] J. Lang, R. Tao, Y. Wang, „Image encryption based on the multiple-parameter discrete fractional Fourier transform and chaos function”, Optics Communic., 283(10), 2092-2096, 2010. [18] A. Bultheel, “A two-phase implementation of the fractional Fourier transform,” Report TW588, Department of Computer Science, K.U.Leuven, 2011. [19] E.-H. Dulf, C. I. Muresan, M. L. Unguresan, “Modeling the (15N) isotope separation column,” Journal of Mathematical Chemistry, Springer, vol. 52:115-131, 2014, DOI 10.1007/s10910-013-0248-2. [20] E.-H. Dulf, C.-I. Pop, F.-V. Dulf, “Systematic Modeling of the (13C) Isotope Cryogenic Distillation Process,” Separation Science and Technology, vol. 47, no. 8, pp. 1234-1240, 2012, DOI: 10.1080/01496395.2011.644614. [21] E.-H. Dulf, C.-I. Pop, F.-V. Dulf, “Fractional calculus in 13C separation column control,” Signal, Image and Video Processing, 6:3, 479-485, 2012, DOI 10.1007/s11760-012-0335-z. [22] C. Candan, M.A. Kutay, and H.M. Ozaktas. “The discrete Fractional Fourier Transform,” IEEE Trans. Sig. Proc., 48:1329--1337, DOI:10.1109/78.839980, 2000. [23] H.M. Ozaktas, M.A. Kutay, G. Bozdagi, “Digital computation of the fractional Fourier transform,” IEEE Trans. Sig. Proc., 44:2141--2150, DOI:10.1109/78.536672M, 1996. [24] R. Tao, G. Liang, X. Zhao, “An efficient FPGA-based implementation of fractional Fourier transform algorithm.” J. Signal Processing Systems, 60(1):47-58, DOI 10.1007/s11265-009-0401-0, 2010. [25] Hui Yin et al., “Order adaptation of the fractional fourier transform using the intraframe pitch change rate for speech recognition,” Proc. 6th International Symposium on Chinese Spoken Language Processing ISCSLP ‘08, 2008. DOI: 10.1109/CHINSL.2008.ECP.60, pp. 1-4. [26] D.-J. Ma, X. Xie, J.-M. Kuang, “A novel algorithm of seeking frft order for speech processing,” Proc. ICASSP 2011, pp. 3832-3835. [27] User Manual National Instruments Co. Available: http://www.ni.com/pdf/manuals/373610f.pdf. [28] User Manual National Instruments Co. Available: http://sine.ni.com/ds/app/doc/p/id/ds-217/lang/en. [29] Cs. Szász, D. Tobák, “The NI SbRIO-9631 prototype robot multimodal communication abilities development,” 17th BSMBID International Conference, Debrecen, Hungary, 2011. [30] Cs. Szász, Zs. László, “Sound processing algorithms implementation in LabView environment for remote control of the NI SbRIO-9631 prototype robot,” 17th BSMBID International Conference, Debrecen, Hungary, 2011. [31] Cs. Szász, P. Török, “Image processing abilities implementation upon the NI SbRIO-9631 prototype robot interfaced with CVS-1415 vision system,” 17th BSMBID International Conference, Debrecen, Hungary, 2011. |