Communication Between Speech Production and Perception Within the Brain--Observation and Simulation

作     者：党建武 赤木正人 本多清志 

作者机构：Japan Advanced Institute of Science and Technology Ishikawa Japan ATR Human Information Science Laboratories Kyoto Japan 

出 版 物：《Journal of Computer Science & Technology》 (计算机科学技术学报（英文版）)

年 卷 期：2006年第21卷第1期

页      面：95-105页

核心收录：

学科分类：12[管理学] 1201[管理学-管理科学与工程(可授管理学、工学学位)] 081104[工学-模式识别与智能系统] 08[工学] 0835[工学-软件工程] 0811[工学-控制科学与工程] 0812[工学-计算机科学与技术（可授工学、理学学位）] 

基　　金：This research has been supported in part by the National Institute of Information Communications 'technology and in part by a Grant-in-Aid for Scientific Research of Japan 

主　　题：speech communication human mechanism speech production speech perception 

摘      要：Realization of an intelligent human-machine interface requires us to investigate human mechanisms and learn from them. This study focuses on communication between speech production and perception within human brain and realizing it in an artificial system. A physiological research study based on electromyographic signals （Honda, 1996） suggested that speech communication in human brain might be based on a topological mapping between speech production and perception, according to an analogous topology between motor and sensory representations. Following this hypothesis, this study first investigated the topologies of the vowel system across the motor, kinematic, and acoustic spaces by means of a model simulation, and then examined the linkage between vowel production and perception in terms of a transformed auditory feedback （TAF） experiment. The model simulation indicated that there exists an invariant mapping from muscle activations （motor space） to articulations （kinematic space） via a coordinate consisting of force-dependent equilibrium positions, and the mapping from the motor space to kinematic space is unique. The motor-kinematic-acoustic deduction in the model simulation showed that the topologies were compatible from one space to another. In the TAF experiment, vowel production exhibited a compensatory response for a perturbation in the feedback sound. This implied that vowel production is controlled in reference to perception monitoring.