JP2007013407A - Sound image localization mobile communication system, mobile communication terminal apparatus, radio base station apparatus, and sound image localization method on mobile communication terminal - Google Patents

Abstract

PROBLEM TO BE SOLVED: To realize a sound image localization mobile communication system capable of sound image localization of a call voice at an azimuth angle of a call partner.
In a mobile communication terminal 100a, a conversion table 5 for converting relative position information between a terminal 100b and a terminal 100b of a communication partner into a sound image localization processing parameter and a sound image localization unit 6 are provided. On the other hand, the vector information calculation means 23a is provided in the radio base stations (300a, 300b). Each terminal (100a, 100b) transmits the current position information obtained using the GPS satellite 200 to the radio base station 300a, calculates the relative position between the terminals in the radio base station as vector information, and obtains the vector information. It is sent back to each terminal (100a, 100b), and using this, the sound image localization processing of the received voice is performed at each terminal.
[Selection] Figure 1

Description

  The present invention relates to a sound image localization mobile communication system, a mobile communication terminal apparatus, a radio base station apparatus, and a sound image localization method on a mobile communication terminal.

  In recent years, mobile communication terminals equipped with communication functions such as PHS (Personal Handy Phone System), mobile phone terminals, PDAs, and the like have been developed to be multifunctional and highly functional. Proposal that enhances the playback function and enables stereo playback using a plurality of speakers (for example, Patent Document 1) and proposal that enables so-called hands-free calling even in mobile communication terminals (for example, Patent Document 2) Has been made.

  Installation of a stereo playback function or a hands-free function in a mobile communication terminal changes the usage pattern of the mobile communication terminal.

  Conventionally, a mobile phone terminal is generally used by being pressed against one ear by a user, but with the addition of a stereo playback function, music can be played with the mobile phone terminal placed in front of the user. It is expected that usage forms such as playing or enjoying stereo reproduction of music with a stereo headset (headphones, earphones, etc.) will also be generalized.

  In addition, by installing the hands-free function, it is possible for the user to have a conversation at a position away from the mobile phone terminal.

  On the other hand, a sound image localization technique has been conventionally known as a technique that makes it possible to reproduce realistic music. Here, the term “sound localization” is ambiguous, but originally it means “to specify the three-dimensional position of the sound source”. From the viewpoint of the acoustic effect, “specific sound source can be freely set. This means that the sound effect is intentionally created to give the listener a sense of hearing that the sound is generated from an arbitrary direction.

  Humans originally have a sound image localization capability that allows them to obtain not only the loudness, height, and timbre of the sound, but also spatial information such as direction and distance. By elucidating and controlling the physical factors of localization, a realistic sound field can be reproduced.

  As a cause of sound image localization, there are a time difference and an intensity difference between signals arriving at both ears of a person, a change in frequency characteristics of a sound wave caused by diffraction due to a head or an earlobe, or reflection by a wall of a room. In order to artificially control the effects of these on humans, the physical characteristic of the head acoustic transfer function is important.

  The head related transfer function (HRTF) is the transfer characteristics of sound from the sound source to the listener's eardrum, including the effect of the head and earlobe, in a space where there is no reflected wave (free space). It is a function to represent. By controlling the parameters of the head acoustic transfer function, various sound environments can be simulated, and realistic sounds can be reproduced. For example, when listening to music by playing music data, it is possible to realize a sense of presence as if the instrument or vocal is on the spot.

  A technique for canceling crosstalk (a sound that reaches the right ear from the left speaker and a sound that reaches the left ear from the right speaker), which is one of the sound image localization techniques, is described in Patent Document 3, for example. Yes.

  A technique for localizing a sound image by a convolution operation using a head acoustic transfer function is described in Patent Document 4, for example.

  On the other hand, mobile phone terminals and the like have been developed and marketed as part of multifunctionalization, which has positioning means for detecting the current position of the own device.

  As the positioning means, for example, a GPS (Global Positioning System) receiver is used. The GPS receiver receives a transmission radio wave from a GPS artificial satellite, demodulates it after shifting to a local frequency, and calculates latitude / longitude as reception position information.

  A mobile phone terminal to which a navigation function using GPS is added is described in Patent Document 5, for example.

JP 2002-57768 A JP 2003-348221 A Japanese Patent Laid-Open No. 5-41900 JP-A-9-215100 Japanese Patent Laid-Open No. 8-1111725

  As described above, when stereo playback and hands-free talk are enabled in a mobile phone terminal, the usage mode of the mobile phone terminal also changes (that is, it is used in a mode different from the mode in which the mobile phone terminal is pressed against one ear). Inevitably, there will inevitably be a movement to further develop and apply the stereo playback function and the like to increase the value of the mobile phone terminal.

  The inventor of the present invention pays attention to this point and studied the introduction of a sound image localization technique to a mobile phone terminal and performing a sound image localization process on the conversational voice of the other party.

  For example, by identifying the relative positional relationship between the mobile phone terminal of the user and the mobile phone terminal of the other party, and changing the position of the sound image of the received voice according to the relative positional relationship, The other party can enjoy a realistic conversation as if they were nearby, and can simply enjoy new voice communication using high-tech.

However, as a result of the above examination, it has been found that the application of the sound image localization technology to the mobile phone terminal has the following difficulties.
(1) In mobile communication, since the positions of the mobile phone terminal of the mobile phone and the mobile phone terminal of the other party are changed, it is difficult to grasp the relative positional relationship. In particular, it is difficult to know the absolute position of the other party.
(2) Even if the absolute positions of the own device and the other party's terminal are known, the orientation of the other party's terminal viewed from the current position of the own device using a navigation system as described in Patent Document 5 In order to know the distance, it is necessary to read the direction and relative distance between the two points from both terminal positions described on the map displayed on the liquid crystal display. Here, the orientation of the map does not necessarily match the orientation of the mobile terminal, so in order to know which direction the call partner is in the current location of your device, There is a need to rotate the mobile terminal so that the direction in which the user currently exists coincides.

  In addition, even if the orientation of the map and the orientation of the mobile terminal match, the relative positional relationship is known only after the positions of the own device and the other party's terminal are superimposed on the map. There is a problem that it takes time and effort.

  Further, in order to be able to know the position of the own device and the terminal of the other party at any position, a wide range of map data is required. As a mobile device, for example, holding all the data of a map in Japan is not realistic because the amount of data becomes very large, so it is necessary to receive map information near the required location using a telephone line, etc. Need to be acquired.

  In this way, it is possible to identify the relative positional relationship between the mobile phone terminal of the user and the mobile phone terminal of the other party and change the position of the sound image of the received voice according to the relative positional relationship. It is difficult.

  The present invention has been made on the basis of such considerations, and efficiently places a relative position between the mobile phone terminal of the mobile phone and the mobile phone terminal of the other party without burdening the mobile communication terminal. An object is to identify the relationship and realize sound image localization of received voice and incoming / outgoing sound according to the relative positional relationship.

  The sound image localization mobile communication system of the present invention has a function of moving at least one sound image of a received voice, a dial tone, and a ring tone on a mobile communication terminal in accordance with a relative positional relationship with a mobile communication terminal of a call partner. A mobile communication terminal comprising: positioning means for acquiring position information of the own device, sound image localization processing means, and a plurality of sound output means; A wireless communication base station that calculates relative position information between the two mobile communication terminals to be used, and each of the two mobile communication terminals obtains its own position information using the positioning means. Then, the relative position information calculation means that transmits the acquired position information to the radio communication base station and is built in the radio communication base station or in cooperation with the radio communication base station is one mobile communication terminal. Others seen from Azimuth information of the mobile communication terminal is calculated, the calculated azimuth information is transmitted as relative position information to the one mobile communication terminal, and the mobile communication terminal that has received the relative position information receives the received voice and the outgoing sound. The sound image localization processing by the sound image localization processing means is performed on at least one of the ringtones, and the signals of the plurality of output channels obtained through the sound image localization processing are output from the plurality of sound output means in parallel. .

  Each of the two mobile communication terminals transmits the current position information of the own device acquired by the positioning means to the radio communication base station using, for example, a data channel, and is linked within the radio base station or in cooperation with this. The relative position information calculating means calculates the relative positional relationship between the two (for example, the other orientation viewed from one side), and transmits the calculation result to the mobile communication terminal using, for example, a control channel. As a result, the mobile communication terminal does not need to obtain a relative positional relationship with the call partner terminal, and does not need to hold a map of the whole country, thereby reducing the burden on the mobile communication terminal. Then, the relative positional relationship between the mobile phone terminal of the mobile phone and the mobile phone terminal of the other party is specified, and according to the relative positional relationship, the other party in the remote location is as if by the sound image localization of the received voice. You can enjoy a realistic conversation as if you are in the vicinity, or simply enjoy new voice communication using high-tech. In addition, it is possible to obtain an effect that the direction in which the other party is located can be known by sound without referring to the map on the liquid crystal display. The same effect can be obtained by performing sound image localization processing according to the direction of the mobile communication terminal on the called side for the dial tone (for example, the dial tone indicating the usage mode of the IP phone and the ringing tone of the other party). Can do. The same effect can be obtained for the ringing tone of the called mobile communication terminal by performing sound image localization processing in accordance with the direction of the calling mobile communication terminal.

  In the sound image localization mobile communication system of the present invention, the mobile communication terminal that has received the relative positional relationship information converts the sound image localization parameter using a conversion table, and uses the sound image localization parameter as the sound image localization process. Including those that perform signal processing using the head-related acoustic transfer function.

  For example, by converting the received azimuth information into a sound image localization parameter using a conversion table (lookup table (LUT) or the like), it is possible to output the sound image localization parameter efficiently at high speed. Further, by using a IIR type digital filter or the like to perform signal processing based on the head acoustic transfer function to generate a signal of each channel subjected to sound image localization, high-accuracy sound image localization is possible.

  In addition, the sound image localization mobile communication system of the present invention includes the one in which the user of the mobile communication terminal can select not to transmit the position information of the own device to the radio communication base station.

  Since at least one of the users of the two terminals that make a call may not want the sound image localization processing, in this case, transmission of the current position information of the own terminal is performed by the user's own device operation. Can be stopped. As a result, disclosure (outflow) of the current position information as personal information can be prevented, and the range of user selection is widened.

  Further, in another aspect of the sound image localization mobile communication system of the present invention, the relative position information calculation means further calculates distance information between two mobile communication terminals, and the calculated distance information is used as the relative position information. In the mobile communication terminal that has been transmitted to the one mobile communication terminal and has received the relative position information, the sound image localization processing is performed, and the volume of the received voice, the volume of the dial tone or the ringtone according to the distance information To change.

  For example, if the distance is within 10 m, the previously set outgoing / incoming / call volume is output as it is, and if the distance is 100 m or more, the volume is half the preset outgoing / incoming / call volume. If the distance is not less than 10 m and not more than 100 m, a process of outputting a sound corresponding to the distance is performed. As a result, the distance to the other party can be recognized sensuously according to the volume, and a conversation with more realism can be enjoyed.

  In another aspect of the sound image localization mobile communication system of the present invention, when there is an incoming call while music is being reproduced on the mobile communication terminal, the sound image localization processing is performed on the reproduced music. By carrying out and changing the music, the user is notified that there was an incoming call.

  When an incoming call is received while playing a music source on a mobile communication terminal, a sound image localization process is performed on the output of the music source to notify the user that there is an incoming call. The sound image localization process is used for notification of an incoming call during music playback, and this makes it possible to tell that there was an incoming call without harming the user.

  The mobile communication terminal device of the present invention comprises positioning means for acquiring position information of its own device, sound image localization processing means, and a plurality of sound output means used in the sound image localization mobile communication system. ing.

  According to the mobile communication terminal of the present invention, sound image localization processing on the mobile communication terminal can be performed, so that the mobile communication terminal can be multifunctional, highly functional, and improved in value of use.

  Further, the radio communication base station apparatus of the present invention calculates relative position information between the two mobile communication terminals used for a telephone call used in the sound image localization mobile communication system of the present invention. It is possible to incorporate the means or to cooperate with the relative position calculation means.

  By providing a base station device, which is an important component of a mobile communication system, with a function for calculating relative position information for sound image localization or by providing a function for linking with an external relative position information calculation means, A mobile communication system can be constructed.

  Further, the sound image localization method on the mobile communication terminal of the present invention includes a plurality of sound output channels, and a mobile communication terminal having a positioning means for acquiring location information of the own device, A sound image localization method on a mobile communication terminal that moves at least one sound image of a received voice, a dial tone, and a ringtone according to a relative positional relationship with the mobile communication terminal of the mobile communication terminal. Each of the mobile communication terminals acquires its own location information using the positioning means, and transmits the acquired location information to a radio communication base station. Receiving the position information of the mobile communication terminal of the own device and the other party, and in the wireless communication base station or in an external device connected to the wireless communication base station by wire or wirelessly Then, using each of the position information, the relative position information is calculated by detecting the azimuth of the communication device of the other party as viewed from the own apparatus and the distance between the two, and the relative position information is obtained from the own apparatus or the In the second step of transmitting to the mobile communication terminal of the other party and the received relative position information in the own device or the mobile communication terminal of the other party, at least one of the received voice, dial tone and ring tone A third step of performing sound image localization processing on the two and outputting a plurality of signals obtained through the sound image localization processing in parallel from the plurality of sound output channels.

  By utilizing a wireless communication function and positioning means provided in a mobile communication terminal, the relative positional relationship with the device of the other party is efficiently obtained, and sound image localization is realized on the mobile communication terminal. This method can also be applied to a remote conference system in which multiple points are connected by a communication device.

  In the sound image localization mobile communication system of the present invention, a mobile communication terminal is introduced by introducing the concept of a distributed processing system and calculating a relative position between terminals in an external device or facility such as a radio base station. In the above, it is not necessary to obtain a relative positional relationship with the terminal of the other party of the call, and it is not necessary to maintain a map of the whole country, and the burden on the mobile communication terminal is reduced.

  Then, the relative positional relationship between the mobile phone terminal of the mobile phone and the mobile phone terminal of the other party is specified, and according to the relative positional relationship, the other party in the remote location is as if by the sound image localization of the received voice. You can enjoy a realistic conversation as if you are in the vicinity, or simply enjoy new voice communication using high-tech.

  In addition, there is an effect that the direction in which the other party is located can be known by sound without referring to the map on the liquid crystal display.

  In addition, for the dial tone (for example, the dial tone indicating the usage mode of the IP phone and the ring tone of the other party) at the calling mobile communication terminal, the sound image localization processing is performed according to the direction of the called mobile communication terminal. By applying, the same effect can be obtained. The same effect can be obtained for the ringing tone of the called mobile communication terminal by performing sound image localization processing in accordance with the direction of the calling mobile communication terminal.

  Also, by converting the received azimuth information into sound image localization parameters using a conversion table (lookup table (LUT) or the like), it is possible to output sound image localization parameters efficiently at high speed.

  Further, by using a IIR type digital filter or the like to perform signal processing based on the head acoustic transfer function to generate a signal of each channel subjected to sound image localization, high-accuracy sound image localization is possible.

  Moreover, it becomes possible to prevent the disclosure (outflow) of the current position information as personal information by allowing the user's own device operation to stop the transmission of the current position information of his / her terminal. In addition, the range of user selection is widened.

  In addition, by changing the volume of the received voice, the dial tone or the ringtone according to the distance to the other party, the distance to the other party can be recognized sensuously by the volume. It is possible to enjoy a conversation.

  Further, by using the sound image localization process for notification of an incoming call during music playback, it is possible to inform that there is an incoming call without harming the user.

  In addition, the mobile communication terminal of the present invention enables sound image localization processing on the mobile communication terminal, so that the mobile communication terminal can be multi-functional, highly functional, and use value can be improved.

  In addition, a base station apparatus that is an important component of a mobile communication system is provided with a function for calculating relative position information for sound image localization, or a function for linking with an external relative position information calculation unit, thereby making it easy. It is possible to construct a sound image localization mobile communication system.

  In addition, by using the sound image localization method of the present invention, the relative position relationship with the other party's device is efficiently obtained by utilizing the wireless communication function and positioning means provided in the mobile communication terminal, and sound image localization is realized on the mobile communication terminal. can do. This method can also be applied to a remote conference system in which multiple points are connected by a communication device.

  According to the present invention, the sound image localization technology can be effectively used in a mobile phone terminal or the like, and the possibilities of the mobile phone terminal or the like can be expanded.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
(First embodiment)

  FIG. 1 is a block diagram showing a configuration of a sound image localization mobile communication system of the present invention.

  The mobile communication terminals (here, mobile phone terminals) 100a and 100b of the present embodiment have at least one sound image of a dial tone, a ring tone, and a received voice in addition to a wireless communication function and positioning means using GPS. It has a voice localization function that localizes the sound image in the direction that the other party is actually talking.

  In the mobile communication terminals 100a and 100b of the present embodiment, an IIR digital filter or the like is used to perform signal processing based on the head acoustic transfer function and perform sound image localization processing.

  For sound image localization, it is necessary to specify the relative positional relationship between the mobile communication terminals 100a and 100b (the azimuth angle of the other terminal viewed from one terminal and the distance between the two terminals). The relative positional relationship specifying process is performed by the vector information calculating unit 23a provided in the base station (BS) 300a or by the external vector information calculating unit 23b linked with the base station 300a. carry out.

  Information indicating the specified relative positional relationship is transmitted to each of the mobile communication terminals 100a and 100b. The information is used for generating sound image localization parameters in the mobile communication terminals 100a and 100b.

  As shown in FIG. 1, a mobile communication terminal (mobile phone terminal) 100a (100b has the same configuration) receives radio waves from a radio communication antenna AN-1a (AN-1b) and a GPS satellite 200. An antenna AN-2a (AN-2b), a telephone number output means 1, a positioning means 2, a wireless transmission means 3, a wireless reception means 4, and a conversion table 5 for converting relative position information into sound image localization parameters; The sound image localization unit 6 that performs sound image localization processing, the sound output means SP (having the speaker 7a corresponding to the left channel and the speaker 7b corresponding to the right channel), the microphone 8, and the operation of each unit are comprehensively controlled. CPU 9, operation unit 10, music source reproduction unit 11, and display unit (liquid crystal display) 12.

The base station (BS) 300a includes a wireless antenna AN-3, a wireless interface 20, a wired interface 21, a vector information calculation unit 23a, a system bus 22,
CPU24.

  The base station 300a can communicate with another base station 300b via the wired interface 21, and can perform information communication via the network (NW). As described above, an external system ( For example, it is possible to communicate with the vector information calculating means 23b provided in the location registration center of the mobile phone terminal.

  Hereinafter, basic operations of the sound image localization mobile communication system of FIG. 1 will be described.

  The voice signal of the other party is received by the wireless transmission means 4 and output to the speakers 7a and 7b through the sound image localization unit 6.

  Further, in order to detect the position of the mobile communication terminal 100a (100b), the transmission radio wave from the GPS satellite 200 is received by the antenna AN-2a, and the latitude / longitude as reception position information is calculated by the positioning means 2. .

  The calculated latitude / longitude information is once transmitted by the wireless transmission means 3 to the wireless base station 300a. The radio base station 300a receives the latitude / longitude information indicating the current positions sent from the mobile communication terminals 100a and 100b via the antenna AN-3 and the radio interface 20, and the received latitude / longitude information. Is sent to the vector information calculation means 23a (or the external vector information calculation means 23b that cooperates).

  The vector information calculation means 23a (23b) is based on the position information (latitude / longitude) of each mobile communication terminal 100a, 100b, and the direction information of the other mobile communication terminal as viewed from one mobile communication terminal (and the distance if necessary). Information is also included), and the calculation result is output as vector information.

  The obtained vector information is transmitted from the base station 300a to the mobile communication terminals 100a and 100b. Each of the mobile communication terminals 100a and 100b receives the vector information by the antenna AN-1a and the radio receiving means 4.

  The received vector information is input to the sound image localization unit 6. The sound image localization unit 6 inputs the vector information to the conversion table 5 (here, a lookup table as firmware). As a result, the conversion table 5 outputs parameters for sound image localization processing (digital filter coefficient, delay constant of delay circuit, gain of output amplifier, etc.).

  The sound image localization unit 6 performs sound image localization processing on the other party's received voice, ringtone and outgoing sound using the obtained sound image localization processing parameters, and performs sound image localization in the direction of the other party. When the volume control parameter is also included as the sound image localization processing parameter, the volume is also controlled.

  In this way, each of the two mobile communication terminals 100a and 100b transmits the current position information of the own device acquired by the positioning means to the radio communication base station using, for example, a data channel, and the radio base station 300a. The relative relative position information calculating means 23a, 23b) in or in cooperation with this calculates the relative positional relationship between them (the other orientation as viewed from one side), and the calculation result is sent to the mobile communication terminal. For example, by transmitting using a control channel, there is no need to obtain a relative positional relationship with the other party's terminal in the mobile communication terminals (100a, 100b), and there is no need to hold a map of the whole country. The burden on the communication terminal is reduced.

  Then, the relative positional relationship between the mobile phone terminal of the mobile phone and the mobile phone terminal of the other party is specified, and according to the relative positional relationship, the other party in the remote location is as if by the sound image localization of the received voice. You can enjoy a realistic conversation as if you are in the vicinity, or simply enjoy new voice communication using high-tech.

  In addition, there is an effect that the direction in which the other party is located can be known by sound without referring to the map on the liquid crystal display. The same effect can be obtained by performing sound image localization processing according to the direction of the mobile communication terminal on the called side for the dial tone (for example, the dial tone indicating the usage mode of the IP phone and the ringing tone of the other party). Can do. The same effect can be obtained for the ringing tone of the called mobile communication terminal by performing sound image localization processing in accordance with the direction of the calling mobile communication terminal.

  Also, by converting the received azimuth information into sound image localization parameters using a conversion table (lookup table (LUT) or the like), it is possible to output sound image localization parameters efficiently at high speed.

  Further, by using a IIR type digital filter or the like to perform signal processing based on the head acoustic transfer function to generate a signal of each channel subjected to sound image localization, high-accuracy sound image localization is possible.

  FIG. 2 is a block diagram showing an example of the internal configuration of the sound image localization unit (reference numeral 6) in FIG.

  As illustrated, the sound image localization unit 6 includes an interaural time difference signal generator 51, a left-channel head acoustic transfer function processor (digital filter) 52, and a right-channel head acoustic transfer function processor (digital filter). ) 53, a left channel output stage amplifier 54, and a right channel output stage amplifier 55.

From the conversion table 5, a delay coefficient, a filter coefficient, and an amplification coefficient are output as parameters for sound image localization processing, and thereby, the delay amount and frequency characteristics of the signals of the left and right channels, and the volume are controlled. Thus, the sound image can be moved in correspondence with the direction of the other party.
(Second Embodiment)

  In the present embodiment, a variation of the usage pattern of the sound image localization mobile communication system of the present invention, more specific operation procedures of each unit, and the like will be described.

  FIG. 3 is a diagram for explaining a usage form of a mobile communication terminal and a procedure for sound image localization processing. In FIG. 3, the same reference numerals are given to portions common to FIG. 1.

  As shown in the figure, the user X wears a stereo headphone set (HP) on the head, and uses the mobile communication terminal 100a via the stereo headphone set (HP).

  In addition, the user Y directly outputs the stereo sound output from the two speakers 7a and 7b (not shown in FIG. 3) provided on the front surface of the housing of the mobile communication terminal 100b by using the hands-free function. Listen.

  As described above, the mobile communication terminals 100a and 100b first receive positioning information from the GPS satellite 200 and measure the latitude / longitude of the terminal (step S1).

  Next, each mobile communication terminal 100a, 100b transmits the current latitude / longitude information of its own device to the radio base station 300a (step S2).

  Next, the wireless base station 300a uses the received latitude / longitude information of each of the mobile communication terminals 100a and 100b to determine the relative positional relationship information (azimuth and distance) of the other mobile communication terminal viewed from one mobile communication terminal. And the relative positional relationship information is transmitted to each mobile communication terminal (100a, 100b) (step S4).

  Then, at each mobile communication terminal (100a, 100b), a sound image localization process parameter is calculated based on the relative positional relationship information, and the sound image localization process is performed on the received voice using the parameter.

  FIG. 4 is a diagram showing a communication sequence among a mobile communication terminal (mobile phone terminal), a radio base station, and a GPS satellite.

  The mobile communication terminals (100a, 100b) perform location registration processing after turning on the power. In the location registration process, the BCCH data of the radio base stations (300a, 300b) is continuously received, the CSID value is read out from the received BCCH, and the electric field strength and CSID at that time are stored in association with each other in a table. That is, during continuous reception, the received BCCH is repeatedly stored in the table.

  Then, the terminal side transmits a link channel establishment request to the CSID having the highest electric field strength, and the radio base station (in this case, the radio base station 300b) that has received the link channel establishment request Send channel assignments. The mobile communication terminals (100a, 100b) that have received the link channel assignment end the location registration process.

  Next, the current position information of each mobile communication terminal (100a, 100b) is obtained from the GPS satellite 200.

  The procedure for obtaining location information is as follows. That is, a position information acquisition request is transmitted from the mobile communication terminals (100a, 100b) to the GPS satellite 200, and the GPS satellite 200 receiving the request transmits position information to the mobile communication terminals (100a, 100b). In this way, the positioning information acquisition process is completed.

  Thereafter, this location registration operation is periodically performed, and the current location information of the mobile communication terminals (100a, 100b) is appropriately updated.

  Next, each mobile communication terminal (100a, 100b) transmits a current position information acquisition request to the GPS satellite 200, and in response to this, the GPS satellite 200 sends a current request to each mobile communication terminal (100a, 100b). Location information is transmitted.

  Next, the operation proceeds to the operation of generating relative position information between the mobile communication terminals (100a, 100b). Hereinafter, a description will be given with reference to FIGS. 5 and 6.

  FIG. 5 is a table format for explaining the generation of relative position information based on latitude / longitude information between mobile communication terminals. FIG. 6 is a diagram illustrating a specific relative positional relationship of a caller who is calling using a mobile communication terminal.

  In FIG. 6, when one mobile communication terminal 100b makes a call and the other mobile communication terminal 100a receives a call, each mobile communication terminal (100a, 100b) makes a current position to the radio base station (300a, 300b). Send information (latitude / longitude information).

  The radio base stations (300a, 300b) that have received the current position information can exchange data with each other via a dedicated line, and one of the radio base stations (for example, 300b) is a user in the cover area. The latitude / longitude information of the Y mobile communication terminal 100b is transmitted to the other radio base station (for example, 300a).

  As shown in FIG. 1, the radio base station 300a includes a vector information calculation unit 23a, and relative position relation information is generated by the vector information calculation unit 23a.

  That is, as shown in FIG. 5, from the latitude / longitude information of both mobile communication terminals (100a, 100b), relative position information including azimuth and distance information when one terminal is viewed from the other terminal is obtained. calculate.

  The specific positional relationship between the two mobile communication terminals (100a, 100b) is as shown in FIG. 6, and the mobile communication terminal 100a is located at the south-southwest of the mobile communication terminal 100b (azimuth angle 190 degrees) and a distance of 50 km. Is located.

  Each mobile communication terminal (100a, 100b) receives relative position information including an azimuth and distance from the base station (300a, 300b), and in what direction and how far the call partner is relative to its position. Know if they exist apart.

  When the call is started, the sound image localization parameter is reset using the conversion table 5 from the azimuth angle information of the relative position information with respect to the other party's voice. In addition, the volume is adjusted according to the distance information as necessary.

  The voice of the other party is output from the left and right speakers (7a, 7b). Since this sound has been subjected to sound image localization processing, the user will hear the sound whose sound image is localized in the direction of the other party (and the sound whose volume is adjusted according to the distance). , You can enjoy a realistic conversation.

  A specific example of changing the volume of the received voice (the volume of the dial tone or ringtone) according to the distance between the two terminals is as follows.

  The volume of outgoing / incoming / call is preset in each mobile communication terminal, and the volume is determined by multiplying the set volume by a coefficient corresponding to the distance. Thereby, it is possible to sensibly recognize the call distance based on the volume.

  That is, for example, if the distance is within 10 m, the preset outgoing / incoming / call volume is output as it is, and if the distance is 100 m or more, it is half of the preset outgoing / incoming / call volume. If the distance is 10 m or more and 100 m or less, a process of outputting a sound corresponding to the sound is performed.

  As a result, the distance to the other party can be recognized sensuously according to the volume, and a conversation with more realism can be enjoyed.

  In addition, as described above, the receiving terminal can perform sound image localization processing on the ringing tone as well as the received voice. Thereby, the user of the terminal on the receiving side can know the direction of the caller sensuously by sound.

Further, when a call is made at the calling side terminal, a sound image localization process is performed on a dial tone (notification sound or ringing tone indicating whether or not an IP phone is used), so that the direction of the user on the called side is present. Can be sensuously known by sound.
(Third embodiment)

  In the present embodiment, the current location information as personal information is disclosed (outflowed) by allowing the user's own device operation to stop the transmission of the current location information of his / her mobile communication terminal. It is possible to prevent. That is, it is possible to set invalidity of sound image localization for the partner terminal before the incoming / outgoing operation is performed. This is because there is a user who does not want to disclose his / her current position information.

  The configuration of the mobile communication terminal is the same as that shown in FIG. A user who does not desire sound image localization processing operates the operation unit 10 in FIG. 1 and registers in advance a flag signal indicating that in the CPU 9 (memory attached thereto). That is, the user presets the invalidation of the sound image localization in the menu setting.

  In this way, the current position information transmitted from the mobile communication terminal (100a, 100b) to the radio base station (300a, 300b) at the time of calling / receiving is determined regardless of the actual position. (For example, FFFF). Thereby, it is possible not to inform the communication partner of his / her position.

  When the radio base station (100a, 100b) receives FFFF data from at least one terminal, the position information of the mobile communication terminal is set to FFFF and fixed. As a result, the generation of relative position information by the vector information calculation means (23a, 23b) is prohibited, and the notification information indicating that the sound image localization processing is prohibited for the mobile communication terminal of the other party is sent to the radio base station (23a). , 23b). This notification is performed using, for example, a control channel for wireless communication.

As a result, the operation performed as usual is not performed without performing the sound image localization of the call or the incoming / outgoing sound output from the speaker of the other party.
(Fourth embodiment)

  In the present embodiment, when an incoming call is received while playing a music source on the mobile communication terminal, sound image localization processing is performed on the output of the music source so as to notify the user that there is an incoming call. To. The sound image localization process is used for notification of an incoming call during music playback, and this makes it possible to tell that there was an incoming call without harming the user.

  The configuration of the mobile communication terminal is the same as that shown in FIG.

  That is, in FIG. 1, when a music mini-disc (MD) or the like is being played back by the music source playback unit 11, when there is an incoming call, the sound image localization unit 6 causes the sound image localization for the reproduced music. Processing is performed (the coefficient of the sound image localization filter is changed), and the position of the sound image is changed. Thereby, the user can know that there was an incoming call.

  It is possible to inform the user that there is an incoming call without harming the user's mood because the music playback is not cut off suddenly or because there is no need to notify the user with a notification sound or flashing light. It becomes.

  The mobile communication terminal of the present invention enables sound image localization processing on the mobile communication terminal, thereby realizing multi-functionality, high functionality, and improved use value of the mobile communication terminal.

  The present invention has been described with reference to the embodiments. However, the present invention is not limited to this, and various modifications and applications are possible without departing from the spirit of the present invention.

  For example, in the above description, the current position of each mobile communication terminal is measured using a GPS satellite, but an optical beacon, Bluetooth device / wireless LAN device / Irda device / position recognition device using video / Current position information can also be acquired using an ultrasonic position detection device or the like.

  The calculation of the relative position information is mainly performed by the base station. As described above, the relative position information is acquired from each base station via another device or facility such as the position registration communication center. Also good.

  As a radio system of the mobile communication terminal, various radio communication systems such as PDC, GSM, and FOMA can be adopted in addition to PHS.

  In addition, when sound is output from the receiver at the start of a call, sound image localization may be performed by switching the sound output destination from the receiver to the speaker.

  Call voice output and sound image localization can be performed using a speaker attached to the mobile communication terminal, a headset / handset / in-vehicle speaker, or the like.

  There may be two or more speakers that output sound (that is, it is sufficient that there are two or more sound output channels), and the number (the number of sound output channels) is not limited.

  The present invention can also be applied to a remote conference system that connects multiple points with communication devices. That is, by using the sound image localization technology of the present invention, it is possible to allow a plurality of people at a remote location of a sound image to talk as if sitting on a single table.

  As described above, according to the sound image localization mobile communication system of the present invention, it is not necessary to obtain the relative positional relationship with the other party's terminal in the mobile communication terminal, and it is not necessary to hold a map of the whole country. The burden on the terminal is reduced.

  Then, the relative positional relationship between the mobile phone terminal of the mobile phone and the mobile phone terminal of the other party is specified, and according to the relative positional relationship, the other party in the remote location is as if by the sound image localization of the received voice. You can enjoy a realistic conversation as if you are in the vicinity, or simply enjoy new voice communication using high-tech.

  In addition, there is an effect that the direction in which the other party is located can be known by sound without referring to the map on the liquid crystal display.

  In addition, for the dial tone (for example, the dial tone indicating the usage mode of the IP phone and the ring tone of the other party) at the calling mobile communication terminal, the sound image localization processing is performed according to the direction of the called mobile communication terminal. By applying, the same effect can be obtained. The same effect can be obtained for the ringing tone of the called mobile communication terminal by performing sound image localization processing in accordance with the direction of the calling mobile communication terminal.

  Also, by converting the received azimuth information into sound image localization parameters using a conversion table (lookup table (LUT) or the like), it is possible to output sound image localization parameters efficiently at high speed.

  Further, by using a IIR type digital filter or the like to perform signal processing based on the head acoustic transfer function to generate a signal of each channel subjected to sound image localization, high-accuracy sound image localization is possible.

  Moreover, it becomes possible to prevent the disclosure (outflow) of the current position information as personal information by allowing the user's own device operation to stop the transmission of the current position information of his / her terminal. In addition, the range of user selection is widened.

  In addition, by changing the volume of the received voice, the dial tone or the ringtone according to the distance to the other party, the distance to the other party can be recognized sensuously by the volume. It is possible to enjoy a conversation.

  Further, by using the sound image localization process for notification of an incoming call during music playback, it is possible to inform that there is an incoming call without harming the user.

  In addition, the mobile communication terminal of the present invention enables sound image localization processing on the mobile communication terminal, so that the mobile communication terminal can be multi-functional, highly functional, and use value can be improved.

  In addition, a base station apparatus that is an important component of a mobile communication system is provided with a function for calculating relative position information for sound image localization, or a function for linking with an external relative position information calculation unit, thereby making it easy. It is possible to construct a sound image localization mobile communication system.

  In addition, by using the sound image localization method of the present invention, the relative position relationship with the other party's device is efficiently obtained by utilizing the wireless communication function and positioning means provided in the mobile communication terminal, and sound image localization is realized on the mobile communication terminal. can do. This method can also be applied to a remote conference system in which multiple points are connected by a communication device.

  According to the present invention, the sound image localization technology can be effectively used in a mobile phone terminal or the like, and the possibilities of the mobile phone terminal or the like can be expanded.

  The present invention has an effect that the sound image localization technology can be effectively used also in a mobile communication terminal, and the possibility of the mobile communication terminal can be expanded. Therefore, PHS (Personal Handy Phone System) It can be used for mobile communication terminals equipped with communication functions and positioning means, such as mobile phone terminals and PDAs, and mobile communication systems using these.

The block diagram which shows the structure of the sound image localization mobile communication system of this invention The block diagram which shows an example of an internal structure of the sound image localization part of FIG. The figure for demonstrating the procedure for the usage form of a mobile communication terminal, and a sound image localization process The figure which shows the communication sequence between a mobile communication terminal (cell-phone terminal), a radio base station, and a GPS satellite The figure for demonstrating the production | generation of the relative position information based on the latitude / longitude information between each mobile communication terminal The figure which shows the concrete relative positional relationship of the caller who is calling using a mobile communication terminal

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Telephone number transmission means 2 Positioning means 3 Wireless transmission means 4 Wireless reception means 5 Conversion table 6 Sound image localization part 7a, 7b Speaker 8 Microphone 9 CPU in mobile communication terminal
DESCRIPTION OF SYMBOLS 10 Operation part 11 Music source reproduction part 12 Display part 20 Wireless interface 21 Wired interface 23a, 23b Vector information calculation means 24 CPU in wireless base station
51 Interaural time difference signal generator 52 Left channel acoustic transfer function processor (digital filter)
53 Sound transfer function processor for right channel (digital filter)
54 Output stage amplifier for left channel 55 Output stage amplifier for right channel 100a, 100b Mobile communication terminal (mobile phone terminal)
200 GPS satellite 300a, 300b Wireless base station

Claims (10)

A sound image localization mobile communication system that realizes a function of moving at least one sound image of a received voice, a dial tone, and a ring tone according to a relative positional relationship with a mobile communication terminal of a call partner on a mobile communication terminal. There,
The mobile communication terminal comprising positioning means for acquiring position information of the own device, sound image localization processing means, and a plurality of sound output means;
A wireless communication base station capable of cooperating with relative position information calculating means for calculating relative position information between the two mobile communication terminals used for a call;
Each of the two mobile communication terminals acquires its own location information using the positioning means, and transmits the acquired location information to the radio communication base station,
The relative position information calculation means in cooperation with the radio communication base station calculates the direction information of the other mobile communication terminal viewed from one mobile communication terminal, and the calculated direction information is used as the relative position information. Sent to the mobile communication terminal,
In the mobile communication terminal that has received the relative position information, a plurality of outputs obtained by performing sound image localization processing by the sound image localization processing means for at least one of a received voice, a dial tone, and a ring tone and performing the sound image localization processing A sound image localization mobile communication system on a mobile communication terminal for outputting a channel signal concurrently from the plurality of sound output means. The sound image localization mobile communication system according to claim 1,
In the mobile communication terminal that has received the relative positional relationship information, the sound image localization parameter is converted using a conversion table, and signal processing using the head acoustic transfer function as the sound image localization process is performed using the sound image localization parameter. A sound image localization mobile communication system to be executed. The sound image localization mobile communication system according to claim 1,
A sound image localization mobile communication system in which a user of the mobile communication terminal can select not to transmit position information of the own device to the radio communication base station. The sound image localization mobile communication system according to claim 1,
The relative position information calculating means further calculates distance information between the two mobile communication terminals, transmits the calculated distance information to the one mobile communication terminal as the relative position information, and A sound image localization mobile communication system that performs the sound image localization process in a mobile communication terminal that has received information, and changes a volume of a received voice, a dial tone, or a ringtone according to the distance information. The sound image localization mobile communication system according to claim 1,
When there is an incoming call while music is being played on the mobile communication terminal, the sound image localization processing is performed on the music being played, and an incoming call is received by changing the music A sound image localization communication system that notifies the user of this fact. The sound image localization mobile communication system according to any one of claims 1 to 5,
A sound image localization mobile communication system in which relative position information calculation means is built in the wireless communication base station. The sound image localization mobile communication system according to any one of claims 1 to 5,
A sound image localization mobile communication system in which a relative position information calculation unit is provided outside the radio communication base station and is linked to the radio communication base station.   A positioning means for acquiring position information of the own device, a sound image localization processing means, and a plurality of sound output means used in the sound image localization mobile communication system according to any one of claims 1 to 7. A mobile communication terminal device.   Relative position information calculation means for calculating relative position information between the two mobile communication terminals used for a call, used in the sound image localization mobile communication system according to any one of claims 1 to 7. Wireless communication base station device that can be linked. On the mobile communication terminal having a plurality of sound output channels and having positioning means for acquiring the position information of the own apparatus, according to the relative positional relationship between the own apparatus and the mobile communication terminal of the other party, A sound image localization method on a mobile communication terminal for moving at least one sound image of a received voice, a dial tone, and a ring tone,
A first step in which each of the mobile communication terminal of the own device and the call partner acquires its own position information using the positioning means, and transmits the acquired position information to the base station for wireless communication;
The wireless communication base station receives the position information of each of the own device and the other party's mobile communication terminal, and uses the position information of each of the other party's communication devices viewed from the own device and between them. A second step of detecting at least one of the distances to calculate relative position information and transmitting the relative position information to the mobile communication terminal of the own device or the call partner;
In the mobile communication terminal of the own device or the other party, using the received relative position information, a sound image localization process is performed for at least one of a received voice, a dial tone, and a ringtone, and the sound image localization process is performed. A third step of simultaneously outputting a plurality of signals obtained from the plurality of sound output channels;
A sound image localization method on a mobile communication terminal.

Images