JP6094844B1 - Sound reproduction apparatus, sound reproduction method, and program - Google Patents

Abstract

A sound reproducing device, a sound reproducing method, and a program for reproducing a three-dimensional sound with enhanced realism using the principle of otoacoustic emission are provided. A sound reproduction apparatus includes: a first otoacoustic emission processing unit that adds an effect of evoked otoacoustic emission and distortion component otoacoustic emission to input audio data; and predetermined audio data after processing. A head transmission adjustment processing unit 2f that adjusts the transmission delay of the sound to the user's head based on the obtained head-related transfer function. The processed voice data is converted into a voice signal and output as a stereoscopic sound with a sense of presence. [Selection] Figure 1

Description

  The present invention relates to a device that reproduces sound with a sense of presence, and more particularly to a sound reproduction device, a sound reproduction method, and a program that enhance the sense of presence using the principle of otoacoustic emission.

  Conventionally, a device that reproduces sound has been demanded to reproduce sound with a higher sense of presence, and stereophonic sound is generated by a binaural signal convoluted with a head-related transfer function (HRTF) in a sound source signal. It has also been played.

  Also, in recent years, when the audio signal played back by the speakers placed on both sides of the screen is played back through headphones or a head mounted display (HMD), the direction of the image does not match the localization position of the sound image. However, various proposals have been made to solve the problem.

  For example, in Patent Document 1, a gyro sensor is provided in an earphone to detect the rotation of the user's head, an acceleration sensor is provided to detect the inclination of the gyro sensor, and a detection output of the gyro sensor is detected by a sound image localization correction unit. A sound processing apparatus is disclosed in which the sound image localization process is performed by correcting the detected position of the sound image so that the localization position of the sound image is constant.

Japanese Patent Application No. 2010-56589

  However, the technique disclosed in Patent Document 1 merely adjusts the localization position of the sound image by sound image localization processing, and the technical idea of incorporating the principle of otoacoustic emission to enhance the sense of reality is also disclosed. There was no suggestion.

  Here, the otoacoustic emission includes “evoked otoacoustic emission”, “spontaneous otoacoustic emission”, and “distortion component otoacoustic emission”. Evoked otoacoustic emission (TEOAE) refers to an acoustic response in which a signal is detected with a delay of about 10 ms with respect to a stimulus using a click sound. Spontaneous Otoacoustic Emission (SOAE) refers to an acoustic reaction in which a signal emitted spontaneously from a cochlea is detected without external stimulating sound. Distortion Product Otoacoustic Emission (DPOAE) means that nf1 ± mf2 (n and m are integers) by inputting two different frequency signals (f1, f2, f1 <f2) to the cochlea. An acoustic reaction in which a frequency signal is detected.

  However, there has been no technology that uses such an otoacoustic emission mechanism to enhance the sense of reality in sound reproduction using, for example, an HMD.

  The present invention has been made in view of such a problem, and provides an audio reproducing device, an audio reproducing method, and a program for reproducing stereoscopic sound with enhanced presence using the principle of otoacoustic emission. Objective.

In order to solve the above-described problem, a sound reproduction device according to the first aspect of the present invention includes a distance sensor that measures distance to an actual object and obtains distance data, and evoked otoacoustic emission with respect to input audio data. provided with a first otoacoustic emissions processing means for adding the effect of the distortion product otoacoustic emission, and a sound output unit for converting the audio signal to audio data processed by the first otoacoustic emission processing means The first otoacoustic emission processing means adjusts the volume of a predetermined frequency band of the audio data based on the distance data, and adjusts the sound pressure of the audio data based on the distance data. Sound pressure adjusting means, amplitude adjusting processing means for adjusting and amplifying the volume of the audio data to compensate for the decrease in volume, and delay adjusting processing means for adding a 10 ms delay effect to the audio data.

  The sound reproducing device according to a second aspect of the present invention is the sound reproducing device according to the first aspect, wherein the sound data after the processing by the first otoacoustic emission processing unit is performed based on a predetermined head related transfer function. Head transmission adjustment processing means for adjusting the transmission delay of the sound to the head is further provided, and the sound output means converts the sound data processed by the head transmission adjustment processing means into a sound signal and outputs the sound signal.

The sound reproduction apparatus according to a third aspect of the present invention is the sound reproduction apparatus according to the first aspect, wherein the second otoacoustic further adds the effect of the spontaneous otoacoustic emission to the audio data processed by the first otoacoustic emission processing means. The second otoacoustic radiation processing means further includes a otoacoustic radiation processing means for adding the effect of the spontaneous otoacoustic radiation to the audio data, and a sampling sound based on the user's latent memory. Latent sound addition processing means, and the sound output means converts the sound data processed by the second otoacoustic emission processing means into a sound signal and outputs the sound signal.

According to a fourth aspect of the present invention, in the first to third aspects, the first otoacoustic emission processing means adjusts the volume of a predetermined frequency band based on heartbeat data, Increase psychological effects.

The sound reproduction method according to the fifth aspect of the present invention includes a first step of measuring distance to an actual object to obtain distance data, a second step of receiving input of audio data, and input audio data On the other hand, a third step of performing a first otoacoustic emission process for adding the effects of evoked otoacoustic emission and distortion component otoacoustic emission, and converting the audio data subjected to the first otoacoustic emission process into an audio signal. And a fourth step of outputting the sound data, wherein in the third step, the sound volume of the sound data is adjusted based on the distance data, and the sound pressure of the sound data is adjusted to the distance data. And adjusting the amplitude of the audio data to compensate and amplify the decrease in volume, and add a 10 ms delay effect to the audio data.

The sound reproduction method according to a sixth aspect of the present invention is the sound reproduction method according to the fifth aspect, based on a predetermined head related transfer function for the sound data after the first otoacoustic emission process in the third step. The method further includes a fifth step of performing a head transmission adjustment process for adjusting a transmission delay of the voice to the user's head, and in the fourth step, the voice data after the head transmission adjustment process in the fifth step Is converted into an audio signal and output.

The sound reproduction method according to a seventh aspect of the present invention is the sound reproduction method according to the sixth aspect, in which the effect of the spontaneous otoacoustic emission is further added to the audio data after the first otoacoustic emission process in the third step. A sixth step of performing an otoacoustic emission process is further included. In the sixth step, the effect of the spontaneous otoacoustic emission is added to the audio data, a sampling sound is added based on the user's latent memory, and the fourth step is performed. In this step, the audio data after the second otoacoustic emission processing in the sixth step is converted into an audio signal and output.

In the program according to the eighth aspect of the present invention, a first otoacoustic emission processing means for adding an effect of evoked otoacoustic emission and distortion component otoacoustic emission to input audio data, and the first The sound data that has been processed by the single ear sound radiation processing means is made to function as sound output means that converts the sound data into a sound signal and outputs the sound signal, and the first ear sound radiation processing means further has a predetermined frequency band of the sound data. Frequency adjustment processing means for adjusting the volume based on distance data obtained by measuring the distance to the actual object , sound pressure adjusting means for adjusting the sound pressure of the audio data based on the distance data, It functions as amplitude adjustment processing means for adjusting the amplitude of the audio data to compensate and amplify the decrease in volume, and delay adjustment processing means for adding a 10 ms delay effect to the audio data.
In the program according to the ninth aspect of the present invention, in the eighth aspect, the sound data after processing by the first otoacoustic emission processing means is performed on the user's head based on a predetermined head-related transfer function. It also functions as head transmission adjustment processing means for adjusting the transmission delay of the voice until the voice output means converts the voice data processed by the head transmission adjustment processing means into a voice signal and outputs it.
In the program according to the tenth aspect of the present invention, in the ninth aspect, the second otoacoustic emission process further adds the effect of the spontaneous otoacoustic emission to the audio data processed by the first otoacoustic emission processing means. The second otoacoustic emission processing means further includes a spontaneous otoacoustic emission processing means for adding the effect of the spontaneous otoacoustic emission to the audio data, and a potential for adding the sampling sound based on the latent memory of the user. The sound output means functions as memory sound addition processing means, and converts the sound data processed by the second otoacoustic emission processing means into a sound signal and outputs the sound signal.

  According to the present invention, it is possible to provide a sound reproducing device, a sound reproducing method, and a program for reproducing three-dimensional sound with enhanced presence using the principle of otoacoustic emission.

It is a lineblock diagram of the sound reproduction device concerning a 1st embodiment of the present invention. It is a detailed block diagram of the 1st otoacoustic emission process part of the sound reproduction apparatus which concerns on 1st Embodiment of this invention. It is a flowchart which shows the process sequence of the sound reproduction by the sound reproduction apparatus which concerns on 1st Embodiment of this invention. It is a flowchart which shows the detailed process sequence of the 1st otoacoustic emission process of FIG. (A) is a characteristic diagram of input audio data, and (b) is a characteristic diagram of output audio data. It is a block diagram of the 1st otoacoustic emission process part of the sound reproduction apparatus which concerns on 2nd Embodiment of this invention. It is a flowchart which shows the detailed process sequence of the 1st otoacoustic emission process by the sound reproduction apparatus which concerns on 2nd Embodiment of this invention. It is a block diagram of the 2nd otoacoustic emission process part of the sound reproduction apparatus which concerns on 3rd Embodiment of this invention. It is a flowchart which shows the detailed process sequence of the 2nd ear sound emission process by the sound reproduction apparatus which concerns on 3rd Embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. The sound reproducing device according to the embodiment of the present invention is used for, for example, a head mounted display (HMD), a headphone, etc., and reproduces three-dimensional sound.

(First embodiment)

  FIG. 1 shows and describes the configuration of a sound reproduction device according to the first embodiment of the present invention.

  As shown in the figure, the sound reproduction device 1 is configured by a computer and includes a control unit 2 including a CPU (Central Processing Unit) and the like. A sound source 3 that outputs a sound source signal is connected to the control unit 2 via an A / D converter 4 or directly. When the sound source signal is an analog signal, it is converted into a digital signal by the A / D converter 4 and then input to the control unit 2. When the sound source signal is a digital signal, it is directly input to the control unit 2.

  The sound source 3 outputs audio signals related to the left and right stereo sound, and may be a storage medium (HDD, RAM, etc.) provided in the computer or an external storage medium (optical disk, USB memory, etc.). Of course, the sound source may be acquired via a communication environment such as the Internet.

  Further, the acceleration sensor 5 is connected to the control unit 2 via the A / D converter 6, the gyro sensor 7 is connected via the A / D converter 8, and the distance sensor 9 connects the A / D converter 10. The geomagnetic sensor 16 is connected via an A / D converter 17. A heart rate sensor 18 is also connected to the control unit 2. The control unit 2 is connected to an input unit 11 including an input device such as a keyboard and a mouse. Furthermore, a storage unit 15 is connected to the control unit 2. The storage unit 15 stores a program 19 executed by the control unit 2, and a database (hereinafter referred to as DB) 15a relating to a head related transfer function is also logically constructed.

  Then, the control unit 2 reads and executes the program 19 in the storage unit 15 to thereby execute a main control unit 2a, a noise reduction processing unit (noise reduction) 2b, a reverberant sound invalidation processing unit (reverb reduction) 2c, and frequency averaging. It functions as a processing unit (graphic equalizer) 2d, a first otoacoustic emission processing unit 2e, a head-related transmission adjustment processing unit 2f, a reverberation adjustment processing unit (reverb) 2g, and a second otoacoustic emission processing unit 2g.

  The output of the control unit 2 is connected to the audio output unit 14L via the D / A converter 12, and is connected to the audio output unit 14R via the D / A converter 13.

  In such a configuration, the acceleration sensor 5 is mounted on, for example, an HMD or a headphone, detects 360-degree acceleration of the user's head, and converts the acceleration signal into digital acceleration data by the A / D converter 6. After conversion, the data is input to the control unit 2. In the control unit 2, the main control unit 2a calculates the moving direction and moving amount of the head based on the acceleration data.

  The gyro sensor 7 is mounted on, for example, an HMD or headphones, detects the rotation angle of the user's head in the vertical and horizontal directions, and converts the angular velocity signal into digital acceleration by the A / D converter 8. After conversion to data, the data is input to the control unit 2. In the control unit 2, the main control unit 2a calculates the rotation angle of the head based on the angular velocity data. The acceleration sensor 5 and the gyro sensor 7 can be selectively used to detect rotation of the user's head, and any one of them may be mounted.

  The distance sensor 9 measures the distance to the actual object, and the sensor signal is converted into distance data by the A / D converter 10 and then input to the control unit 2. The distance data is used in various processes to be described later in order to enhance the sense of reality. Various sensors such as an infrared sensor, an ultrasonic sensor, a distance measuring sensor, a laser, or a sound wave sensor can be used as the distance sensor 9. Of course, when the distance sensor 9 is not provided, data may be input from the input unit 11. Here, the actual object is a main body that generates sound or the like. For example, in the case of a concert venue, the musician on the stage is the actual object.

  The geomagnetic sensor 16 outputs azimuth data, and the azimuth data output via the A / D converter 17 is input to the control unit 2. The direction data is used for recognizing the direction of movement of the user's head. By using the geomagnetic sensor 16 in combination with the above-described gyro sensor 7, the azimuth and angular velocity in three axes can be obtained.

  The heart rate sensor 18 outputs heart rate data related to the user's heart rate, and the output heart rate data is input to the control unit 2.

  The input unit 11 inputs various setting data. Ambience data can be input as setting data. The ambience data is data for determining how much reverberation sound is added, and preset data may be selectively input according to the size of the space. The preset data may be finely adjusted by the user. Further, distance data may be input from the input unit 11. Based on each sensor output mentioned above and the input data of the input part 11, a stereophonic sound is produced | generated by processing left and right stereo sound so that it may mention later.

  In the control unit 2, each unit operates as follows. The noise reduction processing unit 2b performs noise reduction processing on the audio data related to the input stereo sound. The reverberant sound invalidation processing unit 2c invalidates the sound data related to the stereo sound when there is an element of the reverberant sound. The frequency averaging processing unit 2d changes the frequency characteristics of the audio data and averages the overall sound quality. That is, in the audio data, the protruding portions are lowered, and the few are raised, and the overall sound frequency is averaged. This means averaging of sound pressure by frequency.

  Subsequently, the first otoacoustic emission processing unit 2e adds the effects of evoked otoacoustic emission (TEOAE) and distortion component otoacoustic emission (DPOAE) to audio data related to stereo sound.

  More specifically, as shown in FIG. 2, the first otoacoustic emission processing unit 2e includes a frequency adjustment processing unit (parametric equalizer) 20, a sound pressure adjustment processing unit (compressor) 21, an amplitude adjustment processing unit (amplifier). ) 22 and a delay adjustment processing unit (delay) 23.

  In the first otoacoustic emission processing unit 2e, the frequency adjustment processing unit 20 adjusts the volume of a predetermined frequency band (5.28 Hz to 20 KHz) of audio data related to stereo sound based on the distance data. This is to add the effect of evoked otoacoustic emission, and based on the distance data, processing is performed so that the volume increases as the distance approaches.

  The sound pressure adjusting unit 21 adjusts the sound pressure of the sound data related to the stereo sound based on the distance data. For example, when the volume exceeds the threshold, the maximum volume of the volume that has changed is reduced by suppressing the excess volume with the set compression ratio and releasing it within the set time. Thereby, the dynamic range of the maximum volume and the minimum volume is compressed. This adds an effect of evoked otoacoustic emission, and the sound pressure adjusting unit 21 lowers the sound pressure as the distance is longer and increases the sound pressure as the distance is closer based on the distance data.

  For example, in this example, the amplitude adjustment processing unit 22 adjusts the amplitude from 10 dB to 20 dB based on the distance data. This means that the volume is reduced as a whole by the sound pressure adjustment, so that the reduced amount is compensated and amplified. This means adding the effects of both evoked otoacoustic emission and distortion component otoacoustic emission. The amplitude adjustment processing unit 22 has an arbitrary configuration.

  The delay adjustment processing unit 23 adds a 10 ms delay effect to audio data related to stereo sound. As described above, evoked otoacoustic emission is an acoustic reaction in which a signal is detected with a delay of about 10 ms with respect to an input voice stimulus, and means that such an effect is realized in a pseudo manner. To do.

  Returning to FIG. 1, subsequently, the head-related transmission adjustment processing unit 2f adjusts the transmission delay of the sound to the head based on the head-related transfer function. Here, the head-related transfer function (HRTF) represents a change in sound caused by peripheral objects including the ear shell, the human head and the shoulder as a transfer function. In this example, the right ear (R) and left ear (L) pairs are held in a table format in the DB 15a of the storage unit 15. The reason why the right ear and the left ear are separated from each other is that the sound arrival time differs depending on the head position. The head-related adjustment processing unit 2f performs adaptation by referring to the table and performing convolution calculation on the audio data by filtering based on the head-related transfer function corresponding to the depth of the auricle.

  The reverberant adjustment processing unit 2g adds a reverberant sound suitable for the space designated by the preset to the audio data. This reflects, for example, bounce sound from the boundary in the space in the audio data, and the magnitude of the reverberant sound to be added differs depending on the size of the space. In addition, as the time difference between the left and right audio data is smaller, a reverberant sound that assumes a larger space is added.

  The second otoacoustic emission processing unit 2h adds the effect of spontaneous otoacoustic emission (S0AE) to the audio data. Sampling sound or colored noise is added to the frequency band of 1 KHz to 2 KHz of the audio data. What kind of sampling sound and colored noise are added may be selected at a preset stage.

  The audio data relating to the stereophonic sound generated by the above processing is converted to an analog signal via the D / A converter 12 for the right ear and then output from the audio output unit 14R, and the audio data for the left ear is D / After being converted to an analog signal via the A converter 13, it is output from the audio output unit 14L. In this way, sound related to stereophonic sound is reproduced.

  Hereinafter, with reference to the flowchart of FIG. 3, a sound reproduction processing procedure performed by the sound reproduction device according to the first embodiment will be described. This procedure also corresponds to a sound reproduction method.

  When the audio signal related to the stereo sound from the sound source 3 is converted into audio data by the D / A converter 4 and inputted, and various setting information is inputted from the input unit 11 (S1), the noise reduction processing unit 2b Noise reduction processing is performed on the audio data related to the input stereo sound (S2). Then, the reverberant sound invalidation processing unit 2c invalidates the sound data related to the stereo sound when there is an element of the reverberant sound (S3). Subsequently, the frequency averaging processing unit 2d changes the frequency characteristics of the audio data and averages the overall sound quality (S4).

  Subsequently, the details of the processing of the first otoacoustic emission processing unit 2e will be described later with reference to FIG. 5, but the effects of evoked otoacoustic emission (TEOAE) and distortion component otoacoustic emission (DPOAE) are converted into audio data related to stereo sound. (S5).

  Subsequently, the head-related transfer adjustment processing unit 2f adjusts the transmission delay of the sound to the head based on the head-related transfer function (S6). More specifically, with reference to the table, adaptation is achieved by performing convolution calculation of audio data by filtering based on the head-related transfer function corresponding to the depth of the pinna.

  The reverberant adjustment processing unit 2g adds a reverberant sound suitable for the space designated by the preset to the audio data (S7). Then, the second otoacoustic emission processing unit 2h adds the effect of spontaneous otoacoustic emission (S0AE) to the audio data (S8). More specifically, sampling sound or colored noise is added to the frequency band of 1 KHz to 2 KHz of the audio data.

  Thus, the audio data for the right ear is converted to an analog signal via the D / A converter 12 and then output from the audio output unit 14R, and for the left ear is converted to an analog signal via the D / A converter 13. After the conversion, it is output from the audio output unit 14L (S9). With the above, a series of processes related to sound reproduction related to stereophonic sound is completed.

  Here, the flowchart of FIG. 4 shows and describes the detailed processing procedure of the first otoacoustic emission processing executed in step S4 of FIG.

  First, the frequency adjustment processing unit 20 adjusts the volume of a predetermined frequency band (5.28 Hz to 20 KHz) of audio data related to stereo sound based on the distance data. This is to add the effect of evoked otoacoustic emission, and based on the distance data, processing is performed so that the volume increases as the distance approaches (S11).

  Subsequently, the sound pressure adjusting unit 21 adjusts the sound pressure of the sound data related to the stereo sound based on the distance data (S12). That is, based on the distance data, the sound pressure adjustment unit 21 artificially reflects the effect of evoked otoacoustic emission in the sound data by lowering the sound pressure as the distance is longer and increasing the sound pressure as the distance is closer. Let

  Next, the amplitude adjustment processing unit 22 compensates and amplifies the overall decrease in volume by adjusting the amplitude of, for example, 10 dB to 20 dB based on the distance data (S13). That is, the effects of both evoked otoacoustic emission and distortion component otoacoustic emission are reflected in the audio data.

  Then, the delay adjustment processing unit 23 adds a 10 ms delay effect to the audio data related to the stereo sound (S14). This reflects in the audio data the acoustic response of the evoked otoacoustic emission that a signal is detected with a delay of around 10 ms with respect to the input audio stimulus. Thus, the process returns to step S6 and subsequent steps in FIG.

  Here, FIG. 5A is a characteristic diagram of input voice data, and FIG. 5B is a characteristic chart of output voice data. FIG. 5A is a diagram in which physical parameters related to OAE are dynamically changed with respect to the input voice data shown in FIG. 5A to simulate an auditory structure in human spatial recognition and induce an illusion. Audio data as shown in 5 (b) is output. It is possible to perceive more realistic 3D sound compared to binaural sound.

  As described above, according to the first embodiment of the present invention, it is possible to reproduce realistic 3D sound by artificially reflecting the effect of otoacoustic emission on the input audio data. It becomes possible. Moreover, since the effects of evoked otoacoustic emission (TEOAE), spontaneous otoacoustic emission (SOAE), and distortion component otoacoustic emission (DPOAE) can be experienced as otoacoustic emission, the sense of reality is further increased. In addition to the effect of otoacoustic emission, adjustment based on head transmission is also performed, so that more realistic 3D sound reproduction can be realized.

(Second Embodiment)

  The sound reproducing apparatus according to the second embodiment of the present invention is different from the first embodiment in the configuration of the first otoacoustic emission processing unit 2e. Although details will be described later, the frequency adjustment processing is performed using heartbeat data based on psychoacoustics. Since other configurations are the same as those of the first embodiment, the same components as those in FIGS. 1 and 2 are denoted by the same reference numerals, and different portions will be mainly described.

  FIG. 6 illustrates a detailed configuration of the first otoacoustic emission processing unit 2e of the control unit 2 of the sound reproducing device according to the second embodiment of the present invention.

  As shown in the figure, the first otoacoustic emission processing unit 2e includes a first frequency adjustment processing unit (parametric equalizer) 30, a second frequency adjustment processing unit (parametric equalizer) 31, and a sound pressure adjustment processing unit (compressor). 32, an amplitude adjustment processing unit (amplifier) 33, and a delay adjustment processing unit (delay) 34.

  In the first otoacoustic emission processing unit 2e, the first frequency adjustment processing unit 30 adjusts the volume of a predetermined frequency band (500 Hz to 20 KHz) of audio data related to stereo sound based on the distance data. This is to add the effect of evoked otoacoustic emission, and based on the distance data, processing is performed so that the volume increases as the distance approaches.

  The second frequency adjustment processing unit 31 adjusts the volume of a predetermined frequency band (400 Hz to 10 KHz) of audio data related to stereo sound based on heartbeat data based on the concept of acoustic psychology. This is based on acoustic psychology, comparing the heart rate data with a reference value, and if there is an edge in the heart rate, recognizes that there is a user psychological change, and increases the volume of the predetermined frequency so as to further promote To raise. Acoustic psychology has various psychological effects on human perception of sound by changing the physical parameters of the sound.

  The sound pressure adjusting unit 32 adjusts the sound pressure of the sound data related to the stereo sound based on the distance data. For example, when the volume exceeds the threshold, the maximum volume of the volume that has changed is reduced by suppressing the excess volume with the set compression ratio and releasing it within the set time. Thereby, the dynamic range of the maximum volume and the minimum volume is compressed. This adds an effect of evoked otoacoustic emission, and the sound pressure adjusting unit 21 lowers the sound pressure as the distance is longer and increases the sound pressure as the distance is closer based on the distance data.

  For example, in this example, the amplitude adjustment processing unit 33 adjusts the amplitude from 10 dB to 20 dB based on the distance data. This means that the volume is reduced as a whole by the sound pressure adjustment, so that the reduced amount is compensated and amplified. This means adding the effects of both evoked otoacoustic emission and distortion component otoacoustic emission. The amplitude adjustment processing unit 33 has an arbitrary configuration.

  The delay adjustment processing unit 34 adds a 10 ms delay effect to audio data related to stereo sound. As described above, evoked otoacoustic emission is an acoustic reaction in which a signal is detected with a delay of about 10 ms with respect to an input voice stimulus, and means that such an effect is realized in a pseudo manner. To do.

  The processing procedure by the sound reproducing device according to the second embodiment is substantially the same as that in FIG. 3, and only the first otoacoustic emission processing in step S5 in FIG. 3 is different. Therefore, referring to FIG. Only the processing procedure of the first otoacoustic emission processing according to the form will be described.

  First, the first frequency adjustment processing unit 30 adjusts the volume of a predetermined frequency band (5.28 Hz to 20 KHz) of audio data related to stereo sound based on the distance data. This is to add the effect of evoked otoacoustic emission, and based on the distance data, processing is performed so that the volume increases as the distance approaches (S21).

  Subsequently, the second frequency adjustment processing unit 31 adjusts the volume of a predetermined frequency band (400 Hz to 10 KHz) of the audio data related to the stereo sound based on the heartbeat data based on the concept of acoustic psychology (S22).

  Then, the sound pressure adjusting unit 32 adjusts the sound pressure of the sound data related to the stereo sound based on the distance data (S23). That is, the sound pressure adjustment unit 32 reflects the effect of evoked otoacoustic emission on the sound data in a pseudo manner by lowering the sound pressure as the distance is longer and increasing the sound pressure as the distance is closer based on the distance data. Let

  Next, the amplitude adjustment processing unit 33 compensates and amplifies the overall decrease in volume by adjusting the amplitude of, for example, 10 dB to 20 dB based on the distance data (S24). That is, the effects of both evoked otoacoustic emission and distortion component otoacoustic emission are reflected in the audio data.

  Then, the delay adjustment processing unit 34 adds a 10 ms delay effect to the audio data related to the stereo sound (S25). This reflects in the audio data the acoustic response of the evoked otoacoustic emission that a signal is detected with a delay of around 10 ms with respect to the input audio stimulus. Thus, the process returns to step S6 and subsequent steps in FIG.

  As described above, according to the second embodiment of the present invention, in addition to the effects of the first embodiment described above, an acoustic effect based on psychoacoustics can be imparted.

(Third embodiment)

  The sound reproducing device according to the third embodiment of the present invention is different from the first embodiment in the configuration of the second otoacoustic emission processing unit 2h. Although details will be described later, the presence of a latent memory sound enhances the sense of reality. Since other configurations are the same as those of the first embodiment, the same components as those in FIGS. 1 and 2 are denoted by the same reference numerals, and different portions will be mainly described. The latent memory sound refers to a universal environmental sound that is conventionally masked in the auditory sense, and is added and changed as a sampling sound. This promotes priming effects in sound perception and encourages psychological changes.

  FIG. 8 shows a detailed configuration of the second otoacoustic emission processing unit 2h of the control unit 2 of the sound reproducing device according to the second embodiment of the present invention.

  As shown in the figure, the second otoacoustic emission processing unit 2h is composed of a spontaneous otoacoustic emission processing unit 40 and a latent memory sound addition processing unit 41.

  In such a configuration, in the second otoacoustic emission processing unit 2h, the spontaneous otoacoustic emission processing unit 40 adds the effect of the spontaneous otoacoustic emission (S0AE) to the audio data. Sampling sound or colored noise is added to the frequency band of 1 KHz to 2 KHz of the audio data. What kind of sampling sound and colored noise are added may be selected at a preset stage. Then, the latent memory sound addition processing unit 41 adds a sampling sound based on the latent memory. This is because, for example, in the outdoor stage of the plateau, you can enjoy the music of the musicians on the stage while feeling the sound of the wind, but by adding such potentially perceived sound as a sampling sound, The presence can be enhanced.

  The processing procedure by the sound reproducing device according to the third embodiment is substantially the same as that in FIG. 3 and only the second otoacoustic emission processing in step S8 in FIG. 3 is different, so the third embodiment will be described below with reference to FIG. Only the processing procedure of the second otoacoustic emission processing according to the form will be described.

  In this process, first, the spontaneous otoacoustic emission processing unit 40 adds the effect of the spontaneous otoacoustic emission (S0AE) to the audio data (S31). Then, the latent memory sound addition processing unit 41 adds a sampling sound based on the latent memory (S32). Thus, the processing returns to step S9 and subsequent steps in FIG.

  As described above, according to the third embodiment of the present invention, in addition to the effects of the first embodiment, it is possible to further enhance the sense of reality by further adding a latent memory sound.

  The embodiment of the present invention has been described above, but the present invention is not limited to this, and it is needless to say that various improvements and modifications can be made without departing from the spirit of the present invention. For example, it is realizable also as an apparatus which combined 2nd Embodiment and 3rd Embodiment.

  DESCRIPTION OF SYMBOLS 1 ... Sound reproduction apparatus, 2 ... Control part, 2a ... Main control part, 2b ... Noise reduction process part, 2c ... Reverberation sound invalidation process part, 2d ... Frequency averaging process part, 2e ... 1st ear sound radiation process part 2f ... head transmission adjustment processing unit, 2g ... reverberation sound adjustment processing unit, 2h ... second otoacoustic emission processing unit, 3 ... sound source, 4 ... A / D conversion unit, 5 ... acceleration sensor, 6 ... A / D Conversion unit, 7 ... Gyro sensor, 8 ... A / D conversion unit, 9 ... Distance sensor, 10 ... A / D conversion unit, 11 ... Input unit, 12 ... D / A conversion unit, 13 ... D / A converter, 14L, 14R ... audio output unit, 15 ... storage unit, 16 ... geomagnetic sensor, 17 ... A / D converter, 18 ... heart rate sensor, 19 ... program, 20 ... frequency adjustment processing unit, 21 ... sound pressure adjustment processing unit, 22 ... Amplitude adjustment processing unit, 23 ... Delay adjustment processing unit, 30 ... First frequency adjustment processing unit, 31 ... Second Wave number adjustment processing unit, 32 ... sound pressure adjustment unit, 33 ... amplitude adjustment processing section, 34 ... delay adjusting section, 40 ... spontaneous otoacoustic emissions processing unit, 41 ... implicit memory sound adding section.

Claims (10)

A distance sensor that measures the distance to the actual object and obtains distance data;
First otoacoustic emission processing means for adding effects of evoked otoacoustic emission and distortion component otoacoustic emission to the input audio data;
Voice output means for converting the voice data after processing by the first otoacoustic emission processing means into a voice signal and outputting the voice signal;
The first otoacoustic emission processing means includes:
Frequency adjustment processing means for adjusting the volume of a predetermined frequency band of the audio data based on the distance data;
Sound pressure adjusting means for adjusting the sound pressure of the voice data based on the distance data;
Amplitude adjustment processing means for adjusting the amplitude of the audio data to compensate and amplify the decrease in volume;
A sound reproduction apparatus comprising: delay adjustment processing means for adding a delay effect of 10 ms to the audio data. The audio data after processing by the first otoacoustic emission processing means further includes head transmission adjustment processing means for adjusting a transmission delay of the sound to the user's head based on a predetermined head transfer function. ,
The sound reproduction device according to claim 1, wherein the sound output unit converts the sound data processed by the head transmission adjustment processing unit into a sound signal and outputs the sound signal. The audio data after processing by the first otoacoustic emission processing means further includes second otoacoustic emission processing means for further adding an effect of spontaneous otoacoustic emission,
The second otoacoustic emission processing means includes a spontaneous otoacoustic emission processing means for adding the effect of the spontaneous otoacoustic emission to the audio data, and a latent memory sound addition processing means for adding a sampling sound based on the user's latent memory. Have
The sound reproduction device according to claim 1, wherein the sound output unit converts sound data after processing by the second otoacoustic emission processing unit into a sound signal and outputs the sound signal. The sound reproduction device according to claim 1, wherein the first otoacoustic emission processing means enhances a psychological effect by adjusting a volume of a predetermined frequency band based on heartbeat data. A first step of measuring the distance to the real object and obtaining distance data;
A second step for receiving input of voice data;
A third step of performing a first otoacoustic emission process for adding the effects of evoked otoacoustic emission and distortion component otoacoustic emission to the input audio data;
A fourth step of converting the sound data subjected to the first otoacoustic emission process into a sound signal and outputting the sound signal;
In the third step, the volume of a predetermined frequency band of the audio data is adjusted based on the distance data, the sound pressure of the audio data is adjusted based on the distance data, and the amplitude of the audio data is adjusted A sound reproduction method for compensating and amplifying a decrease in volume and adding a 10 ms delay effect to the audio data. For the audio data after the first otoacoustic emission process in the third step, a head transmission adjustment process for adjusting a transmission delay of the sound to the user's head is performed based on a predetermined head transfer function. And further comprising a fifth step,
The sound reproduction method according to claim 5, wherein in the fourth step, the sound data after the head transmission adjustment processing in the fifth step is converted into a sound signal and output. The audio data after the first otoacoustic emission process in the third step further includes a sixth step of performing a second otoacoustic emission process for further adding the effect of spontaneous otoacoustic emission,
In the sixth step, the effect of the spontaneous otoacoustic emission is added to the audio data, the sampling sound is added based on the user's latent memory,
The sound reproduction method according to claim 5, wherein in the fourth step, the sound data after the second otoacoustic emission processing in the sixth step is converted into an audio signal and output. Computer
First otoacoustic emission processing means for adding effects of evoked otoacoustic emission and distortion component otoacoustic emission to input audio data, and audio data processed by the first otoacoustic emission processing means as audio Function as audio output means to convert to signal and output,
The first otoacoustic emission processing means further includes:
Frequency adjustment processing means for adjusting the volume of the predetermined frequency band of the audio data based on distance data obtained by measuring the distance to the actual object ;
Sound pressure adjusting means for adjusting the sound pressure of the voice data based on the distance data;
Amplitude adjustment processing means for adjusting the amplitude of the audio data to compensate and amplify the decrease in volume;
A program that functions as delay adjustment processing means for adding a delay effect of 10 ms to the audio data. The voice data after processing by the first otoacoustic emission processing means also functions as a head-related transmission adjustment processing means for adjusting the transmission delay of the voice to the user's head based on a predetermined head-related transfer function. And
The program according to claim 8, wherein the sound output unit converts the sound data processed by the head transmission adjustment processing unit into a sound signal and outputs the sound signal. The sound data after processing by the first otoacoustic emission processing means functions as a second otoacoustic emission processing means for further adding the effect of spontaneous otoacoustic emission,
The second otoacoustic emission processing means further includes a spontaneous otoacoustic emission processing means for adding the effect of the spontaneous otoacoustic emission to the audio data, and a latent memory sound addition processing means for adding a sampling sound based on the user's latent memory. Function as
The program according to claim 8, wherein the sound output unit converts the sound data processed by the second otoacoustic emission processing unit into a sound signal and outputs the sound signal.