JP6773876B2 - Input / output device - Google Patents

Description

The present invention relates to an input / output device used for a voice recognition device or the like that recognizes a spoken voice.

In recent years, many in-vehicle devices, mobile devices, and the like have a built-in voice recognition device (voice recognition function) so that they do not need to operate buttons or the like and can be easily operated only by voice.

In this type of voice recognition device, the processing result corresponding to the input voice is output as a response with the display information such as voice information and images, and the response such as the acceptance of the input and the recognition result is output to the input voice. Output as voice information or display information. Such a response method has always been performed by a predetermined method such as a constant voice level and a constant brightness without considering the surrounding situation of the speaker.

As an example of the method of operating the voice recognition device in consideration of the surrounding situation of the speaker, the method described in Patent Document 1 can be mentioned. The voice recognition device described in Patent Document 1 amplifies the input voice level according to the usage state of the portable information terminal device to an appropriate level, and makes it possible to prevent a decrease in the recognition rate.

Japanese Patent No. 4299768

In a conventional voice recognition device, the speaker always responds in a fixed manner without considering the surrounding situation of the speaker, so that the speaker does not want or can see the contents of the response to the surrounding people. If I didn't want to, I couldn't handle it and had to refrain from using the voice recognition device. Therefore, in such a situation, there is a problem that it is inconvenient to operate with a button or the like.

The voice recognition device described in Patent Document 1 controls the input voice level in order to prevent a decrease in the recognition rate, and does not consider the response from the voice recognition device as described above.

Therefore, in view of the above-mentioned problems, it is an object of the present invention to provide, for example, an input / output device capable of changing and outputting a response to an input according to a surrounding situation.

In order to solve the above problems, the invention according to claim 1 includes an audio output unit that outputs audio and an audio output unit.
A display unit that displays an image, an utterance voice signal output unit that outputs the user's utterance voice as a voice signal to the voice recognition means, and a response information acquisition unit that acquires response information according to the recognition result of the voice recognition means. When the voice level of the voice signal is lower than the predetermined voice level, the control unit that does not output the voice based on the response information by the voice output unit and displays the image based on the response information by the display unit. It is characterized by having.

The invention according to claim 4 is an input / output method executed by an input / output device including a voice output unit and a display unit, which comprises a voice signal output step of outputting a user's voice as a voice signal to a voice recognition means. , The response information acquisition step of acquiring the response information according to the recognition result of the voice recognition means, and when the voice level of the voice signal is smaller than the predetermined voice level, the voice based on the response information is output as the voice. It is characterized by including a control step of displaying an image based on the response information by the display unit without being output by the unit.

The invention according to claim 5 is an input / output program executed by a computer of an input / output device including a voice output unit and a display unit, and outputs the computer to a voice recognition means as a voice signal of a user's spoken voice. Spoken voice signal output unit, response information acquisition unit that acquires response information according to the recognition result of the voice recognition means, and response information when the voice level of the voice signal is smaller than a predetermined voice level. It is characterized in that it functions as a control unit that does not output the voice based on the above by the voice output unit and displays an image based on the response information by the display unit.

The invention according to claim 6 is characterized in that the input / output program according to claim 5 is stored.

It is a block diagram of the input / output device which concerns on 1st Example of this invention. It is a flowchart of the operation of the input / output device shown in FIG. It is a block diagram of the input / output device which concerns on 2nd Embodiment of this invention. It is a flowchart of the operation of the input / output device shown in FIG. It is a block diagram of the input / output device which concerns on another Example of this invention. It is a block diagram of the input / output device which concerns on another Example of this invention.

Hereinafter, an input / output device according to an embodiment of the present invention will be described. The input / output device according to the embodiment of the present invention includes a first sound collecting means for collecting the spoken input sound and a first output means for outputting the input sound collected by the first sound collecting means to the voice recognition means. A response acquisition means for acquiring a response from the voice recognition means, and a second output means for outputting the response acquired by the response acquisition means. Then, a voice level comparing means and a voice level comparing means that detect the input voice level which is the voice level of the input voice collected by the first sound collecting means and compare the input voice level with a predetermined voice level. Further has a control means for changing the output of the second output means so that the response is difficult to be recognized from the surroundings when the input voice level compared with is smaller than the predetermined voice level. By doing so, when the voice level of the input voice is low, it is determined that the voice recognition response is not desired to be heard or seen by the surroundings, and the output of the second output means is recognized from the surroundings. It can be changed to make it difficult. Therefore, the response to the input can be changed and output according to the surrounding situation.

Further, the second output means has a voice output means that outputs a response as a sound, and the control means outputs the response from the voice output means when the result of comparison by the voice level comparison means is smaller than a predetermined voice level. The sound produced may be reduced. By doing so, it is possible to reduce the sound output from the voice output means such as a speaker when it is not desired to hear the voice recognition response to the surroundings.

Further, the second output means further includes a display means for displaying the response as an image, and the control means displays the display means when the result of comparison by the voice level comparison means is smaller than a predetermined voice level. The sound output from the audio output means may be reduced while being stopped. By doing so, when both the audio output means and the display means are provided, the display of the display means can be stopped and the sound output from the audio output means such as a speaker can be reduced and output.

Further, the second output means further has an output interface for outputting the response as sound from the external voice output means, and the control means means that the result of comparison by the voice level comparison means is smaller than a predetermined voice level. In addition, the response may be output only to the output interface. By doing so, when it is not desired to hear the voice recognition response from the surroundings, the sound can be output only from an external voice output means such as an earphone.

Further, the second output means has a display means for displaying the response as an image, and the control means recognizes the image from the surroundings when the result of comparison by the voice level comparison means is smaller than a predetermined voice level. The display of the display means may be changed so as to make it difficult. By doing so, it is possible to change, for example, the brightness and viewing angle of a display means such as a liquid crystal display when it is not desired to see the voice recognition response in the surroundings.

Further, the second output means further includes a voice output means that outputs a response as a sound, and the control means of the voice output means when the result of comparison by the voice level comparison means is smaller than a predetermined voice level. The output may be stopped and the display of the display means may be changed so that the image is difficult to recognize from the surroundings. By doing so, when both the audio output means and the display means are provided, the sound output from the audio output means can be stopped to make it difficult to recognize the display of the display device.

Further, the input / output device according to the embodiment of the present invention includes a first sound collecting means for collecting the spoken input sound, a second sound collecting means for collecting ambient sounds other than the input sound, and a first collection. The first output means for outputting the input sound collected by the sound means to the voice recognition means, the ambient sound level detecting means for detecting the ambient sound level which is the sound level of the ambient sound collected by the second sound collecting means, and the ambient sound level detecting means. It has a response acquisition means for acquiring a response from the voice recognition means, and a second output means for outputting the response acquired by the response acquisition means. Then, the ratio calculation means that detects the input voice level, which is the voice level of the input voice collected by the first sound collecting means, and calculates the ratio between the input voice level and the ambient sound level detected by the ambient sound level detecting means. Further, when the ratio calculated by the ratio calculating means is smaller than a predetermined value, the control means for changing the output of the second output means so that the response is difficult to be recognized from the surroundings is further provided. ing. By doing so, the surrounding situation of the speaker can be judged from the ratio of the input voice and the ambient sound. In other words, if the ratio of the spoken input voice level to the ambient sound level (S / N ratio) is small, it can be determined that there are many people around and the utterance is made in a small voice. You can change the output of the output means as you do not want to be heard or seen by.

Further, the input / output method according to the embodiment of the present invention is an input / output method in an input / output device that outputs a response from the voice recognition means to the spoken input voice, and is a first input / output method for collecting the input voice. The input voice level compared in the voice level comparison step and the voice level comparison step of detecting the input voice level, which is the voice level of the voice collected by the sound collecting means, and comparing the input voice level with a predetermined voice level. It includes a control step of changing the output of the response so that the response of the speech recognition means is difficult to recognize from the surroundings when the level is smaller than a predetermined speech level. By doing so, when the voice level of the input voice is low, it is possible to determine that the voice recognition response is not heard or seen by the surroundings and change the output of the response. Therefore, the response to the input can be changed and output according to the surrounding situation.

Further, it may be configured as an input / output program in which the above-mentioned input / output method is executed by a computer. By doing so, when the voice level of the input voice is low using a computer, it is judged that the voice recognition response is not heard or seen by the surroundings, and the output of the response is changed. Can be made to. Therefore, the response to the input can be changed and output according to the surrounding situation.

Further, the above-mentioned voice recognition program may be stored in a computer-readable recording medium. By doing so, the program can be distributed as a single unit in addition to being incorporated in the device, and version upgrades and the like can be easily performed.

Further, the input / output method according to the embodiment of the present invention is an input / output method in an input / output device that outputs a response from the voice recognition means to the spoken input sound, and is a first input / output method for collecting the input sound. The input sound level, which is the sound level of the sound collected by the sound collecting means, is detected, and the ambient sound level, which is the sound level of the ambient sound collected by the second sound collecting means, is used to collect the ambient sound other than the input sound. When the ratio calculation step of detecting and calculating the ratio of the input voice level to the ambient sound level and the ratio compared in the ratio calculation step are smaller than a predetermined value, the response of the voice recognition means is recognized from the surroundings. It includes a control step that changes the output of the response so that it is difficult to do. By doing so, the surrounding situation of the speaker can be judged from the ratio of the input voice and the ambient sound. In other words, if the ratio of the spoken input voice level to the ambient sound level (S / N ratio) is small, it can be determined that there are many people around and the utterance is made in a small voice. You can change the output of the output means as you do not want to be heard or seen by.

Further, it may be configured as an input / output program in which the above-mentioned input / output method is executed by a computer. By doing so, when the S / N ratio is small, the computer is used to determine that the voice recognition response is not heard or seen by the surroundings, and the output of the response is changed. be able to. Therefore, the response to the input can be changed and output according to the surrounding situation.

Further, the above-mentioned voice recognition program may be stored in a computer-readable recording medium. By doing so, the program can be distributed as a single unit in addition to being incorporated in the device, and version upgrades and the like can be easily performed.

A voice recognition device having an input / output device according to a first embodiment of the present invention will be described with reference to FIGS. 1 and 2. As shown in FIG. 1, the voice recognition device 1 includes a microphone 2, a control device 3, and an external output device 4.

The microphone 2 as the first sound collecting means collects the voice (input voice) spoken by the user, converts it into an electric signal, and outputs the voice signal to the control device 3.

The control device 3 includes a level check unit 31, a voice recognition engine unit 32, and a use case determination unit 33. The control device 3 is composed of, for example, a microcomputer (microcomputer), a digital signal processor (DSP), an ASIC (Application Specific Integrated Circuit), or the like.

The level check unit 31 as the first output means and the voice level comparison means outputs the voice signal input from the microphone 2 to the voice recognition engine unit 32. That is, the input sound collected by the first sound collecting means is output to the voice recognition means. The level check unit 31 detects the level of the voice signal input from the microphone 2 and outputs it to the use case determination unit 33 as the input voice level. That is, the first sound collecting means detects the input voice level, which is the voice level of the input voice collected. The level of the audio signal in the present specification indicates the loudness of the target sound, for example, the maximum value or the average value of the amplitude of the audio signal.

The voice recognition engine unit 32 converts the voice signal input from the level check unit 31 into a digital signal and performs voice recognition processing (the level check unit 31 may convert the voice signal into a digital signal). The speech recognition process is not particularly limited as long as a known method such as a statistical method, a dynamic time expansion / contraction method, or a hidden Markov model is used. The voice recognition engine unit 32 outputs a response regarding the result of the voice recognition process to the external output device 4. The response regarding the result of the voice recognition process is not limited to the voice information and display information related to the response to the spoken voice content, but the voice information and display information indicating that the voice has been recognized, or the voice could not be recognized. It also includes voice information and display information indicating that, or voice information and display information prompting the input of the next command and the like.

Further, the voice recognition engine unit 32 outputs a command to another processing device (not shown) as a result of voice recognition. The other processing device is not limited to the one that is integrally configured with the voice recognition device 1, and may be detachably or wirelessly or wiredly communicated via a network or the like. In the case of the configuration shown in FIG. 1, since the voice recognition engine unit 32 is included in the control device 3, the voice recognition engine unit 32 is a response acquisition means for acquiring a response from the voice recognition means and the voice recognition means. Also serves as.

When the input voice level detected by the level check unit 31 is smaller than a predetermined voice signal level (predetermined voice level), the use case determination unit 33 as the voice level comparison means and the control means , It is determined that the private mode is a mode indicating a situation in which the surroundings do not want to hear or see the voice recognition response, and the external output device 4 is controlled to change to the output corresponding to the private mode. Output a signal. That is, the input voice level is compared with a predetermined voice level. Then, when the input voice level compared by the voice level comparing means is smaller than the predetermined voice level, the output of the second output means is changed so that the response is difficult to be recognized from the surroundings.

If the input voice level is small, the recognition rate in the voice recognition engine unit 32 may decrease. Therefore, the predetermined voice signal level is set within a range in which the recognition rate in the voice recognition engine unit 32 does not decrease. Is desirable. Alternatively, the voice recognition process may be performed after performing a process such as the process described in Patent Document 1 that reduces the influence of ambient noise.

In FIG. 1, the control device 3 includes, but is not limited to, the level check unit 31, the voice recognition engine unit 32, and the use case determination unit 33. For example, each may be composed of individual parts (microcomputer, DSP, ASIC, etc.).

The external output device 4 as the second output means has an audio output unit 41 as an audio output means and a display unit 42 as a display means. The voice output unit 41 includes a speaker that outputs the response input as voice information as voice among the responses related to the result of the voice recognition process output from the voice recognition engine unit 32, an amplifier that controls the volume output to the speaker, and the like. have. The display unit 42 displays a liquid crystal display or an organic EL (including text-only information) that displays the response input as the display information among the responses related to the result of the voice recognition process output from the voice recognition engine unit 32. Electro Luminescence) It has a display device such as a display and a driver circuit that controls the display of the display device. That is, the external output device 4 outputs the response acquired by the response acquisition means.

Then, when a control signal that causes the use case determination unit 33 to determine that it is in private mode and change the output is input, the audio output unit 41 uses an amplifier or the like to reduce the sound output from the speaker. To change. That is, when the result of comparison by the voice level comparing means is smaller than a predetermined voice level, the sound output from the voice output means is reduced. Further, the display unit 42 is controlled by a driver circuit so as to reduce the brightness of the display device. That is, when the result of comparison by the voice level comparing means is smaller than a predetermined voice level, the display of the display means is changed so that the image is difficult to recognize from the surroundings.

As is clear from the above description, the microphone 2, the level check unit 31, the use case determination unit 33, and the external output device 4 constitute the input / output device 10 according to the first embodiment of the present invention.

Next, the operation of the input / output device 10 having the above-described configuration will be described with reference to the flowchart of FIG. The flowchart shown in FIG. 2 is executed by the control device 3.

First, in step S11, the voice signal of the input voice is input from the microphone 2 to the level check unit 31, and the process proceeds to step S12.

Next, in step S12, the level check unit 31 detects the input voice level of the voice signal of the input voice input from the microphone 2 and outputs it to the use case determination unit 33, and proceeds to step S13.

Next, in step S13, the use case determination unit 33 compares the input audio level detected by the level check unit 31 with a predetermined audio signal level, and is smaller than the predetermined audio signal level (YES). In the case of), the process proceeds to step S14, and in the case of a predetermined audio signal level or higher (NO), the process proceeds to step S15. That is, in steps S12 and S13, it functions as a voice level comparison step.

Next, in step S14, since it is determined in step S13 that the audio signal level is lower than the predetermined audio signal level, the use case determination unit 33 changes the output of the external output device 4 so as to be difficult to recognize from the surroundings as a private mode. (Output control). Specifically, as described above, the audio output unit 41 changes the amplification factor of the amplifier or the like so that the sound output from the speaker becomes smaller than the default volume, and the display unit 42 determines the brightness of the display device. Let the driver circuit control the brightness to be lower than the default brightness. That is, this step functions as a control process. Here, the default volume and brightness are the volume and brightness in the initial state of the voice recognition device 1.

On the other hand, in step S15, since it was determined in step S13 that the level is equal to or higher than the predetermined level, the use case determination unit 33 sets the default volume and brightness as the normal mode. In other words, if the default volume and brightness were set before the execution of this step, they are not changed as they are. If the volume and brightness were lower than the default volume and brightness before this step was executed, the default volume and brightness are restored.

According to this embodiment, in the voice recognition device 1, the level check unit 31 detects the input voice level output from the microphone 2, and the use case determination unit 33 determines the detected input voice level in advance. Judge whether it is lower than the voice signal level of. When the input audio level is smaller than a predetermined audio signal level, the sound output from the speaker is reduced and the brightness of the display device is reduced. By doing so, when the input voice level is low, it is possible to judge that the response of voice recognition is not heard or seen by the surroundings, and the sound is reduced or the brightness is lowered. it can. Therefore, the response to the input can be changed and output according to the surrounding situation.

Next, the voice recognition device 1 according to the second embodiment of the present invention will be described with reference to FIGS. 3 and 4. The same parts as those in the first embodiment described above are designated by the same reference numerals, and the description thereof will be omitted.

In the input / output device 10 according to this embodiment, a microphone 5 is added to the voice recognition device 1 shown in FIG. The microphone 5 as the second sound collecting means does not collect the sound spoken by the user, but collects the surrounding sound (ambient sound) of the voice recognition device 1. That is, ambient sounds other than the spoken input voice are collected.

The level check unit 31 detects the level of the ambient sound collected by the microphone 5, and outputs the level of the audio signal (ambient sound level) to the use case determination unit 33. That is, the level check unit 31 functions as an ambient sound level detecting means for detecting the ambient sound level, which is the sound level of the ambient sound collected by the second sound collecting means.

The use case determination unit 33 calculates the ratio (S / N ratio) of the input sound level collected by the microphone 2 detected by the level check unit 31 to the ambient sound level. Here, the S / N ratio in this embodiment is a value obtained by dividing the input voice level by the ambient sound level (input voice level / ambient sound level). Then, when the calculated S / N ratio is smaller than a predetermined value determined in advance, it is determined that the mode is private, and a control signal is output to the external output device 4 so as to change the output to correspond to the private mode. That is, the use case determination unit 33 functions as a ratio calculation means.

That is, when the S / N ratio is small, it means that the ambient sound is relatively loud with respect to the user's utterance, so it can be inferred that the utterance is made in a low voice in a situation where there are many people around. .. Therefore, when the S / N ratio is small, it is determined that the response of the voice recognition engine unit 32 is not desired to be heard or seen by the surroundings, and the operation of the private mode is performed. The operation of the external output device 4 in the private mode is the same as that of the first embodiment. That is, the sound output from the speaker is reduced, and the brightness is lowered so that the image displayed on the display device is difficult to recognize from the surroundings.

Next, the operation of the voice recognition device 1 in this embodiment will be described with reference to the flowchart of FIG. The flowchart shown in FIG. 4 is executed by the control device 3.

First, in step S21, the audio signal is input from the microphone 2 and the microphone 5 to the level check unit 31, and the process proceeds to step S12.

Next, in step S22, the level check unit 31 detects the input audio level of the audio signal input from the microphone 2, detects the ambient sound level of the audio signal input from the microphone 5, and determines each use case. Output to unit 33, and the process proceeds to step S23.

Next, in step S23, the use case determination unit 33 calculates the ratio (S / N ratio) between the input voice level and the ambient sound level detected by the level check unit 31, and the S / N ratio is from a predetermined value. If it is small (YES), the process proceeds to step S24, and if it is equal to or more than a predetermined value (NO), the process proceeds to step S25. That is, in steps S22 and S23, it functions as a ratio calculation step.

Step S24 and step S25 are the same as steps S14 and S15 of FIG.

According to this embodiment, in the voice recognition device 1, the level check unit 31 detects the input sound level and the ambient sound level (ambient sound level) output from the microphone 5, and the use case determination unit 33 determines the input sound. It is determined whether or not the ratio of the level to the ambient sound level (S / N ratio) is smaller than a predetermined value. When the S / N ratio is smaller than a predetermined value, for example, the sound output from the speaker is reduced and the brightness of the display device is reduced. By doing so, when the S / N ratio is small, it is possible to reduce the sound or reduce the brightness by judging that the response of the voice recognition is not heard or seen by the surroundings. it can. Therefore, the response to the input can be changed according to the surrounding situation.

In the above two embodiments, the brightness of the display device included in the display unit 42 is reduced to make it difficult for the displayed image to be recognized from the surroundings. However, the present invention is not limited to this, for example, the display device. The viewing angle may be narrowed. In this case, for example, a filter or the like that changes the polarization direction by changing the orientation state of the liquid crystal by applying a voltage to the liquid crystal element may be provided on the surface of the display device.

Further, in the above-mentioned two embodiments, the control of both the audio output unit 41 and the display unit 42 is changed, but only one of them may be used.

Further, in the case where both the speaker (audio output unit 41) and the display device (display unit 42) are provided as in the second embodiment described above, when the private mode is determined, the display device is displayed. You may stop (turn off the screen) to reduce the sound output by the speaker. Alternatively, conversely, the output of sound from the speaker may be stopped to reduce the brightness of the display device or narrow the viewing angle. That is, when both the voice output means and the display means are provided, stopping one of the operations is also included in changing the output so that the response is difficult to be recognized from the surroundings.

Further, the voice recognition engine unit 32 is not limited to the form included in the control device 3 as shown in FIGS. 1 and 3, and is provided in, for example, an external server or the like that communicates wirelessly or by wire via a network or the like. May be good. An example thereof is shown in FIG. In FIG. 5, the control device 3 is provided with a communication unit 34. The communication unit 34 outputs the voice signal input from the level check unit 31 to the voice recognition engine unit 21 provided in the server 20 connected to the Internet 30. Then, the communication unit 34 outputs the response input from the voice recognition engine unit 21 to the external output device 4, another processing device, or the like. In the case shown in FIG. 5, the communication unit 34 functions as the first output means and the response acquisition means.

Further, as shown in FIG. 6, a terminal for connecting an external audio output means 6 such as earphones and headphones, a circuit, an antenna, and the like for wireless communication between the external audio output means 6 and Bluetooth (registered trademark) and the like. It may have an output interface 43 of.

The output interface 43 shown in FIG. 6 can be switched by the audio output unit 41 and the changeover switch 44. That is, when earphones or headphones are connected, the changeover switch 44 is switched to the output interface 43 side so that no sound is output from the speaker of the audio output unit.

In the case of having the output interface 43 shown in FIG. 6, when it is determined that the mode is private, the display of the display device is stopped, and the sound (voice signal) applied to the response of the voice recognition engine unit 32 only from the output interface. ) May be output. By doing so, when it is not desired to see the voice recognition response in the surroundings, it is possible to output only the sound from an external voice output means such as earphones or headphones.

Further, if the level check unit 31 and the use case determination unit 33 are configured by a computer such as a microcomputer and the flowcharts shown in FIGS. 2 and 4 are used as computer programs, they can be configured as input / output programs.

Further, the present invention is not limited to the above examples. That is, those skilled in the art can carry out various modifications according to conventionally known knowledge within a range that does not deviate from the gist of the present invention. As long as the input / output device of the present invention is still provided by such modification, it is, of course, included in the category of the present invention.

2 Microphone (1st sound collecting means)
31 Level check unit (first output means, voice level comparison means, ambient sound level detection means)
32 Speech recognition engine (response acquisition means)
33 Use case judgment unit (voice level comparison means, control means, ratio calculation means)
4 External output device (second output means)
41 Audio output unit (second output means, audio output means)
42 Display unit (second output means, display means)
5 Microphone (second sound collecting means)
6 External audio output means 10 Input / output device S12 Level check (audio level comparison process)
S13 Less than the predetermined voice signal level (voice level comparison process)
S14 Private mode (control process)
S22 level check (ratio calculation process)
S23 Smaller than the specified value (ratio calculation process)
S24 Private mode (control process)

Claims (6)

An audio output unit that outputs audio and
A display unit that displays images and
An utterance voice signal output unit that outputs the user's utterance voice as a voice signal to the voice recognition means,
A response information acquisition unit that acquires response information according to the recognition result of the voice recognition means, and
When the voice level of the voice signal is lower than the predetermined voice level, the control unit that does not output the voice based on the response information by the voice output unit and displays the image based on the response information by the display unit. When,
An input / output device characterized by being provided with. When the voice level of the voice signal is equal to or higher than the predetermined voice level, the control unit causes the voice output unit to output voice based on the response information, and the display unit outputs an image based on the response information. The input / output device according to claim 1, wherein the input / output device is displayed. The utterance voice signal output unit outputs the voice signal to the voice recognition means provided in the external server device.
The input / output device according to claim 1 or 2, wherein the response information acquisition unit acquires the response information from the server device. It is an input / output method executed by an input / output device having an audio output unit and a display unit.
The utterance voice signal output process that outputs the user's utterance voice as a voice signal to the voice recognition means,
A response information acquisition step of acquiring response information according to the recognition result of the voice recognition means, and
When the voice level of the voice signal is smaller than the predetermined voice level, the control step of not outputting the voice based on the response information by the voice output unit and displaying the image based on the response information by the display unit. When,
An input / output method characterized by including. An input / output program executed by a computer of an input / output device having an audio output unit and a display unit.
The computer
An utterance voice signal output unit that outputs the user's utterance voice as a voice signal to the voice recognition means,
A response information acquisition unit that acquires response information according to the recognition result of the voice recognition means, and
When the voice level of the voice signal is lower than the predetermined voice level, the control unit that does not output the voice based on the response information by the voice output unit and displays the image based on the response information by the display unit. When,
An input / output program characterized by functioning. A computer-readable recording medium comprising storing the input / output program according to claim 5.

Images