JP2007329753A - Voice communication device and voice communication device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a voice communication device capable of adjusting an output voice to the voice of a specific speaker flexibly by listeners by a relatively simple constitution. <P>SOLUTION: When it is hard to hear the voice of a conference member J at a spot (b) and then conference members A and G at a spot (a) adjust an output sound, a voice conference device 111A adjusts the mutual relation between and among voices outputted from respective speakers in a speaker array to adjust only output voices in directions Dir11 and Dir18 corresponding to the conference members A and G based upon respective output voice adjustment contents. The output voice adjustment contents are transmitted to a network server 101 and when the number of output voice adjustment contents to the conference member J reaches a predetermined value, the network server 101 supplies sound collection correction data for correcting a sound gathering signal from a direction Dir24 corresponding to the conference member J to a voice conference device 111B. The voice conference device 111B corrects the sound gathering signal from the direction Dir24 based upon the sound gathering correction data and sends the corrected signal to each of voice conference devices 111A and 111C. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a voice communication system that performs a remote conference and the like by communicating voice signals with each other via a network, and a voice communication apparatus used in the voice communication system.

  Various voice communication systems have been devised in which a plurality of points are connected via a network to perform voice conferences and chats.

  For example, Patent Document 1 discloses a system in which each conference person individually connects a personal computer corresponding to an audio communication device to a network and has a meeting with each other in a virtual conference room.

And in patent document 1, each conference person operates a voice communication apparatus separately, and adjusts the sound quality, volume, and sound of a received voice signal, and has a sense of presence in each speaker unit. A meeting can be held.
JP-A-8-125761

  However, in the audio communication system of Patent Document 1, an audio communication device must be installed for each conference person. When the conference scale increases, the scale of the audio communication system increases significantly.

  Further, in the voice communication system of Patent Document 1, the sound emission characteristics are set according to the positional relationship of each conference person in the virtual conference room. This specification is used when the voice of a specific speaker is low and difficult to hear. It is not possible to flexibly adjust the sound emission to the speaker.

  Furthermore, even if a plurality of conference persons are present in one voice communication apparatus, sound emission control in a predetermined direction cannot be performed, so that only the same voice can be provided to all the conference participants.

  Accordingly, an object of the present invention is to provide a voice communication system capable of flexibly adjusting a sound emitted to a specific speaker's voice for each listener with a relatively simple system configuration that is hardly affected by the number of participants, and the voice communication. An object of the present invention is to provide a voice communication device used in a system.

  (1) The voice communication device according to the present invention forms a sound emitting beam only in a predetermined plurality of directions, a speaker array in which a plurality of speakers are arranged in a predetermined manner, operation receiving means for receiving a sound emission characteristic adjustment operation, A sound emission control means for delaying / amplifying the input voice communication signal and applying it to a plurality of speakers so as to adjust a sound emission beam in a designated direction based on a sound emission characteristic received by the operation reception means; It is characterized by having.

  In this configuration, the sound emission control means sets the sound emitted from each speaker of the speaker array by performing delay / amplitude processing on the input voice communication signal. At this time, the sound emission control means performs the delay / amplitude processing of the voice communication signal so that the sound is emitted only in a predetermined plurality of directions set depending on the position at which the conference person is present. Each sound emitting beam is set so as to have a strong directivity with respect to. Further, when the sound emission control unit receives an operation for setting the sound emission characteristic from the conference through the operation reception unit, the sound emission control unit emits a sound emission beam in a direction corresponding to the conference person based on the received sound emission characteristic. adjust. As a result, sound can be emitted toward each conference person and the characteristics can be changed for a conference person who wants to change the characteristics of the emitted sound.

  (2) Further, the voice communication apparatus of the present invention is characterized in that the sound emission characteristic is set by any one of volume, sound quality, voice feature quantity, or a combination thereof.

  In this configuration, by appropriately operating the volume, sound quality, and audio feature amount, the sound emission characteristics change, and sound suitable for the conference (listener) is provided.

  (3) Further, the voice communication apparatus of the present invention forms a sound collecting beam with respect to a plurality of predetermined directions, identifies the speaker direction by comparing the sound collecting beam intensities, and together with the speaker direction, A sound collecting means for outputting a voice communication signal based on a sound collecting beam in a speaker direction is provided.

  In this configuration, when the voice of the speaker is output to the network, the communication is performed in a state where the voice communication signal and the speaker orientation are associated with each other.

  (4) Further, the voice communication system of the present invention includes a network server that manages a plurality of voice communication apparatuses connected to the network and manages the communication of the network, and the voice communication apparatus accepts sound emission characteristics. To the network server, and the network server has a plurality of adjustment contents received from each voice communication device for the same speaker direction, and has the same tendency, and the number of adjustment contents received is If the number is greater than or equal to the predetermined number, the sound collection correction characteristic for the speaker orientation is set and given to the corresponding voice communication apparatus, and the voice communication apparatus given the sound collection correction characteristic receives the voice communication signal from the corresponding direction. It is characterized by being output after being corrected by sound collection correction characteristics.

  In this configuration, when a plurality of listeners adjust the sound emission characteristics, each voice communication device disposed at a position where the corresponding plurality of listeners are present accepts an operation for adjusting the sound emission characteristics. Each voice communication device transmits the adjustment contents of the sound emission characteristics to the network server, and the network server receives this. The network server compares the received adjustment contents of the sound emission characteristics, and determines whether or not the number of receptions of the same tendency contents (for example, all indicating an increase in volume or the like) is greater than or equal to a predetermined value. Here, the predetermined value is set by, for example, a majority of conferencers (speakers) currently connected to the network and conducting a conference (voice communication). When the network server determines that the value is equal to or greater than the predetermined value, the network server transmits the sound collection correction characteristic based on the adjustment content group set for the corresponding speaker orientation to the corresponding voice communication device. The voice communication apparatus that has received the sound collection correction characteristic corrects the voice communication signal with the sound collection correction characteristic when a sound collection beam obtained from the corresponding direction (speaker direction) is selected and converted into a voice communication signal. Output to the network. As a result, when a listener of a predetermined value or more adjusts the sound from a specific speaker, the sound can be adjusted in a unified manner when the speaker collects sound.

  (5) Further, the network server of the voice communication system of the present invention provides the sound collection correction characteristics to all the voice communication devices connected to the network, and the sound emission control means of each voice communication device provides the given sound collection correction. The sound emission beam is adjusted based on a difference between the characteristic and the received sound emission characteristic.

  In this configuration, when the above-described correction at the time of sound collection is performed, the voice communication signal from the specific speaker is input to each of the other voice communication devices in a state corrected by the sound collection correction characteristic. At this time, each voice communication device is given the same sound collection correction characteristic from the network server. Each voice communication device makes a difference between the sound collection correction characteristic and the adjustment content of the sound emission characteristic input to the own device. Each voice communication device forms a sound emission beam based on the difference result in a direction in which the adjustment content of the sound emission characteristic is designated. As a result, for the listener who adjusted the sound emission characteristics, the sound emission beam is not formed in a state where the sound collection correction characteristics and the sound emission characteristic adjustment contents are superimposed, but the original sound emission characteristic adjustment contents A sound emitting beam based on

  (6) Further, the sound emission control means of each voice communication device of the voice communication system according to the present invention is an adjustment that cancels the sound collection correction characteristic with respect to the sound emission beam in the direction where the sound emission characteristic adjustment operation is not performed. It is characterized by performing.

  In this configuration, each voice communication device other than the voice communication device in which the speaker is present acquires a sound collection correction characteristic, and generates a characteristic that cancels the sound collection correction characteristic. When each voice communication device receives a voice communication signal corrected with the sound collection correction characteristic, the sound communication apparatus performs adjustment based on the characteristic that cancels the sound collection correction characteristic for the sound emission beam in the direction where the sound emission characteristic adjustment operation is not performed. Do. As a result, a sound emission beam based on the raw speaker voice before correction by the sound collection correction characteristic is formed for the listener who has not performed the adjustment operation.

  According to the present invention, even if a plurality of speakers (listeners) are present in one voice communication device without allocating the voice communication device to each speaker (listener), The voice of the speaker can be emitted with a favorite voice for each listener.

  In addition, according to the present invention, when a listener of a predetermined value or more adjusts the sound from a specific speaker, the sound is collectively corrected at the time of sound collection from the specific speaker, so that all the members can simultaneously hear the sound. Can be adjusted. For example, if there are people who are difficult to hear but don't know how to make adjustments, or people who are hard to hear but don't dare to make adjustments, it is easy to listen to these people. it can.

  Further, according to the present invention, it is possible to emit the sound of the specific speaker as it is to the listener who has not adjusted the sound. This is because, for example, if the person who has not made the adjustment is listening without any problem, the person who wants to adjust the sound is provided with the corrected sound, and the person who has not made the sound adjustment is the original. As-is audio can be provided.

  In the following embodiments, an audio conference system will be described with reference to the drawings as a specific system example of an audio communication system.

FIG. 1 is a configuration diagram of an audio conference system according to the present embodiment.
2A is a diagram showing the configuration of the point a in the audio conference system shown in FIG. 1, and FIG. 2B is a plan view of the remote control device 120 (120A to 120G) shown in FIG.
FIG. 3 shows a side view and a bottom view of the audio conference apparatus 111 (111A to 111C) of the present embodiment.
FIG. 4 is a block diagram showing the main configuration of the audio conference apparatus shown in FIG.
FIG. 5 is a simplified diagram for explaining processing of the main control unit 10 at the time of sound emission and sound collection. The main control unit 10A of the audio conference apparatus 111A performs sound emission control, and the main of the audio conference apparatus 111B. The case where the control part 10B is performing sound collection control is shown.
FIG. 6 is a block diagram showing the main configuration of the network server 101 of this embodiment.

  The audio conference system according to the present embodiment includes audio conference apparatuses 111 </ b> A to 111 </ b> C connected to a network 100 and a network server 101.

  The audio conference apparatuses 111 </ b> A to 111 </ b> C are respectively arranged at points a to c that are separated from each other. The audio conference device 111A is arranged at the point a, the audio conference device 111B is arranged at the point b, and the audio conference device 111C is arranged at the point c.

  At the point a, the audio conference device 111A is arranged, and so as to surround the audio conference device 111A, the seven participants A to G have directions Dir11 to Dir16 and Dir18 with respect to the audio conference device 111A, respectively. Being present. The audio conference device 111B is arranged at the point b, and five persons from the conference person H to the conference person L surround the audio conference device 111B with respect to the audio conference device 111B, respectively, with the directions Dir21 and Dir22. , Dir24, Dir26, Dir28. An audio conference device 111C is arranged at the point c, and the conference persons M, N, P, and Q are directed to the audio conference device 111C in directions Dir31, Dir34, and Dir36 so as to surround the audio conference device 111C. , Is present at Dir38.

  Here, each conference person is present surrounding the voice conference device, and has a remote control 120 for adjusting sound emission at each hand. For example, as shown in FIG. 2, in the case of a point a, conference participants A to G are present surrounding the audio conference apparatus 111 </ b> A, and each conference participant A to G has a remote controller 10 </ b> A to 120 </ b> G.

  For example, as shown in FIG. 2B, the remote controller 120 includes a display unit 121, a selection button 122, an execution button 123, an adjustment key 124, and a remote control signal transmission unit 125. The display unit 121 displays currently set “volume”, “sound quality”, and “voice quality”. “Sound quality” is further classified into “HI (high sound)”, “MID (medium sound)”, and “LOW (low sound)”.

  Then, the conference person can select a sound emission characteristic (“volume”, “sound quality”, “voice quality”) to be adjusted with the selection button 122, and can adjust the desired volume or desired voice quality with the adjustment key 124. “Volume” and “sound quality” are set as relative values with respect to the current value such as “+1” and “−3”, for example. “Voice quality” is set in a mode for indicating the state as it is, a mode in which a formant of a specific person such as an announcer is used, and the like. When the conference person confirms the adjustment with the execution button 123, a remote control communication signal such as infrared rays is transmitted from the remote control signal transmission unit 125 to the remote control transmission / reception unit 20 of the audio conference device 111. From the remote control signal, the audio conference apparatuses 111A to 111C set the sound emission for each conference person based on either “individual processing for each audio conference apparatus” or “batch processing by the network server” described later.

As shown in FIG. 3, the audio conference apparatus 111 according to the present embodiment mechanically includes a housing 112, a leg 113, and an operation unit 114.
The casing 112 has a substantially rectangular parallelepiped shape that is long in one direction, and has a predetermined height that separates the lower surface of the casing 112 from the installation surface at predetermined intervals at both ends of the long side (surface) of the casing 112. Legs 113 are installed. In the following description, of the four side surfaces of the housing 112, a long surface is referred to as a long surface, and a short surface is referred to as a short surface.

  An operation unit 114 including a plurality of buttons and a display screen is installed at one end of the upper surface of the housing 112 in the long direction. These operation units 114 are connected to the main control unit 10 installed in the housing 112, receive operation inputs from conference participants, output them to the main control unit 10, and display operation contents and execution modes on a display screen. indicate.

  Although not shown, various input / output interface terminals such as a network connection terminal are installed on the short surface of the housing 112 on the side where the operation unit 114 is installed.

  Speakers SP <b> 1 to SP <b> 16 having the same shape are installed on the lower surface of the housing 112. These speakers SP1 to SP16 are installed in a straight line at regular intervals along the longitudinal direction, thereby constituting a speaker array. On one long surface of the housing 112, microphones MIC101 to MIC116 having the same shape are installed. These microphones MIC101 to MIC116 are installed in a straight line at regular intervals along the longitudinal direction, thereby forming a microphone array. In addition, microphones MIC201 to MIC216 having the same shape are also installed on the other long surface of the casing 112. These microphones MIC201 to MIC216 are also installed in a straight line at regular intervals along the longitudinal direction, thereby forming a microphone array. On the lower surface side of the housing 112, a lower surface grill (not shown) formed in a shape covering the speaker array and the microphone array and punch meshed is installed. In this embodiment, the number of speakers in the speaker array is 16 and the number of microphones in each microphone array is 16. However, the present invention is not limited to this, and the number of speakers and the number of microphones may be set as appropriate according to the specifications. That's fine.

  As shown in FIG. 4, the audio conference apparatuses 111 </ b> A to 111 </ b> C functionally include a main control unit 10, a communication control unit 11, a sound emission control unit 12, a D / A converter 13, a sound emission amplifier (AMP) 14, a receiver. Sound amplifier (AMP) 15, A / D converter 16, sound collection control unit 17, echo cancellation unit 18, audio signal correction unit 19, remote control transmission / reception unit 20, operation unit 114, speakers SP1 to SP16, microphones MIC101 to MIC116, MIC201 -MIC216.

  The main control unit 10 performs overall control of the audio conference apparatus, and also performs control such as power on / off input from the operation unit 114, and various control of other signal processing systems.

  Here, in order to make the explanation easy to understand, explanation will be made assuming that sound emission control is performed by the audio conference apparatus 111A and sound collection control is performed by the audio conference apparatus 111B. In FIG. 5, when the sound emission side (during sound emission) control unit 10A receives the sound emission adjustment data Dcd from the remote controller 120 via the remote control transmission / reception unit 20A, the sound emission adjustment data Dcd is received as the communication control unit 11A, The data is transmitted to the network server 101 via the network 100.

  At the same time, the main control unit 10B on the sound collection side (at the time of sound collection) transmits the speaker orientation data Ddw given from the sound collection control unit 17B to the network server 101 via the communication control unit 11B and the network 100. To do. When the network server 101 determines that sound collection correction is necessary based on a method described later, the network server 101 transmits sound collection correction data DsB for the audio conference apparatus 111B to each audio conference apparatus 111A, 111B, and releases it to the main controller 10B on the sound collection side. The sound-side main control unit 10A receives the sound collection correction data DsB.

  When the sound collection side main control unit 10B detects that the sound collection correction data DsB is for the device itself and detects that the current speaker orientation data Ddw is a sound collection correction target, the sound collection beam The sound collection control data Dr (= sound collection correction data DsB + speaker direction data Ddw) for correcting the signal is given to the sound signal correction unit 19B. The sound signal correcting unit 19B outputs a sound communication signal obtained by correcting the sound collecting beam signal with the sound collecting correction data DsB.

  On the other hand, when the main control unit 10A on the sound emission side detects that the sound collection correction data DsB is not for the own device and detects that the speaker orientation data Ddw of the voice communication signal being received is a correction target. Then, the sound emission control data DcA (= Dcd−DsB) obtained by subtracting the sound collection correction data DsB for the other device is generated from the sound emission adjustment data Dcd received by the own device, and is given to the sound emission control unit 12A. The sound emission control unit 12A performs sound emission control on the input voice signal received by the communication control unit 11A based on the given sound emission control data DcA.

  Further, if the sound collection correction data from the network server 101 has not received DsB from the network server 101, the main control unit 10A on the sound emission side emits sound control data DcA ′ (set only by the sound emission adjustment data Dcd received by its own device. = Dcd) is generated and given to the sound emission control unit 12A.

  The communication control unit 11 is connected to the network 100, converts an audio file received from another device via the network 100 from a network format data to a general audio signal, and releases it via the echo cancellation unit 18. The sound is output to the sound control unit 12. Here, the communication control unit 11 identifies the audio conference device as the transmission source from the device data and the speaker orientation data corresponding to the received audio file, and outputs the audio conference device for each audio conference device. For example, in the case of the audio conference apparatus 111A of the present embodiment, the audio signal S1 from the audio conference apparatus 111B and the audio signal S2 from the audio conference apparatus 111C are output to the sound emission control unit 12.

  Further, when the sound emission adjustment data input from the remote controller 120 is given from the main control unit 10, the communication control unit 11 transmits the sound emission adjustment data to the network server 101.

  In addition, the communication control unit 11 attaches the speaker orientation data from the main control unit 10 and the device data serving as device recognition data to the audio communication signal from the audio signal correction unit 19 to perform network communication. The data is converted into a format and transmitted to the network 100. The device data is an individual identification ID set for each voice conference device connected to the network 100 and is automatically assigned when each voice conference device is connected to the network 100.

  The sound emission control unit 12 performs delay processing, amplitude processing, and the like on the input audio signal S1 or audio signal S2 based on the sound emission control data from the main control unit 10 to surround the audio conference apparatus. A sound emission signal corresponding to each of the speakers SP1 to SP16 is generated so as to form a sound emission beam with individual characteristics for each conference participant present.

  Each D / A converter 13 performs digital-analog conversion on the input sound emission signal and applies it to each sound emission amplifier 14, and each sound emission amplifier 14 amplifies the analog sound emission signal to produce each speaker. Give to SP1-SP16. Each of the speakers SP1 to SP16 converts the input electrical sound signal into sound and emits the sound.

  At this time, by performing the sound emission control described above, the sound emission adjustment data received by the own device and the sound collection correction data set for the other device are simultaneously and individually received by each conference participant. Sound emission can be provided. That is, it is possible to emit a sound with appropriate volume, sound quality and voice quality for each conference person.

  The microphones MIC101 to MIC116 and MIC201 to MIC216 collect ambient sounds including utterances from speakers present around the device, convert them into electrical sound collection signals, and provide them to the sound collection amplifier 15 . The sound collection amplifier 15 amplifies the sound collection signal and applies it to the A / D converter 16, and the A / D converter 16 converts the analog sound collection signal into a digital signal and outputs it to the sound collection control unit 17.

  The sound collection control unit 17 performs a delay process on the sound collection signals of the microphones MIC101 to MIC116 and MIC201 to MIC216, and generates a sound collection beam signal having a strong directivity in a predetermined direction including the direction of each conference person. To do. For example, in the audio conference apparatus 111A of FIG. 1, the sound collection direction Dir11 corresponding to the direction of the conference A, the sound collection direction Dir12 corresponding to the direction of the conference B, and the sound collection direction corresponding to the direction of the conference C Dir13, sound collection direction Dir14 corresponding to the direction of the party D, sound collection direction Dir15 corresponding to the direction of the party E, sound collection direction Dir16 corresponding to the direction of the party F, and the collection corresponding to the direction of the party G A sound collecting beam signal having strong directivity in each of the predetermined sound collecting directions Dir11 to Dir18 including the sound direction Dir18 is generated. The sound collection control unit 17 compares the amplitudes of the generated sound collection beam signals in the respective directions, selects the sound collection beam signal having the largest amplitude, and outputs it to the echo cancellation unit 18. Further, the sound collection control unit 17 extracts the sound collection direction Dir corresponding to the selected sound collection beam signal, and gives it to the main control unit 10 as the speaker direction data.

  The echo cancellation unit 18 includes two echo cancellers 181 and 182, and each echo canceller 181 and 182 includes an adaptive filter and a post processor, respectively. The echo canceller 181 generates a pseudo regression sound signal based on the audio signal S1 with an adaptive filter, and converts the pseudo regression sound signal of the audio signal S1 from the sound collection beam signal output from the sound collection control unit 17 with a post processor. Subtract and output to the post processor of the echo canceller 182. The echo canceller 182 generates a pseudo regression sound signal based on the audio signal S2 with an adaptive filter, and subtracts the pseudo regression sound signal of the audio signal S2 from the collected sound beam signal subtracted by the post processor of the echo canceller 181. And output to the audio signal correction unit 19. Thereby, the wraparound sound from the speaker SP to the microphone MIC is suppressed.

  Based on the sound collection control data from the main control unit 10, the audio signal correction unit 19 performs amplitude processing, equalizing, and further, if necessary, on the collected sound beam signal after echo cancellation corresponding to the specified specific speaker. A voice communication signal is generated by performing voice quality conversion processing. The audio signal correction unit 19 outputs this audio communication signal to the communication control unit 11. As described above, if the sound collection correction data provided from the network server 101 is not intended for the device itself, but is intended for other devices connected to the network 100, the main control unit 10 collects data. Sound control data is not generated and is not given to the audio signal correction unit 19. Therefore, the audio signal correction unit 19 outputs the input sound collection beam signal as it is as an audio communication signal. By using such a configuration, the sound can be corrected and transmitted by the voice conference device on the sound collection side without adjusting the sound emission individually by each other voice conference device. That is, it is possible to perform sound correction (adjustment) in a lump for the conference participants of the other audio conference devices by the audio conference device on the sound collection side.

  The network server 101 includes a network control unit 102 and a conference information storage unit 103.

  The network control unit 102 controls the entire network 100. The conference information storage unit 103 stores the number of conference participants currently participating in the conference, an adjustment content DB based on sound emission adjustment data, a correction history that is a generation history of sound collection correction data, and the like. Based on the information stored in the conference information storage unit 103, the network control unit 102 generates sound collection correction data if the number of sound emission adjustments for a specific speaker is equal to or greater than a predetermined threshold, and each audio conference device Send to. At this time, device data indicating the voice conference device that is the target of sound collection correction and target speaker orientation data are attached to the sound collection correction data.

  FIG. 7 is a flowchart showing a sound collection correction setting flow of the network server 101.

  The network control unit 102 sequentially receives sound emission adjustment data from each audio conference device via the network 100 (S201). At the same time, the network control unit 102 detects speaker orientation data (including device data) corresponding to each sound emission adjustment data (S202). Here, the speaker orientation data is orientation data for designating a specific speaker attached to an audio file transmitted from the transmission source audio conference apparatus. When the sound emission adjustment data is acquired, the speaker orientation data is stored in the network 100. Obtain from the audio file sent and received.

  The network control unit 102 analyzes each sound emission adjustment data, acquires the sound emission adjustment content, and stores it in the adjustment content DB in association with the speaker orientation data (S203). Here, the sound emission adjustment content is represented by transmission source azimuth data, volume setting amount, high tone (HI) sound quality setting amount, medium sound (MID) sound quality setting amount, bass (LOW) sound quality setting amount, and voice quality setting content. The volume setting amount and each sound quality setting amount are set depending on the magnitude of the current value. Note that the transmission source azimuth data is azimuth data that specifies the azimuth of the listener from which the sound emission adjustment data is transmitted, and is transmitted in association with the sound emission adjustment data from each audio conference device.

  When the network control unit 102 counts the number of source direction data for each speaker direction data and detects that the source direction data for the same speaker direction data is equal to or greater than a predetermined threshold (S204), the corresponding speaker Sound collection correction data for correcting the sound from the direction corresponding to the direction data at the time of sound collection is generated (S205). This sound collection correction data includes correction direction data including device data, “volume”, “sound quality”, and “voice quality”, and “volume” and “sound quality” are the same as the sound emission adjustment data with respect to the current value. Set as a relative value. In this description, the example in which the sound collection correction data is generated when the number of transmission source direction data with respect to specific speaker direction data is equal to or greater than a predetermined threshold is shown. Sound collection correction data may be generated when the number of original orientation data reaches a majority of the number of conference participants. When the network control unit 102 generates sound collection correction data, the network control unit 102 records it in the conference information storage unit 103.

  The network control unit 102 transmits the sound collection correction data to each of the audio conference apparatuses 111A to 111C via the network 100 (S206).

Next, a more specific method of sound emission adjustment and sound collection correction in the audio conference apparatus will be described with reference to the drawings.
FIG. 8 is a flowchart showing the sound emission and collection processing of the audio conference apparatus.
Each voice conference device 111 is in a sound pickup state, a sound emission state, and a standby state based on the reception status of the voice file in the communication control unit 11 and the sound pickup state in the sound pickup control unit 17. It is determined in which state (S1). Here, if the sound is emitted, the following sound emission process is performed. If the sound is collected, the sound collection process shown below is performed. If the sound is in the standby state, the sound is emitted or the sound is collected. Repeat detection.

When the sound collection correction data is received from the network server 101 in the state of sound emission, sound collection, and standby processing, or a sound emission control operation input is performed from a conference person (remote controller), the audio conference apparatus The interrupt process shown in FIG. 9 is executed.
FIG. 9 is a flowchart showing interruption processing for sound emission adjustment change and sound collection correction change of the audio conference apparatus.
The voice conference device 111 operates in a state where interrupt processing from the network server 101 and the remote controller 120 can be accepted at any time in any state of sound emission, sound collection, and standby as long as the power is on. When the voice conference apparatus 111 detects an interrupt (S101), it determines the type of the interrupt process (S102).

  Specifically, when a remote control communication signal from the remote controller 120 is detected, the audio conference apparatus 111 detects a user interruption. Then, the audio conference apparatus 111 receives the sound emission adjustment content set by the remote controller 120 (S103). At this time, the audio conference apparatus 111 simultaneously detects which remote controller 120 is arranged around the apparatus to determine the remote control communication signal.

  The audio conference apparatus 111 includes a sound emission adjustment flag for each direction (conference person's direction) that emits sound. The audio conference apparatus 111 sets the sound emission adjustment flag to the ON state for the direction corresponding to the remote controller 120 that is the transmission source (S104).

  Then, the audio conference apparatus 111 generates and stores sound emission adjustment data from the received sound emission adjustment content (S105), associates the sound emission adjustment data with the direction data of the transmission source, and causes the communication control unit 11 to Via the network server 101 (S106).

  On the other hand, when the communication control unit 11 detects sound collection correction data from the network server 101, the audio conference apparatus 111 detects that the server is interrupted and accepts the received sound collection correction data (S107). The audio conference apparatus 111 analyzes the sound collection correction data and detects whether or not the sound collection correction data is for the own apparatus from the apparatus data (S108).

  If the audio conferencing device 111 is sound collection correction data for the device itself, the audio conference device 111 acquires speaker orientation data from the sound collection correction data. The audio conference apparatus 111 includes a sound collection correction flag for each direction, and turns on the sound collection correction flag for the direction corresponding to the acquired speaker direction data (S109). Then, the audio conference apparatus 111 stores sound collection correction data (S110).

  In this way, the audio conference apparatus 111 sets the sound emission adjustment flag based on the sound emission adjustment content when sound is output, and sets the sound collection correction flag when the own apparatus is a correction target during sound collection.

  Returning to the flow shown in FIG. 8, when it is detected that the own apparatus is in the sound emission state, the main control unit 10 of the audio conference apparatus 111 detects whether or not sound collection correction data has been acquired from the network server 101 ( S2). If the sound collection correction data is acquired and stored, the main control unit 10 detects whether sound emission adjustment data is received for each direction in which sound emission is performed (S4). If the main control unit 10 has not received the sound emission adjustment data, that is, if it is confirmed that the sound emission adjustment flag is OFF for all directions, the main control unit 10 emits sound based on the sound collection correction data. Sound emission control data having the same sound emission adjustment amount for all directions is generated and given to the sound emission control unit 12 (S6).

  Further, if the main control unit 10 has received the sound emission adjustment data, the difference obtained by subtracting the sound emission adjustment amount based on the sound emission adjustment data from the reference amount using the sound emission adjustment amount based on the sound collection correction data as a reference amount. Sound emission control data is generated by setting the amount for each direction in which the sound emission adjustment flag is in the ON state, and is given to the sound emission control unit 12 (S7). That is, for the direction in which the sound emission adjustment data is received (the direction in which the sound emission adjustment flag is ON), sound emission adjustment is performed based on the difference amount, and the direction in which the sound emission adjustment data is not received (the sound emission adjustment flag is OFF) Sound direction control data for performing sound emission adjustment based on the sound collection correction data is given to the (direction of state).

  Moreover, the main control part 10 detects whether sound emission adjustment data is received with respect to each azimuth | direction which performs sound emission, even when there is no sound collection correction data (S5). If the sound emission adjustment data is not received, that is, if the sound emission adjustment flag is OFF for all directions, the main control unit 10 releases the voice communication signal received for all directions as it is. Sound control data is generated and given to the sound emission control unit 12. In this case, it is not necessary to give sound emission control data.

  In addition, when there is no sound collection correction data and the sound emission adjustment data is received, the main control unit 10 sets the sound emission adjustment amount for each direction in which the sound emission adjustment flag is ON. Control data is generated and given to the sound emission control unit 12 (S8). That is, in the direction in which the sound emission adjustment data has been received (the direction in which the sound emission adjustment flag is ON), the sound emission adjustment is performed based on the sound emission adjustment data, and the direction in which the sound emission adjustment data is not received (the sound emission adjustment flag) In the OFF state), sound emission control data for giving a sound as it is is given.

  The sound emission control unit 12 generates and outputs sound emission signals to be given to the speakers SP1 to SP16 based on the given sound emission control data so that a desired sound emission beam is formed in each direction.

  On the other hand, when it is detected that the own device is in the sound collecting state, the main control unit 10 of the audio conference apparatus 111 detects whether or not sound collecting correction data is acquired from the network server 101 (S3). When receiving the sound collection correction data and detecting that it is the sound collection correction data for the own device, that is, detecting that the sound collection correction flag is in the ON state for any one direction, the main control unit 10 The sound collection control data based on the sound collection correction data is given to the sound signal correction unit 19 (S9).

  The main control unit 10 of the audio conference apparatus 111 does not particularly control the audio signal correction unit 19 unless the sound collection correction data is acquired.

  If the sound collection control data is given, the voice signal correction unit 19 starts from the direction in which the sound collection correction flag is ON based on the speaker orientation data and the sound collection control data given from the main control unit 10. A sound communication signal is generated by correcting the collected sound beam signal. The communication control unit 11 attaches the speaker orientation data and the device data to the voice communication signal and transmits it to the network 100 (S10).

Next, the actual state of sound emission and collection when such a configuration is used will be described with reference to FIGS.
In the following description, a situation in which it is difficult to hear the voice of the conference person J at the point b is shown as an example.

(1) Individual correspondence of sound emission adjustment FIG. 10 is a diagram showing a sound emission and collection situation in the case of individual correspondence of sound emission adjustment.
As shown in FIG. 10, when the conference person A and the conference person G at the point a perform sound emission adjustment by operating the remote controller 120 while the conference person J at the point b speaks, the audio conference apparatus at the point a 111A acquires the sound emission adjustment contents operated by each remote controller 120. In this case, with respect to the conference A, the sound output adjustment contents for setting the volume to “+7”, the sound quality HI to “+5”, and the sound quality LOW to “−2”, and the volume to the conference G are “ The sound emission adjustment content for setting the sound quality HI to “+4” is acquired at “+5”. The audio conference apparatus 111A transmits these sound emission adjustment contents as sound emission adjustment data to the network server 101, and sets the sound emission adjustment flag to ON for the directions Dir11 and Dir18 corresponding to the conference participants A and G, respectively. Set. When the voice conference apparatus 111A acquires the speaker data from the received voice communication signal and detects that the voice is the voice of the conference person J, the voice conference apparatus 111A adjusts the sound emission to the directions Dir11 and Dir18. Adjust according to the content and emit sound. As a result, the conference participants A and G can listen to the voice of the conference participant J in a state adjusted according to the specified sound emission adjustment content. That is, conference A can hear the voice of conference J where the volume is “7” higher, the treble is “5” higher, and the bass is “2” lower, and conference G is “5” higher. , The voice of the conferee J whose treble is increased by “4” is heard, and the other conferees (the conferee B to the conferee F at the point a and the conferee M to the conferee Q at the point c) Can be heard without being adjusted.

  In this case, since the conferee who performed the sound emission adjustment is a minority group with respect to the entire conferencing party, the network server 101 does not perform control to collectively correct the voice of the conferee J at the time of sound collection.

  In this way, when the number of conferences (listeners) that perform sound emission adjustment for a specific conference (speaker) is extremely small, sound output adjustment is performed for each listener in the audio conference device in which each listener is present. Thereby, only the listener who wants to adjust the sound emission can emit sound according to the adjustment contents.

(2) Collecting sound correction collectively FIG. 11 and FIG. 12 are diagrams showing the state of sound emission and collection in the case of collect sound correction collectively. FIG. 11 shows the situation before collective correction and FIG. 12 shows the situation after collective correction. Show.

  As shown in FIG. 11, when the conference person A and the conference person G at the point a perform sound emission adjustment by operating the remote controller 120 while the conference person J at the point b speaks, the audio conference apparatus at the point a 111A acquires the sound emission adjustment contents operated by each remote controller 120. In this case, for the conference A, the sound emission adjustment content for obtaining the volume “+7”, the sound quality HI “+5”, and the sound quality LOW “−2” is acquired, and the volume of the conference G is obtained. Is set to “+5”, and the sound emission adjustment contents for setting the sound quality HI to “+4” are acquired. The audio conference apparatus 111A transmits these sound emission adjustment contents as sound emission adjustment data to the network server 101, and sets the sound emission adjustment flag to ON for the directions Dir11 and Dir18 corresponding to the conference participants A and G, respectively. Set.

  Similarly, when the conference person M, the conference person N, and the conference person Q at the point c operate the remote controller 120 to adjust the sound emission, the audio conference device 111C at the point c is operated by the remote controller 120. Get the sound adjustment contents. In this case, the sound emission adjustment content for obtaining the volume “+3” and the sound quality HI “+2” is obtained for the conference person M, and the sound quality HI is obtained for the conference person N with the volume “+4”. The sound emission adjustment content that sets the sound quality LOW to “−1” is acquired at “+2”, and the sound emission adjustment content that sets the volume to “+2” and the sound quality HI to “+1” is acquired for the conference person Q. To do. The audio conference apparatus 111C transmits these sound emission adjustment contents as sound emission adjustment data to the network server 101 and emits sound emission adjustment flags for the directions Dir31, Dir34, and Dir38 corresponding to the conference persons M, N, and Q, respectively. Set to ON. When the voice conference apparatuses 111A and 111C acquire the speaker data from the received voice communication signal and detect that the voice is the voice of the conference person J, the voice conference apparatuses 111A and 111C emit sound to the directions Dir11, Dir18, Dir31, Dir34, and Dir38. The sound is adjusted according to the sound emission adjustment contents and emitted. Accordingly, the voices of the conference person J can be heard by the conference persons A, G, M, N, and Q in a state adjusted according to the designated sound emission adjustment contents. That is, conference A can hear the voice of conference J where the volume is “7” higher, the treble is “5” higher, and the bass is “2” lower, and conference G is “5” higher. You can hear the voice of the conferee J whose treble is "4" louder. In addition, the conference participant M can hear the voice of the conference participant J whose volume is increased by “3” and the high tone is increased by “2”, and the conference participant N is increased by “4” and the high tone is increased by “2”. The voice of the conferee J whose bass is reduced by “1” is heard, and the voice of the conferee J whose volume is increased by “2” and whose treble is increased by “1” is heard by the conferee.

  When the network server 101 detects that the number of sound emission adjustment data for the conference participant J exceeds a majority of the number of conference participants, the network server 101 acquires each adjustment amount of the sound emission adjustment data and performs average processing. In the example of FIG. 11, the volume is calculated as “+4”, the sound quality HI is “+3”, and the sound quality LOW is calculated as “−1”. The network server 101 generates sound collection correction data using the adjustment amounts calculated as described above, and attaches speaker data (direction data) to be corrected to the audio conference apparatuses 111A to 111C.

  The audio conference apparatus 111B in which the conference subject J to be corrected is present corrects the collected beam signal collected from the conference participant J based on the received collected sound correction data, and transmits it to the network 100. In this example, the volume of the collected beam signal of the conference person J is set to “+4”, the sound quality HI is set to “+3”, and the sound quality LOW is corrected to “−1” and transmitted.

  In this state, in the direction in which sound emission adjustment has been performed by the audio conference apparatuses 111A and 111C, sound is emitted in a state where the sound emission adjustment content and the correction content are added, resulting in a louder sound than necessary.

  Therefore, the audio conference apparatus 111A makes a difference between each adjustment amount of the received sound collection correction data and each adjustment amount of the sound emission adjustment data set and stored in advance, and performs sound emission adjustment from the adjustment amount set by this difference value. Do. Specifically, the conference person A has a volume “7-4” = “+ 3”, a sound quality HI “5-3” = “+ 2”, and a sound quality LOW “-2-(− 1)” = “− 1”. Change the adjustment amount to. For the conference person G, the adjustment amount is changed to volume “5-4” = “+ 1”, sound quality HI “4-3” = “+ 1”, and sound quality LOW “0-(− 1)” = “+ 1”. Then, based on the changed adjustment amount, the sound communication signal in the corrected state (volume “+4”, sound quality HI “+3”, sound quality LOW “−1”) is adjusted for sound emission. Thereby, the conference persons A and G can hear the voice of the conference person J according to the content which self adjusted.

  Similarly to the audio conference apparatus 111A, the audio conference apparatus 111C performs sound emission adjustment from the adjustment amount set by the difference value. Specifically, the conference person M has a volume “3-4” = “− 1”, a sound quality HI “2-3” = “− 1”, and a sound quality LOW “0 − (− 1)” = “+ 1”. Change the adjustment amount to. For the conference person N, the adjustment amount is changed to volume “4-4” = “0”, sound quality HI “2-3” = “− 1”, and sound quality LOW “−1 − (− 1)” = “0”. To do. For the conference person Q, the volume is adjusted to “2-4” = “− 2”, the sound quality HI “1-3” = “− 2”, and the sound quality LOW “0 − (− 1)” = “+ 1”. To do. Then, based on the changed adjustment amount, the sound communication signal in the corrected state (volume “+4”, sound quality HI “+3”, sound quality LOW “−1”) is adjusted for sound emission. Thereby, the conference persons M, N, and Q can also hear the voice of the conference person J according to the content adjusted by the conference persons.

  In addition, the voices of the conferee J can be heard by other conferees (the conferee B to the conferee F at the point a and the conferee P at the point c) in a state corrected on the sound collection side.

  This allows each speaker (listener) adjusted for sound emission to hear the speaker's voice with the sound set by the conference (listener). However, the speaker's voice can be heard with the corrected sound that is easy to hear.

  In addition, the conference person who has not performed the sound emission adjustment may not feel that it is difficult to hear the voice of the conference person J.

  In this case, as shown in FIG. 13, reverse correction may be applied to a conference person who has not adjusted the sound emission.

FIG. 13 is a diagram showing a sound emission and collection situation in the case similar to FIGS. 11 and 12 and performing reverse correction.
The method for adjusting the sound emission for the conference participant who has adjusted the sound emission is the same as in FIG.

  Upon receiving the sound collection correction data from the network server 101, the voice conference apparatuses 111A and 111C on the side that receives the voice communication signal generate reverse correction sound emission adjustment data that reversely corrects each adjustment amount of the sound collection correction data. To do. In the example of FIG. 13, with respect to the volume “+4”, the sound quality HI “+3”, and the sound quality LOW “−1” that are correction adjustment amounts, the volume “−4”, the sound quality HI “−” 3 ”and sound quality LOW“ +1 ”are set.

  Unlike the case of FIG. 12, the audio conference apparatus 111A turns on the sound emission adjustment flag for the directions Dir11 to Dir16 and Dir18 corresponding to all the participants A to G, and the conference person for whom sound emission adjustment is not specified. For B to F, reverse correction sound emission adjustment data is applied. Thereby, the audio | voices of the raw conference person J before correction | amendment can be heard to the conference persons BF. Similarly, the audio conferencing apparatus 111C also applies reverse correction sound emission adjustment data to the conference person P for whom sound emission adjustment is not designated. Thereby, the voice of the raw conference person J before correction | amendment can also be heard also to the conference person P. FIG.

  Thereby, the person who has not performed the sound emission adjustment can emit the voice as it is, assuming that there is a judgment that the voice of the conference person J is not difficult to hear.

  In the case where such adjustment is unnecessary, it is possible to more clearly determine whether adjustment is unnecessary by providing buttons and commands that do not require adjustment on the remote controller 120 in advance.

  As described above, by using the configuration and processing of the present embodiment, when a conference is performed between remote locations, the voice of a specific speaker can be changed with a different volume and sound quality for each listener with a relatively simple system. I can tell you.

  In the above description, the example of adjustment / correction related to voice quality was not shown. However, voice quality that is easy to hear is stored in advance, and the voice of the speaker is emitted with the selected voice quality by selecting the appropriate voice quality. You can also For example, formant information of a television announcer is stored, and if this voice quality is selected, the sound of a specific speaker may be formant converted and emitted.

  In the above description, the network server 101 may store sound collection correction data and sound emission adjustment data in the conference information storage unit 103 together with corresponding speaker orientation data. Then, when a meeting is held with the same member from the next time onward, the network server 101 reads the speaker orientation data, sound collection correction data, and sound emission adjustment data, and transmits them to the audio conference apparatuses 111A to 111C. Each of the audio conference apparatuses 111A to 111C collects and emits sound based on the acquired sound collection correction data and sound emission adjustment data. As a result, from the beginning of the conference, each conference participant can hear the speaker's speech with his / her favorite voice.

It is a block diagram of the audio conference system of embodiment of this invention. It is a figure which shows the structure of the point a in the audio conference system shown in FIG. 1, and a top view of remote control device 120 (120A-120G). It is the both-sides figure and bottom view of the audio conference apparatus 111 (111A-111C) of embodiment of this invention. It is a block diagram which shows the main structures of the audio conference apparatus shown in FIG. It is a simplified diagram for explaining processing of the main control unit 10 at the time of sound emission and sound collection. It is a block diagram which shows the main structures of the network server 101 of embodiment of this invention. It is a flowchart which shows the sound collection correction | amendment setting flow of a network server. It is a flowchart which shows the sound emission processing of an audio conference apparatus. It is a flowchart which shows the interruption process of the sound emission adjustment change of a voice conference apparatus, and a sound-collection correction change. It is the figure which showed the sound emission collection situation in the case of sound emission adjustment individual correspondence. It is the figure which showed the sound emission collection condition before the collective correction in the case of collective sound correction collective correspondence. It is the figure which showed the sound collection condition after the collective correction in the case of collective sound correction collective correspondence. It is the figure which showed the sound emission and collection condition in the case similar to FIG. 11, FIG. 12, and when performing reverse correction.

Explanation of symbols

100-network, 101-network server, 102-network control unit, 103-conference information storage unit, 111 (111A to 111C) -voice conference device, 120-remote controller, 112-housing for voice conference device, 113-voice conference Legs of apparatus, 114-operation unit, 10-main control unit, 11-communication control unit, 12-sound emission control unit, 13-D / A converter, 14-sound emission amplifier, 15-sound collection amplifier, 16- A / D converter, 17-sound collecting control unit, 18-echo canceling unit, 19-audio signal correcting unit, 20-remote control transmission / reception unit

Claims (6)

A speaker array in which a plurality of speakers are arranged in a predetermined manner;
Operation accepting means for accepting a sound emission characteristic adjustment operation;
The input voice communication signal is delayed / amplified so that the sound emission beam is formed only in a plurality of predetermined directions and the sound emission beam in the designated direction is adjusted based on the sound emission characteristics received by the operation receiving means. Sound emission control means for processing and providing to the plurality of speakers;
A voice communication device comprising:   The voice communication apparatus according to claim 1, wherein the sound emission characteristic is set by any one of volume, sound quality, voice feature amount, or a combination thereof.   The voice communication based on the sound collecting beam of the speaker direction together with the speaker direction by identifying a speaker direction by forming a sound collecting beam with respect to the predetermined plurality of directions and comparing the sound collecting beam intensities The voice communication apparatus according to claim 1, further comprising sound collection means for outputting a signal. A voice communication system comprising a network server for managing a plurality of voice communication apparatuses according to claim 3 connected to a network, and managing communication of the network,
The voice communication apparatus gives the adjustment contents of the received sound emission characteristics to the network server,
In the network server, if a plurality of adjustment contents received from each voice communication device correspond to the same speaker orientation and have the same tendency, and the number of adjustment contents received is a predetermined number or more, Set the sound collection correction characteristic for the speaker orientation and give it to the corresponding voice communication device,
The voice communication apparatus to which the sound collection correction characteristic is given is a voice communication system that corrects and outputs a voice communication signal obtained from a corresponding direction with the sound collection correction characteristic. The network server provides sound collection correction characteristics to all voice communication devices connected to the network,
5. The voice communication system according to claim 4, wherein the sound emission control means of each voice communication device adjusts the sound emission beam based on a difference between the given sound collection correction characteristic and the accepted sound emission characteristic.   6. The voice communication according to claim 5, wherein the sound emission control means of each of the voice communication devices performs an adjustment for canceling the sound collection correction characteristic with respect to a sound emission beam in a direction where a sound emission characteristic adjustment operation is not performed. system.

Images