JPH09284404A - Video conference system and terminal equipment used for the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To exactly change a sound volume level of a microphone by visually and easily grasping a conference terminal the sound volume of the microphone of which is changed. SOLUTION: This system is provided with a command preparing analyzing part 110 preparing a control command for changing the speech signal level of a communication opposite party when the size of the window displaying an opposite-side picture displayed on a monitor 102 is changed by the dragging operation of a mouse, a communication line interface 120 transmitting this prepared control command to the communication opposite party and a speech signal level changing part 115 changing the speech signal level corresponding to the control command sent from a communication line 122. Then by changing the speech signal level of the communication opposite party with the change of the size of the window displaying the opposite-side picture on the monitor 102, the video terminal of which speech signal level is changed is visually confirmed by the size of the window displaying the opposite-side picture.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video conference system and a terminal device used for the same, and more particularly, when a plurality of terminal devices are connected via a communication network to hold a video conference, any one terminal device It is suitable for use in a video conference system capable of changing the microphone volume level of other terminal devices.

[0002]

2. Description of the Related Art There is a video conference system in which a plurality of users at remote locations connect their respective video conference terminal devices to each other to hold a meeting through a communication line. In such a system, when there are multiple participants in the conference due to multiple terminal connections, any one of the participants in the video conference acts as the chair of the conference and assigns the floor through the conference system, as in a normal conference. By this, the conference was in progress.

In such a system, a speaker who is given a speaking right by the chairman can hear the talk of the speaker when another speaker is speaking while the speaker is speaking or the voice of the speaker is low. It may be difficult. In that case, the operator (chairperson) of any one conference terminal (conference terminal with chair mode selected) who chairs the remote conference sets the input level of the audio signal input from the microphone attached to each conference terminal. It was changed appropriately by remote control.

[0004]

However, in the above-mentioned prior art, when the microphone volume level of the conference terminal used by the speaker is to be changed from the conference terminal on the chair side by remote control, the conference terminal on the chair side is changed. There was no change on the monitor, and it was not possible to visually judge which conference terminal currently changing the microphone volume level.

Therefore, when proceeding with the conference while changing the microphone volume level during the conference, the conference terminal operator on the chair side always remembers which conference terminal the microphone volume level was changed to. However, there is a problem in that the remote control for properly setting the microphone volume level cannot be performed easily.

The present invention has been made in order to solve the above problems, and it is possible to easily visually grasp which conference terminal is changing the microphone volume level at the conference terminal on the chairperson side, so that the It is an object of the present invention to provide a video conference system capable of changing a microphone volume level accurately.

[0007]

A video conference system of the present invention displays at least a partner image in a video conference system in which a plurality of terminal devices connected via a communication network mutually communicate images and audio. Means for changing the size of the partner image display window displayed on the display means, and the size of the partner image display window is modified by the window size modifying means. At this time, a change operation means for remotely controlling the change of the voice signal level of the communication partner and a level change means for changing the voice signal level in response to an instruction from the change operation means are provided.

Another feature of the present invention is that, in a video conference system in which a plurality of terminal devices connected via a communication network mutually communicate images and audio, switching between a chair mode and a general mode is performed. In the terminal mode switching means for performing, the display means having at least a window for displaying the partner image, and the terminal device operating in the chair mode, the size of the partner image display window displayed on the display means is changed. Window size changing means and a change operation for remotely controlling the change of the audio signal level in the terminal device of the communication partner operating in the general mode when the size of the partner image display window is changed by the window size changing means. Means and a level change for changing the audio signal level in accordance with an instruction from the change operation means It is provided and the stage.

According to the present invention configured as described above, when the size of the partner image display window for displaying the image of the communication partner is changed, the voice signal level of the communication partner is changed in accordance with the size change. As a result, the usability of the user is improved, and it is possible to confirm to which communication partner the remote operation for changing the audio signal level is performed by looking at the size of the above partner image display window. Becomes

Further, the terminal device of the present invention is a terminal device which communicates images and voices via a communication network, and is displayed on the display means having at least a window for displaying a partner image. Window size changing means for changing the size of the partner image display window, and voice level changing means for changing the voice signal level of the communication partner when the size of the partner image display window is changed by the window size changing means. And are provided.

According to the present invention configured as described above, when the size of the partner image display window for displaying the image of the communication partner is changed, the voice signal level of the communication partner is changed in accordance with the size change. As a result, the usability for the user is improved, and it is possible to confirm the terminal whose voice level is being changed by looking at the size of the partner image display window.

[0012]

BEST MODE FOR CARRYING OUT THE INVENTION An embodiment of a video conference system according to the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram showing a configuration example of a terminal device (hereinafter referred to as a conference terminal) used in the video conference system according to the present embodiment. A plurality of conference terminals having such a configuration are connected via a communication line, and a video conference can be held by mutually communicating images and sounds.

In FIG. 1, 101 is a camera for inputting an image signal, 102 is a monitor for outputting an image signal such as at least a partner image (an image taken by a camera of a communication partner), and 103 is an image input / output device (the above camera). 101 and monitor 102), an image input / output device controller, 1
An image signal encoding / decoding unit 04 encodes an image signal input from the camera 101 and decodes an image signal received from a communication partner.

Reference numeral 105 denotes a destination information storage unit for storing information such as the display position and size of the destination image display window and the address of the destination of communication corresponding to the image displayed in the destination image display window. Is an input device controller that controls input devices such as the mouse 107 and the keyboard 108.

Reference numeral 109 is a system control unit for controlling processing of the entire system including switching processing of terminal modes (chairperson mode and general mode), and 110 is a control command received through a communication line 122 such as ISDN (Integrated Services Digital Network). Is a control command creating / analyzing unit that analyzes a command and creates a command for remotely controlling another conference terminal.

Reference numeral 111 denotes an audio signal control section for controlling the audio signal level detection section 114 and the audio signal level changing section 115, and 112 denotes a preset audio signal level change width (level change value) and audio signal level detection. Part 11
Reference numeral 4 denotes a voice signal level storage unit for storing the input level of the voice signal detected by 4, and 113 is a microphone for voice input.

The above-mentioned voice signal level detecting section 114 detects the level of the voice signal input from the microphone 113. The audio signal level changing unit 115 changes the level of the audio signal input from the microphone 113 according to an instruction from the audio signal control unit 111.

Reference numeral 116 denotes a voice signal coding unit 117 for coding the voice signal input from the microphone 113 and having the voice signal level changed by the voice signal level changing unit 115.
Is a speaker for outputting the received audio signal, and 118 is an audio signal decoding unit for decoding the received audio signal.

Reference numeral 119 is a multiplexer / separator for multiplexing and separating image signals, audio signals, conference control commands, data, etc., 120 is a communication line interface for connecting with a communication line 122, 121 is a call originator, It is a communication control unit that controls a series of calls such as incoming call, line connection, and line disconnection.

When the video conference terminal having the configuration shown in FIG. 1 is assumed to operate in the chairperson mode (hereinafter, this videoconference terminal is referred to as chairperson conference terminal X), the chairperson conference terminal X is connected to the communication line 122. Communication with other video conference terminals (hereinafter, referred to as general conference terminals A to D) that are operating will be described with reference to the flowcharts below. In the following, the configuration of the chairperson conference terminal X and the general conference terminal A
In order to clearly distinguish them from the configurations of D to D, the symbols of x and a to d are appropriately added to the symbols shown in FIG.

[First Embodiment] As shown in FIG. 5, on a monitor 102x immediately after a chairperson conference terminal X operating in a chairperson mode is activated, a self-portrait input from a camera 101x attached to the self-terminal and communication are performed. The four partner images sent from the general conference terminals A to D connected by the line 122 are displayed as windows of the same size under the control of the image input / output device control unit 103x.

Information such as the position and size of the partner image display window on the monitor 102x and the communication partner address corresponding to the partner image displayed in the partner image display window are stored in the partner information storage unit 105x. There is. Also, the monitors 102a to 10 of the general conference terminals A to D
The same display as in FIG. 5 is displayed on 2d.

The operation in the case of adjusting the microphone volume level of the general conference terminal A in the chair conference terminal X in such a state will be described with reference to the flowchart of FIG. First, the size of the image display window for the general conference terminal A displayed on the monitor 102x of the chairperson conference terminal X is changed by the mouse 107x. Normally, when changing the size of a window, the window frame is selected by the mouse pointer and dragged.

At this time, at the chairperson conference terminal X, the mouse 1
The system control unit 109x, which has detected the input from 07x through the input device control unit 106x, calculates the display position of the mouse pointer (start position of mouse operation) on the monitor 102x through the image input / output device control unit 103x. Then, the calculated display position and the destination information storage unit 105
Based on the information on the monitor 102x stored in x, it is determined whether or not the mouse input is an input to the partner image display window displayed on the monitor 102x (step S201).

If it is a mouse input to the partner image display window, the system controller 109x analyzes the contents of the mouse input made to the partner image display window (step S202), and the size of the partner image display window is changed. It is determined whether the input is a mouse input (step S203). Here, if there is an input other than the mouse input for the window size changing process such as the window moving process, another process is performed (step S209).

On the other hand, if it is a mouse input for changing the size of the other party image display window, the system control section 109x determines the other party's address corresponding to the other party image display window A having the mouse input as the other party information storage section. 1
It is obtained by searching from 05x (step S204). next,
The system control unit 109x has a destination information storage unit 105x.
It is determined whether the size of the partner image display window A is expanded or contracted by comparing the size of the partner image display window A stored in (1) with the size of the partner image display window A after the drag operation (step S205).

Here, as shown in FIG. 6, if the size of the image display window for the general conference terminal A is enlarged on the monitor 102x of the chairperson conference terminal X, the general conference terminal A is displayed.
In order to instruct to perform the amplification correction of the input level of the audio signal, an audio signal level up command including the address of the general conference terminal A searched in step S204 is created (step S206).

If the size of the image display window for the general conference terminal A has been reduced, the above-mentioned step S204 is executed in order to instruct the general conference terminal A to perform attenuation correction of the input level of the audio signal. A voice signal level down command including the address of the general conference terminal A searched by is created (step S208).

Then, the voice signal level changing command created in the above step S207 or step S208 is multiplexed with the coded image signal and the coded voice signal in the multiplexing / demultiplexing unit 119x, and passed through the communication line interface 120x. It is sent to the communication line 122 (step S207).

Next, the operation of the general conference terminal A which receives the voice signal level change command will be described with reference to the flowchart of FIG. In the general conference terminal A, the communication line 1
22 receives the multiplexed data sent through the communication line interface 120a, and the multiplexing / separating unit 119 receives the multiplexed data.
Separated by a. If the conference control data is included in the multiplexed data (step S301), the conference control data is analyzed by the control command creating / analyzing unit 110a (step S302).

If the received conference control data is not the control data for the own terminal (general conference terminal A) (step S303), the process for the conference control data is not performed.

On the other hand, if the received conference control data is control data for the terminal itself (step S303) and the content of the conference control data is a voice signal level change command (step S304), the system control unit 109
a instructs the audio signal control unit 111a to change the current audio signal level according to the command content. If the content of the conference control data is not the voice signal level change command (step S304), other processing corresponding thereto is performed (step S312).

The audio signal control unit 111a, which has received the instruction to change the audio signal level from the system control unit 109a, first uses the audio signal level detection unit 114a.
The current audio signal input level input from the audio signal 13 is detected (step S305), and is detected by the audio signal level storage unit 1
It is stored in 12a (step S306). further,
The audio signal control unit 111a analyzes the audio signal level change command (step S307).

As a result of the analysis, if the received voice signal level change command is the voice signal level up command (step S308), the voice signal control section 111a
A new audio signal level is set by adding the audio signal level change width (level change value) preset in the audio signal level storage unit 112a to the current audio signal level (step S309). In response, the audio signal level changing unit 115a amplifies the audio signal level input from the microphone 113a based on the new audio signal level set above (step S311).

That is, when the voice signal level up command is received, the new voice signal level after the voice signal level change is as follows. (Voice signal level after change) = (Current voice signal level) + (Stored level change width)

On the other hand, the result of the analysis of the voice signal level change command by the voice signal control unit 111a (step S3
07), if the received voice signal level change command is the voice signal level down command (step S30)
8), the audio signal control unit 111a subtracts the audio signal level change width (level change value) preset in the audio signal level storage unit 112a from the current audio signal level to set a new audio signal level ( Step S3
10). Then, the audio signal level changing unit 115a uses the microphone 1 based on the new audio signal level set above.
The audio signal level input from 13a is attenuated (step S311).

That is, when the voice signal level down command is received, the new voice signal level after the voice signal level change is as follows. (Voice signal level after change) = (current voice signal level)-(stored level change width)

The speech signal whose input level has been changed as described above is coded by the speech coding unit 116a,
After being multiplexed with other data by the multiplexing / separating unit 119a, it is sent to the communication line 122 through the communication line interface 120a.

[Second Embodiment] As shown in FIG.
The self-portrait input from the camera 101x attached to the own terminal and the general conference terminals A to D connected by the communication line 122 are sent to the monitor 102x immediately after the activation of the chair conference terminal X operating in the chair mode. The four incoming images are displayed as windows of the same size under the control of the image input / output device control unit 103x.

Information such as the position and size of the partner image display window on the monitor 102x and the communication partner address corresponding to the partner image displayed in the partner image display window are stored in the partner information storage unit 105x. There is. Also, the monitors 102a to 10 of the general conference terminals A to D
The same display as in FIG. 5 is displayed on 2d.

The operation for adjusting the microphone volume level of the general conference terminal A in the chair conference terminal X in such a state will be described with reference to the flowchart of FIG. First, the size of the image display window for the general conference terminal A displayed on the monitor 102x of the chairperson conference terminal X is changed by dragging the mouse 107x.

At this time, in the chairperson conference terminal X, the mouse 1
The system control unit 109x, which has detected the input from 07x through the input device control unit 106x, calculates the display position of the mouse pointer (start position of mouse operation) on the monitor 102x through the image input / output device control unit 103x.

Then, based on the calculated display position and the information on the monitor 102x stored in the other party information storage section 105x, the mouse input is input to the other party image display window displayed on the monitor 102x. Is determined (step S401).

If it is a mouse input to the partner image display window, the system control unit 109x analyzes the content of the mouse input made to the partner image display window (step S402) and changes the size of the partner image display window. It is determined whether or not the input is a mouse input (step S403). Here, if there is an input other than the mouse input for the window size changing process such as the window moving process, another process is performed (step S410).

On the other hand, if it is a mouse input for changing the size of the other party image display window, the system control unit 109x causes the other party image display windows B to D other than the other party image display window A having the mouse input. The destination address is obtained by searching the destination information storage unit 105x (step S404).

Next, the system control unit 109x compares the size of the partner image display window A stored in the partner information storage unit 105x with the size of the partner image display window A after the drag operation, thereby It is determined whether the size of the image display window A has been enlarged or reduced (S405).

Here, as shown in FIG. 6, if the size of the image display window for the general conference terminal A is enlarged on the monitor 102x of the chair conference terminal X, the audio is sent to the general conference terminals B to D. In order to instruct to perform attenuation correction of the signal input level, a voice signal level down command including the addresses of the general conference terminals B to D searched in step S404 is created (step S406).

Each of the audio signal level down commands thus created is sent to the multiplexer / separator 11
The signal is multiplexed with the coded image signal and the coded audio signal in 9x and sent to the communication line 122 through the communication line interface 120x (step S407). At this time, command transmission is repeated until the command transmission to all the general conference terminals B to D is completed (step S409).

If the size of the other party image display window for the general conference terminal A is reduced, the general conference terminal A
Other than the general conference terminals B to C, in order to instruct to perform amplification correction of the input level of the audio signal, the audio signal level including the addresses of the general conference terminals B to D searched in step 404 above. An up command is created (step S408).

The voice signal level up command thus created is multiplexed / demultiplexed by the multiplexer / demultiplexer 1 as in the case of transmitting the voice signal level down command described above.
19x is multiplexed with the coded image signal and the coded audio signal, and the command transmission is repeatedly performed until the command transmission to all the general conference terminals B to D is completed (steps S407 and S409). .

The processing in each of the general conference terminals B to D that has received the voice signal change command created as described above is the same as in the case of the flowchart of FIG. 3 described in the first embodiment. The description is omitted here.

As described above, in the present embodiment, the sizes of the partner image display windows A to D displayed on the monitor 102x of the video conference terminal X on the chairperson side are changed as shown in FIG. 6, for example. By doing so, it is possible to change the microphone volume level of the other party. In this way, by performing the remote control for changing the audio signal level by changing the window size, the remote control of the proper microphone volume can be facilitated while visually confirming it on the monitor 102x of the chairperson conference terminal X. It can be carried out.

The above embodiment is an example in which the audio signal input level is increased or decreased by a certain width depending on whether the size of the partner image display window is larger or smaller than usual. The width of change of the audio signal input level may be determined according to how much the size of the partner image display window is increased or decreased.

[0054]

As described above, according to the present invention, the size of the partner image display window displayed on the display means is changed so that the voice signal level of the communication partner is changed in accordance with the size change. By doing so, it becomes unnecessary to adjust the audio level by the user, the usability for the user is improved, and it becomes possible to visually confirm which terminal device has changed the audio signal level. As a result, for example, in a teleconference using a video conference system, it is possible to precisely adjust the audio signal level, make it easier to hear the voice of the speaker during the conference, and smoothly proceed with the conference. Like

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration example of a conference terminal used in a video conference system according to an embodiment of the present invention.

FIG. 2 is a flowchart showing a processing operation of a chairperson conference terminal according to the first embodiment.

FIG. 3 is a flowchart showing a processing operation of a general conference terminal in the first and second embodiments.

FIG. 4 is a flowchart showing a processing operation of a chairperson conference terminal in the second embodiment.

FIG. 5 is a diagram showing a display example of a monitor when the chairperson conference terminal of the video conference system is activated.

FIG. 6 is a diagram showing a display example of a monitor at the time of a voice signal level changing operation of the chairperson conference terminal of the video conference system.

[Explanation of symbols]

 Reference Signs List 101 image signal input camera 102 image signal output monitor 103 image input / output device control unit 104 image signal encoding / decoding unit 105 destination information storage unit 106 input device control unit 107 mouse 108 keyboard 109 system control unit 110 control command Creation / analysis unit 111 Audio signal control unit 112 Audio signal level storage unit 113 Audio input microphone 114 Audio signal level detection unit 115 Audio signal level changing unit 116 Audio signal encoding unit 117 Speaker 118 Audio signal decoding unit 119 Multiplexing / Separation unit 120 Communication line interface 121 Communication control unit 122 Communication line

Claims (9)

[Claims] 1. A video conferencing system for mutually communicating images and sounds between a plurality of terminal devices connected via a communication network, at least a display unit having a window for displaying a partner image, and the display unit. Window size changing means for changing the size of the other party image display window displayed on the screen, and changing the voice signal level of the communication partner when the size of the other party image display window is changed by the window size changing means. A video conferencing system comprising: a change operating means for remotely operating the computer and a level changing means for changing the audio signal level in accordance with an instruction from the change operating means. 2. In a video conference system for mutually communicating images and voices between a plurality of terminal devices connected via a communication network, a terminal mode switching means for switching between a chair mode and a general mode, and at least a partner. Display means having a window for displaying an image; window size changing means for changing the size of the partner image display window displayed on the display means in the terminal device operating in the chair mode; When the size of the other party image display window is changed by the changing means, the change operating means for remotely operating the change of the audio signal level in the terminal device of the communication partner operating in the general mode, and the change operating means Level changing means for changing the audio signal level in response to an instruction. TV conference system. 3. The command generation means for generating a control command for changing a voice signal level of a communication partner when the size of the partner image display window is modified by the window size modifying means. 3. The video conference system according to claim 1 or 2, further comprising: a means and a command transmitting means for transmitting the control command generated by the command generating means to the communication partner via a communication network. 4. The changing operation means changes the voice signal level of the communication partner with respect to the communication partner corresponding to the partner image display window whose size has been changed by the window size changing means. The video conference system according to claim 1, wherein the video conference system is operated remotely. 5. The changing operation means raises the audio signal level when the size of the partner image display window is increased by the window size changing means, and reduces the size of the partner image display window by the window size changing means. The video conference system according to claim 4, wherein a changing operation is sometimes performed so as to lower the audio signal level. 6. The changing operation means sets the communication destination of all the communication destinations corresponding to the partner image display windows other than the partner image display window whose size is changed by the window size changing means. The video conference system according to any one of claims 1 to 3, wherein remote control is performed to change the audio signal level. 7. The changing operation means lowers the audio signal level when the size of the partner image display window is increased by the window size changing means, and reduces the size of the partner image display window by the window size changing means. 7. The video conference system according to claim 6, wherein a changing operation is sometimes performed so as to raise the audio signal level. 8. A terminal device for communicating images and sounds via a communication network, the display device having at least a window for displaying a partner image, and the size of the partner image display window displayed on the display device. And a command generation means for generating a control command for changing the voice signal level of the communication partner when the size of the partner image display window is modified by the window size modification means. A terminal device, comprising: command transmitting means for transmitting the control command generated by the command generating means to the communication partner via a communication network. 9. In a terminal device for communicating images and voices via a communication network, display means having at least a window for displaying a partner image, and a size of the partner image display window displayed on the display means. And a voice level changing means for changing the voice signal level of the communication partner when the size of the partner image display window is changed by the window size changing means. And the terminal device.