JPH04207287A - Video telephone conference system - Google Patents

Abstract

PURPOSE:To enable communication to be executed even at the same transmission speed as that of an ordinary video telephone and to enble a video conference to be performed anytime and at any place by synthesizing an image and a voice. CONSTITUTION:A video is decoded by a video decoder 7 passing a communication interface 6, and is synthesized by a video synthesizer 11. The video signal is encoded by a video encoder 12, and passes a communication interface 15, and the same video is sent to respective video telephone set. After a person is specified, a mode switching device 8 is switched to a switching device 13, and also, a specific number detector 9 instructs the device 13 which video is a specified video. The device 13 sends out the video sent from the video telephone set C to A via the interface 15 as it is. The voice is sent to a talker detector 10 via the interface 6. Voice synthesis is performed by a voice synthesizer 14 corresponding to the number of persons checked by the detector 10. The voice is sent to the communication interface 16 by supplying constant delay by a delay device 15.

Description

DETAILED DESCRIPTION OF THE INVENTION [Object of the Invention] (Industrial Field of Application) The present invention relates to a video conference system for holding a video conference between a plurality of speakers using, for example, individual video telephones.

(Prior Art) Conventionally, video conferencing systems have been expensive, so the places where they can be installed have been limited. Therefore, when a user wants to use a video conference system, he or she has to go to the location where the system is installed.

(Problems to be Solved by the Invention) The present invention has been made based on the above circumstances, and even if the places where dedicated video conferencing systems are installed are limited, the present invention will become more widespread. The purpose of the present invention is to provide a video conference system that can be constructed using parts using video telephones.

[Structure of the Invention] (Means for Solving the Problems) The present invention combines and displays videos of multiple participants in a conference in a communication system consisting of multiple videophone terminals, a center, and transmission lines connecting them. The present invention is characterized by comprising means for displaying an image of a selected person among the participants of the conference, and means for identifying a speaker among the participants of the conference and displaying an image of that person. video conference system.

More preferably, the video conference system includes means for decoding the video sent to the center, means for editing the video sent to the center, means for encoding the edited video, and a means for decoding the video sent to the center, and a means for encoding the edited video. , means for switching the video sent to the center, means for detecting a speaker, and means for synthesizing the audio sent to the center.

(Function) According to the present invention, it is possible to construct a video teleconference system using the functions originally provided in video telephones.

(Example) Hereinafter, an example of the present invention will be described with reference to the drawings.

FIG. 1 is an example of a configuration diagram of a video conference system according to this embodiment. The system shown in the figure consists of a center device 2 that synthesizes images and sounds, and a videophone 3. The center device 2 and the plurality of video telephones 3 are interconnected by a transmission line 4.

Next, FIG. 2 shows an example of a schematic configuration diagram of the center device 2 in the video conference system configured as described above. This center device 2 includes a communication interface 6 that receives signals sent from a plurality of videophones 3, and a video decoding device 7 that decodes video information sent from each videophone. Furthermore, a mode switching device 8 for switching between compositing and switching images.
It also includes a special number detection device 9 that recognizes a special number sent from a user and issues an instruction, and a speaker detection device 10 that detects a speaker. A plurality of videos decoded by the video decoding device 7 are combined by a video combining device 11. The video synthesized by the video synthesis device 11 is encoded by the video encoding device 12. The video encoded by the video encoding device 12 is sent by the switching device 13 to
By simply switching, it is sent to another video phone. On the other hand, the speech detected by the speaker detection device 10 is synthesized by the speech synthesis device 14. The speech synthesized by the speech synthesis device 14 is delayed by the delay device 15 and then sent out. It includes a communication interface 16 for sending out the video and audio information sent out as described above to the transmission path.

Next, in this system configured as described above, the operation of the center side when, for example, four people A to D hold a video conference using video telephones as shown in FIG. 1 will be described.

Here, the mode for combining and transmitting the video of everyone is the composite mode, the mode for transmitting the video selected by the user by special number etc. is the selection mode, and the mode for transmitting the video of the person detected by speaker detection is the mode for transmitting the video of the person detected by the speaker. Let's call it mode.

The state shown in FIG. 1 is such that participants A to D are connected to the center side by calling, for example, a specific telephone number from any location. For example, assume that it is predetermined to be in the compositing mode immediately after the start of the conference.

In this case, first, the A-D video is transmitted through the communication interface 6.
The signals are passed through the video decoding device 7, decoded, and then synthesized by the video compositing device 11 in a form that divides the screen into four, as shown in FIG. 3, for example.

Here, as a method of composing the images, A to D may be arranged horizontally, or the background and the person may be separated and arranged horizontally.

Next, this synthesized video signal is encoded by the video encoding device 12 and sent via the communication interface 15.
The same video is sent to each videophone. Here, the transmission speed of the encoded video may be the same as the speed at which each video phone sends video to the center, or may be the number of users times the speed at which each video phone sends video to the center. .

In addition, although the videos of all participants were combined here, it is of course not necessary to include your own video.

Next, we will describe the operation when A wants to see C's video while a video conference is being held in composite mode. Here, if you dial "#2" in advance,
Assume that it has been decided to switch to selection mode. First, A uses the special number (#2) to request the center to switch modes. Center 5 received “#2”
The special number detection device 9 determines “#2”, and then A
Wait for instructions on which screen from D to display. This instruction can be given, for example, by displaying "#2*3" on the screen and dialing a certain number, or if a mouse is connected, by clicking the mouse on the screen. A method of selecting which screen you want to display may also be used. After the person is identified in this way, the mode switching device 8 switches the switch to connect with the switching device 13, and the special number detection device 9 informs the switching device 13 of which video is identified. (here refers to the video of C). Next, the switching device 13 sends the video sent from C directly to A via the communication interface 15. Here, you may decide in advance to return to the composition mode by dialing "#1°," for example.Next,
The operation when switching to speaker mode will be described.

Here, it is assumed that it has been determined in advance that dialing "#3" will switch to the selection mode. first,
A uses the special number (#3) to request the center to switch modes. After receiving "#3", the center 5 uses the special number detection device 9 to determine "#3°." Next, the special number detection device 9 performs speaker detection on the speaker detection device 10. It also instructs the mode switching device 8 to switch the switch to the one connected to the switching device 13. When the speaker detection device 10 detects the speaker, it sends the information to the switching device 13. , the switching device 13 will transmit an image of the speaker to A via the communication interface 15. Here, speaker detection is to detect the speaker of the conference.
For example, if multiple people are speaking, the person with the loudest voice may be detected. In addition, if the screen is changed every time the speaker changes, the screen will change rapidly and become difficult to see, for example when the discussion becomes tense. , the screen may be changed after a certain period of time.

Next, operations on the center side regarding audio information during a conference will be described. The voices A to D are sent to the speaker detection device 10 via the communication interface 6. Find out how many people are speaking at the same time. Next, speaker detection device 1
0, depending on the number of people investigated, the speech synthesizer 1
4 performs speech synthesis. For example, if A is the only speaker, A's voice is sent as is to BD. If there are multiple speakers, you can, for example, multiply the level of each speaker's voice by 1/n (n is the number of speakers) and synthesize it, or combine the voices of all speakers. may be synthesized as is. In addition, if the energy level is saturated when the voices of all speakers are synthesized, the RMS
may be used to control the level. Also, if you perform speaker detection and synthesize only the speaker's voice, it may become silent, but in this case, you can leave it silent, or
Ambient noise etc. may be transmitted separately.

Further, although the case where a speaker detection device is used has been described here, it is of course possible to use a method of synthesizing the voices of all participants as they are. Next, the voice synthesized in this manner is sent to the communication interface 16 after being given a certain delay by the delay device 15. At this time,
In the case of composite mode, the video delay within the center is determined by the decoding −
Since composite encoding is performed, it is expected that the size will be quite large. Therefore, if the audio is transmitted as is without any delay, the video and audio will be significantly out of sync on the videophone. Even if the videophone has a built-in delay circuit, it is necessary to decode it for general use.
Since the process of combining and encoding is not taken into account, this delay must be guaranteed at the center. In addition, if each videophone does not have a function to compensate for audio delay,
A delay may be given at the center. Like this,
Since the delay correction differs between the combination mode, selection mode, and speaker mode, control may be performed to change the amount of delay depending on the mode detected by the special number detection device 9.

Here, we have described the operation of the center when one group holds a conference, but of course it is also possible that multiple groups hold different conferences at the same time, but in this case the center has multiple equivalent functions. If you have it, you can make it happen.

Further, the center may be located on the network side, or a specific terminal may have this function. Furthermore, it goes without saying that the network may be a public network or a dedicated line network.

[Effects of the Invention] As explained above, according to the video conference system of the present invention, by synthesizing images and sounds, communication can be performed even at the same transmission speed as a normal video phone. It is also possible to send high-quality video by changing the transmission speed, but even in this case, the video phone only needs one codec, so the system can be constructed at low cost.

Furthermore, there is no need to install an expensive video conference system, and there is no need to go to a place where a video conference system is installed, allowing video conferences to be held anytime and anywhere.

[Brief explanation of the drawing]

FIG. 1 is a diagram showing an example of a schematic configuration diagram of the video conference system according to the present invention, FIG. 2 is a diagram showing an example of a schematic configuration diagram inside the center of the video conference system, and FIG. FIG. 2 is a diagram illustrating an example of a screen format when images of all participants in a teleconference system are combined. DESCRIPTION OF SYMBOLS 1... Video conference system, 2... Center device, 3... Video telephone, 4...
Transmission path, 5... Center device, 6... Communication interface. 7... Video decoding device, 8... Mode switching device. 9...Special number detection device, 10...Speaker detection device, 11
...Video synthesis device, 12...Video encoding device, 13
... Switching device, 14... Speech synthesis device. 15...Delay device, 16...Communication interface Fig. 4 1 212 Fig. 3

Claims (5)

[Claims] (1) In a communication system consisting of a plurality of videophone terminals, a center, and a transmission line connecting these, there is a means for synthesizing and displaying images of multiple participants in a conference, and a means for combining and displaying images of multiple participants in a conference, and A video teleconference system characterized by comprising means for displaying an image, and means for identifying a speaker among participants in a conference and displaying an image of that person. (2) In claim 1, the means for synthesizing and displaying videos of a plurality of participants is a means for editing the sent videos of all participants according to an arbitrary format and encoding them in a predetermined manner at the center. A video teleconferencing system comprising: (3) In claim 1, the means for displaying the video of the person selected from among the conference participants is configured to display the video selected by the user in a predetermined method at the center among all the videos sent. 1. A video conference system characterized by comprising means for selecting from among the following and transmitting it as is. (4) In claim 1, the means for identifying the speaker and displaying the image of the person detects the speaker from the audio information sent at the center and displays the image of the detected speaker. A video teleconference system characterized by including means for transmitting data as is. (5) In a communication system consisting of multiple videophones, a center, and a transmission line connecting them, a means for adjusting the volume to a predetermined volume and synthesizing the sound according to the number of people talking at the same time, and the sound synthesized by this means. 1. A video teleconference system comprising: means for transmitting a video with a predetermined delay.