JPH06152765A - Video conference system - Google Patents

Abstract

PURPOSE:To carry out a conference in a smooth and efficient way by reducing the burden on user's operations such as the display of the personal information of the attendants in the conference, etc. CONSTITUTION:A conference user sets his call card at a scanner 5 and inputs the personal information through a console 2 to inform a system control part 22 of the information. Then the user controls a monitor TV interface 38 to display the animation image on its own terminal. The input still picture information is written in a still picture image memory 31, and the part 22 produces the picture information for an animation image memory 30 to designate a display position and then displays the picture information on a monitor TV 3. When the display position is designated by the user, the information on this designated position is transmitted as the additional information of the personal information. At the conference terminal of the receiver side, the display position information is extracted out of the received personal information and stored in the memory 31. The part 22 successively reads the information out of the memory 31 to send these information to the address corresponding to the display position of the memory 30. Then the animation images are synthesized and transferred to the TV 3 for display.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video conference system, and more particularly to a multi-point video conference system for handling voice, moving images and still images, and a video conference system comprising audiovisual terminals such as AGC terminal devices.

[0002]

2. Description of the Related Art In recent years, due to the development of digital public communication networks, it is predicted that the video conference system will spread rapidly, and the standardization of the video conference system (CCI
H.T. of TT recommendation 320) enables connection between different types of video conference systems. With such a background, video conferences that have been held locally, such as inter-site communication within companies, are now being held globally via a public network like telephones. As a form of using the video conference accompanying this, the use of the video conference between the first meeting person and the group first meeting is expected more and more in the future.

Therefore, unlike the actual conference in which the conferees meet together, the conventional video conferencing system does not have an application equivalent to exchanging business cards introduced by the conferees who meet for the first time. Was introducing himself through moving images and voice communication, for example. Further, in the conventional video conference system, the following means are mainly adopted as a means for communicating voice information. That is, the voice information is simply synthesized and distributed, the token level is automatically detected and the token is controlled, or the conductor is defined and the token is controlled by switching the switch by the conductor. Specifically, it is mainly used in a video conference system between two points, and when a plurality of voice input devices are connected to one terminal, the voice is synthesized and transmitted to the partner terminal. The means (1) and (2) are used in a video conference system between two points or multipoints, and in a system which is star-connected in the multipoint video conference system, an MCU (Mu
The control is performed within the ltippoint Control Unit.

A conventional example of this type is, for example, Japanese Patent Laid-Open No.
There is one disclosed in Japanese Patent Laid-Open No. 302159. Further, in the conventional video conference system, the following means are mainly adopted as means for communicating moving image information. That is, it simply sends the image of its own terminal to the other terminal (when it is between two points), automatically performs token control along with the switching of voice tokens, determines a conductor, and synthesizes images selected by the conductor. , Distribution was done. In the case of this moving image, it is necessary to adjust the composition of the moving image input device and the focal length, but this is adjusted by the conductor or each terminal. Specifically, in the above means, the operation information displayed on the own terminal or the other terminal is controlled by the console of the own terminal or the console of the other terminal, and the moving image input device is selected, the composition of the moving image input device, and the focus of the moving image input device. I was adjusting the distance. Also,
In the conventional means, the conductor inputs the terminal number, the moving image input device number, and adjusts the moving image input device as in the case of.

A conventional example of this type is, for example, Japanese Patent Laid-Open No.
There is one disclosed in Japanese Patent No. 3587. In the conventional video conference system, the conference material is mainly designated by the material number, and the conductor (the user when the conductor is not set) inputs the material number from the console to display the conference material. Displayed above or output from printer.

A conventional example of this type is, for example, Japanese Patent Publication No. 2
There is one disclosed in Japanese Unexamined Patent Publication No.-30624.

[0007]

However, in such a conventional video conference system, there is no application corresponding to business card exchange in a normal conference that does not use the video conference system, so that the user can display moving images and Since there is only a means to introduce yourself through voice communication and it is not possible to attend the meeting after fully recognizing each other, there is a problem that the operation of the meeting is disturbed.

Further, according to the conventional means, the conductor inputs the terminal number or the voice input device number to switch the voice input from the plurality of voice inputs connected to one terminal or the voice input from the plurality of terminals, and the voice is input. I was switching inputs. Therefore, in order to give a token to a speaker, the conductor needs to be aware of the terminal used by the speaker and the voice input device installed closest to the speaker. There was a problem that a great load was imposed when the meeting was held with the other party, and the operation of the meeting was hindered.

Further, during the usual video conference,
There are many demands for close-up display of the appearance of the speaker.Therefore, every time the speaker operates, the user operating the console switches the video input device, changes the composition of the video input device, or changes the focal length. Coordination has been forced, and there was a problem that a large number of people, especially when holding a meeting with the person they met for the first time, imposes a great load and hinders the operation of the meeting.

Further, the conventional conference material is mainly designated by the material number, and the conductor (the user when the conductor is not set) inputs the material number from the console to display the conference material on the display device. It was displaying or outputting from the printer. For this reason, which material was created or registered by the conductor (user)
Had to be aware of that, there was a problem that the conductor (user) would be overloaded and the operation of the conference would be hindered.

The present invention has been made in view of the above-mentioned conventional problems, and displays personal information of attendees of a conference during holding of the conference and retains the personal information input once to use at the time of holding another conference. By reducing the operational burden on the user and specifying each of these users by specifying personal information for voice token, video display, switching of meeting materials, or adjustment thereof. , The purpose is to provide a video conference system that smoothly and efficiently conducts conferences.

[0012]

The invention according to claim 1 is
In a video conference system that conducts a conference by communicating voice data, moving image data, still image data, etc. between two points or multiple points via a communication line, a personal information reading means for reading personal information of a conference participant and reading Personal information storage means for storing the stored personal information, personal information transmission means for transmitting the stored personal information to the other conference terminal, and personal information display for displaying the personal information transmitted to the other conference terminal on the screen. Means and are provided.

According to a second aspect of the present invention, in the video conference system according to the first aspect, a personal information holding means for holding the personal information of the conference participants input at the own terminal even after the conference is ended, and a new conference is held. Sometimes, a personal information list display means for displaying a list of the held personal information, and a personal information calling means for reusing the personal information by selecting and designing the user of the personal information by looking at the displayed list. And are provided.

According to a third aspect of the present invention, in the video conference system according to the first aspect, the personal information storage means is
When personal information is stored, it is stored in association with the position information of the conference participation terminal or the voice input device, and by designating the personal information displayed on the display device, it corresponds to the designated personal information. It is characterized in that a voice input switching means for switching the voice input from the conference participation terminal or the voice input from the voice input device is provided.

According to a fourth aspect of the present invention, in the video conference system according to the first aspect, the personal information storage means is
When personal information is stored, it is stored in association with the composition information of the conference participation terminal or the moving image input device, and by designating the personal information displayed on the display device, it corresponds to the designated personal information. It is characterized by further comprising moving image control means for switching the moving image input from the conference participation terminal and controlling the composition of the moving image input device.

According to a fifth aspect of the present invention, in the video conference system according to the first aspect, the personal information storage means is
When storing personal information, store it in correspondence with meeting materials,
By designating personal information displayed on the display device, there is provided a conference material display means for displaying the conference material corresponding to the designated personal information. The invention according to claim 6 is, in the video conference system according to any one of claims 3 to 5, for personal information designated, personal information designation for displaying on the display device a display clearly indicating that the personal information has been designated. It is characterized by having an explicit means.

[0017]

In the invention according to claim 1, the personal information of the conference participants is read in advance by the personal information reading means before the conference is held.
The personal information is stored in the personal information storage means, the stored personal information is transmitted to the partner conference terminal by the personal information transmission means, and the transmitted personal information is displayed on the screen during the conference by the personal information display means of the partner conference terminal. Since it is displayed, the conference can be operated smoothly and efficiently.

According to the second aspect of the invention, the personal information of the conference participants at the own terminal entered in the first aspect is retained by the personal information retaining means even after the conference is ended, and a personal information list is displayed when a new conference is held. By displaying a list of personal information held by the means and allowing the user to select and specify by personal information calling means while looking at the list of personal information, the personal information once input can be used even when another meeting is held. It can be used and the burden on the user for operating the system is reduced.

According to the third aspect of the invention, when the personal information is stored by the personal information storing means of the first aspect, the personal information is stored in correspondence with the position information of the conference participation terminal or the voice input device, and the personal information is stored on the display device. When the personal information displayed in is designated, the voice input switching means automatically switches to the voice input from the conference participation terminal corresponding to the designated personal information or the voice input from the voice input device. The burden on the users involved in meeting management is reduced.

According to a fourth aspect of the present invention, when the personal information is stored by the personal information storing means of the first aspect, the personal information is stored in association with the composition information of the conference participation terminal or the moving image input device, and the display device. When the personal information displayed above is specified, the moving image control means performs switching of moving image input from the conference participation terminal corresponding to the specified personal information and composition control of the moving image input device. , The burden on the users involved in meeting management is reduced.

According to the invention of claim 5, when the personal information is stored by the personal information storing means of claim 1, the personal information is stored in association with the conference material, and the personal information displayed on the display device is stored. When specified, the meeting material display means displays the meeting material corresponding to the specified personal information, so that the burden on the user concerning the operation of the meeting is reduced. In the invention described in claim 6, as described in claims 3 to 5, it is displayed on the voice token holder during the conference operation, the user shown in the moving image on the display device, or the display device. The user who created and registered the meeting materials,
Since the personal information is designated and displayed on the display device, the conference operation can be smoothly and efficiently performed.

[0022]

Embodiments of the present invention will be described below with reference to the drawings. In the present embodiment, a video conference system connected between two points will be described as an example. First, the configuration will be described. FIG. 1 is a schematic diagram showing the overall configuration of an embodiment of a video conference system according to the present invention. In the figure, 1,51
Is a main device of a video conference system connected via an ISDN line, 2, 52 is a console for controlling the main device, 3, 53 is a monitor TV mainly used for displaying moving images, 4, 54 Is a speaker built into the monitor TV, 5, 55 is a scanner connected to read still images such as conference materials, 6, 56 is a printer connected to output still image information, and 7 is still images Is a liquid crystal projector connected to display a screen, 8 is a screen for projecting a still image by the liquid crystal projector 7, 57
Is also an LCD (liquid crystal display device) connected to display a still image, 9, 10, 59 are video cameras for inputting moving images, and 11, 12, 61 are videos operated by control signals from the main device. A pedestal for adjusting the composition of the camera, and 13, 14, 15, 63, and 64 are microphones for inputting voice. Also, 16-21,6
6 to 69 are users who are participating in the video conference. Then, the main devices 1 and 51 communicate with each other by voice data, moving image data, still image data, etc. to perform a teleconference, ISDN (Integrated Services).
It is connected via a network 70 such as a Digital Network).

FIG. 2 is a block diagram showing a configuration example of the main unit of the conference terminal on the A side in FIG. In the figure, 1 is a main unit, 22 is a system control unit (SCU) that manages and controls the entire main unit 1, 23 is a network interface unit (INCU) that interfaces with an ISDN network,
Reference numeral 24 denotes a multimedia demultiplexing / demultiplexing unit (M) for demultiplexing / demultiplexing signals for each medium (voice, moving image, still image, data) used in this system on the ISDN transmission path.
PX / DMPX), 25 is a voice encoding / decoding unit that performs encoding, decoding, or echo cancellation processing of voice, and 26 is a moving image encoding / decoding unit that performs high-efficiency encoding / decoding of color moving images. , 27 is a still image encoding / decoding unit that encodes and decodes still image data, 28 is an audio input changeover switch that selects a plurality of audio inputs and connects to the audio encoding / decoding unit 25, and 29 is the same. An operation input changeover switch for selecting a plurality of operation inputs and connecting to the moving image encoding / decoding unit 26, 30 a moving image memory for temporarily storing a moving image, and 31 similarly similarly for temporarily storing a still image. Image memory for still images, 32, 33 and 34 are microphone interfaces for inputting audio signals from the microphones 13, 14 and 15 and performing amplification, analog and digital conversion, and 35 is a decoded interface. A speaker interface that performs digital / analog conversion and amplification of the generated audio signal and outputs the amplified audio signal to the speaker 4. Reference numerals 36 and 37 input the video signal from each video camera, perform decoding and analog / digital conversion to the video image memory 30. A video camera interface for writing out and outputting a control signal such as a change of focal length to the video cameras 9 and 10 under the control of the system control unit 38, 38 reads out moving image data from the moving image memory 30 and performs digital / analog conversion. , A monitor television interface for encoding and outputting to the monitor television 3, 39 is a liquid crystal projector interface for reading out still image data from the still image memory 31 and outputting it to the liquid crystal projector 7, 40 is under the control of the system control unit 22 , Various systems A scanner interface that outputs signals to the scanner 5 and writes the still image data read from the scanner 5 to the still image memory 31. 41 outputs various control signals to the printer 6 under the control of the system controller 22. Also, a printer interface for reading still image data from the still image memory 31 and outputting it to the printer 6,
42 and 43 are controlled by the system control unit 22.
A pedestal control interface that outputs a control signal that causes the pedestal of each video camera to perform up, down, left, and right operations, 44 notifies the system control unit 22 of key input data from the console 2, and the console in accordance with control by the system control unit 22. 2 is a console interface for outputting display data displayed on the console 2 to the console 2, 45 is a magnetic disk for storing input or received still image information, system management information and the like, and 46 is an IS to which the main unit is connected.
It is a DN line.

The video conference system of this embodiment is configured as described above. The operation will be described below. First of all, it is necessary to connect the line before starting the video conference. This follows the normal call (or call) procedure done through LAPD. FIG. 3 is a sequence chart explaining a communication protocol between a calling side and a called side of a video conference system between two points, and FIG. 10 is a flowchart showing a procedure of starting and ending the video conference system.

Therefore, as shown in FIGS. 3 and 10, the calling operation is performed from the calling terminal side to the called terminal side (step 100), and the line is connected. The user of the calling side terminal (A side) of FIG. 1 operates the console 2 first,
Enter the ISDN number of the other party's terminal and then make a call. As shown in FIG. 2, the console 2 is operated by the system control unit 2 via the console interface 44.
2 will be notified. Then, the system control unit 22 controls the network interface unit 23 to make a call (SETUP) to the ISDN network 46. Looking at this in Figure 3,
SETUP (call setup message) is a transmission capability (BC)
Unrestricted Digital, Lower Layer Consistency (LLC) to H.264.
221, High Layer Consistency (HLC) is sent out as a conference.

When the partner terminal analyzes the SETUP and the communication possibility is approved, the partner terminal returns a CONN (response) (step 101) and the call is established (step 10).
2). Here, in the lower layer consistency, the H.264 standard is used. 221 is C in the multimedia multiplexing / separating unit 24 in FIG.
H.C. of the CITT recommendation. 221 is being executed. When the call is established in this way, the system control unit 22 controls the multimedia multiplexing / separating unit 24 to send out a multi-frame synchronization signal to establish multi-frame synchronization, as shown in FIG. (Step 10
3).

Further, the system control unit 22 uses the CCIT
H.T. The multimedia multiplexing / separating unit 23 is controlled according to 242 to notify the capability (step 104),
A communication mode is established (step 105). this is,
H. This is performed on the BAS signal on the H.221, and the channel setting and bit rate allocation necessary for the common capability are performed. In this embodiment, three channels are assigned (assigned): an audio channel, a moving image channel, and a data (still image) channel. Then, when the communication mode is determined, each channel can be treated as independent B channel data (step 106), a protocol required for each channel is created, and operation as a conference system is started (step 107). ).

When the conference is started, the user 1 shown in FIG.
6, 66 (users operating consoles) operate consoles 2, 52, respectively, to select a microphone for inputting voice data to be transmitted to the other party. Therefore, taking the main unit 1 on the A side shown in FIGS. 1 and 2 as an example, the input from the console 2 is notified to the system control unit 22 via the console interface 44, and the system control unit 22 switches the voice input. The switch 28 is controlled to connect the designated microphone input path to the voice encoding / decoding unit 25.
The voice input from the designated microphone is amplified by any of the microphone interfaces 32, 33, 34,
The analog data is converted into digital data and input to the voice encoding / decoding unit 25 via the voice input changeover switch 28. The voice encoding / decoding unit 25 receives the input voice data from the partner terminal, decodes the voice data, and performs echo cancellation processing with the voice data output to the speaker interface 35. It is encoded according to 722 and transmitted to the above-mentioned voice channel.

On the contrary, the voice data received from the partner terminal is input from the voice channel to the voice encoding / decoding unit 25, and the voice encoding / decoding unit 25 receives the G.264 data. Decoding is performed according to 722, and output to the speaker interface 35. The speaker interface 35 performs digital / analog conversion on the input signal, amplifies the signal, and outputs the amplified signal to the speaker 4.

Further, the user 16 operates the console 2 as in the case of voice to select a video camera for inputting the moving image data to be transmitted to the other party. The input from the console 2 is notified to the system control unit 22 via the console interface 44, and the system control unit 22 controls the moving image input changeover switch 29, and the moving image encoding / decoding unit determines the designated video camera input path. Connect to 26.

Note that the B-side terminal shown in FIG. 1 does not require the above operation since only one system of moving image input is possible. Video input from this video camera is decoded by the video camera interfaces 36 and 37 (NTS
The C signal is separated into Y / C), analog / digital conversion is performed, and the data is written in the moving image memory 30. Of the data once stored in the moving image memory 30, only the moving image data from the video camera selected via the moving image input changeover switch 29 is input to the moving image encoding / decoding unit 26. The moving picture encoding / decoding unit 26 uses the H.264 standard recommended by CCITT. After converting to a format according to H.261, it is encoded and transmitted to the above-mentioned moving picture channel.

On the contrary, the moving picture data received from the partner terminal is input to the moving picture coding / decoding section 26 from the moving picture channel, and the moving picture coding / decoding section 26 sends the H.264 data. Decoding is performed in accordance with H.261, and the format is converted and then written in the moving image memory 30. The data once stored in the moving picture image memory 30 is read out by the monitor TV interface 38, converted into digital / analog, and output to the monitor TV after encoding. At this time, the moving picture is controlled by the system control unit 22. It is possible to perform switching processing (switching processing to display of the transmitted self-terminal moving image data) of images (superimpose, picture-in-picture, etc.).

When adjusting the focal length and composition of the video camera, the user inputs an adjustment key prepared on the console 2. The input from the console is notified to the system control unit 22 via the console interface 44. The system control unit 22 controls the video camera interface 36 or 37 to transmit a control signal for adjusting the focal length and a pedestal control interface 42.
Alternatively, the control signal 43 is controlled to be transmitted as a control signal for composition adjustment. The focus position adjustment (focusing) is performed as a function of the video camera alone.

The conference material may be transmitted in advance before the conference is held or in the case where the conference is being held. Here, the operation when transmitting the conference material will be described. Therefore, the user sets the conference material to be transmitted to the scanner 5 and then the console 2
Enter the ID number and the reading instruction to identify the conference material. The console interface 44 notifies the system control unit 22 of the input data, and the system control unit 22 controls the scanner interface 40 according to the reading instruction to input the still image information from the scanner 5.
The input still image information is the scanner interface 4
It is transferred to the still image memory 31 via 0.

Subsequently, the system control unit 22 controls the still image encoding / decoding unit 27 to perform encoding. At this time,
Control is performed so that the ID number previously input is added as the attribute information of the conference material. The still image encoding / decoding unit 27
Read still image data from the image memory 31 for still images,
After encoding, the ID number is added and the data is transmitted to the above-mentioned data channel.

On the contrary, when the conference material is received, the still picture coding / decoding section 27 extracts the ID number from the still picture information from the data channel and notifies the system control section 22 to carry out the decoding. After that, the image is written in the still image memory 31. Based on the received ID number, the system control unit 22 creates a file managed by the ID number in the magnetic disk device 45, reads the data from the still image memory 31 and stores it in the file.

When displaying the still image information, the user inputs the ID number and the display instruction from the console 2. The console interface 44 notifies the system controller 22 of the input data, and the system controller 22 identifies and reads the file stored in the magnetic disk device 45 from the ID number according to the display instruction, and reads the still image memory 3
Written to 1. Subsequently, the system control unit 22 controls the liquid crystal projector interface 39 to read the data in the still image memory 31 and transmit the data to the liquid crystal projector 7.

After the conference (step 108), the B channel protocol is disconnected (step 109) and the call is disconnected (step 110). Next, the operation of the video conference system according to the invention of each claim will be described. 4A and 4B are views showing a display screen of a monitor television according to an embodiment of the invention described in claim 1, where FIG. 4A is a display screen of a self-terminal image on the A side, and FIG. 4B is selection of a display position on the A side. Screen, (c) is the display screen during the conference seen on the monitor TV on the A side, (d) is B
Side display screen of own terminal image, (e) is a display screen for selecting the B side display position, (f) is a display screen during a conference viewed on the B side monitor TV, and FIG. 11 is the invention according to claim 1. 12 is a flow chart showing an operation at the time of inputting personal information according to claim 1, FIG. 12 is a flow chart showing an operation at the time of receiving personal information according to the invention of claim 1, and FIG. 13 is a flow chart showing personal information according to the invention of claim 1. It is a flow chart which shows operation at the time of display.

First, in the video conference system according to the embodiment of the first aspect, the personal information of the conference participants is input in advance when the conference is held. Although various forms are conceivable as the input means, an example of inputting a business card (still image information) as personal information will be described here. First, as shown in FIGS. 1 and 11, the user sets the business card scanner 5 and instructs the console 2 to input personal information (step 200). The input from the console 2 is, as shown in FIG.
4 is notified to the system control unit 22, and the system control unit 22 controls the monitor television interface 38 as described above to display the moving image data of the own terminal as shown in FIG. 4 (a). (In the case of the terminal on the B side, FIG.
(Displayed as (d)).

Then, the system controller 22 controls the scanner interface 40 to input the still image information from the scanner 5 (step 201). The input still image information is written to the still image memory 31 via the scanner interface 40 (step 20).
2). Subsequently, the system control unit 22 creates image information as a guide for designating the display position in the moving image memory 30 (step 203), and controls the monitor TV interface 38 to create the created image on the monitor TV 3. (Step 204, see FIG. 4B), and prompts the user to input the display position (in the case of the B-side terminal, it is displayed as shown in FIG. 4E). The user of the A side terminal is
When the designation of the display position is input from the console 2 while looking at this screen (step 205), the system control unit 22
Controls the still image encoding / decoding unit 27 to perform encoding, and controls to add the display position information input at this time as additional information of personal information (step 20).
6). The still image encoding / decoding unit 27 reads the still image data from the still image memory 31 and encodes the image data (step 207), adds the display position information, and transmits the information to the above-mentioned data channel (step). 208). In addition,
If the scanner 5 is not ready in step 201, an error message is displayed on the console 2 (step 209).

On the contrary, when the A side terminal receives the personal information from the B side terminal (step 300), the still picture coding / decoding section 27 extracts the display position information from the still picture information from the data channel. After notifying the system control unit 22 to perform decoding (step 301), it is stored in the still image memory 31 (step 302). The system control unit 22 stores the address of the personal information stored in the still image memory 31 and the notified display position in association with each other (step 303). By repeating the above operation, the personal information of all the conference participants is transmitted and received.

After the completion of the transmission / reception of the personal information, if there is an instruction to display the personal information (step 400), the system control unit 22 sequentially receives it from the still image memory 31 or inputs it at its own terminal. The personal information is read and transferred to the address corresponding to the display position on the moving image memory 30 (step 401). The monitor TV interface 38 transmits data to the monitor TV 3 after performing processing such as synthesizing a moving image, and the data is sent to the monitor TV 3 as shown in FIG. )
Is displayed (step 402). In this way, the above operation is repeated until all the information is displayed (step 403).

As described above, in the embodiment described in claim 1, the personal information of the conference participants is transmitted and received between the conference terminals in advance before the conference is held, and the personal information is called during the conference and displayed on the monitor TV screen. It is displayed at a predetermined position of. Therefore, the conference participants can easily obtain the personal information corresponding to the business card exchange of the other conference participants, as in the actual conference, and can smoothly and efficiently conduct the conference.

Next, the operation of the video conference system according to the second aspect of the invention will be described. FIG. 5 shows claim 2.
It is a figure which shows the example of a screen display of the monitor television which concerns on one Example of the described invention, (a) is a display screen of personal information of the registered user, (b) is a selection screen of a display position, 14 is a flow chart showing an operation at the time of inputting personal information according to the invention of claim 2.

In the video conference system according to the second aspect, when an instruction to input personal information is given from the console 2 in FIG. 1 (step 500), first, the system control unit 22 is stored in the magnetic disk device 45. Read 1 personal information. Here, the personal information read out is stored in the following procedure. That is, in the above-described embodiment according to claim 1, the system control unit 2
When 2 controls the still image encoding / decoding unit 27 to encode the personal information, the encoded data is read,
The data is written under a personal information storage directory prepared in advance in the magnetic disk device 45.

The system control unit 22 sequentially reads the personal information stored in the above procedure and inputs it to the still image coding / decoding unit 27 (step 501). The still image coding / decoding unit 27 decodes the input data and writes it in the still image memory 31 (step 50).
2). The system control unit 22 includes a still image memory 31.
The data written in is sequentially transferred to the moving image memory 30 (step 503), the selection number is written in the moving image memory (step 504), and the combined display is made on the monitor television 3. An example of this display screen is shown in FIG.
It is (a).

If there is undisplayed data in the magnetic disk device 45, the above operation is repeated (step 505), and when all the data are displayed, the input of the information selection number of the registration data is awaited. The user selects valid information from the list of personal information displayed on the screen as shown in FIG. 5A (personal information of users participating in this conference).
Is searched, and if there is, the current display position is input by the number of the information displayed on the console 2 and the display position selection screen of FIG. 5B (step 506).

The system control unit 22 controls the still picture coding / decoding unit 27, and if the input information number is a valid number, the personal information corresponding to the information number is operated in the same manner as in claim 1 ( The transmission is performed in steps 508 to 513 in FIG. 14, which are steps 203 to 208 in FIG. 11. If the information number is not valid in step 507, personal information has not been input, and therefore the same operation as that of claim 1 (see FIG. 1).
The personal information is input and transmitted in steps 513 to 522 of FIG. 14 which are steps 201 to 209) of step 1. At that time, in step 521, the encoded personal information is stored in the magnetic disk so as to be prepared for the next reuse.

Next, the operation of the video conference system according to claim 3 will be described by taking the case where the user 16 of FIG. 1 is a conductor as an example. FIG. 6 is a diagram showing a screen display example of a monitor television according to an embodiment of the invention described in claim 3, and FIG. 15 is a flowchart showing an operation at the time of inputting personal information according to the invention described in claim 3. FIG.
Is a flowchart showing an operation at the time of receiving personal information according to the invention of claim 3, FIG. 17 is a flowchart showing an operation at the time of designating personal information according to the invention of claim 3, and FIG. FIG. 19 is a flowchart showing an operation at the time of displaying personal information according to the invention described in FIG.
7 is a flowchart showing an operation when receiving a microphone number according to the described invention.

Also in the video conference system according to claim 3, personal information is input (steps 600 to 610 in FIG. 15) by substantially the same operation as in claim 1 (steps 200 to 209 in FIG. 11). ). A characteristic point here is that when the personal information is input, the display position number is input (step 605) and the microphone number is input (step 60).
6) is performed. That is, the microphones 13, 1 that are located closest to each user (used by each user)
The numbers 4 and 15 are input by the same means as the input of the display position.

For example, in the terminal A on the side shown in FIG. 1, the users 16 and 19 input the microphone number of the microphone 13. Next, the input microphone number operates almost the same as in the case of claim 1 (steps 300 to 303 in FIG. 12).
Is transmitted to the partner terminal as additional information of personal information similar to the display position information (step 700 in FIG. 16).
~ 703).

When the transmission and reception of the personal information is completed as described above, the conference is advanced by the display on the monitor television 3 as shown in FIG. 6, but in the video conference system according to claim 3, the conference is displayed. Appropriate numbers are assigned to the personal information to be displayed together. Further, although FIG. 6 shows a display example in which the child screen is set and the personal information of all conference participants is displayed, only the personal information is displayed in the fixed area even when the child screen is not set. You can also do so. This is because in the video conference system according to the third aspect, the personal information of all the conference participants is always displayed so that any conference participant can be designated.

Next, the user 16 acting as a conductor switches the voice token according to the displayed personal information number. For example, when giving a token to the conference user of the B-side terminal, "3" is input (step 8).
00). That is, the input from the console 2 is notified to the system control unit 22, and the system control unit 22 specifies the personal information from the input number (step 801,
802).

If the designated number is the B side terminal (corresponding terminal), the microphone number corresponding to the personal information is transmitted via the data channel of the multimedia multiplexing / separating section 24 (step 803). ). When the microphone number is received (step 1000), the B-side terminal switches voice input according to the received microphone number (step 1001).

When the designated number is the A-side terminal (own terminal) (step 802), the system control unit 22 controls the voice input changeover switch 28 in the own terminal to switch the voice input ( In step 805), the microphone number is not transmitted to the B-side terminal. In this case, the voice input changeover switch 28 of the B side terminal holds the previous state, and the voice signal received from the B side on the A side is discarded by the voice encoding / decoding unit 25 and output to the speaker 4. Is not performed (step 806). Also,
The display operation of the personal information is performed by substantially the same operation as in claim 1 (steps 400 to 403 in FIG. 13) (steps 900 to 904 in FIG. 18).

Next, the operation of the video conference system according to claim 4 will be described by taking the case where the user 16 of the A-side terminal is a conductor as an example. FIG. 7 is a diagram showing a screen display example of a monitor television according to an embodiment of the invention described in claim 4, (a) is a display screen of the own terminal image,
FIG. 8B is a camera composition registration screen, FIG. 8C is a display position selection screen, and FIG. 8 is a diagram showing a screen display example of a monitor television according to an embodiment of the present invention. ) Is a display screen during a meeting, (b) is a display screen after personal information is specified, FIG. 20 is a flowchart showing an operation at the time of inputting personal information according to the invention of claim 4, and FIG. 4 is a flowchart showing an operation when receiving personal information according to the invention described in claim 4, FIG. 22 is a flowchart showing an operation when displaying personal information according to the invention described in claim 4, and FIG. 23 is an invention described in claim 4. 24 is a flow chart showing the operation when the personal information is designated, and 24 is a flow chart showing the operation when the camera control information according to the invention of claim 4 is received.

Also in the video conference system according to claim 4, personal information is input by the same operation as in the case of claim 1 (flow of FIG. 11) (flow of FIG. 20), but the feature here is The number, composition, and focal length of the video camera when each user closes up is registered in advance. Therefore, the user 20 at the A-side terminal
The case of registering will be described as an example.

First, the user 16 who operates the console 2 shown in FIG. 1 operates the console 2 and sets the input of the video camera to the video camera 9. Furthermore, user 16
Operates the console 2 to adjust the focal length of the video camera 9 and the angle (composition) of the pedestal 11 so that a close-up image of the user 20 is displayed on the monitor TV 3. Then, when registration of personal information is instructed as in the case of claim 1 (step 1100), the system control unit 22 causes the video camera number (9 in this case) selected at that time, the focal length of the video camera, and the selection. The angle information of the pedestal 11 that controls the composition of the video camera is stored (step 1101), and is transmitted to the partner terminal as additional information of personal information similar to the display position information (steps 1103 to 1110).

FIG. 7 is a diagram showing a state of the monitor television screen at the time of registration. In FIG. 7, FIG. 7B to FIG.
Although the focal length and composition of the video camera are switched to full display when switching to (c), the focal length and composition of each video camera during full display are preset for each video camera. On the personal information receiving terminal side, personal information is received by the same operation as in claim 1 (flow of FIG. 12) (flow of FIG. 21), but here, the display position input when personal information is input. The number, camera number, focal length, pedestal angle, etc. are written in the still image memory as personal information (steps 1200 to 120).
3).

When the transmission / reception of the personal information is completed as described above, normally, a screen display as shown in FIG. 8A is displayed (at the time of whole display, according to the operation flow of FIG. 22 similar to FIG. 13 of claim 1). Display) advances the conference. And, in the video conference system according to claim 4, FIG.
As shown in (a), an appropriate number is assigned to the personal information and displayed together. In addition to the personal information, an appropriate number is also assigned to the symbol for overall display and displayed.

Next, the user 16 as a conductor inputs the displayed number to switch the moving image. For example, in order to obtain the close-up screen of the user 67, the user 16 who is a conductor is shown in FIG.
While watching the screen of the monitor television 3 of (a), "3" is input using the console 2 (step 1400).
The system control unit 2 inputs the selection number from the console 2.
2 is notified, and the system control unit 22 identifies the personal information from the input number (steps 1401 and 140).
2) The video camera number (only the video camera 59 on the B side), the focal length, and the pedestal angle corresponding to the personal information are transmitted (step 1403).

When the selected personal information is the terminal on the B side, as shown in FIG. 24, the moving image input is switched according to the received information (step 1500) (step 1501) and the focal length of the video camera 59 is changed. Adjustment (step 1501) and angle adjustment of the pedestal 61 (step 150)
After the control of 3) and the like to invalidate the received moving image data (step 1504), it is displayed on the monitor television 53 (step 1505).

When the designated number is the A side,
The system control unit 22 switches the moving image input with the moving image input changeover switch 29 in its own terminal (step 140).
6) The focal length is adjusted by the video camera interfaces 30 and 37 (step 1407), and the pedestal control interfaces 42 and 43 are controlled to adjust the pedestal angle (step 1408). Information on distance and pedestal angle is not transmitted (step 1
409). In this case, the focal length and the pedestal angle of the video camera at the B-side terminal are kept in the previous state, and the moving picture information received from the B-side terminal at the A-side terminal is discarded by the moving picture coding / decoding unit 26. , The monitor TV 3 is made to display the moving image transmitted by the terminal itself (step 141).
0).

Steps 1411 to 1414 shown in FIG.
Is an operation flow for displaying personal information when the personal information of the own terminal or the partner terminal is designated.
13 is almost the same as the flow of steps 401 to 403 in FIG. 13, but in step 1412, the selection number is written in the moving image memory. Next, regarding the operation in the video conference system according to claim 5, the user 1
The case where 6 is a conductor will be described as an example.

FIG. 25 is a flowchart showing the operation at the time of inputting personal information according to the invention of claim 5, and FIG. 26 is a flowchart showing the operation at the time of receiving personal information according to the invention of claim 5. 27 is a flowchart showing an operation at the time of displaying personal information according to the invention of claim 5, FIG. 28 is a flowchart showing an operation at the time of designating personal information according to the invention of claim 5, and FIG. 5
It is a flowchart which shows operation | movement at the time of receiving the meeting material ID number which concerns on the invention of description.

Also in the video conference system according to claim 5, the personal information is input according to FIG. 25 as in the case of claim 1. At this time, the ID number of the conference material transmitted in advance is input by the same means as the input of the display position (step 1601). Then, the entered ID number is a valid ID with material settings.
It is judged whether or not it is a number (step 1607), and a valid I
In the case of the D number, the ID number is added to the display position number (steps 1608 to 1610), and when the ID number is not valid, only the display position number (steps 1612 to 161).
4), similarly to steps 206 to 208 in FIG. 11, the additional information of the personal information is transmitted to the partner terminal.

When the transmission / reception of the personal information is completed as described above, the conference is proceeded by the image display as shown in FIG. 6. However, in the video conference system according to claim 5, the personal information to be displayed is changed. Allocate an appropriate number and display it together. In addition, FIG. 6 shows a display example in which the child screen is set and the personal information of all the conference participants is displayed. However, when the child screen is not set, only the personal information is displayed in the fixed area. You can also This is because in the video conference system according to the fifth aspect, the personal information of all the conference participants is always displayed so that any conference participant can be designated.

User 16 of terminal A on the conductor side
Switches the meeting material according to the displayed personal information number. For example, when displaying the conference material corresponding to the user 67 of the B-side terminal, "3" is input (step 1900). The input from the console 2 is notified to the system control unit 22, and the system control unit 22 identifies the personal information from the input number (step 1901),
If the ID number is registered (step 1902), the ID number of the conference material corresponding to the personal information is transmitted via the data channel of the multimedia multiplexing / separating unit 24 (1903).

At the B-side terminal, the still image display device (LC
D) Display the relevant conference material at 57. Similarly, in the A-side terminal, the corresponding conference material is displayed on the liquid crystal projector 7 according to the input ID number. Further, the same operation is performed when the designated personal information is the A-side terminal. If the meeting material corresponding to the specified personal information is not registered, the system control unit 22
Displays this on console 2 (step 19
08), discard the entered personal information number.

FIG. 9 is a diagram showing an example of a reference table of personal information managed by the system control unit 22 in the embodiment according to the invention described in claims 1 to 5. Next, regarding the operation in the video conference system according to claim 6,
Here, a case where the video conference system according to claim 5 is applied will be described as an example. FIG. 30 is a flow chart showing the operation when the personal information is specified according to the invention of claim 6.

In claim 5 described above, the meeting material is specified by specifying the personal information, but in the case of claim 6, the system control unit 22 specifies the personal information from the input personal information number. After that (step 2100), the marker information is written to the address of the moving image memory 30 corresponding to the display position where the personal information is displayed (step 2101), and the marker is displayed on the monitor TV 3 (step 2102). ). This display allows the user to know which user the conference material currently displayed on the liquid crystal projector 7 corresponds to, and the conference can be smoothly and efficiently operated. .

In this embodiment, the video conference system between two points has been described as an example, but in the case of the video conference system between multiple points, the conference terminal is further identified in the transmission of the conference material and the personal information. Attribute information is required. In the case of a star-connected multi-point video conference system, the above-mentioned MCU assigns an identifier for identifying the conference terminal, and the MCU itself manages the identifier.

In the above embodiment, an example of reading a business card as personal information from the scanner has been shown. However, as personal information input means, key input from the console 2 or creation and transfer on a PC connected to the main device is performed. It is possible to consider various means such as Further, in the present embodiment, the example of displaying the personal information is displayed on the monitor television 3 or the like, but the personal information is displayed on the still image display device or the console 2. It is also possible.

Further, for example, in the case of the console 2 in which an LCD and a touch panel are integrated (a so-called AGC which can also display a still image).
In the case of a terminal), personal information may be iconized and displayed on the LCD, and the personal information may be designated by bonding the touch panel. By the way, in the above-mentioned video conference system according to claim 6, when the function of claim 6 is applied to the system having the function of claim 4, this embodiment shows an example in which personal information is displayed on the monitor TV 3. Therefore, it is not necessary, but
It is useful in a configuration in which the personal information as described above is displayed on the still image display device or the console.

Further, in the present embodiment, since the personal information number is arbitrarily set on each terminal side, only the designated side can display, but a common personal information identifier can be given to each terminal. Alternatively, if the management number of each terminal is transmitted and received in advance, the display on all terminals becomes possible. Further, in claim 3 or 4, the present embodiment shows an example of a video conference system between two points.
In the case of a video conference between two points, one conductor is not defined as in the present embodiment, and the users who operate the consoles on each terminal side act as local conductors to switch microphones and to display video. The switching operation may be performed.

[0076]

According to the invention described in claim 1, the personal information of the conference participants is read and stored in advance before the conference is held, and the stored personal information is transmitted to the other conference terminal to hold the conference. Since it is displayed on the display screen of the other conference terminal, the conference can be smoothly and efficiently operated.

According to the second aspect of the invention, the personal information of the conference participants entered in the first terminal is retained even after the conference ends, and a list of the personal information is displayed when a new conference is held. Since the personal information to be used can be selected and specified while looking at the list, the personal information once input can be used at the time of holding another conference, and the burden on the system operation of the user can be reduced.

According to the third aspect of the invention, when the personal information is stored in the first aspect, the personal information is stored in correspondence with the position information of the conference participation terminal or the voice input device and displayed on the display device. By specifying the personal information, it is possible to automatically switch to the voice input from the conference participation terminal or the voice input device corresponding to the specified personal information, so the burden on the user involved in the conference operation is reduced. can do.

According to the invention described in claim 4, when the personal information is stored in claim 1, the personal information is stored in association with the composition information of the conference participation terminal or the moving image input device and displayed on the display device. By specifying the personal information that is specified, it is possible to switch the moving image input from the conference participation terminal corresponding to the specified personal information and control the composition of the moving image input device, so the burden on the user related to the conference operation is reduced. Can be reduced.

According to the invention described in claim 5, when the personal information is stored in claim 1, the personal information is stored in association with the conference material,
By designating the personal information displayed on the display device, the conference material corresponding to the designated personal information is displayed. Therefore, it is possible to reduce the burden on the user regarding the conference management. According to the invention of claim 6, claims 3 to 5
As described, the voice token holder during the conference operation, the user displayed in the moving image on the display device, or the user who created and registered the conference material displayed on the display device, Since the information is displayed on the display device by the personal information designation clarification means, the conference can be smoothly and efficiently operated.

[Brief description of drawings]

FIG. 1 is a schematic diagram showing an overall configuration of an embodiment of a video conference system according to the present invention.

FIG. 2 is a block diagram showing a configuration example of a main device of a conference terminal on the A side in FIG.

FIG. 3 is a sequence chart illustrating a communication protocol between a calling side and a called side of a video conference system between two points.

FIG. 4 is a diagram showing a screen display example of a monitor television according to an embodiment of the invention as set forth in claim 1, (a) is a display screen of an own terminal image on the A side, and (b) is a display position on the A side. Selection screen,
(C) is a display screen during the conference viewed on the monitor TV on the A side, (d) is a display screen of the own terminal image on the B side, and (e) is B.
The display screen for selecting the display position on the side, (f) is the display screen during the conference viewed on the monitor TV on the B side.

FIG. 5 is a diagram showing a screen display example of a monitor television according to an embodiment of the invention as set forth in claim 2, (a) is a display screen of a registered user, and (b) is a display position selection screen. Is.

FIG. 6 is a diagram showing a screen display example of a monitor television according to an embodiment of the invention as set forth in claim 3;

FIG. 7 is a diagram showing a screen display example of a monitor television according to an embodiment of the invention as set forth in claim 4, (a) is a display screen of a self-terminal image, (b) is a registration screen of a camera composition, and (c) is a screen. ) Is a display position selection screen.

FIG. 8 is a diagram showing a screen display example of a monitor television according to an embodiment of the invention described in claim 4, (a) is a display screen during a meeting, and (b) is a display screen after personal information is designated. .

FIG. 9 is an example of a reference table of personal information managed by the system control unit when the embodiment according to the inventions of claims 1 to 5 is implemented.

FIG. 10 is a flowchart showing a procedure of starting and ending a video conference system.

FIG. 11 is a flowchart showing an operation when personal information is input according to the invention of claim 1.

FIG. 12 is a flowchart showing an operation at the time of receiving personal information according to the invention described in claim 1.

FIG. 13 is a flowchart showing an operation at the time of displaying personal information according to the invention described in claim 1.

FIG. 14 is a flowchart showing an operation at the time of inputting personal information according to the invention of claim 2;

FIG. 15 is a flowchart showing an operation when personal information is input according to the invention of claim 3;

FIG. 16 is a flowchart showing an operation at the time of receiving personal information according to the invention described in claim 3.

FIG. 17 is a flowchart showing an operation when personal information is specified according to the invention of claim 3;

FIG. 18 is a flowchart showing an operation at the time of displaying personal information according to the invention of claim 3;

FIG. 19 is a flowchart showing an operation at the time of receiving a microphone number according to the invention of claim 3;

FIG. 20 is a flowchart showing an operation at the time of inputting personal information according to the invention of claim 4;

FIG. 21 is a flow chart showing an operation at the time of receiving personal information according to the invention of claim 4;

FIG. 22 is a flowchart showing an operation at the time of displaying personal information according to the invention of claim 4;

FIG. 23 is a flowchart showing an operation when personal information is specified according to the invention of claim 4;

FIG. 24 is a flowchart showing an operation at the time of receiving camera control information according to the invention of claim 4;

FIG. 25 is a flowchart showing an operation when personal information is input according to the invention of claim 5;

FIG. 26 is a flowchart showing an operation at the time of receiving personal information according to the invention of claim 5;

FIG. 27 is a flowchart showing an operation at the time of displaying personal information according to the invention of claim 5;

FIG. 28 is a flowchart showing an operation at the time of designating personal information according to the invention of claim 5;

FIG. 29 is a flowchart showing an operation at the time of receiving a conference material ID number according to the invention described in claim 5;

FIG. 30 is a flowchart showing an operation at the time of designating personal information according to the invention of claim 6;

[Explanation of symbols]

 1 main device 2 console 3 monitor TV 4 speaker 5 scanner 6 printer 7 liquid crystal projector 9,10 video camera 13-15 microphone 16-21 user 22 system control unit 23 network interface unit 24 multimedia multiplex / separation unit 25 voice code / Decoding unit 26 Moving image coding / decoding unit 27 Still image coding / decoding unit 28 Audio input changeover switch 29 Moving image input changeover switch 30 Moving image memory 31 Still image memory 45 Magnetic disk unit 70 Network

Claims (6)

[Claims] 1. A personal information for reading personal information of a conference participant in a video conference system for conducting a conference by communicating voice data, moving image data, still image data, etc. between two points or multiple points via a communication line. Reading means, personal information storage means for storing the read personal information, personal information transmitting means for transmitting the stored personal information to the other conference terminal, and personal information transmitted to the other conference terminal on the screen. A video conferencing system comprising: personal information display means for displaying. 2. The video conferencing system according to claim 1, wherein personal information holding means for holding personal information of the conference participants input at the own terminal even after the conference is ended, and the personal information holding means for holding the personal information when the new conference is held. Personal information list display means for displaying a list of personal information stored therein, and personal information calling means for reusing the personal information by selecting and designating a list of users of the personal information Video conferencing system characterized by. 3. The video conference system according to claim 1, wherein the personal information storage means stores personal information in correspondence with position information of a conference participation terminal or a voice input device, and displays the personal information on a display device. By specifying the personal information displayed on the screen, a voice input switching means for switching the voice input from the conference participation terminal corresponding to the designated personal information or the voice input from the voice input device is provided. Video conferencing system. 4. The video conference system according to claim 1, wherein the personal information storage means stores personal information in association with composition information of a conference participation terminal or a moving image input device, and a display device. By providing the personal information displayed above, a moving picture control means is provided for switching the moving picture input from the conference participation terminal corresponding to the specified personal information and controlling the composition of the moving picture input device. Video conferencing system characterized by 5. The video conference system according to claim 1, wherein the personal information storage means stores the personal information stored in association with the conference material and storing the personal information displayed on the display device. A video conference system comprising a conference material display means for displaying a conference material corresponding to the designated personal information by designating. 6. The video conference system according to any one of claims 3 to 5, further comprising a personal information designation demonstrating means for displaying, on a display device, a designation that clearly indicates that the designated personal information has been designated. A video conferencing system characterized by being equipped.