JP2001036884A - System and method for generating conference video - Google Patents

Abstract

PROBLEM TO BE SOLVED: To execute individual work while grasping the state of the entire conference by providing an operation video generating means and a composite video generating means, etc., for generating video obtained by composting the video of an individual working state and the video of the entire working state so as to display the generated composite video by a picture display means. SOLUTION: The terminal video generating part 22 of a participant terminal 20 reads an individual working state from a seat managing part 24 and compares it with the value of an individual working state read last time and in the case of deciding it to have changed, the part 22 generates the video of the individual working state. After generating this video of the individual working state, the video of a conference state is read from a conference state video generating part 12 and the displaying state of a window is read from the part 24 to decide the displaying state of the window. When the state is decided to be the entire working display at this time, the video of the conference state read to a participant conference window is displayed and except for it, the generated individual state video and the read conference state video are composited and displayed.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a conference video display system for displaying a conference status of a remote conference, in which a window capable of performing personal work in addition to the overall work can be displayed. And methods.

[0002]

2. Description of the Related Art Conventionally, various teleconferencing systems have been proposed for interconnecting a plurality of terminal devices and servers via a network so as to enable smooth communication between a plurality of conference participants who are distant from each other. Have been.

[0003] Such a conventional remote conference system adopts a system in which a conference participant transmits reference conference information to the participant.
No. 84076 discloses an "electronic conference display system". In this method, the state of the conference is expressed using video in which objects such as participants, whiteboards, and conference desks are placed in a virtual conference room, and this conference status video is displayed on the window of each conference participant's terminal. are doing.

[0004]

However, in the above-mentioned prior art, work at a meeting is limited to collaborative work. On the other hand, at a meeting, personal work such as writing notes on distributed materials and daily work are performed. Some participants work together, such as asking another participant or giving a note, which is often seen when meeting with a group of people. In addition, joint work and individual work are not only frequently performed frequently, but also sometimes performed in parallel.

The present invention has been made in view of the above-mentioned conference situation, and not only can confirm both joint work and individual work at the same time, but also can perform the work of each conference participant as necessary. It is an object of the present invention to provide a conference video generation system and method that can be performed while switching.

[0006]

In order to achieve the above object, according to the first aspect of the present invention, a state of a display screen in a screen display means of one terminal connected to the same communication network is provided. In response to the input of the operation on the display screen by the input means of the terminal, a personal work state video for performing personal work and an overall work state video for performing work by all conference participants A work video generating means for appropriately generating the work video and a composite video generating means for generating a video obtained by combining the personal work status video and the overall work status video, and displaying the generated composite video on the screen display means. Features.

According to a second aspect of the present invention, in the first aspect of the present invention, when there is no change in the state of the display screen and there is no operation on the display screen by the input means, the entire work generated by the work video generating means. It is characterized in that only the state video is displayed on the screen display means.

According to a third aspect of the present invention, in the first or second aspect of the present invention, a personal work sheet is provided on the personal work state image.

The invention according to claim 4 is based on the state of the display screen on the screen display means of one terminal connected to the same communication network and the input of the operation on the display screen by the input means of the terminal. Read the personal work state from the personal work state change means for changing the personal work state, and compare the personal work state with the previously read personal work state. First determining means for determining whether or not the read individual work state has changed; and the determination result includes:
When the personal work state read this time is compared with the personal work state read last time, and it is determined that the personal work state read this time has changed, a personal work state image for performing a personal work is appropriately generated. The personal work state image generating means, and the judgment result is compared with the personal work state read this time and the personal work state read last time, and when it is determined that the personal work state read this time is changed, An overall work state image generating means for appropriately generating a new overall work state image by processing the overall work state image for performing work by all conference participants; and Second determining means for determining whether or not the display state image is displayed, and determining that the display screen state is not the display state of the overall work display state image Read out the individual work state image from the individual work state image generation means, read the entire display state image from the entire work state image generation means, and generate an image in which the individual work state image and the entire display state image are combined. And a composite video generation unit, wherein the generated composite video is displayed on the screen display unit.

According to a fifth aspect of the present invention, in the fourth aspect of the invention, the second determination means determines that the state of the display screen on the screen display means is not a state of displaying the overall work state image. At this time, it is characterized in that the whole work state image generated by the whole work state image generation means is displayed on the screen display means.

According to a sixth aspect of the present invention, in the fourth or fifth aspect of the present invention, an individual work sheet is provided on the personal work state image.

According to a seventh aspect of the present invention, there is provided a conference image generating system comprising a mutually connected conference server and a plurality of participant terminals, wherein the conference server comprises a participant of the conference, a conference desk, a document, and a bulletin board. A first creating means for arranging the objects of the conference and generating a video representing the progress of the entire conference, and a first display means for displaying the video on a display device connected to the conference server, A terminal for receiving the video transmitted from the conference server; a second generating unit for generating a video on which an object representing the work state of each participant is arranged on the video; A combination of an operation on the object displayed in the conference window and a method of editing and displaying data is determined in advance. It is characterized by a control means for controlling when a predetermined operation is performed Te.

The invention according to claim 8 is based on the state of the display screen on the screen display means of one terminal connected to the same communication network and the input of the operation on the display screen by the input means of the terminal. A work image generation step of appropriately generating a personal work state image for performing personal work and an overall work state image for performing work by all conference participants, respectively, a personal work state image and an overall work state And a composite video generation step of generating a video synthesized with the video, wherein the generated composite video is displayed on the screen display means.

According to a ninth aspect of the present invention, in the eighth aspect of the present invention, when there is no change in the state of the display screen and there is no operation on the display screen by the input means, the entire work generated in the work video generating step. It is characterized in that only the state video is displayed on the screen display means.

The invention according to claim 10 is the invention according to claim 8 or 9.
In the described invention, a personal work sheet is provided on the personal work state image.

The invention according to claim 11 is based on the state of the display screen on the screen display means of one terminal connected to the same communication network and the input of the operation on the display screen by the input means of the terminal. The personal work state change step of changing the personal work state and the personal work state are read, the personal work state is compared with the previously read personal work state, and the personal work state read this time is the personal work state read last time. A first determination step of determining whether or not the personal work state read this time is different from the personal work state read this time and the personal work state read last time. When it is determined that the personal work state video generation step for appropriately generating a personal work state video for performing personal work, the determination result,
Compared with the personal work state read this time and the personal work state read last time, when it is determined that the personal work state read this time has changed, the overall work state for performing the work with all the meeting participants generated last time An overall work state image generating step of appropriately generating a new overall work state image by processing the image, and determining whether the state of the display screen on the screen display means is a state in which the entire work display state image is displayed The second determination step, and the determination result, when it is determined that the state of the display screen is not the display state of the overall work display state video, read the personal work state video, and also read the entire display state video, A composite video generation step of generating a video obtained by combining the personal work state video and the entire display state video, and displaying the generated composite video on a screen display means. .

According to a twelfth aspect of the present invention, in the invention of the eleventh aspect, it is determined in the second determining step that the state of the display screen on the screen display means is not a state of displaying the overall work state image. And displaying the whole work state image generated in the whole work state image generation step on the screen display means.
2. The method for generating a conference image according to 1.

According to a thirteenth aspect, in the eleventh or twelfth aspect, an individual work sheet is provided on the personal work state image.

According to a fourteenth aspect of the present invention, there is provided a conference video generating method comprising a mutually connected conference server and a plurality of participant terminals, wherein the conference server comprises: a conference participant, a conference desk, a document, and a bulletin board. Generates an image that represents the progress of the entire conference by arranging the objects of the conference, displays the video on a display device connected to the conference server, the participant terminal receives the video transmitted from the conference server, Create a video in which objects representing the individual working status of the participant are arranged on the video, display the created on the participant's terminal, operate on the object displayed in the conference window, edit data and control the display And control means for controlling when a predetermined operation has been performed on the object in advance.

[0020]

Embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

FIG. 1 is a diagram showing a schematic configuration of an embodiment of a conference video generation system according to the present invention. According to FIG. 1, the participant terminals 20 and 30 are connected to the conference server 1.
0 via a communication network 60. The conference server 10 creates a conference status image 300 according to the connection status to the conference server at another location or the participant terminal 20 or the participant terminal 30 and outputs the conference state image 300 to the participant terminals 20 and 30.

The conference state image 300 generated by the conference server 10 is also displayed on the terminal image display section 40 provided in the conference server 10, and the user of the participant terminal 20 and the user of the participant terminal 30 are displayed. Can refer to the conference state image 300 displayed on the terminal image display unit 40.

FIG. 2 shows an example of the conference status image 300 displayed on the terminal image display section 40. The conference display image 300 includes a participant A object 1001, a participant B object 1002, and a participant C object 100.
3 is placed around the conference desk object 1000, and the material A object 1005 and the three-dimensional CG object 10
Reference numeral 04 denotes a state where it is arranged on the conference desk object 1000. Then, in the conference state video 300 displayed on the terminal video display unit 40, the participants A, B, and C participate in the conference, and the material A and the three-dimensional CG are present as shared conference materials. Is shown.

Each participant object is displayed in correspondence with a participant terminal connected to the conference server 10.

Further, referring to FIG. 1, the participant terminal 2
0, a conference status window 121 is displayed on the terminal screen 120.
Is displayed, and the terminal screen 130 of the participant terminal 30 is displayed.
Above, a conference status window 131 is displayed. Conference status window 121 and conference status window 13
1 includes a conference state image 300 generated by the conference server 10.
Is displayed.

FIG. 3 is a diagram showing the internal configuration of the conference server 10, the participant terminal 20, and the participant terminal 30, and also shows the configuration of the conference video generation system in the present embodiment.

Referring to FIG. 3, the conference server 10 includes a terminal image display unit 40 externally and a conference state management unit 11 therein.
And a conference state video generation unit 12, and a participant terminal 20,
30 has terminal screens 21 and 31, terminal video generation units 22 and 32, terminal screen operation units 23 and 33, and sheet management units 24 and 34, respectively.

Next, the operation of each of the above-mentioned units relating to the conference of each participant will be described with reference to FIG. Terminal screen operation unit 2
3 is an operation performed on the terminal screen 21 by the sheet management unit 2.
4 and the sheet management unit 24 changes the personal conference state according to the above-described operation and the screen display state on the terminal screen 21, and displays the changed personal conference state on the conference server 1.
0 to the conference state management unit 11. Terminal video generator 2
2 generates a terminal conference video on the basis of the video generated and transmitted by the conference status video generation unit 12 and the personal conference information held in the sheet management unit 24;
In step 1, the terminal conference video generated here is displayed.

The conference status management unit 11 of the conference server 10
The conference state is changed by receiving the transmission of the personal conference state from the sheet management units 24 and 34 of the participant terminal 20 and the participant terminal 30 which are the terminals connected to the conference server 10, and the sheet management is performed. The changed conference state is transmitted to the units 24 and 34. The conference state video generation unit 12 receives the change of the conference information from the conference state management unit 11 and generates a video representing the conference state. The video generated here is transmitted to the terminal video display unit 40 and output.

The conference state video generator 12 operates the terminal screen operation unit 23 of the participant terminal 20 on the terminal screen 21 as described above, and the personal management unit 24 When the conference state is input to the conference state management unit 11, processing is performed on the previously generated conference state image,
It is transmitted to the participant terminals 20 and 30 and displayed on the terminal screens 21 and 31.

Next, referring to FIG. 4 to FIG. 6, one example of generating a conference information image displayed on each of the participant terminals 20 and 30 by an operation on the terminal screen 21 by the terminal screen operation unit 23 will be described. An embodiment will be described.

FIGS. 4 and 5 show examples of the participant terminal conference state video displayed in the participant conference window 121 (participant conference window 131).

In FIG. 4, a conference window 121 for participants is shown.
Shows a case where only the state of the entire conference is displayed in the conference state video for the participant terminal.

As shown in FIG. 4, the conference status video 400 for the participant terminal displays the same video as the conference status video 300 displayed on the terminal video display unit 40. The participant B object 1002 and the participant C object 1003 are arranged around the conference desk object 1000, and the material object 1004 and the three-dimensional CG object 1003 are arranged on the conference desk object 1000, and are displayed on the terminal video display unit 40. In the conference status video 400 for the participant terminal, the participants A, B, and C participate in the conference, and the material A and the three-dimensional CG are shared. It is shown that it exists as a meeting material of.

In FIG. 5, the conference window 121 for participants
2 shows a case where the participant terminal conference state video displayed both shows the state of the entire conference and the personal work state.

According to FIG. 5, the conference status video 500 for the participant terminal is the same as the conference status video 400 and the conference status video 300 for the participant terminal.
1. The participant B object 1002 and the participant C object 1003 are arranged around the conference desk object 1000, the material A object 1004 and the three-dimensional CG object 1003 are arranged on the conference desk object 1000, and This shows a state in which the participant A, the participant B, and the participant C are participating, and the material A and the three-dimensional CG are present as shared conference materials.

Further, in the conference state video 500 for the participant terminal shown in FIG. 5, a mail object 1100, a memo object 1101, a character object 1102, and an animation object 1103 are displayed in addition to the above objects. These four objects indicate the state of personal work in the participant terminal 20.

The mail object 1100 is displayed above the participant, and indicates that a mail has been transmitted from the participant terminal 20 to the participant A.

The animation object 1103 is
Displayed on the conference desk object 1000
When the terminal screen operation unit 23 of the participant terminal 20 performs an operation on the three-dimensional CG object 1005, an animation image such as a rotation motion is displayed on the participant's conference window 12.
It is shown that only 1 is displayed.

The memo object 1101 is displayed beside the participant C object 1003. As a result of the operation performed on the participant C object 1003 by the terminal screen operation unit 23 of the participant terminal 20, the participant C This indicates that a memo about the C object has been input.

The character object 1102 is displayed so as to be superimposed on the participant C object 10003, and indicates that the title has been input to the participant C as a result of an operation performed by the terminal screen operation unit 23. I have.

According to the present invention, not only the above objects but also various objects can be arranged as necessary on the terminal screen, and only characters and figures can be written on the sheet on the screen. Instead, still images such as bitmaps and photos, and animations such as animations and videos can be pasted.

As described above, as shown in FIG. 5, the conference status video 50 for the participant terminal displays both the overall conference status and the individual work status.

Next, referring to FIG. 6 to FIG.
The method for generating the conference state video for the participant terminal to be displayed on the screen will be described in detail.

FIG. 6 shows a terminal video generation unit 2 when displaying a conference status video for a participant terminal in the participant window 121.
3 is a flowchart showing an example of an operation performed by a second example in detail. According to FIG. 6, the terminal video generation unit 22 of the participant terminal 20 reads the personal work state from the sheet management unit 24 (step S2000), and the read personal work state value is the previously read personal work state value. It is determined whether or not there is a change (step S2001), and if it is determined that there is a change (step S2001 /
YER), generating a personal work state image (step S2)
002). If it is determined that it has not changed (step S2001 / NO), the process proceeds to step S2003.

The terminal video generation unit 22 determines in step S200
After the generation of the personal work state image in Step 2, the conference state image is read from the conference state image generation unit 12 (Step S2).
003), the display state of the window is read from the sheet management unit 24 (step S2004), and the display state of the window is determined (step S2005).

Here, if it is determined that the display is the entire work display (step S2005 / YES), the terminal video generation unit 2
2 is displayed on the participant conference window 121 in step S20.
03 is displayed (step S
2007), otherwise, the personal status video generated in step S2002 and the conference status video read in step S2003 are combined and displayed (step S2006).

FIG. 7 shows an example of the personal work state image generated in step S2002. 7 includes a mail object 1100, a memo object 1101, a character object 1102, and an animation object 11.
03 is displayed. In the personal work video, the area other than the area where the object is displayed is transparent.

FIG. 8 shows an example of the participant's conference state image read out by the terminal image generation unit 22 from the conference state image generation unit 12 and displayed on the terminal screen 21 in step S2003. The conference state video 700 for participants shown in FIG. 8 includes a participant A object 1001, a participant B
Object 1002 and Participant C Object 10
03 is placed around the conference desk object 1000, and the material object 1004 and the three-dimensional CG object 10
05 is on the conference desk object 1000. The conference state image 300 displayed on the terminal image display unit 40 includes the participants A, the participants B, and the participants, and the material A and the three-dimensional CG are present as shared conference materials. This indicates that there is a

FIG. 9 is a diagram showing an example of an image obtained by synthesizing the personal state image and the conference state image. Personal condition picture 6
Since 00 is transparent except where the object is placed, an image representing the state of the entire conference can be created by combining the 00 with the participant conference state image 700. In addition, by creating a personal state image in advance, when the display state of the participant conference window is changed, the image can be switched at high speed.

According to the present embodiment, the progress of the entire meeting and the work status of the individual can be simultaneously viewed, so that the individual can perform work while grasping the state of the entire conference.

[0052]

As is apparent from the above description, according to the present invention, it is possible to manage both the progress state of the entire conference and the individual work state, and to display each conference state in a single image. Therefore, it is possible to perform individual work while grasping the state of the entire meeting.

[Brief description of the drawings]

FIG. 1 is a diagram showing a schematic configuration of a conference video generation system according to an embodiment of the present invention.

FIG. 2 is a diagram illustrating a conference state image displayed on a terminal image display unit according to an embodiment of the present invention.

FIG. 3 is a diagram illustrating a configuration of a conference video generation system while showing an internal configuration of a conference server, a participant terminal, and a participant terminal in the embodiment of the present invention.

FIG. 4 is a diagram illustrating a case where a conference state video for a participant terminal displayed in a conference window for a participant according to the embodiment of the present invention displays only the state of the entire conference;

FIG. 5 is a diagram showing a case where a participant terminal conference state image displayed in a participant conference window in the embodiment of the present invention displays both the state of the entire conference and the personal work state.

FIG. 6 is a flowchart illustrating in detail an example of an operation performed by a terminal video generation unit when displaying a conference status video for a participant terminal in a participant window according to the embodiment of the present invention.

FIG. 7 is a diagram illustrating an example of a personal work state image generated by a terminal image generation unit according to the embodiment of the present invention.

FIG. 8 is a diagram illustrating an example of a participant's conference state image read out by the terminal image generation unit from the conference state image generation unit and displayed on the terminal screen according to the embodiment of the present invention.

FIG. 9 is a diagram showing an example of an image obtained by synthesizing a personal state image and a conference state image in the embodiment of the present invention.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 10 Conference server 20, 30 Participant's terminal 40 Terminal video display part 50 Communication network 120, 21, 130, 31 Terminal screen 121, 131 Participant's conference window 11 Conference status management part 12 Conference status video generation part 22, 32 Terminal Image generation unit 23, 33 Terminal screen operation unit 24, 34 Sheet management unit 300 Conference status video 400, 500, 700 Conference status video for participants 600 Personal work status video 1000 Conference desk object 1001-1003 Participant object 1004 Document object 1005 3D CG object 1100 Mail object 1101 Memo object 1102 Character object 1103 Animation object

Claims (14)

[Claims] 1. A personal terminal according to a state of a display screen of a screen display means of one terminal connected to the same communication network and an input of an operation on the display screen by an input means of the terminal. Work image generating means for appropriately generating an individual work state image for performing a specific work, and an overall work state image for performing work by the entire conference participants, and the personal work state image and the overall work state image And a composite video generating means for generating a video obtained by combining the above, and the generated composite video is displayed on the screen display means. 2. When the state of the display screen is not changed and there is no operation on the display screen by the input unit, only the entire work state image generated by the work image generation unit is displayed on the screen display unit. 2. The conference image generation system according to claim 1, wherein the conference image is displayed. 3. The conference video generation system according to claim 1, wherein a personal work sheet is provided on the personal work status video. 4. A personal work based on a state of a display screen on a screen display means of one terminal connected to the same communication network and an operation input on the display screen by an input means of the terminal. A personal work state changing means for changing a state, and reading the personal work state from the personal work changing means,
First determining means for comparing the personal work state with the previously read personal work state and determining whether the personal work state read this time has changed from the personal work state read last time; The determination result, compared with the personal work state read this time and the personal work state read last time, when it is determined that the personal work state read this time has changed,
A personal work state video generating means for appropriately generating a personal work state video for performing a personal work, wherein the determination result is compared with the personal work state read this time and the personal work state read last time, When it is determined that the read individual work state has changed,
A general work state image generating means for appropriately generating a new general work state image by processing the general work state image for performing work by the entire conference participants generated last time, and a state of the display screen in the screen display means A second determining means for determining whether or not the overall work display state image is displayed; and determining that the state of the display screen is not the display state of the overall work display state image. When performed, the personal work state image is read from the personal work state image generation unit, the entire display state image is read from the entire work state image generation unit, and the personal work state image and the entire display state image are read. A conference video generation system, comprising: synthesized video generation means for generating a synthesized video; and displaying the generated synthesized video on the screen display means. 5. When the second determination means determines that the state of the display screen on the screen display means is not a state in which an overall work state image is displayed, the overall work state image generation means 5. The conference video generation system according to claim 4, wherein the display of the generated overall work status video on the screen display means is displayed. 6. The conference video generating system according to claim 4, wherein a personal work sheet is provided on the personal work status video. 7. A conference video generation system comprising a conference server and a plurality of participant terminals connected to each other, wherein the conference server arranges conference participants, conference desks, materials, and bulletin board objects. First creating means for creating an image representing the progress of the entire conference by means of a conference, and first display means for displaying the image on a display device connected to the conference server; Receiving means for receiving an image transmitted from the conference server; second creating means for creating an image on which an object representing a participant's personal work state is arranged; and a participant terminal. A second display means for displaying the created display, wherein a combination of an operation on an object displayed in the conference window and a method of editing and displaying data is determined in advance. Conference video generation system characterized by a control means for controlling when a predetermined operation is performed with respect to objects. 8. A personal terminal according to a state of a display screen on a screen display unit of one terminal connected to the same communication network and an operation input on the display screen by an input unit of the terminal. Individual work state video for performing a proper work, and a work video generation step of appropriately generating an overall work state video for performing work by the entire conference participants, and the personal work state image and the overall work state image And a composite video generating step of generating a composite video of the video and the composite video, wherein the generated composite video is displayed on the screen display means. 9. When the state of the display screen is not changed and the operation on the display screen by the input unit is not performed, only the entire work state image generated in the work image generation step is displayed on the screen display unit. 9. The method according to claim 8, wherein the conference image is displayed. 10. A personal work sheet is provided on the personal work state image.
The described method of generating a conference image. 11. A personal work based on a state of a display screen on a screen display means of one terminal connected to the same communication network and an input of an operation on the display screen by an input means of the terminal. A personal work state changing step of changing the state; reading the personal work state; comparing the personal work state with the previously read personal work state; and the personal work state read this time is the personal work read last time. A first determination step of determining whether or not the state has changed with respect to the state; and the determination result is compared with the individual work state read this time and the individual work state read last time, and When it is determined that the work state has changed,
A personal work state video generation step of appropriately generating a personal work state video for performing a personal work, and the determination result is compared with the personal work state read this time and the personal work state read last time, When it is determined that the read individual work state has changed,
An overall work state image generating step of appropriately generating a new overall work state image by processing the entire work state image for performing work by the entire conference participants generated last time, and a state of the display screen in the screen display means A second determining step of determining whether or not the overall work display state image is displayed, and determining that the state of the display screen is not the display state of the overall work display state image Read out the personal work state image, read out the entire display state image, and generate a combined image of the personal work state image and the entire display state image. A method for generating a conference video, wherein the generated composite video is displayed on the screen display means. 12. In the second determination step, when it is determined that the state of the display screen on the screen display means is not a state in which an overall work state image is displayed, the overall work state image generation step The method according to claim 11, further comprising displaying that the generated overall work state image is displayed on the screen display unit. 13. The conference video generation method according to claim 11, wherein a personal work sheet is provided on the personal work status video. 14. A conference video generation method comprising a mutually connected conference server and a plurality of participant terminals, wherein the conference server arranges conference participants, conference desks, materials, and bulletin board objects. Generating a video expressing the progress of the entire conference, displaying the video on a display device connected to the conference server, the participant terminal receives the video transmitted from the conference server, Create a video on which an object representing the work status of each participant is placed on the video, display the created video on the participant's terminal, control operations on the object displayed on the conference window, and control data editing and display And a control means for controlling when a predetermined operation is performed on an object in advance by determining a combination with a method. Method.