JP2009239762A - Video conference system and video conference method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a video conference system giving a feeling of being there. <P>SOLUTION: The video conference system 1 includes an imaging device 10 and a display device 20. The imaging device 10 includes a plurality of photographing units 101 which photograph different subjects and an output unit 102 which outputs a plurality of image information representing images photographed by the plurality of photographing units 101. The display unit 20 includes a reception unit 201 which receives the plurality of image information, and a plurality of display units 203 which displays the images of the subjects photographed by the plurality of photographing units 101 using the plurality of image information received by the reception unit 201. They are arranged to satisfy the relative positional relationships between the subjects corresponding to the displayed images. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a video conference system that performs a conference using images.

Conventionally, a video conference system has been developed. By using the video conference system, images and sounds can be transmitted and received between two or more remote conference rooms. (See, for example, Patent Document 1).
In such a video conference system, by disposing a plurality of video cameras in the conference room, various events occurring in the conference can be captured (Patent Document 1, page 1, FIG. 1). etc).
Japanese Patent Laid-Open No. 10-285567

However, in the conventional video conference system, an image obtained by photographing the state of one conference room is displayed on one television of the other conference room. For this reason, in each conference room, a conference was held while a plurality of participants looked at the video of another conference room projected on one TV. For this reason, it was not possible to get a sense of reality as if an actual meeting was being held.
In addition, since all participants in other conference rooms are usually shown on the television, even if only one participant of the conference speaks on the television, only that speaker can be selectively selected. There is a problem that the conference cannot be efficiently performed because attention cannot be focused on the speech of the speaker, because the user cannot see.

  In addition, the conventional video conference system is difficult to use for a round table conference or the like because it is difficult to photograph all participants from the front even if the arrangement of the cameras is devised. It was. In addition, even when a plurality of cameras are used, there is a problem in that when the captured images are displayed, it is difficult to grasp the positional relationship of the participants captured between the displayed images, and the user feels uncomfortable.

  The video conference system according to the present invention is a video conference system including a photographing device and a display device, and the photographing device photographs a plurality of photographing units that photograph different subjects and the plurality of photographing units, respectively. An output unit that outputs a plurality of image information that is information indicating an image, and the display device uses a reception unit that receives the plurality of image information, and a plurality of image information received by the reception unit, A plurality of display units arranged to display the images of the subjects photographed by the plurality of photographing units and to have a positional relationship corresponding to the relative positional relationship between the subjects corresponding to the images displayed on the respective images; Is a video conference system.

  With such a configuration, in a conference room where the display unit is arranged, it is matched to the positional relationship of a plurality of subjects participating in the conference in the conference room where the photographing unit is arranged, specifically, participants. Since each participant's image will be placed on the display part placed at the position, in the conference room where the display part is placed, the placement of the participants in the meeting room where the photographing part is placed is accurately set. It can be reproduced using multiple display units, and participants in the conference room where the shooting unit is located can hold a meeting as if they were actually there, and it is full of realism A meeting can be held.

In the video conference system of the present invention, in the video conference system, the plurality of display units are arranged so as to have a positional relationship similar to a relative positional relationship between the subjects. It is.
With such a configuration, it is possible to hold a meeting full of realism. In addition, a video conference system having a size corresponding to the size of the conference room can be arranged.

Further, in the video conference system according to the present invention, in the video conference system, a subject photographed by each of the plurality of photographing units is one person, and the plurality of photographing units are directed toward the front of the person. The video conference system is arranged.
With this configuration, it is possible to accurately and individually reproduce the positional relationship of the participants who are participating in the conference in a conference room or the like where the photographing unit is arranged.

The video conference system according to the present invention is the video conference system according to the video conference system, wherein the plurality of photographing units are arranged so that photographing directions intersect with each other.
With such a configuration, it is possible to obtain an effect that a plurality of persons participating in a video conference are concentrating around the round table, and a video conference full of realism can be performed. In addition, it is possible to accurately reproduce the positional relationship between a plurality of people participating in a video conference.

The video conference system according to the present invention is a video conference system in which, in the video conference system, the photographing unit is arranged on a substantially circumference centered around a position where the photographing directions intersect.
With such a configuration, it is possible to make the setting of the angle of view or the like at the time of shooting by the shooting unit the same for all the shooting units, and to facilitate the setting.

In the video conference system according to the present invention, in the video conference system, the subject that each of the plurality of imaging units shoots is a single person, and further includes a plurality of seats on which the subject is seated. The plurality of seats are arranged on a substantially circumference centered around a position where the shooting directions intersect with each other such that the front faces of the persons seated in the plurality of seats respectively face the plurality of shooting units. This is a video conference system.
With such a configuration, it is possible to obtain an effect that a plurality of persons sitting in a seat and participating in a video conference surround the round table and can perform a video conference full of realism. . In addition, using the seat makes it easy to specify the position of the subject.

In the video conference system according to the present invention, in the video conference system, the plurality of photographing units are individually arranged on at least two sides of a polygonal plane region, and the display unit includes the polygon and the polygon. It is a video conference system arranged individually on at least two or more sides of a polygonal planar region that is similar.
With this configuration, it is possible to easily specify the shooting unit, the display unit, the position where the subject is arranged, and the like.

In the video conference system of the present invention, in the video conference system, the photographing device generates synchronization information that is information for associating the points of time taken simultaneously of images taken by the plurality of photographing units. A creation unit, and the output unit adds the synchronization information created by the synchronization information creation unit to a plurality of pieces of image information that is information indicating images captured by the plurality of photographing units, and outputs the information. The reception unit receives a plurality of pieces of image information to which the synchronization information is added, and the display device further includes a synchronization processing unit that synchronizes the plurality of pieces of image information using the synchronization information. The display unit is a video conference system that displays images of the subject captured by the plurality of imaging units, respectively, using a plurality of pieces of image information synchronized by the synchronization processing unit.
With such a configuration, it is possible to display a plurality of pieces of image information on a plurality of display units using synchronized image information, and more accurately reproduce the state of other conference rooms, so that a meeting full of realism can be achieved. Can be reproduced.

  The video conference system of the present invention is a video conference system comprising a first video conference terminal and a second video conference terminal, wherein the first video conference terminal outputs from the second video conference terminal. A first reception unit that receives a plurality of image information, and a plurality of second images arranged on each side of the polygonal region that displays a plurality of images using the plurality of image information received by the first reception unit. A plurality of first imaging units that shoot different subjects opposite to the first display unit, and a plurality of images that are information indicating images captured by the plurality of first imaging units, respectively. A first output unit that outputs information, wherein the second video conference terminal receives a plurality of image information output from the first video conference terminal, and the second reception unit receives Multiple Displaying a plurality of images using image information, each of polygonal regions similar to the polygonal region of the first video conference terminal, on the sides corresponding to the sides where the plurality of first display units are arranged A plurality of second display units arranged, a plurality of second imaging units that shoot different subjects facing the plurality of second display units, and images captured by the plurality of second imaging units, respectively. A second output unit that outputs a plurality of image information as information, and the plurality of first display units convert the plurality of images into a relative positional relationship between subjects corresponding to the plurality of images. The plurality of second display units display the plurality of images so as to have a positional relationship corresponding to a relative positional relationship between subjects corresponding to the plurality of images. It is a video conference system.

  With this configuration, a participant who is participating in a conference in a different conference room using each of the first video conference terminal and the second video conference terminal is a participant who is participating in the conference in another conference room. Therefore, it is possible to hold a conference as if it actually exists on the spot, and it is possible to hold a conference full of realism in both directions. In addition, the participants in the conference simply go to a position facing any one of the display units on which the images of the participants photographed in the other conference terminal are displayed. The image of the participant of the other conference is displayed on the display portion that is easy to see, so that it is easy to install the video conference terminal.

  In the video conference system according to the present invention, in the video conference system, each of the plurality of first display units is a polygon of the second video conference terminal that is similar to a polygonal region of the first video conference terminal. Each of the plurality of second display units displays the image captured by each of the second image capturing units that capture the subject facing the second display unit disposed on the corresponding side of the region. Each of the first imaging units that shoot subjects facing the first display unit disposed on the corresponding side of the polygonal region of the first videoconference terminal that is similar to the polygonal region of the videoconference terminal respectively captured This is a video conference system that displays images.

  With this configuration, a participant who is participating in a conference in a different conference room using each of the first video conference terminal and the second video conference terminal is a participant who is participating in the conference in another conference room. Therefore, it is possible to hold a conference as if it actually exists on the spot, and it is possible to hold a conference full of realism in both directions. In addition, the participants in the conference simply go to a position facing any one of the display units on which the images of the participants photographed in the other conference terminal are displayed. Thus, the image of the participant of the other conference is displayed on the display unit that is easy to see, and the installation of the video conference terminal becomes easy.

In the video conference system of the present invention, in the video conference system, a subject photographed by each of the plurality of first photographing units and the second photographing unit is one person, and the plurality of first photographing units The second photographing unit is a video conference system arranged toward the front of the person.
With such a configuration, it is possible to obtain an effect that a plurality of persons sitting in a seat and participating in a video conference surround the round table and can perform a video conference full of realism. . In addition, using the seat makes it easy to specify the position of the subject.

In the video conference system of the present invention, in the video conference system, the plurality of first imaging units and the second imaging unit each have an abbreviation centered around a position where the shooting directions intersect and the shooting directions intersect. This is a video conference system arranged on a circle.
With this configuration, the designation of the angle of view and the like when the first photographing unit and the second photographing unit shoot can be made the same in all the photographing units, and the setting can be facilitated.

In the video conference system according to the present invention, the subject photographed by each of the plurality of first photographing units and the second photographing unit is a single person, and further includes a plurality of seats on which the subject is seated. And the plurality of seats are arranged on a substantially circumference centered around a position where the shooting directions intersect with each other such that the front faces of the persons seated in the plurality of seats respectively face the plurality of shooting units. Is a videoconferencing system.
With such a configuration, it is possible to obtain an effect that a plurality of persons sitting in a seat and participating in a video conference surround the round table and can perform a video conference full of realism. . In addition, using the seat makes it easy to specify the position of the subject.

The video conference system of the present invention is a video conference system in which the polygon is a substantially regular octagon.
With this configuration, it is possible to realize a video conference that is full of realism.

In the video conference system according to the present invention, in the video conference system, the first video conference terminal is information that associates the time points of the images captured by the plurality of first image capturing units with each other. A first synchronization information creation unit that creates synchronization information is further provided, wherein the first output unit is an image obtained by the first imaging units, respectively, of the first synchronization information created by the first synchronization information creation unit. The two reception units receive a plurality of pieces of image information with the first synchronization information added thereto, and the second video conference terminal receives the first synchronization information. A second synchronization processing unit that synchronizes the plurality of pieces of image information using the information, and the plurality of second display units receive the plurality of pieces of image information synchronized by the second synchronization processing unit. Using the plurality of first The image of the object shadow is taken is a videoconference system for displaying respectively.
With such a configuration, it is possible to display a plurality of pieces of image information on a plurality of display units using synchronized image information, and more accurately reproduce the state of other conference rooms, so that a meeting full of realism can be achieved. Can be reproduced.

In the video conference system according to the present invention, in the video conference system, the second video conference terminal is information that associates the time points at which the plurality of second image capturing units are simultaneously captured with each other. A second synchronization information creation unit that creates synchronization information is further provided, and the second output unit is an image obtained by each of the plurality of second imaging units capturing the second synchronization information created by the second synchronization information creation unit. The one reception unit receives a plurality of pieces of image information to which the second synchronization information is added, and the first video conference terminal receives the second synchronization information. A first synchronization processing unit that synchronizes the plurality of pieces of image information using the information, and the plurality of first display units receive the plurality of pieces of image information synchronized by the first synchronization processing unit. Using the plurality of second The image of the object shadow is taken is a videoconference system for displaying respectively.
With such a configuration, it is possible to display a plurality of pieces of image information on a plurality of display units using synchronized image information, and more accurately reproduce the state of other conference rooms, so that a meeting full of realism can be achieved. Can be reproduced.

  According to the video conference system and the like according to the present invention, it is possible to realize a video conference full of realism.

Hereinafter, embodiments of the video conference system and the like will be described with reference to the drawings. In addition, since the component which attached | subjected the same code | symbol in embodiment performs the same operation | movement, description may be abbreviate | omitted again.
(Embodiment 1)
FIG. 1 is a block diagram of the video conference system according to the present embodiment.
FIG. 2 is a schematic diagram for explaining the arrangement of the video conference system according to the present embodiment.

The video conference system 1 includes a photographing device 10 and a display device 20.
The imaging device 10 and the display device 20 are communicably connected via a communication line or the like.
For example, the imaging device 10 and the display device 20 may be connected via the Internet or a network such as a wireless or wired LAN. The protocol used for communication is not particularly limited as long as it can be used for a video conference system. The information transmission / reception means may be a communication means or a broadcasting means. Usually, the imaging device 10 and the display device 20 are installed in different places such as a remote place.

The photographing apparatus 10 includes a plurality of photographing units 101, an output unit 102, and a photographing position information storage unit 103. In FIG. 2, the case where the photographing apparatus 10 includes four photographing units 101 is illustrated as an example, but the number of photographing units 101 is not limited as long as there are a plurality of photographing units 101.
The imaging unit 101 captures an image, particularly a moving image here. The moving image described here includes a plurality of continuous still images. As an example, the images captured by each of the plurality of imaging units 101 are images that are captured in a state in which a meeting is being performed.

  The conference to be photographed is, for example, a conference in which a plurality of participants are arranged so that directions perpendicular to the front of each participant intersect, for example, a conference in which a table is surrounded by a plurality of participants, etc. It is. The photographing unit 101 is a camera that photographs an image, for example, and photographs an image using an image sensor such as a CCD or a CMOS. As shown in FIG. 2, the plurality of photographing units 101 are arranged to photograph different subjects. Then, the plurality of imaging units 101 configure and output image information that is information indicating each captured image.

  The subject is a subject to be photographed by the photographing unit 101, and is, for example, a person or a product here. The number of subjects in each photographing unit 101 may be one or more. For example, one photographing unit 101 may photograph only one person as a subject, or two persons as subjects. However, it is preferable that the subject of one photographing unit 101 and the subject of another photographing unit 101 are different from each other. “Different from each other” means that there is no complete match or partial match. It is preferable that the number of subjects in each photographing unit 101 is one. The photographing unit 101 is disposed so as to face a surface on which a subject is desired to be photographed.

  In addition, when the subject which the imaging | photography part 101 image | photographs is a person, it is preferable that the imaging | photography part 101 is arrange | positioned toward the front of a person from the point that the effect which is talking facing a person is acquired. The human front described here is the substantial front of the entire body.For example, even if only a part of the body, for example, the face is facing sideways, the entire body is facing front, Here, it is considered to be a human front. In addition, the front described here may be slightly deviated, for example, about 0 to 20 degrees as long as it is considered to be the front as viewed from others.

  As a result, it is only necessary that the photographing unit 101 is disposed so as to face the surface on which the subject is to be photographed. For example, the arrangement of the photographing unit 101 may be changed or the arrangement of the subject itself may be changed. As shown in FIG. 2, the plurality of photographing units 101 are preferably arranged so that the photographing directions intersect each other. The shooting direction is a direction in which the shooting unit 101 performs shooting. However, here, regardless of the direction, the direction opposite to the direction in which the photographing unit 101 performs photographing is also set as the photographing direction.

  For example, when the photographing unit 101 is a camera, the photographing direction is on the optical axis of the camera lens or along the optical axis. Here, the imaging directions intersect each other means that the imaging directions intersect at least when viewed from above. Therefore, for example, if the shooting directions are in a twisted relationship and do not intersect with each other, but appear to intersect as seen from above, they are considered to intersect.

  Further, the state where the photographing directions intersect each other includes a state where the optical axes of the photographing unit 101 can be seen as intersecting at least when viewed from above. The photographing directions of the plurality of photographing units 101 preferably intersect at one point, but do not necessarily intersect at one point. The plurality of photographing units 101 are preferably arranged on a substantially circumference centered around the position where the photographing directions intersect with each other. In particular, it is preferable to dispose them individually on at least two or more sides of a plane area of a polygon, preferably a substantially regular polygon. By arranging in this way, adjustment of the distance from the photographing unit 101 to the subject can be simplified and the magnification of the subject displayed in the photographed image can be set to substantially the same value.

  In addition, a plurality of photographing units 101 are arranged in advance on a substantially circumference around a predetermined position, or on two or more sides of a polygon, preferably a substantially regular polygon, and the photographing direction of the photographing unit 101 is determined. By adjusting the position of each photographing unit 101 so as to be in a direction connecting a predetermined position that is substantially on the circumference or the center of the polygon and the position of the photographing unit 101, the setting of the plurality of photographing units 101 can be performed. It can be done easily.

  In this case, assuming that the subject of each photographing unit 101 is a single person, the human being who is the plurality of subjects has the front of the person on a substantially circumference centered around the position where the photographing directions intersect. It is preferable that the plurality of imaging units 101 are arranged to face each other. Alternatively, a plurality of seats on which a plurality of human subjects are seated are arranged on a substantially circumference centered around the position where the shooting directions intersect, and a plurality of front faces of one person seated on each of the plurality of seats are You may make it arrange | position so that each imaging | photography part may be opposed.

  There is no limitation on the data structure, timing, or the like for each photographing unit 101 to output a moving image. For example, the imaging unit 101 may output the acquired moving image information as one moving image file. Further, the photographing unit 101 may sequentially output the image information of each frame constituting the moving image or the image information corresponding to each frame every time it acquires, or an image of a predetermined number of frames is acquired. At this point, the image information may be output in units of a predetermined number of frames.

  Further, the photographing unit 101 may create a moving image to which time position information that is information that can specify an arbitrary temporal position in the moving image is added to the captured moving image. For example, a moving image to which information indicating a time position such as information indicating the time at the time of shooting is added may be created as the time position information. For example, for the image information of each frame constituting the moving image, the image capturing unit 101 adds information on the time when the image information was acquired as time position information, specifically, a time code or image information added as a time stamp. May be created. Further, frame identification information for identifying a frame may be added to each frame of the image information. Image information created and output by each photographing unit 101 may be analog image information or digital image information.

  For example, in the case of digital image information, MPEG (Moving Picture Experts Group) or ITU-T H.264 is used. H.264 and other algorithms for compressing and encoding image information may be used. Further, uncompressed image information may be output. The image information may be any image quality, resolution, etc. such as an HD image. Further, the photographing unit 101 may include a microphone or the like, and may acquire audio information. In addition, it is preferable that each imaging | photography part 101 outputs the positional identification information which is information which identifies the relative positional relationship between the subjects which each imaging | photography part 101 image | photographs with the image information to output.

  As long as the position identification information is information that can identify the relative positional relationship between the subjects as a result, the positional identification information is information that identifies the relative positional relationship between the plurality of imaging units 101 that shoot each subject. Also good. As a result, the position identification information is used as information for specifying the relative positional relationship of the display unit that displays the image of the subject. Therefore, the position identification information may be considered as information for specifying the display position. The data structure of position identification information does not matter. The position identification information includes, for example, “left”, “center”, “right”, “north”, “east”, “south”, “0 degrees”, “30 degrees”, “ May be information such as “−45 degrees”, or when the rules of the relative positional relationship between the subjects are determined in advance, “1”, “2”, “3”, “ Information such as “A”, “B”, and “C”, and information such as “D0134” and “SB098” may be used.

  The position identification information is stored in advance in a recording medium such as a memory (not shown) in each photographing unit 101, for example. It does not matter how each photographing unit 101 outputs the position identification information. Each imaging unit 101 may transmit the position identification information included in the image information, or may output the position identification information included in the header or footer of the image information output by each imaging unit 101, for example. . Further, each photographing unit 101 may output device identification information for identifying each photographing unit 101. The device identification information may be a manufacturing number of the photographing device when each photographing unit 101 is a photographing device such as a camera, or identification information set in advance for each photographing unit 101. May be.

  Also, physical address information on the network such as the IP address of the photographing unit 101 may be used. The device identification information may be information that can identify the photographing unit 101 as a result, and may be information that identifies an input terminal such as a port number to which the photographing unit 101 is connected. The apparatus identification information is stored in advance in, for example, a memory (not shown) in the photographing unit 101. Moreover, it does not ask | require how each imaging | photography part 101 transmits identification information. Specifically, the identification information can be output by the same method as the position identification information described above.

  The output unit 102 outputs a plurality of pieces of image information photographed by the plurality of photographing units 101, respectively. Specifically, the image information output from the plurality of imaging units 101 is acquired and output. For example, the output unit 102 transmits a plurality of pieces of image information to the display device 20. The output unit 102 preferably outputs each piece of image information in a streaming manner when a conference is performed in real time. Further, the image information may be multiplexed and output. The connection form of the plurality of imaging units 101 and the output unit 102 is not limited. For example, it may be connected via a hub or the like by a network, a serial bus, or the like, or may be connected via a dedicated connection interface having a plurality of input terminals. There is no limitation on the timing and method of outputting image information by the output unit 102.

  For example, image information may be output every time image information is acquired, or image information may be output when a predetermined amount of image information is acquired. Further, the output unit 102 outputs image information output from the plurality of imaging units 101 to MPEG, ITU-T H.264, or the like. Compression encoding may be performed using a compression encoding algorithm such as H.264. Further, the output unit 102 may output the image information acquired from each photographing unit 101 individually or collectively. For example, image information having a data structure having a plurality of pieces of image information in different tracks may be configured and output.

  Further, the output unit 102 may create synchronization information for synchronizing a plurality of pieces of image information, or may acquire the synchronization information from another processing unit and give it to the image information for output. The synchronization described here refers to, for example, associating time points at which images are simultaneously captured, for example, frames, or time points simultaneously received by the output unit 102 among a plurality of pieces of image information. The synchronization information is information that associates the time points at which images taken by the plurality of photographing units 101 are simultaneously photographed. This synchronization information is used by the display device 20 and the like which will be described later in order to simultaneously reproduce images taken at the same time.

  The synchronization information is, for example, each frame of images taken at the same time, or time information indicating the time when photographing was performed, which is given every predetermined number of frames, that is, a time code or a time stamp. In addition, the synchronization information may be information on the time at which shooting of each piece of image information is started. The synchronization information may be a combination of frame identification information for identifying a frame of a photographed image and information indicating a correspondence relationship between frame identification information of a plurality of frames photographed at the same time. In addition, when the reference time of the information indicating the time position such as the information indicating the time of shooting of each image information is different, the information further includes information indicating the correspondence between the information indicating the time position indicating the same shooting time. But it ’s okay. The output unit 102 may output the synchronization information by adding it to the image information.

  For example, the output unit 102 is information on the time at which each frame was acquired or information on the time at which each frame was captured for each frame of image information acquired from a plurality of imaging units 101 or a predetermined number of frames. The synchronization information, that is, the time code or the time stamp may be added to constitute image information and output. The time described here may be an absolute time or a relative time. In addition, when time position information as described above is individually added to each piece of image information acquired from a plurality of imaging units 101, the time that each piece of image information has to indicate the portion of each piece of image information received simultaneously Information indicating the correspondence between the position information may be output together with the image information as synchronization information.

  Further, the output unit 102 adds synchronization information, which is information for setting the start time, to the first frame of each image information so that the simultaneously received portions of each image information can be reproduced simultaneously. Also good. Here, a case will be described as an example where the output unit 102 outputs position identification information that is information for identifying a relative positional relationship between subjects of a plurality of pieces of image information as described above. When each of the above-described photographing units 101 outputs, in addition to the image information, the positional relationship information of the subject of each photographed image, the output unit 102 includes the image information transmitted by each of the photographing units 101 and What is necessary is just to make it output corresponding to position identification information.

  In addition, when each of the imaging units 101 described above outputs device identification information in addition to image information, the output unit 102 previously includes device identification information, position identification information associated with the device identification information, Shooting position management information, for example, a shooting position management table, which is information for managing the correspondence between the image information, and using the shooting position management information, the device identification information received together with the image information is used as a search key in the image information. Corresponding pre-stored position identification information may be acquired, and image information and position identification information transmitted by each photographing unit 101 may be output in association with each other.

  Information for managing such correspondence is stored in advance in a recording medium such as a memory. This information may be appropriately rewritten according to information received by an accepting unit (not shown) via an input device such as a keyboard. Here, a case will be described in which position identification information corresponding to device identification information output together with image information is acquired from the image capturing unit 101 using such shooting position management information and output together with image information. It is assumed that the position identification information is stored in the shooting position information storage unit 103 described later.

  Further, when the output unit 102 and the photographing unit 101 are connected by a plurality of identifiable input terminals, information such as a plurality of input terminals or port numbers for identifying the input terminals and corresponding to each photographing unit 101 If the image information is input in advance, the position identification information corresponding to the input terminal input is acquired as the position identification information corresponding to the image information. You may make it output with information. In addition, as long as image information and position identification information are matched, the output part 102 may output image information and position identification information how. For example, it may be included in the image information or may be added to a header or the like.

  The output unit 102 outputs the device identification information output by the plurality of imaging units 101 together with the image information, and the display device 20 described later corresponds to the device identification information as described above and the position identification information. The position identification information corresponding to the image information may be acquired using information for managing the relationship, for example, the shooting position management table, using the apparatus identification information received together with the image information as a search key. The output described here is a concept including transmission to an external device, accumulation in a recording medium, and the like. For example, the output unit 102 may store a plurality of pieces of image information on a recording medium such as an optical disk or a hard disk instead of transmitting them, or may store a plurality of pieces of image information on a recording medium simultaneously with the transmission. Also good.

  The output unit 102 may or may not include an output device such as a communication device. The output unit 102 can be realized by output device driver software, or output device driver software and an output device. When the output unit 102 performs compression encoding processing or the like, the output unit 102 may include an MPU, a memory, or the like for executing these processing. These processing procedures are usually realized by software, and the software is recorded in a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).

  The shooting position information storage unit 103 stores position identification information corresponding to the above-described apparatus identification information. The correspondence between the position identification information and the apparatus identification information is managed by the above-described shooting position management information. The correspondence relationship between the position identification information and the apparatus identification information may be appropriately rewritten using information input via a reception unit (not shown) or the like. This management information may be stored in the imaging position information storage unit 103 or may be stored in another recording medium. The shooting position information storage unit 103 is preferably a non-volatile recording medium, but can also be realized by a volatile recording medium.

The display device 20 includes a receiving unit 201, a display position information storage unit 202, and a plurality of display units 203. In FIG. 2, the case where the display device 20 includes four display units 203 is shown as an example, but the number of display units 203 is not limited as long as there are a plurality of display units 203.
The receiving unit 201 receives a plurality of pieces of image information output from the imaging device 10. The accepting unit 201 receives, for example, a plurality of pieces of image information transmitted from the photographing apparatus 10 via a communication line or the like. Further, a plurality of pieces of image information recorded on the recording medium by the photographing apparatus 10 may be read and acquired.

  The plurality of pieces of image information received by the reception unit 201 may be information output as one file or a plurality of packets with the plurality of pieces of image information as a unit, or each of the plurality of pieces of image information may be a file or a plurality of pieces of information. It may be information output as a packet, and its data structure is not limited. The receiving unit 201 may perform a decoding process when the received image information is compressed and encoded. The receiving unit 201 outputs the received plurality of pieces of image information to the plurality of display units 203 individually. The receiving unit 201 determines the output destination of each piece of image information using the position identification information or device identification information transmitted together with the image information.

  Here, specifically, display position management information that is information for managing correspondence between position identification information or device identification information prepared in advance and information specifying a plurality of display units 203 as output destinations Information specifying the display unit 203 corresponding to the position identification information or device identification information associated with each received image information is acquired by, for example, a search, and the information specifying the display unit 203 indicates The received image information is output to the display unit 203. The information specifying the display unit 203 may be information for identifying the display unit 203 or information for identifying an output terminal to which the display unit 203 is connected, for example.

  Here, as an example, a case will be described in which display position management information, which is information for managing the correspondence between position identification information and information for specifying a plurality of output destination display units 203, is used. The display position management information is accumulated in a display position information storage unit 202 described later. In addition, when the synchronization signal is output together with the image information from the imaging device 10, the reception unit 201 may synchronize a plurality of pieces of image information using the synchronization signal and output them to the plurality of display units 203. . For example, among the plurality of pieces of image information, image information at the time of simultaneous shooting indicated by the synchronization signal, for example, image information of frames shot simultaneously, may be output to the display unit 203 at the same time.

The reception described here is, for example, reception of an input signal transmitted from another device or the like, reading of information from a recording medium, or the like. The accepting unit 201 can be realized by a device driver of communication means, control software of an apparatus that reads information from a recording medium, or the like.
The display position information storage unit 202 stores information specifying a plurality of output destination display units 203 associated with the above-described position identification information or device identification information. The correspondence relationship between the position identification information or the apparatus identification information and information specifying the plurality of display units 203 as output destinations is managed by the display position management information described above. This management information may be stored in the display position information storage unit 202 or may be stored in another recording medium.

  The display unit 203 receives and displays image information output from the receiving unit 201 by designating an output destination. Each display unit 203 has a display surface that is a surface for displaying an image. The size of the display surface of each display unit 203 may be the same or different. Each display unit 203 has identification information that is information for identifying each, and this identification information may be used as information for the reception unit 201 to specify the display destination of each image information. In this case, each display unit 203 may accept and output only image information output together with identification information that matches the identification information.

  When each display unit 203 is connected to a different output terminal of the receiving unit 201, it is only necessary to display image information output from the output terminal. The plurality of display units 203 are arranged as follows. That is, the plurality of display units 203 are arranged so as to have a positional relationship corresponding to the relative positional relationship between the subjects corresponding to the images displayed on each of the display units 203. In particular, each of the plurality of display units 203 has a display surface that displays an image of a subject so as to have a positional relationship corresponding to the relative positional relationship between the surfaces on which the subject to be photographed is photographed. Be placed. Specifically, the plurality of display units 203 are preferably arranged so as to have a positional relationship similar to the relative positional relationship between the subjects.

  For example, three subjects are arranged on the three sides of a rectangular area, approximately at the center of each of the rectangles so that the center side of the rectangle is the front, and three pieces of image information obtained by photographing each subject from the front. However, when the image is output from the imaging device 10, the three display units are, for example, on the three sides of the same or similar rectangle as the rectangle on which the subject is arranged, and the center side of the rectangle is the display surface. Arranged so that. Although a rectangle is used here, the same applies to a polygon. In addition, for example, when a plurality of subjects are arranged on a substantially circumference centered around the position where the shooting directions intersect, the plurality of display units 203 also have positions where normals to the display surface of each display unit 203 intersect. It arrange | positions on the substantially circumference centering. However, the absolute positional relationship between the subjects and the absolute positional relationship between the display units 203 may be different.

  For example, the direction and orientation in which the entire subject is arranged may be different from the direction and orientation in which the entire display unit 203 is arranged. Note that the arrangement of the plurality of display units 203 is within a range in which the correspondence between the positional relationship between the subjects to be imaged and the positional relationship between the subjects in the image displayed on the display unit 203 can be clearly understood. If so, there may be a slight change in the arrangement of the front, rear, left and right, a slight change in the orientation, etc., and they do not necessarily have to be completely the same or in a completely similar relationship. For example, when the display surface of one display unit 203 is large, the display unit 203 may be arranged at a position farther from the other display units. Specifically, the plurality of display units 203 are preferably arranged so as to have a positional relationship that is substantially similar to the relative positional relationship between the subjects.

  Note that the plurality of pieces of image information output by the receiving unit 201 are displayed so that the relative positional relationship between the subjects to be imaged is the same as the relative positional relationship between the plurality of display units 203 arranged as described above. The assignment of a plurality of pieces of image information for display is managed by display position management information set in advance as described above. When the display position management information is changed, the display unit 203 that outputs each piece of image information is changed. The display unit 203 is a display device that can display a moving image, such as a liquid crystal display, a CRT display, a plasma display, or a projector. The display unit 203 may include an audio output device such as a speaker for outputting audio.

Next, the operation of the imaging device 10 of the video conference system 1 will be described using the flowchart of FIG. Here, the case where the imaging device 10 includes n (n is an integer of 2 or more) imaging units 101 will be described. Here, it is assumed that each photographing unit 101 continuously outputs image information. Here, the case where the output unit 102 collects image information of m (m is an integer of 1 or more) frames and transmits them to the display device 20 will be described as an example.
(Step S301) The output unit 102 substitutes 1 for a counter j.
(Step S302) The output unit 102 substitutes 1 for the counter k.

  (Step S <b> 303) The output unit 102 acquires one frame of image information from the k th imaging unit 101. In addition, device identification information for identifying the k th imaging unit 101 that is output from the k th imaging unit 101 together with the image information is acquired. In addition, instead of the imaging unit 101 output from the imaging unit 101, identification information such as a port number of an input terminal to which the kth imaging unit 101 is connected is used to identify the kth imaging unit 101. It may be acquired as information. When the image information output from the photographing unit 101 is analog information, it may be converted into digital image information at the time of acquisition. Further, synchronization information such as a time code may be added to the acquired image information. The output unit 102 temporarily stores the acquired image information of one frame in a recording medium such as a memory. Further, the device identification information of the k-th imaging unit 101 acquired together with the image information is also temporarily stored in a memory or the like in association with the image information.

(Step S304) The output unit 102 increments the counter k by 1.
(Step S305) The output unit 102 determines whether or not the value of the counter k is greater than n. If so, the process proceeds to step S306, and if not, the process returns to step S303.
(Step S306) The output unit 102 increments the counter j by 1.
(Step S307) The output unit 102 determines whether or not the value of the counter j is greater than m. If so, the process proceeds to step S308. If not, the process returns to step S302.

(Step S308) The output unit 102 substitutes 1 for the counter k.
(Step S309) The output unit 102 acquires position identification information corresponding to the kth imaging unit 101. Specifically, the device identification information associated with the image information acquired from the k-th photographing unit 101 and temporarily stored in a memory or the like is used as a search key, and associated with the device identification information of the plurality of photographing units 101. Thus, position identification information corresponding to the k-th imaging unit 101 is acquired from the position identification information stored in the imaging position information storage unit 103.
(Step S <b> 310) The output unit 102 compresses and encodes image information of m frames acquired from the k-th imaging unit 101.

(Step S311) The output unit 102 associates the image information compressed and encoded in step S310 with the position identification information acquired in step S309, and transmits the image information to the display device 20. For example, a packet in which a header including position identification information is added to image information is transmitted. It is assumed that address information such as an IP address for designating the transmission destination of the display device 20 is stored in advance in a memory or the like (not shown).
(Step S312) The output unit 102 increments the counter k by 1.
(Step S313) The output unit 102 determines whether or not the value of the counter k is greater than n. If greater than n, the process returns to step S301, and if not greater than n, the process returns to step S309.

In the flowchart of FIG. 3, image information acquired from different imaging units 101 is individually transmitted. However, image information acquired from a plurality of imaging units 101 is simultaneously transmitted, for example, multiplexed. Also good.
In the flowchart of FIG. 3, the process ends when the power is turned off or the process is terminated.

Next, operation | movement of the display apparatus 20 of the video conference system 1 is demonstrated using the flowchart of FIG. Here, a case will be described in which the display device 20 includes l (l is an integer of 2 or more) display units 203. Also, a case will be described where the reception unit 201 receives image information acquired by each imaging unit 101 and transmitted for each imaging unit 101. Further, it is assumed that the position identification information corresponding to each photographing unit 101 is received together with the image information acquired by each photographing unit 101.
(Step S401) The receiving unit 201 determines whether image information has been received. If accepted, the process proceeds to step S402. If not accepted, the process proceeds to step S405.

  (Step S402) The reception unit 201 determines the display unit 203 that outputs image information using the position identification information received together with the image information. Specifically, using the position identification information received together with the image information as a search key, the output destination display unit 203 stored in the display position information storage unit 202 is specified in association with a plurality of position identification information. Information indicating the display unit 203 that outputs image information, for example, information for identifying a connection terminal such as a port number to which the display unit 203 is connected is acquired from the information. The display unit 203 indicated by the information indicating the display unit 203 is determined as the display unit 203 that is the output destination of the image information. If the display unit 203 that is the output destination cannot be determined, the processes in steps S403 and S404 below are ignored.

(Step S403) The receiving unit 201 decodes the received image information.
(Step S404) The receiving unit 201 temporarily stores the received image information in a recording medium such as a memory in association with the display unit 203 that is the output destination of the image information. For example, the image information is temporarily stored in an area corresponding to the display unit 203 serving as an output destination of the image information in the memory. Then, the process returns to step S401.
(Step S405) The reception unit 201 assigns 1 to the counter i.

  (Step S406) The reception unit 201 determines whether the image information temporarily stored in step S404 includes image information displayed by the i-th display unit 203, specifically, image information for one frame. To do. If there is, the process proceeds to step S407, and if not, the process proceeds to step S408. Note that the determination of this processing may be performed when it is time to display, for example, by determining whether it is time to display an image of one preset frame. This display timing may be determined in any way.

  For example, whether or not it is a preset image display timing, for example, if it is set to display one frame image every 1/30 seconds, 1/30 seconds have elapsed since the previous image display If it is a display timing, it is determined that it is a timing for displaying an image of one frame. If it is not the display timing, the determination process may be repeated until the display timing comes, or the process may return to step S401.

(Step S407) The reception unit 201 reads out image information of a frame with the earliest shooting time out of image information that is temporarily stored in a memory or the like and that designates the i-th display unit 203 as an output destination. To the second display unit 203. The i-th display unit 203 displays an image of one frame indicated by this image information. The read image information of one frame is discarded from the memory or the like.
(Step S408) The reception unit 201 increments the counter i by 1.
(Step S409) The reception unit 201 determines whether or not the value of the counter i is greater than l. When it is larger, the process returns to step S401, and when it is not larger than 1, the process returns to step S406.

In the flowchart of FIG. 4, image information acquired from different imaging units 101 is individually received. However, the reception unit 201 receives image information acquired, multiplexed, and transmitted by a plurality of imaging units 101. You may receive it. In this case, the display unit 203 as an output destination may be determined for each multiplexed image information and temporarily stored in a memory or the like.
In the flowchart of FIG. 4, the process ends when the power is turned off or the process ends.

Hereinafter, a specific operation of the video conference system according to the present embodiment will be described.
FIG. 5 is a conceptual diagram of a video conference system for explaining the operation of a specific example of the present embodiment. In the figure, the same reference numerals as those in FIGS. 1 and 2 denote the same or corresponding parts.
FIG. 6 is a block diagram illustrating a configuration of a video conference system according to a specific example of the present embodiment. In the figure, the same reference numerals as those in FIGS. 1 and 2 denote the same or corresponding parts.

In this specific example, each conference room is provided with the imaging device 10 and the display device 20 described in this embodiment so that a two-way dialogue can be performed between two separate conference rooms. A video conference system in which one video conference terminal 50 and the first video conference terminal 50 are arranged will be described. Here, the conference rooms in which the first video conference terminal 50 and the second video conference terminal 60 are installed are referred to as a first conference room 500 and a second conference room 600, respectively.
FIG. 7 is a perspective view showing the configuration of the first video conference terminal of the video conference system of a specific example of the present embodiment.

  In this video conference system, the first video conference terminal 50 and the second video conference terminal 60 have the same configuration. In this video conference system, the imaging device 10 of the first video conference terminal 50 and the display device 20 of the second video conference terminal 60 are connected via a network, for example. Moreover, the imaging device 10 of the second video conference terminal 60 and the display device 20 of the first video conference terminal 50 are connected via a network, for example. That is, in this video conference system, two sets of video conference systems 1 as shown in FIGS. 1 and 2 are provided.

  The first video conference terminal 50 includes six photographing units 101, six display units 203, and an information processing device 5000. Here, each imaging unit 101 is referred to as imaging units 101a to 101f, and each display unit 203 is referred to as display units 203a to 203f. The imaging units 101a to 101f are assumed to be cameras, and the display units 203a to 203f are assumed to be displays. The information processing apparatus 5000 includes an output unit 102, a shooting position information storage unit 103, a reception unit 201, and a display position information storage unit 202. The imaging units 101a to 101f are assumed to be connected to the output unit 102 of the information processing device 5000 via different input terminals (not shown). The display units 203a to 203f are also connected to the reception unit 201 of the information processing apparatus 5000 via different output terminals (not shown).

In FIG. 5, illustration of connections between the imaging units 101 a to 101 f and the display units 203 a to 203 f and the information processing device 5000 is omitted.
In the first conference room 500 in which the first video conference terminal 50 is installed, for example, a circular table 501 is installed, and six seats surrounding two or more conference participants are surrounded by the circular table. 502a to 502f are arranged. These two or more conference participants are subjects of the photographing unit 101.

  Each display unit 203a to 203f of the first video conference terminal 50 has six sides of a virtual substantially regular octagon 503 with six sides facing the front of each seat 502a to 502f, with the circular table 501 as the center. Are arranged almost on the center of each. The display units 203a to 203f are arranged so that the display surface of the image is parallel to each of the six sides of the virtual octagonal region 503. The six seats 502a to 502f are individually arranged so that the front faces the display surfaces of the display units 203a to 203f. Thereby, the display surfaces of the display units 203a to 203f are positioned in front of the participants of the conference seated in the seats 502a to 502f, respectively. Here, the relative positional relationship of the subject and the relative positional relationship between the display units 203a to 203f are substantially similar.

  The photographing units 101a to 101f of the first video conference terminal 50 are arranged at positions for photographing different subjects facing the display surfaces of the display units 203a to 203f. Here, as an example, the above-described substantially regular octagonal region 503 is disposed on substantially the center of the six sides so as to face each of the seats 502a to 502f. More specifically, the imaging units 101a to 101f are arranged above the display units 203a to 203f, and the imaging direction, specifically the optical axis of the camera, is respectively in front of the six seats 502a to 502f. Each is arranged to face.

Usually, the front of the seat is in the same direction as the front of the person seated in the seat. Here, the shooting directions of the shooting units 101 a to 101 f are crossed on the table 501. Accordingly, the plurality of seats 502a to 502f are arranged on the substantially circumference centered around the positions where the shooting directions intersect, and the front faces of the humans seated in the plurality of seats 502a to 502f are respectively connected to the plurality of shooting units 101a to 101f. They are arranged to face each other.
In addition, the angle of view of each of the imaging units 101a to 101f is adjusted so that only the conference participants who are seated in the seats 502a to 502f are captured as subjects. Therefore, as long as the participants of the conference are seated in the seats 502a to 502f, the photographing units 101a to 101f photograph the participants who are different subjects from the front.

Here, the display units 203a to 203f of the first video conference terminal 50 are arranged on the six sides of the same virtual substantially regular octagonal region 503 as the imaging units 101a to 101f of the first video conference terminal 50. However, a substantially regular octagonal region for arranging the display units 203a to 203f includes a region 503 having six sides facing the front of each of the seats 502a to 502f, with the circular table 501 substantially at the center. May be different virtual substantially regular octagonal regions.
Each of the photographing units 101a to 101f is preferably installed at a high position so that an image displayed on each of the display units 203a to 203f and the like can be photographed while looking down at the participant who is the subject. .

Similar to the first video conference terminal 50, the second video conference terminal 60 includes six photographing units 101a to 101f, six display units 203a to 203f, and an information processing device 6000.
The information processing apparatus 6000 includes an output unit 102, a shooting position information storage unit 103, a reception unit 201, and a display position information storage unit 202. Here, it is assumed that the output unit 102 of the information processing device 5000 is connected to the reception unit 201 of the information processing device 6000 via a network or the like. Further, it is assumed that the output unit 102 of the information processing device 6000 is connected to the reception unit 201 of the information processing device 5000 via a network or the like. In FIG. 5, illustration of connections between the imaging units 101 a to 101 f and the display units 203 a to 203 f and the information processing device 6000 is omitted.

Also, for the second conference room 600 in which the second video conference terminal 60 is installed, a circular table 601 is installed instead of the circular table 501 in the first conference room 500, and six seats 502a to 502 are installed. Assume that six seats 602a to 602f are arranged instead of 502f.
In addition, the arrangement of the six imaging units 101a to 101f and the six display units 203a to 203f of the second video conference terminal 60, the arrangement of the circular table 601 and the like are illustrated here as examples. It is assumed that the relationship is similar to or similar to 500 arrangement.

  That is, the display units 203a to 203f of the second video conference terminal 60 are the same as the substantially regular octagon 503 described above in which six sides are opposed to the front of the seats 602a to 602f with the circular table 601 as the center. Alternatively, they are arranged on the approximate centers of six sides of a similar virtual substantially regular octagon 603. The display units 203a to 203f of the second video conference terminal 60 are substantially octagonal 603 corresponding to the sides of the substantially regular octagon 503 on which the display units 203a to 203f of the first video conference terminal 50 are respectively arranged. It is arranged on the side.

The display units 203a to 203f of the second video conference terminal 60 are arranged so that the display surface is parallel to each of the six sides of the virtual octagonal region 603. The six seats 602a to 602f are individually arranged so that the front faces the display surfaces of the display units 203a to 203f. As a result, the display surfaces of the display units 203a to 203f are positioned in front of the participants of the conference seated in the seats 602a to 602f, respectively.
In addition, each of the imaging units 101a to 101f of the second video conference terminal 60 is disposed at a position for imaging different subjects facing the display surfaces of the display units 203a to 203f of the second video conference terminal 60. Here, as an example, the above-described substantially regular octagonal region 603 is disposed on substantially the center of the six sides so as to face the seats 602a to 602f.

  More specifically, each imaging unit 101a to 101f is arranged above each display unit 203a to 203f, and the imaging direction, specifically the optical axis of the camera, is respectively in front of the six seats 602a to 602f. Each is arranged to face. Here, the photographing directions of the photographing units 101 a to 101 f are crossed on the table 601. In addition, the angle of view of each of the imaging units 101a to 101f is adjusted so that only the participants of the conference seated in the respective seats 602a to 602f are captured as subjects. Therefore, as long as the conference participants are seated in the seats 602a to 602f, the photographing units 101a to 101f of the second video conference terminal 60 photograph the participants who are different subjects from the front. It has become.

  However, the overall orientation of the first conference room 500 and the overall orientation of the second conference room 600 may not be the same. For example, when the orientation of the display unit 203d viewed from the table 501 side in the first conference room 500 is eastward, the orientation of the display unit 203d viewed from the table 601 side in the second conference room 600 is a direction other than the eastward orientation. For example, it may be facing south. Further, if the positional relationship between the captured image and the displayed image is substantially maintained, it is possible to slightly change the position and orientation.

  Here, the arrangement of the photographing units 101a to 101f and the arrangement of the display units 203a to 203f in the first video conference terminal 50 and the second video conference terminal 60 are the same or similar unless the overall orientation is taken into consideration. Therefore, the relative positional relationship between the seats 502a to 502f where the participant who is the subject of the first video conference terminal 50 is seated and the display unit 203a of the second video conference terminal 60 are set. The relative positional relationship between ˜203f is almost similar.

  In this specific example, as will be described later, a subject facing each display unit 203a to 203f of the first video conference terminal 50 in the first conference room 500 is photographed by specifying the photographing position management table and the display position management table. As a result, the image is set to be displayed on each of the display units 203a to 203f of the second video conference terminal 60 of the second conference room 600. In addition, as a result, images obtained by photographing subjects facing the display units 203a to 203f of the second video conference terminal 60 in the second conference room 600 are displayed on the first video conference terminal 50 in the first conference room 500. It is set to be displayed on each of the display sections 203a to 203f.

That is, the images shot by the shooting units 101a to 101f of the first video conference terminal 50 are displayed on the display units 203a to 203f of the second video conference terminal 60, respectively. In addition, images captured by the respective imaging units 101 a to 101 f of the second video conference terminal 60 are displayed on the display units 203 a to 203 f of the first video conference terminal 50, respectively.
Therefore, in this specific example, the first video conference terminal 50 uses the reception unit 201 that receives a plurality of pieces of image information output from the second video conference terminal 60 and the plurality of pieces of image information that the reception unit 201 has received. A plurality of display units 203a to 203f arranged on the sides of the polygonal region 503, which display a plurality of images, and a plurality of imaging units 101a that shoot different subjects facing the plurality of display units 203a to 203f. ˜101f and an output unit 102 that outputs a plurality of pieces of image information that is information indicating images taken by the plurality of photographing units 101a to 101f.

  In addition, the second video conference terminal 60 displays a plurality of images using a reception unit 201 that receives a plurality of pieces of image information output from the first video conference terminal 50 and a plurality of pieces of image information that the reception unit 201 has received. The polygonal region 603 similar to the polygonal region 503 of the first video conference terminal 50 is arranged on each side corresponding to the side where the plurality of display units 203a to 203f of the first video conference terminal 50 are arranged. A plurality of display units 203a to 203f, a plurality of imaging units 101a to 101f that shoot different subjects facing each of the plurality of display units 203a to 203f, and images captured by the plurality of imaging units 101a to 101f, respectively. And an output unit 102 that outputs a plurality of pieces of image information that is information indicating the above.

Further, the plurality of display units 203a to 203f of the first video conference terminal 50 display the plurality of images so as to have a positional relationship corresponding to the relative positional relationship between the subjects corresponding to the plurality of images. The plurality of display units 203a to 203f of the two video conference terminals 60 display a plurality of images so as to have a positional relationship corresponding to a relative positional relationship between subjects corresponding to the plurality of images. .
In addition, each of the plurality of display units 203a to 203f of the first video conference terminal 50 corresponds to the polygon region 603 of the second video conference terminal 60 that is similar to the polygon region 503 of the first video conference terminal 50. Each of the front image capturing units 101a to 101f of the second video conference terminal 60 that captures a subject facing the display units 203a to 203f of the second video conference terminal 60 arranged on the side displays the captured images. ing.

In addition, each of the plurality of display units 203a to 203f of the second video conference terminal 60 corresponds to the polygon region 503 of the first video conference terminal 50 that is similar to the polygon region 603 of the second video conference terminal 60. Each of the front photographing units 101a to 101f of the first video conference terminal 50 that captures the subject facing the display units 203a to 203f of the first video conference terminal 50 arranged on the side displays the images respectively taken. ing.
In the first video conference terminal 50 and the second video conference terminal 60, it is assumed that whether or not the photographing units 101a to 101f and the display units 203a to 203f are used, for example, on and off can be individually controlled.

Hereinafter, the operation will be described in detail. In the first conference room 500 shown in FIG. 5, a plurality of, here, four conference participants are seated from the seat 502c to the seat 502f, respectively. .
First, the photographing units 101c to 101f facing the seats 502c to 502f where the conference participants in the first conference room 500 are seated are turned on, and the other photographing units 101a to 101c are turned off. And
Thereby, the image of the participant who is the subject seated in each of the seats 502c to 502f is taken by the photographing units 101c to 101f of the first video conference terminal 50, respectively. Here, image information obtained by photographing is output from the photographing units 101c to 101f to the output unit 102 of the information processing device 5000.

  The output unit 102 of the information processing device 5000 sequentially acquires image information in units of frames captured by the imaging units 101c to 101f in real time. Further, the identification number of the input terminal to which each of the photographing units 101c to 101f is connected is acquired together with the image information output from each of the photographing units 101c to 101f. Here, the identification numbers of these input terminals are device identification information for identifying the photographing unit 101 described above. Here, the identification number of the input terminal to which the imaging unit 101c is connected, that is, the device identification information of the imaging unit 101c is “10c”, and the identification number of the input terminal to which the imaging unit 101d is connected, that is, the imaging unit 101d. The device identification information is “10d”, the identification number of the input terminal to which the photographing unit 101e is connected, that is, the device identification information of the photographing unit 101e is “10e”, and the identification number of the input terminal to which the photographing unit 101f is connected, that is, Assume that the device identification information of the imaging unit 101f is “10f”.

FIG. 8 is a schematic diagram for explaining a state in which the output unit 102 receives image information output from the imaging units 101c to 101f and an identification number of the input terminal.
FIG. 9 is a shooting position management table for managing the correspondence between the position identification information stored in the shooting position information storage unit 103 and the device identification information received by the output unit 102. The shooting position management table has “apparatus identification information” and “position identification information” as attributes. “Device identification information” is device identification information for identifying the photographing unit 101 that photographed the subject, and “position identification information” is for identifying the position of the subject photographed by the photographing unit 101 as described above. It is position identification information.

  For example, “L1”, “L2”, and “L3” are the first, second, and third subjects on the left side when viewed from the center of the six subjects, here, between the seat 502c and the seat 502d. , Specifically, information for identifying the positions of the seats 502d, 502e, and 502f where the human subject is seated. “R1”, “R2”, and “R3” are the positions of the first, second, and third subjects on the right side as viewed from the position between the seat 502c and the seat 502d. This is information for identifying the positions of the seats 502c, 502b, and 502a where the user sits.

  The output unit 102 of the information processing device 5000 temporarily stores the acquired image information in a memory or the like for each device identification information. When image information of a preset number of frames is stored for the image information for each device identification information, the output unit 102 includes the device identification information stored in association with each image information, and the shooting position management table. Are used to obtain position identification information corresponding to the device identification information. Specifically, each record of the shooting position management table as shown in FIG. 9 is searched using the device identification information associated with each image information as a search key, and has a “device identification information” attribute that matches the search key. Acquires the “location identification information” attribute included in the record.

Here, the position identification information “R1” is associated with the device identification information “10c” of the photographing unit 101c, the position identification information “L1” is associated with the device identification information “10d” of the photographing unit 101d, and the device of the photographing unit 101e. The output unit 102 acquires the position identification information “L2” for the identification information “10e” and the position identification information “L3” for the apparatus identification information “10f” of the imaging unit 101f.
Then, the output unit 102 includes image information of a preset number of frames in the temporarily stored image information for each device identification information, and position identification information obtained using the device identification information acquired together with the image information. Is transmitted to the second video conference terminal 60 via a network or the like.

Note that image information is usually compressed and encoded before transmission. Moreover, what is necessary is just to read the address information, such as an IP address of the 2nd video conference terminal 60, previously stored in the memory.
FIG. 10 is a diagram schematically illustrating an example of a data structure of image information output from the output unit 102. The output unit 102 configures and outputs a packet of image information having, for example, compression-encoded image information in the payload unit 91 and position identification information obtained corresponding to the image information in the header unit 92. Further, information such as a physical address on the network of the second video conference terminal 60 may be included in the header section 92.
The reception unit 201 of the second video conference terminal 60 receives the image information transmitted from the output unit 102 of the first video conference terminal 50 via the network.

  FIG. 11 shows display position management for managing the correspondence between display position designation information, which is information for designating an output destination display section stored in the display position information storage section 202, and position identification information received by the receiving section 201. It is a table. The display position management table has “position identification information” and “display position designation information” as attributes. The “position identification information” is position identification information for identifying the position of the subject photographed in the image information received together with the image information. The display position designation information is information for designating the display unit 203 that displays the image information received by the reception unit 201, and here is identification information of the output terminal to which the display units 203a to 203f are connected. For example, here, “20a” to “20f” of the display position designation information are information identifying the output terminals to which the display units 203a to 203f are connected, respectively.

It should be noted that the positional relationship between the positions of the subject identified by the position identification information and the positional relationship between the display units 203a to 201f specified by the display position specifying information are similar in the case where the corresponding relationship, for example, the direction is not considered. Therefore, it is necessary to associate the position identification information with the display position designation information in advance and manage them in the display position management table.
The reception unit 201 of the second video conference terminal 60 corresponds to the position identification information by using the position identification information received together with the image information and the display position management table stored in the display position information storage unit 202. Display position designation information which is information for designating an output destination display section is acquired.

  Specifically, the record having the “position identification information” attribute matching the search key is searched by using the position identification information received together with each image information as a search key to search each record in the display position management table as shown in FIG. The “display position designation information” attribute included in is acquired. For example, here, the display position management table shown in FIG. 11 is used from “R1”, “L1”, “L2”, and “L3”, which are position identification information transmitted together with image information from the first video conference terminal 50. Thus, display position designation information “20c”, “20d”, “20e”, and “20f” is obtained, respectively.

The second video conference terminal 60 decodes the image information received by the receiving unit 201, and outputs the decoded image information to the output terminal indicated by the display position designation information acquired using the position identification information received together with the image information. The data is output to the connected display units 203a to 203f. The display units 203a to 203f display an image indicated by the image information received from the receiving unit 201.
Here, finally, images are displayed on the display units 203c to 203f connected to the output terminals designated by the display position designation information “20c”, “20d”, “20e”, and “20f”. The image displayed on the display unit 203c is an image of the front of the attendee seated on the seat 502c photographed by the photographing unit 101c of the first video conference terminal 50.

The image displayed on the display unit 203d is a front image of the attendee seated on the seat 502d photographed by the photographing unit 101d of the first video conference terminal 50. The image displayed on the display unit 203e is an image in front of the attendee seated on the seat 502e photographed by the photographing unit 101e of the first video conference terminal 50. The image displayed on the display unit 203f is a front image of the attendee seated on the seat 502f taken by the photographing unit 101f of the first video conference terminal 50.
Then, in the second conference room 600, for example, a seat 602 in which one to a maximum of four conference participants do not back the display units 203c to 203f, which are display units 203 on which images are displayed, here. By seating in any of the seats 602c to 602f, the conference can be performed while viewing the images of the four persons participating in the conference in the first conference room 500.

FIG. 12 is a schematic diagram showing a state in which a video conference is being held according to the configuration of this specific example.
Here, since the first video conference terminal 50 and the second video conference terminal 60 have the same configuration and arrangement, images of participants participating in the conference in the second conference room 600 are also included. Similarly to the images of the participants in the first conference room 500, the display units 203c to 203f other than the display units 203a and 203b behind the plurality of participants in the display unit 203 in the first conference room 500. It is displayed on either of them, and a two-way video conference is possible.
The display unit 203 on which no image is displayed may be manually switched on / off, or may be automatically turned off when image information is not sent for a certain period of time. good.

  Further, each display unit 203 may be configured so that power is turned on or information that can be displayed is displayed only when image information is sent. In the first conference room 500, when the imaging unit 101 to be used is turned on or a signal indicating that the imaging unit 101 is used is provided, an image corresponding to the imaging unit 101 is displayed. The first video conference terminal 50 may output instructions to the second video conference terminal 60 to turn on the display unit 203 or to enable display. In the second video conference terminal 60, in response to such an instruction, the display unit 203 that performs display may be turned on or in a displayable state. In addition, when the power of the display unit 203 of one video conference terminal is turned on or off, the power of the photographing unit 101 that captures an image to be displayed on the display unit of the other video conference terminal is turned on or off. May be.

Here, the total number of participants who can participate in the video conference is a maximum of eight people in total including the first conference room 500 and the second conference room 600, and if it is eight or less, it can be used.
Here, the participants participating in each conference room are seated side by side continuously, but need not be continuous. However, each participant needs to select a seat so as not to turn his back to the display unit 203 on which the participant is displayed.

  In this specific example, the first video conference terminal 50 and the second video conference terminal 60 are each provided with six photographing units 101 and six display units along the sides of a virtual substantially regular octagonal region. However, the number of the imaging units 101 and the display units 203 in the video conference system of this embodiment may be two or more. For example, as illustrated in FIG. 15, the first video conference terminal 50 and the second video conference terminal 60 each include seven photographing units 101 a to 101 g along the sides of a virtual substantially regular octagonal region, and seven units. Display units 203a to 203g may be arranged.

  In this specific example, the photographing unit 101 and the display unit 203 are arranged along the side of the virtual substantially regular octagonal region. However, in the present embodiment, the photographing unit 101 and the display unit are arranged. The arrangement 203 may be an arrangement along a side of a polygon area other than an octagon, or an arrangement not along the side of the polygon area. For example, the present invention can also be applied to a case where an imaging unit and a display unit of at least 2n−1 or less, but 2 or more, are arranged in a substantially positive 2n (n is an integer of 2 or more) square region. Further, the present invention can also be applied to the case where at least 2n or less, but 2 or more photographing units and display units are arranged in a substantially positive 2n-1 (n is an integer of 2 or more) square region. However, in order to eliminate the display portion that becomes a blind spot from the participant, the region is preferably a 2n square region, and preferably n ≧ 3.

  As described above, according to the present embodiment, a plurality of displays in which images of a plurality of participants in one conference room are arranged corresponding to the positional relationship between the plurality of participants in the other conference room. Displayed individually. For this reason, in the other conference room, the conference can proceed while looking at images displayed at positions that are similar to the actual positional relationship of a plurality of participants in the one conference room. Participants in the conference room can hold the conference as if they actually existed in the other conference room, so that a conference full of realism can be held.

  In addition, the relative positional relationship between a plurality of participants in one conference room is also maintained in the positional relationship of the images of the plurality of participants displayed on the plurality of display units in the other conference room. When participant A in one conference room faces his face to participant B in the same conference room, the image of participant B is displayed as the image of participant A in the other conference room. It is displayed as if the face is directed in the direction of the display unit 203 being displayed. Thereby, a more realistic conference can be realized.

  Further, the positional relationship between the images of the participants displayed in one conference room and the participants who are actually attending the conference room is kept the same between the two conference rooms. Thus, for example, in one conference room, when the participant C turns his face to the image of the participant D in the other conference room displayed on the display unit 203, in the other conference room, the participant Toward D, an image of participant C facing his face is displayed. Thereby, a more realistic conference can be realized.

In addition, when a plurality of participants in one conference room are individually displayed on different display units, for example, when one of the conference participants speaks on one display unit, The display part on which the person is displayed can be selectively viewed by directing his / her face or body, the attention can be concentrated on the speaker's remarks, etc., and the conference can be efficiently performed. .
Further, in the present embodiment, since the shooting directions of the plurality of shooting units 101 are arranged so as to intersect each other, it is difficult to realize in a conventional video conference system, such as a round table conference. Even in a conference that surrounds a table or the like, it is possible to realize a video conference full of realism.

  In the present embodiment, the position identification information is used, and the correspondence relationship between the position identification information and the relative positional relationship of the subject is defined in advance, so that a plurality of components constituting the photographing apparatus 10 are configured. Even if the device identification information about the photographing unit 101 and the arrangement thereof are not known, the relative positional relationship between the subjects captured by the image information can be known from the position identification information. If it is set which image information corresponding to which position identification information is to be displayed on the display unit 203, as a result, an image corresponding to the relative arrangement of subjects displayed on the plurality of display units 203 can be displayed. Since it becomes possible, setting becomes easy.

  In the present embodiment, in the photographing apparatus 10, one output unit 102 outputs image information photographed by a plurality of photographing units 101 to the display device 20, and in the display device 20, One reception unit 201 receives a plurality of pieces of image information captured by a plurality of imaging units 101 and outputs them to a preset display unit 203. In the present embodiment, however, FIG. As shown in FIG. 13, the imaging apparatus 10 is provided with the same number of output units 1301 as the plurality of imaging units 101, the imaging position information storage unit 103 is omitted, and the display device 20 includes a plurality of display units 203. The same number of receiving units 1302 may be provided, and the display position information storage unit 202 may be omitted.

  In this case, each output unit 1301 outputs the image information output from each photographing unit 101 to a preset reception unit 1302, and each reception unit 1302 sends the received image information to each display unit 203. Except for the point of output, the configuration of each output unit 1301 and each reception unit 1302 is the same as the configuration of the output unit 102 and reception unit 201 of the above embodiment. The connection relationship between each output unit 1301 and each reception unit 1302 is the same as the above embodiment in the relationship between the image captured by each imaging unit 101 and the image displayed on each display unit 203. Set to be.

In the above specific example, as shown in FIG. 5, the plurality of photographing units 101 are arranged outside the table 501, but in the present invention, as shown in FIG. 14, the plurality of photographing units 101 a to 101 f are arranged. You may make it arrange | position so that the direction which image | photographs may be turned to the seats 502a-502f arrange | positioned on the outer side of the table 501 in the center side of the table 501. FIG.
Note that the processing of the imaging device 10, the display device 20, the first video conference terminal 50, and the second video conference terminal 60 in the present embodiment may be realized by software. Then, this software may be distributed by software download or the like. Further, this software may be recorded and distributed on a recording medium such as a CD-ROM.

(Embodiment 2)
In the video conference system according to the present embodiment, in the video conference system according to the first embodiment, the imaging device provides synchronization information to image information that is information indicating images captured by a plurality of imaging units, The display device displays each of the images of the subject photographed by the plurality of photographing units using the plurality of pieces of image information synchronized using the synchronization information.
FIG. 16 is a block diagram of the video conference system according to the present embodiment. In the figure, the same reference numerals as those in FIG. 1 denote the same or corresponding parts. The video conference system according to the present embodiment includes a photographing device 11 and a display device 21.

The imaging device 11 includes a plurality of imaging units 101, an output unit 102, an imaging position information storage unit 103, and a synchronization information creation unit 104. The configurations of the photographing unit 101 and the photographing position information storage unit 103 are the same as those in the first embodiment, and a description thereof will be omitted.
The synchronization information creation unit 104 creates synchronization information. The synchronization information is information that associates the time points at which the images taken by the plurality of photographing units 101 are photographed at the same time. For example, as described in the above embodiment, the synchronization information is provided for each frame of an image captured simultaneously by each imaging unit 101 or received simultaneously by the output unit 102 or for each predetermined number of frames. Time information indicating the time at which the image was taken, that is, a time code, a time stamp, and the like.

  For example, when the synchronization information is time information such as a time code, the synchronization information creation unit 104 normally creates information indicating the current time or information about the shooting time estimated from the current time, Output to the output unit 102 or the like. The time described here may be an absolute time or a relative time. Further, the synchronization information may be information on the time at which each photographing unit 101 starts photographing image information or the time at which the output unit 102 first receives an image. Further, it may be information for associating frames captured simultaneously by a plurality of imaging units 101. Also, the time position information as described above for one image information may be acquired, and may be added as synchronization information to image information that has been captured or received at the same time.

  For example, when the time position information as described above is individually added to each piece of image information acquired from the plurality of imaging units 101, the time position information given to the frames received at the same time is acquired and simultaneously Information indicating the correspondence between the received time position information may be configured, and the information indicating the correspondence may be created as synchronization information. Alternatively, the output unit 102 may acquire information on the time at which reception of each piece of image information is started, and create synchronization information having the information on the start time. The synchronization information creation unit 104 may include a clock or the like, or may configure synchronization information such as a time code using, for example, a clock frequency. The synchronization information creation unit 104 is configured by an MPU, a memory, and the like, and these processing procedures are usually realized by software, and the software is recorded on a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).

  The output unit 102 has the same configuration as the output unit 102 described in the first embodiment. However, the output unit 102 adds the synchronization information created by the synchronization information creation unit 104 to a plurality of pieces of image information that is information indicating images captured by the plurality of imaging units 101 and outputs the information. is there. The output unit 102 may output the synchronization information created by the synchronization information creation unit 104 by adding it to the image information. For example, the output unit 102 outputs the synchronization information such as the time code and the time stamp created by the synchronization information creation unit 104 for each frame of the image information acquired from the plurality of imaging units 101 or a predetermined number of frames. The added image information may be configured and output.

  When the synchronization information is information indicating the shooting start time of each image information, the output unit 102 may add this synchronization information to the first frame of each image information. Or you may output the synchronous information which is the information which shows such imaging | photography start time with image information. In addition, when the synchronization information is information indicating the correspondence relationship between the time position information of the portions photographed at the same time between the image information, this synchronization information may be output together with the image information.

  The display device 21 includes a plurality of imaging units 101, a reception unit 201, a display position information storage unit 202, a plurality of display units 203, and a synchronization processing unit 204. The configurations of the reception unit 201, the display position information storage unit 202, and the display unit 203 are the same as those in the first embodiment, and a description thereof will be omitted. However, the accepting unit 201 accepts image information to which synchronization information is added here. That is, as a result, synchronization information is received together with image information. Further, the image information to be displayed on each display unit 203 is not directly output to the display unit 203 by the reception unit 201 but is output to each display unit 203 via the synchronization processing unit 204.

  The synchronization processing unit 204 uses the image information received together with the image information by the receiving unit 201 to synchronize a plurality of image information received by the receiving unit 201. Synchronizing means associating the time points at which images taken by a plurality of photographing units 101 were simultaneously photographed. Here, specifically, the synchronization processing unit 204 uses the synchronization information added to the image information to indicate information indicating an image captured at the same time out of a plurality of pieces of image information, for example, images of frames captured at the same time. Information is output to each display unit 203 substantially simultaneously. For example, when synchronization information, which is time information such as a time code having a common reference time and time axis, is added to each frame of image information, the time of day from a plurality of image information in the order of time information. Are sequentially read out from the plurality of pieces of image information and transmitted to the display unit 203.

  In addition, when synchronization information that is information on the shooting start time of image information is added to each image information, the synchronization processing unit 204 determines that each frame of each image information is based on the shooting start time that is synchronization information. The shooting time is calculated from the frame rate and the like, and a frame shot at the same time is detected and read from each image information, and is output to each display unit 203 almost simultaneously. The synchronization processing unit 204 is configured by an MPU, a memory, and the like, and these processing procedures are usually realized by software, and the software is recorded on a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).

  Next, the operation of the photographing apparatus 11 will be described. Here, a case will be described in which a time code, which is information about the time when the output unit 102 acquires image information from the imaging unit 101, is added as synchronization information. The operation of the imaging device 11 is as follows. In the process of step S303 shown in the flowchart of FIG. 3, the image information for one frame is acquired from the k-th imaging unit 101, and the synchronization information created by the synchronization information creation unit 104 is used. The output unit 102 adds information to the image information. Other processes are the same as those in the flowchart of FIG. Note that the process in which the synchronization information creating unit 104 creates the synchronization information is assumed to be performed independently of the other parts of the imaging apparatus 11 in this example.

Next, the operation of the display device 21 will be described using the flowchart of FIG. Here, a case will be described in which the receiving unit 201 receives a plurality of pieces of image information to which synchronization information is added. In FIG. 17, the same steps as those in FIG. 4 indicate the same or corresponding steps.
(Step S1701) The synchronization processing unit 204 substitutes 1 for a counter i.
(Step S1702) The synchronization processing unit 204 determines whether the image information temporarily stored in step S404 includes image information whose display destination is the i-th display unit 203, specifically, image information for one frame. Determine whether. If there is, the process proceeds to step S1703, and if not, the process proceeds to step S401. Note that the determination of this processing may be performed when it is time to display, for example, by determining whether it is time to display an image of one preset frame. This display timing may be determined in any way.

  For example, whether or not it is a preset image display timing, for example, if it is set to display one frame image every 1/30 seconds, 1/30 seconds have elapsed since the previous image display If it is a display timing, it is determined that it is a timing for displaying an image of one frame. If it is not the display timing, the determination process may be repeated until the display timing comes, or the process may return to step S401.

  (Step S1703) The synchronization processing unit 204 reads out the image information of the oldest frame with the i = l-th display unit 203 as a display destination from the memory or the like temporarily stored in Step S404. The read image information is output to the i-th display unit 203. The i-th display unit 203 displays an image of one frame indicated by this image information. The read image information of one frame is discarded from the memory or the like. However, the synchronization information added to the one-frame image information read out in step S1703, here the time code as an example, is temporarily stored in a memory (not shown) or the like. If the synchronization information is already stored, it is overwritten with the latest synchronization information.

(Step S1704) The synchronization processing unit 204 increments the counter i by 1.
(Step S1705) The synchronization processing unit 204 determines whether or not the value of the counter i is greater than l. l (l is an integer of 2 or more) is the number of display units 203. If it is larger, the process returns to step S401. If it is not larger than l, the process proceeds to step S1706.
(Step S1706) The synchronization processing unit 204 reads the synchronization information added to the image information of one frame read out in the immediately preceding step S1703 from the memory temporarily stored in step S1703. Whether there is image information of a frame in which synchronization information matching the synchronization information is added to the image information having the i-th display unit 203 as a display destination, such as a memory that temporarily stores the image information in step S404. Determine whether. If there is, the process proceeds to step S1707. If not, the process returns to step S1704.

(Step S1707) The synchronization processing unit 204 reads out and acquires image information for one frame, for which the synchronization information is determined to match in step S1706, from a memory or the like.
(Step S1708) The synchronization processing unit 204 outputs the image information read in step S1707 to the i-th display unit 203 determined in step S402. Then, the process returns to step S1704.
In the flowchart of FIG. 17, the process ends when the power is turned off or the process ends.

Next, a specific example of the present embodiment will be described.
FIG. 18 shows a conceptual diagram of the video conference system of this embodiment.
FIG. 19 is a block diagram illustrating a configuration of the video conference system according to the present embodiment.
The first video conference terminal 51 of this video conference system further includes an information processing device 5000 instead of the information processing device 5000 in the first video conference terminal 50 shown as a specific example in the first embodiment. The information processing apparatus 5001 provided with the synchronization information creation unit 104 is provided.
The second video conference terminal 61 of this video conference system further includes an information processing device 6000 instead of the information processing device 6000 in the second video conference terminal 60 shown in the specific example in the first embodiment. The information processing apparatus 6001 provided with the synchronization processing unit 204 is provided.

In the first conference room 500 shown in FIG. 18, a case is considered in which a plurality of, in this case, four participants are seated from the seat 502c to the seat 502f.
First, the images of the participants who are the subjects seated in the seats 502c to 502f are respectively photographed by the photographing units 101c to 101f of the first video conference terminal 51.
The output unit 102 of the information processing apparatus 5001 acquires the image information output from the imaging units 101c to 101f together with the device identification information corresponding to the imaging units 101c to 101f, for example, for each frame. The output unit 102 acquires the synchronization information, in this case the time code, which is sequentially generated by the synchronization information generation unit 104, and adds the time code, which is the synchronization information, to the image information of each frame output from each of the imaging units 101c to 101f. Configure the added image information. Then, the output unit 102 adds the position identification information corresponding to the device identification information to the image information to which the synchronization information is added, and transmits the image information to the second video conference terminal 61.

FIG. 20 is a diagram schematically illustrating a state in which image information to which synchronization information output from the output unit 102 is added and position identification information are being output. A time code 2000 is added to each frame of the image information.
Next, the reception unit 201 of the second video conference terminal 61 receives the image information and the position identification information to which the synchronization information transmitted from the first video conference terminal 51 is added.
Using the position identification information added to the received plurality of pieces of image information and the display position management table shown in FIG. 11, the receiving unit 201 uses “20c”, as in the specific example of the first embodiment. , “20d”, “20e” and “20f” are acquired. Then, the received plurality of pieces of image information are decoded, and temporarily stored in a memory or the like in association with the display position designation information.

  Next, the synchronization processing unit 204, from the image information temporarily stored in association with the display position designation information in a memory or the like, as an example, one frame of decoded image information, with the display unit 203c as a display destination, Then, the first frame is read as an example. Specifically, the image information associated with the display position designation information “20c” corresponding to the display unit 203c is read out. Then, the synchronization information added to the read frame, here, the time code is acquired. Then, the synchronization processing unit 204 outputs one frame of the read image information to the display unit 203c. The display unit 203c displays this one frame image.

Next, the synchronization processing unit 204 generates one frame of image information having the same time code as this time code from the image information temporarily stored in the memory or the like in association with the display position designation information, for each of the display units 203d to 203f. Read sequentially. Then, one frame of the read image information is displayed on the display units 203d to 203f.
FIG. 21 is a diagram schematically illustrating a process in which the synchronization processing unit 204 acquires image information of a frame to which the same time code is added from the memory and displays the image information on the display units 203c to 203f. The memory 2100 is a recording medium that temporarily stores the image information decoded by the receiving unit 201.

By performing such processing, an image synchronized with each of the display units 203c to 203f can be displayed.
In addition, about the case where the image image | photographed with the 2nd video conference terminal 61 is displayed with the 1st video conference terminal 51, since it is the same as the above, description is abbreviate | omitted here.

  As described above, according to the present embodiment, the same effects as those of the first embodiment can be obtained, and synchronization information is added to a plurality of photographed image information, and when the plurality of image information is displayed, Since the synchronization information is used to display the plurality of pieces of image information on the plurality of display units using the synchronized image information, the state of the other conference room can be more accurately reproduced. For example, when one participant speaks in another conference room, what kind of facial expression the other participant expressed, and at what timing multiple participants spoke , Etc. can be accurately reproduced.

  As a first modification of the second embodiment, as shown in FIG. 22, image information and position identification information or a device in which the synchronization information received by the receiving unit 201 is added to the second video conference terminal 61. The storage unit 2201 that stores the identification information in a storage medium or the like is provided, and the reception unit 201 in the same second video conference terminal 61 receives the image information stored by the storage unit 2201 in response to a user instruction or the like. And the position identification information or the apparatus identification information are read out as appropriate, and the read image information is converted into the first image information using the display position management information stored in the display position information storage unit 202 as in the second embodiment. You may make it display on the some display part 203 of the 2nd video conference terminal 61 arrange | positioned in the positional relationship corresponding to the relative positional relationship of the some participant in the conference room 500. FIG.

  In this case, for example, when the arrangement of the video conference system is as shown in FIG. 18, when the image information read from the storage unit 2201 is displayed, the imaging units 101 a to 101 a of the first video conference terminal 51 are displayed. Images captured by 101f may be displayed on the display units 203a to 203f of the second video conference terminal 61, respectively. Alternatively, since the video conference has already ended, if the relative positional relationship between the plurality of displayed images is maintained, the display unit 203 on which the plurality of images are displayed is changed to the same display unit in the same direction. May be shifted by the number of. For example, images captured by the imaging units 101a to 101c of the first video conference terminal 51 may be displayed on the display units 203c to 203e of the second video conference terminal 61, respectively.

  With such a configuration, the status of the video conference can be reproduced accurately and in a realistic state using a plurality of synchronized images after the video conference is completed. For example, in the first conference room 500, after the video conference, the situation of the second conference room 600 at the time of the video conference can be accurately reproduced in a state full of realism.

  In particular, when a meeting that has been recorded once is replayed at a later date and viewed by another person, unlike when a meeting is performed in real time, the timing for starting the reproduction of multiple images is well matched. If it is not performed, there is a possibility that the timing of reproduction between the plurality of images may be shifted and it may be difficult to grasp the contents of the conference. However, as in this embodiment, a plurality of synchronization information is used. By synchronizing a plurality of images displayed on the display unit, such a timing shift is eliminated, and the state at the time of the meeting can be more accurately reproduced.

Such a configuration can also be applied to the video conference system shown in FIG. 1, the first video conference terminal 50, the first video conference terminal 51, the second video conference terminal 60, and the like.
Instead of accumulating the image information received by the accepting unit 201 and the position identification information or device identification information, the accumulating unit 2201 decodes the image information accepted by the accepting unit 201 by the same process as step S403 in FIG. The image information obtained in this manner is associated with the display position designation information obtained by the same processing as step S402 in FIG. 4 using the position identification information or the apparatus identification information received by the receiving unit 201, and recorded on a recording medium or the like. You may make it accumulate | store.

  In this case, when the reception unit 201 displays the image information read from the storage unit 2201 on each of the plurality of display units 203, processing corresponding to the processing in step S402 and step S403 in FIG. 4 can be omitted. In FIG. 22, the same reference numerals as those in FIG. 19 denote the same or corresponding parts. Further, the storage unit 2201 may have a recording medium such as a hard disk that stores image information or the like in the storage unit 2201, or may have a recording medium outside the storage unit 2201.

  As a second modification of the second embodiment, as shown in FIG. 23, image information indicating images captured by the plurality of imaging units 101 of the second video conference terminal 61 and device identification information or position identification. The storage unit 2301 that stores information in a storage medium or the like is provided in the second video conference terminal 61, and the reception unit 201 in the same second video conference terminal 61 performs this storage in accordance with a user instruction or the like. The image information accumulated by the unit 2301 and the position identification information or the device identification information are appropriately read out, and the read image information is converted into the second video conference using the display position management information stored in the display position information storage unit 202. The plurality of display units 20 of the second video conference terminal 61 are arranged so that the plurality of photographing units 101 of the terminal 61 have a positional relationship corresponding to the relative positional relationship of the plurality of subjects to be photographed. It may be displayed on.

  In this case, for example, when the arrangement of the video conference system is as shown in FIG. 18, when the image information read from the storage unit 2201 is displayed, the imaging units 101 a to 101 a of the second video conference terminal 61 are displayed. Images captured by 101f may be displayed on the display units 203a to 203f of the second video conference terminal 61, respectively. Alternatively, as long as the relative positional relationship between the plurality of displayed images is maintained, the display units 203 on which the plurality of images are displayed may be shifted by the number of the same display units in the same direction. For example, images captured by the imaging units 101a to 101c of the second video conference terminal 61 may be displayed on the display units 203c to 203e of the second video conference terminal 61, respectively.

In addition, when the display unit 203 is provided on the back of the subject photographed by the photographing unit 101 of the second video conference terminal 61, the images photographed by the respective photographing units 101 of the second video conference terminal 61 are the photographing targets. It is preferable to be displayed on the display unit 203 on the back of the subject.
By adopting such a configuration, the situation in the video conference can be reproduced accurately and in a state full of realism using synchronized images. For example, in the second conference room 600, the situation of the second conference room 600 at the time of the video conference can be reproduced in a state full of realism after the video conference ends.

In particular, when a meeting that has been recorded once is replayed at a later date and viewed by another person, unlike when a meeting is performed in real time, the timing for starting the reproduction of multiple images is well matched. If it is not performed, there is a possibility that the timing of reproduction between the plurality of images may be shifted and it may be difficult to grasp the contents of the conference. However, as in this embodiment, a plurality of synchronization information is used. By synchronizing a plurality of images displayed on the display unit, such a timing shift is eliminated, and the state at the time of the meeting can be more accurately reproduced.
Such a configuration can also be applied to the first video conference terminal 50, the first video conference terminal 51, the second video conference terminal 60, and the like.

  Instead of accumulating the image information acquired by the imaging unit 101 of the second video conference terminal 61 and the position identification information or the device identification information, the storage unit 2301 is temporarily used by the imaging unit 101 of the second video conference terminal 61. Image information obtained by decoding the acquired image information by the process similar to step S403 in FIG. 4 and display position designation information acquired by the process similar to step S402 in FIG. 4 using the position identification information or device identification information. The data may be stored in a recording medium in association with each other.

In this case, when the reception unit 201 of the second video conference terminal 61 displays the image information read from the storage unit 2301 on each of the plurality of display units 203 of the second video conference terminal 61, step S402 in FIG. And the process corresponding to the process of step S403 can be omitted. 23, the same reference numerals as those in FIG. 19 denote the same or corresponding parts. In addition, the storage unit 2301 may have a recording medium such as a hard disk that stores image information or the like in the storage unit 2301, or may have a recording medium outside the storage unit 2201.
Note that the image information and the like stored in the recording medium by the storage unit 2301 may be read by the reception unit 201 of the first video conference terminal 51.

Furthermore, as a third modification of the second embodiment, as shown in FIG. 24, the second video conference terminal 61 includes the storage unit 2201 of the first modification described above and the storage of the second modification. A configuration combining the unit 2301 may be employed.
At this time, as described in the present embodiment, using the synchronization information between the image information of the storage unit 2201 and the image information of the storage unit 2301, an image captured by the first video conference terminal 51, and the second TV It is preferable to display the images captured by the conference terminal 61 in synchronization.

  Also, the second video conference using the image information stored in the second video conference terminal 61 using the image information stored in the storage unit 2201 and the image information stored in the storage unit 2301. The relationship between the images displayed on the plurality of display units 203 in the terminal 61 is based on the subject of the image displayed on the display unit 203 of the second video conference terminal 61 and the second conference room 600 during the video conference. It is preferable to set the relationship so as to correspond to the relationship of the respective orientations with the subject to be photographed by the photographing unit 101, specifically, the relationship of facing each other.

  For example, the second video conference is performed on the image of the participant A in the first conference room 500 displayed on one of the plurality of display units 203 in the second video conference terminal 61 during the video conference. When the participant B of the conference in the second conference room 600 in which the second video conference terminal 61 that is the subject to be photographed by the photographing unit 101 of the terminal 61 is seated facing, accumulation is performed by the accumulation unit 2201. The second video conference using the image of the participant A displayed on one of the plurality of display units 203 in the second video conference terminal 61 by using the image information thus obtained and the image information stored by the storage unit 2301 It is preferable that the image of the participant B displayed on one of the plurality of display units 203 in the terminal 61 is displayed oppositely.

  As a specific example, for example, when the video conference system is arranged as shown in FIG. 18, when the image information read from the storage unit 2201 is displayed, the first video conference terminal 51 takes a picture. Images captured by the units 101b and 101c are displayed on the display units 203b and 203c of the second video conference terminal 61, respectively, and images captured by the imaging units 101a and 101b of the second video conference terminal 61 are displayed on the second TV conference terminal 61, respectively. The information is displayed on the display units 203e and 203f of the conference terminal 61.

  Alternatively, the display units on which all these images are displayed are shifted one by one, and the images captured by the imaging units 101b and 101c of the second video conference terminal 61 are respectively displayed on the display unit 203a of the second video conference terminal 61. , 203b and images taken by the photographing units 101a and 101b of the second video conference terminal 61 may be displayed on the display units 203d and 203e of the second video conference terminal 61. Note that display position management information for displaying images accumulated by the accumulation unit 2201 and the accumulation unit 2301 on each display unit 203 in such a relationship is displayed in the display position information storage unit 202 of the second video conference terminal 61. It may be stored in advance.

By adopting such a configuration, the status of the video conference in the two conference rooms can be changed so that a plurality of synchronized images can be obtained as if the conference was held in one place after the video conference ended. It is possible to reproduce the positional relationship and the time relationship accurately and in a realistic state.
Note that a plurality of display units (not shown) different from the display unit 203 are provided in the second video conference terminal 61 or other devices, and the storage units 2201 and 2301 store these display units. The displayed image information may be displayed in the same manner as described above.

Such a configuration can also be applied to the first video conference terminal 50, the first video conference terminal 51, the second video conference terminal 60, and the like.
Note that the processing of the imaging device 11, the display device 21, the first video conference terminal 51, and the second video conference terminal 61 in the present embodiment may be realized by software. Then, this software may be distributed by software download or the like. Further, this software may be recorded and distributed on a recording medium such as a CD-ROM.

In each of the above embodiments, each process (each function) may be realized by centralized processing by a single device (system), or by distributed processing by a plurality of devices. May be.
Further, in each of the above embodiments, it goes without saying that two or more communication means (such as an output unit) existing in one apparatus may be physically realized by one medium.
The present invention is not limited to the above-described embodiment, and various modifications are possible, and it goes without saying that these are also included in the scope of the present invention.

  As described above, the video conference system and the like according to the present invention are suitable as a video conference system that performs a conference using images, and are useful as a video conference system and the like that can realize a conference full of realism.

Block diagram of a video conference system according to Embodiment 1 Schematic diagram of the video conference system A flowchart for explaining the operation of the photographing apparatus of the video conference system A flowchart for explaining the operation of the display device of the video conference system Conceptual diagram of a specific example of the video conference system Block diagram of a specific example of the video conference system The perspective view for demonstrating the structure of the specific example of the video conference system Schematic diagram for explaining the operation of the video conference system The figure which shows the photographing position management table of the same video conference system The figure which shows the data structure of the image information of the video conference system The figure which shows the display position management table of the video conference system The figure which shows the state of the meeting which uses the same video conference system Block diagram showing a modification of the video conference system Schematic diagram showing a modification of the video conference system Schematic diagram showing a modification of the video conference system Block diagram of a video conference system according to Embodiment 2 Flow chart for explaining the operation of the video conference system Conceptual diagram of a specific example of the video conference system Block diagram of a specific example of the video conference system Schematic diagram for explaining the operation of the video conference system Schematic diagram for explaining the operation of the video conference system Block diagram showing a first modification of the video conference system Block diagram showing a second modification of the video conference system Block diagram showing a second modification of the video conference system

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Video conference system 10, 11 Image pick-up device 20, 21 Display device 50, 51 1st video conference terminal 60, 61 2nd video conference terminal 91 Payload part 92 Header part 101, 101a-101f Image pick-up part 102, 1301 Output part 103 Photographing Position information storage unit 104 Synchronization information creation unit 1302, 201 Reception unit 202 Display position information storage unit 203, 203a to 203f Display unit 204 Synchronization processing unit 502a to 502f, 602a to 602f Seat 1301 Output unit 1302 Reception unit 2201, 2301 Storage unit 5000, 5001, 6000, 6001 Information processing apparatus

Claims (8)

A video conference system including a photographing device and a display device,
The imaging device
A plurality of photographing units for photographing different subjects;
An output unit that outputs a plurality of image information that is information indicating images captured by the plurality of imaging units,
The display device
A receiving unit that receives the plurality of pieces of image information;
Using the plurality of pieces of image information received by the reception unit, each of the images of the subject photographed by the plurality of photographing units is displayed, and the relative positional relationship between the subjects corresponding to the images displayed on the respective images is supported. A video conferencing system comprising: a plurality of display units arranged so as to have the above-described positional relationship. The video conference system according to claim 1, wherein the plurality of display units are arranged so as to have a positional relationship similar to a relative positional relationship between the subjects. The plurality of photographing units are
The video conference system according to claim 1, wherein the video shooting directions are arranged so as to intersect with each other. The subjects that each of the plurality of photographing units shoot are one person,
A plurality of seats each seated by the subject;
The plurality of seats are arranged on a substantially circumference centered around a position where the shooting directions intersect with each other so that the front faces of the persons seated in the plurality of seats respectively face the plurality of shooting units. The video conference system according to claim 3. The photographing apparatus further includes a synchronization information creating unit that creates synchronization information that is information that associates the time points at which the plurality of photographing units photographed at the same time,
The output unit adds the synchronization information created by the synchronization information creation unit to a plurality of pieces of image information that is information indicating images captured by the plurality of photographing units, and outputs the information.
The reception unit receives a plurality of pieces of image information to which the synchronization information is added,
The display device further includes a synchronization processing unit that synchronizes the plurality of pieces of image information using the synchronization information,
The plurality of display units respectively display images of subjects photographed by the plurality of photographing units using a plurality of pieces of image information synchronized by the synchronization processing unit. Video conference system. A video conference system comprising a first video conference terminal and a second video conference terminal,
The first video conference terminal is:
A first reception unit that receives a plurality of pieces of image information output from the second video conference terminal;
A plurality of first display units respectively arranged on the sides of the polygonal area, which display a plurality of images using the plurality of image information received by the first receiving unit;
A plurality of first photographing units for photographing different subjects, facing the plurality of first display units;
A first output unit that outputs a plurality of image information that is information indicating images captured by the plurality of first imaging units,
The second video conference terminal is
A second reception unit that receives a plurality of pieces of image information output from the first video conference terminal;
The plurality of first display units arranged in a polygonal area similar to the polygonal area of the first video conference terminal that displays a plurality of images using the plurality of image information received by the second receiving unit. A plurality of second display portions respectively arranged on the sides corresponding to the arranged sides;
A plurality of second imaging units that shoot different subjects opposite to the plurality of second display units;
A second output unit that outputs a plurality of image information that is information indicating images captured by the plurality of second imaging units,
The plurality of first display units display the plurality of images in a positional relationship corresponding to a relative positional relationship between subjects corresponding to the plurality of images,
The plurality of second display units display the plurality of images so as to have a positional relationship corresponding to a relative positional relationship between subjects corresponding to the plurality of images. Each of the plurality of first display units is arranged on a second display unit arranged on a corresponding side of the polygonal region of the second videoconference terminal that is similar to the polygonal region of the first videoconference terminal. Each of the images taken by the second shooting unit that captures the opposite subject is displayed.
Each of the plurality of second display units is arranged on a first display unit disposed on a corresponding side of the polygonal region of the first videoconference terminal that is similar to the polygonal region of the second videoconference terminal. The video conference system according to claim 6, wherein each of the images taken by the first photographing unit that photographs the opposing subject is displayed. A video conference method that is performed using a plurality of photographing units that photograph different subjects and a plurality of display units that respectively display images of the subjects photographed by the plurality of photographing units,
A shooting step in which the plurality of shooting units shoot different subjects;
An output step of outputting a plurality of pieces of image information, which are information indicating images captured in the shooting step;
A receiving step for receiving the plurality of pieces of image information;
Using the plurality of image information received in the receiving step, the images of the subject captured by the plurality of imaging units are displayed on the plurality of display units so as to have a positional relationship corresponding to a relative positional relationship between the subjects. A video conferencing method comprising: a display step of displaying.

Images