JP2010277372A - Video display system and video display method - Google Patents

Abstract

Provided is a video display system and a video display method capable of easily displaying a desired portion of a video displayed on one video display device on another video display device by a user's intuitive operation. To do.
Infrared elements (23, 24) attached to a flat display (20) and an infrared element (34) attached to a stereoscopic display (30) are imaged by observation devices (41, 42). The control device 10 detects that the user has gripped the three-dimensional display 30 based on the detection signal of the touch sensor 33 provided on the three-dimensional display 30, and the user determines based on the images obtained by the observation devices 41 and 42. It is detected that the flat display 20 has approached a predetermined range and that an operation for designating a portion of the video displayed on the flat display 20 has been performed, and the designated video portion is displayed on the stereoscopic display 30.
[Selection] Figure 2

Description

  The present invention relates to a video display system and a video display method for displaying video.

  Various video display devices such as a flat display and a stereoscopic display have been developed (see, for example, Patent Document 1).

JP 2009-8837 A

  In some cases, it is desired to observe a part of the video displayed on one video display device with another video display device. When multiple video display devices are connected to computers on the network, the user can cut the video displayed on one video display device by operating the computer and display it on another video display device. Can do. However, such an operation is very troublesome.

  For example, in a remote conference, if you want to observe a part of the video displayed on the screen of a large video display device in detail with a small video display device at hand, the attendance of the attendees can make the conference progress There will be a delay. For this reason, it is difficult to display a part of a video displayed on one video display device on another video display device and observe it in detail under a situation changing in real time.

  An object of the present invention is to provide a video display system and a video display capable of easily displaying a desired portion of a video displayed on one video display device on another video display device by a user's intuitive operation. Is to provide a method.

  (1) A video display system according to a first invention is a first video display device that displays video, a second video display device that displays video, and a user holds the second video display device. Grip detection means for detecting this, proximity detection means for detecting that the second video display device approaches within a predetermined range of the first video display device, and a user displayed on the first video display device. It is detected that the second image display device approaches within a predetermined range of the first image display device by the designation operation detection means for detecting that the operation for designating the portion of the image is performed and the approach detection means. In this case, the control means for determining the part of the video designated by the user based on the operation detected by the designated operation detecting means and controlling the second video display device to display the designated video part. Are provided.

  In the video display system according to the first aspect of the invention, it is detected by the grip detection means that the user has gripped the second video display device, and the second video display device is within a predetermined range of the first video display device. Is detected by the approach detection means, and it is detected by the designation operation detection means that the user has performed an operation of designating the portion of the video displayed on the first video display device. In that case, the video portion designated by the user based on the detected operation is discriminated by the control means, and the second video display is performed such that the designated video portion is displayed on the second video display device. The device is controlled.

  As a result, the user grasps the second video display device, approaches the first video display device, and performs an operation of designating a portion of the video displayed on the first video display device. The displayed portion is displayed on the second video display device. Therefore, the user can easily display a desired portion of the video displayed on the first video display device on the second video display device by an intuitive operation without performing a complicated operation. Become.

  (2) The designation operation detection means includes position detection means for detecting the position of the second video display device relative to the first video display device, and the control means is based on the position detected by the position detection means. The part of the video specified by may be determined.

  In this case, based on the position of the second video display device relative to the first video display device, it can be detected that an operation for designating a portion of the video displayed on the first video display device has been performed. At the same time, the designated video portion can be determined.

  (3) The position detection means includes a first image pickup unit provided in the first video display device and a second image pickup unit provided in the second video display device. A plurality of imaging means for imaging the imaged part and the second imaged part, and the control means discriminates a video portion designated by the user based on images obtained by the plurality of imaging means. Good.

  In this case, the first image pickup unit provided in the first video display device and the second image pickup unit provided in the second video display device are imaged from different positions by the plurality of image pickup means. The position of the first video display device can be specified based on the image of the first imaged part obtained by the plurality of imaging means. In addition, the position of the second video display device can be specified based on the image of the second imaged part obtained by the plurality of imaging means. Thereby, the position of the second video display device relative to the first video display device can be detected. Therefore, the user can designate a desired portion of the video displayed on the first video display device by moving the second video display device relative to the first video display device, and It becomes possible to determine the portion of the video designated by the user based on the image obtained by the imaging means.

  (4) The approach detection means includes a position detection means common to the position detection means of the designation operation detection means, and the second video display device displays the first video based on the position detected by the common position detection means. You may detect having approached within the predetermined range of the apparatus.

  In this case, an operation for designating that the second video display device approaches the predetermined range of the first video display device and a part of the video displayed on the first video display device by the common position detection means. Can be detected. Therefore, the configuration of the video display system is not complicated.

  (5) The approach detection unit may include a first contact detection unit that is provided in the first video display device and detects a contact of the second video display device.

  In this case, the contact of the first video display device is detected by the first contact detection means, thereby detecting that the second video display device has approached the predetermined range of the first video display device. .

  (6) The approach detection unit may include a proximity detection unit that is provided in the first video display device and detects the proximity of the second video display device.

  In this case, when the proximity of the first video display device is detected by the proximity detection means, it is detected that the second video display device approaches within a predetermined range of the first video display device.

  (7) The grip detection unit may include a second contact detection unit that is provided in the second video display device and detects that the user's body is in contact.

  In this case, it is detected that the user has gripped the second video display device by detecting that the user has touched the second video display device.

  (8) The control means provides the first video display device with the storage unit for storing data for displaying the video and the data stored in the storage unit, and corresponds to the video portion designated by the user. A main control unit that acquires data from the storage unit and provides the acquired data to the second video display device, the first video display device displays video based on the data supplied from the main control unit, The second video display device may display a video portion designated by the user based on data provided from the main control unit.

  In this case, the data stored in the storage unit is given to the first video display device. Thereby, an image is displayed on the first image display device. Further, data corresponding to the video portion designated by the user is acquired from the storage unit, and the acquired data is provided to the second video display device. Thereby, the part designated by the user is displayed on the second video display device.

  In this way, by using the common data stored in the common storage unit, the designated portion of the video displayed on the first video display device is easily and reliably displayed on the second video display device. It becomes possible.

  (9) The second video display device may display the designated video portion as a stereoscopic video.

  In this case, the designated portion of the video displayed on the first video display device is displayed on the second video display device as a stereoscopic video. Thereby, the user can observe the desired portion of the image in detail from an arbitrary angle.

  (10) A video display method according to a second invention includes a step of displaying a video on the first video display device, a step of detecting that the user has gripped the second video display device, and a second Detecting that the video display device has approached the predetermined range of the first video display device, and detecting that the user has performed an operation of designating a portion of the video displayed on the first video display device And determining a portion of the video designated by the user based on the detected operation when it is detected that the second video display device approaches the predetermined range of the first video display device. And a step of controlling the second video display device so as to display the designated video portion.

  In the video display method according to the second invention, it is detected that the user has gripped the second video display device, and the second video display device approaches within a predetermined range of the first video display device. Is detected, and it is detected that the user has performed an operation of designating a portion of the video displayed on the first video display device. In that case, the second video display device controls the second video display device to determine the video portion designated by the user based on the detected operation and display the designated video portion on the second video display device. Is done.

  As a result, the user grasps the second video display device, approaches the first video display device, and performs an operation of designating a portion of the video displayed on the first video display device. The displayed portion is displayed on the second video display device. Therefore, the user can easily display a desired portion of the video displayed on the first video display device on the second video display device by an intuitive operation without performing a complicated operation. Become.

  According to the present invention, a desired portion of an image displayed on the first image display device can be easily displayed on the second image display device by an intuitive operation.

1 is a schematic external view showing a configuration of a video display system according to an embodiment of the present invention. It is a block diagram which shows the detailed structure of the control system of the video display system of FIG. It is typical explanatory drawing which shows the identification method of the relative positional relationship of a flat display and a three-dimensional display. It is a typical external view which shows the structure of a three-dimensional display. It is typical sectional drawing which shows the element display surface which comprises a three-dimensional display surface. It is a figure for demonstrating the production method of the stereo image data for displaying a stereo image. It is a figure for demonstrating the image | video displayed on the spatial light modulator of a three-dimensional display based on three-dimensional image data. It is a flowchart which shows operation | movement of the main-control part of a control apparatus. It is explanatory drawing of operation | movement of a video display system. It is a block diagram which shows the other example of a structure of a flat display.

(1) Configuration of Video Display System FIG. 1 is a schematic external view showing the configuration of a video display system according to an embodiment of the present invention.

  As shown in FIG. 1, the video display system 100 includes a control device 10, a flat display 20, a stereoscopic display 30, and a plurality of observation devices 41 and 42.

  The flat display 20 has a rectangular screen that displays a flat image. Elements (hereinafter referred to as infrared elements) 23 and 24 that emit infrared rays are attached in the vicinity of the corners of the upper ends of the front surface of the flat display 20.

  The stereoscopic display 30 has a cubic shape and displays a stereoscopic image. The configuration and operation of the three-dimensional display 30 will be described later. An infrared element 34 is attached in the vicinity of one corner of the three-dimensional display 30. A touch sensor is provided on the surface of the stereoscopic display 30.

  The three-dimensional display 30 has a size that can be easily carried by the user. In the present embodiment, the length of one side of the one surface of the stereoscopic display 30 is smaller than the vertical and horizontal lengths of the screen of the flat display 20.

  A plurality of observation devices 41 and 42 are arranged above the front side of the flat display 20 so as to image the infrared elements 23 and 24. In this embodiment, two observation devices 41 and 42 are used. The observation devices 41 and 42 are composed of cameras capable of detecting infrared rays, for example. Further, the observation devices 41 and 42 image the infrared element 34 when the stereoscopic display 30 is located within a predetermined range in front of the flat display 20.

  The control device 10 stores shape data for displaying a planar image or a stereoscopic image, and gives part or all of the stored shape data to the planar display 20 and the stereoscopic display 30. The flat display 20 displays a flat image based on the shape data given from the control device 10. In addition, the stereoscopic display 30 displays a stereoscopic image based on the shape data given from the control device 10.

  In addition, the control device 10 specifies the relative positional relationship between the flat display 20 and the three-dimensional display 30 based on the images of the light emission points of the infrared elements 23, 24, and 34 obtained by the observation devices 41 and 42. Thereby, the control device 10 detects that the stereoscopic display 30 has approached a predetermined range in front of the flat display 20, and the relative positional relationship between the flat image displayed on the flat display 20 and the stereoscopic display 30. Is identified.

  In the video display system 100 according to the present embodiment, the user grasps the three-dimensional display 30 and approaches a predetermined range in front of the flat display 20 to display a desired portion of the flat video displayed on the flat display 20. By performing the designation operation, the designated portion of the planar video can be displayed on the stereoscopic display 30 as a stereoscopic video. Thereby, a desired part of the image displayed on the flat display 20 can be moved or copied to the stereoscopic display 30.

(2) Control System of Video Display System FIG. 2 is a block diagram showing a detailed configuration of the control system of the video display system of FIG.

  The control device 10 includes a main control unit 11, a shape data storage unit 12, a memory 13, an input / output circuit 14, and a communication unit 15. The flat display 20 includes a display unit 21, a flat display control unit 22, infrared elements 23 and 24, and an input / output circuit 25. The stereoscopic display 30 includes a stereoscopic display surface 31, a stereoscopic display control unit 32, a touch sensor 33, an infrared element 34, and a communication unit 35.

  The main control unit 11 is composed of, for example, a CPU (Central Processing Unit). The memory 13 stores a video display program for performing a video display process described later. The memory 13 is used as a work area for the main control unit 11. The shape data storage unit 12 stores shape data.

  The input / output circuit 14 of the control device 10 is connected to the input / output circuit 25 of the flat display 20. The input / output circuit 14 is connected to observation devices 41 and 42.

  The main control unit 11 of the control device 10 gives the shape data stored in the shape data storage unit 12 to the flat display 20 via the input / output circuit 14. Further, the main control unit 11 acquires an image obtained by the observation devices 41 and 42 as image data through the input / output circuit 14. Further, the main control unit 11 gives a control signal for controlling the lighting of the infrared elements 23 and 24 to the flat display 20 via the input / output circuit 14.

  The communication unit 15 of the control device 10 and the communication unit 35 of the three-dimensional display 30 transmit and receive data and signals by wireless communication. The main control unit 11 of the control device 10 transmits the shape data stored in the shape data storage unit 12 to the stereoscopic display 30 via the communication unit 15. Further, the main control unit 11 transmits a control signal for controlling lighting of the infrared element 34 to the three-dimensional display 30 via the communication unit 15. Further, the main control unit 11 receives the detection signal of the touch sensor 33 transmitted from the three-dimensional display 30 via the communication unit 15.

  The display unit 21 of the flat display 20 is composed of, for example, a liquid crystal display or a plasma display. The flat display control unit 22 includes, for example, a CPU, converts shape data given from the control device 10 via the input / output circuit 25 into flat video data, and gives the flat video data to the display unit 21. Thereby, a plane image is displayed on the screen of the display unit 21. Further, the flat display control unit 22 turns on the infrared elements 23 and 24 based on a control signal supplied from the control device 10 via the input / output circuit 25.

  In the present embodiment, the infrared elements 23 and 24 are turned on under the control of the control device 10, but the infrared elements 23 and 24 may be turned on when the flat display 20 is operated without being controlled by the control device 10. . Similarly, in the present embodiment, the infrared element 34 is turned on under the control of the control device 10, but the infrared element 34 may be turned on when the three-dimensional display 30 is operated without being controlled by the control device 10.

  The configuration of the stereoscopic display surface 31 of the stereoscopic display 30 will be described later. The stereoscopic display control unit 32 includes, for example, a CPU, converts shape data provided from the control device 10 via the communication unit 35 into stereoscopic video data, and supplies the stereoscopic video data to the stereoscopic display surface 31. As a result, a stereoscopic image is displayed on the stereoscopic display surface 31. Further, the stereoscopic display control unit 32 turns on the infrared element 34 based on a control signal received from the control device 10 via the communication unit 35. Furthermore, the stereoscopic display control unit 32 transmits a detection signal output from the touch sensor 33 to the control device 10 via the communication unit 35.

(3) Method for Specifying Relative Position Relationship between Flat Display and Stereoscopic Display FIG. 3 is a schematic explanatory diagram showing a method for specifying the relative positional relationship between the flat display 20 and the three-dimensional display 30. FIG. 3A shows a state where the light emitting points of the infrared elements 23 and 24 of the flat display 20 and the light emitting point of the infrared element 34 of the three-dimensional display 30 are imaged by the two observation devices 41 and 42. ) Shows the field of view of the observation device 41, and FIG. 3C shows the field of view of the observation device 42.

  In FIG. 3A, the visual fields of the observation devices 41 and 42 are indicated by virtual planes VP1 and VP2, respectively. A point where a straight line L1 connecting the observation center point C1 of the observation device 41 and the light emitting point of the infrared element 34 of the stereoscopic display 30 intersects the virtual plane VP1 is defined as I1c. Further, a point where a straight line L2 connecting the observation center point C2 of the observation device 42 and the light emitting point of the infrared element 34 of the stereoscopic display 30 intersects the virtual plane VP2 is defined as I2c.

  The two-dimensional coordinates of the point I1c on the virtual plane VP1 shown in FIG. 3B are obtained from the image obtained by the observation device 41. The two-dimensional coordinates of the point I2c on the virtual plane VP2 shown in FIG. 3C are obtained from the image obtained by the observation device 42.

  Based on the positions and orientations of the observation devices 41 and 42 and the two-dimensional coordinates of the points I1c and I2c, the three-dimensional coordinates of the infrared element 34 can be obtained.

  Similarly, I1a is a point where a straight line connecting the observation center point C1 of the observation device 41 and the light emitting point of the infrared element 23 of the flat display 20 intersects the virtual plane VP1, and the observation center point C2 of the observation device 42 and the flat display 20 Let I2a be the point where a straight line connecting the light emitting point of the infrared element 23 intersects the virtual plane VP2.

  Further, a point where a straight line connecting the observation center point C1 of the observation device 41 and the light emitting point of the infrared element 24 of the flat display 20 intersects the virtual plane VP1 is defined as I1b, and the observation central point C2 of the observation device 42 and the infrared light of the flat display 20 A point where a straight line connecting the light emitting point of the element 24 intersects the virtual plane VP2 is defined as I2b.

  The two-dimensional coordinates of the points I1a and I1b on the virtual plane VP1 shown in FIG. 3B are obtained from the image obtained by the observation device 41. The two-dimensional coordinates of the points I2a and I2b on the virtual plane VP2 shown in FIG. 3C are obtained from the image obtained by the observation device 42.

  Based on the positions and orientations of the observation devices 41 and 42 and the two-dimensional coordinates of the points I1a and I2a, the three-dimensional coordinates of the infrared element 23 can be obtained, and the positions and orientations of the observation devices 41 and 42 and the coordinates of the points I1b and I2b are obtained. Based on the above, the three-dimensional coordinates of the infrared element 24 can be obtained.

  The screen of the flat display 20 is provided perpendicular to the installation surface. Further, the vertical length of the screen of the flat display 20 is known. In this case, the position in the three-dimensional space of the screen of the flat display 20 can be uniquely specified from the three-dimensional coordinates of the infrared elements 23 and 24.

  In this way, the control device 10 detects that the stereoscopic display 30 has approached a predetermined range in front of the flat display 20 based on the images obtained by the observation devices 41 and 42 and is displayed on the flat display 20. The relative positional relationship between the flat image and the three-dimensional display 30 can be specified.

  In addition, when the screen of the flat display 20 is not provided vertically, or when the vertical length of the flat display 20 is not known, it is preferable to attach three or more infrared elements to the flat display 20.

(4) Configuration of stereoscopic display Next, the configuration of the stereoscopic display 30 will be described. FIG. 4 is a schematic external view showing the configuration of the three-dimensional display 30.

  As shown in FIG. 4, the stereoscopic display 30 includes a stereoscopic display surface 31 having a stereoscopic outer surface. The three-dimensional display surface 31 is configured by combining a plurality of element display surfaces 31a. In the present embodiment, the three-dimensional display surface 31 is formed in a cube by six square element display surfaces 31a. A stereoscopic video 31b is displayed inside the virtual space S surrounded by the stereoscopic display surface 31.

  FIG. 5 is a schematic cross-sectional view showing an element display surface 31 a constituting the three-dimensional display surface 31. As shown in FIG. 5, the element display surface 31a includes a planar spatial light modulator 31c, a planar light controller 31d, and a transparent outer skin layer 31e.

  The spatial light modulator 31c includes a matrix display element that can display colors in a matrix. The spatial light modulator 31c has a plurality of pixels arranged in a matrix. As the spatial light modulator 31c, for example, a liquid crystal display or an organic electroluminescence display can be used.

  The light beam controller 31d is composed of an optical element that can control the direction of the light beam, and has a function of reproducing the state of light traveling in various directions from the spatial light modulator 31c. In the present embodiment, a lens array including a plurality of lenses is used as the light beam controller 31d. Instead of the lens array, a diffraction grating array including a plurality of diffraction gratings may be used. Further, as the light beam controller 31d, a pinhole array having a plurality of pinholes or a prism array including a plurality of prisms can be used.

  The direction of the light beam from the plurality of pixels of the spatial light modulator 31c is controlled by each lens of the light beam controller 31d. Each lens corresponds to a pixel group located below the lens. Even if a light shielding member 31f for partitioning adjacent lenses is provided between the spatial light modulator 31c and the light controller 31d so that the direction of light from only the pixel group to which each lens corresponds can be controlled. Good. In addition, you may comprise so that each lens may control the direction of the light ray only from the pixel group located in the lower part by adjusting the distance of a lens and a pixel group.

  The number of light rays and the direction of the light rays that can be controlled by the light ray controller 31d are determined by the number of pixels located under each lens, the distance between the lenses, the optical design of the lens such as the refractive index of the lens, and the like. .

  As shown in FIG. 5, the lens L of the light beam controller 31d controls light traveling in various directions from the pixels Pa, Pb, Pc, and Pd of the spatial light modulator 31c in directions indicated by dotted lines.

  A touch sensor 33 is provided along the element display surface 31a. The touch sensor 33 is composed of, for example, a tactile sensor array. The tactile sensor array includes a plurality of tactile sensor elements arranged in a matrix. As the tactile sensor element, various tactile sensors that can detect contact of a person or an object can be used.

  In the present embodiment, the touch sensor 33 is composed of a plurality of tactile sensor elements embedded between the lenses of the lens array. For example, as the tactile sensor element, a piezoelectric element (piezo element) that detects a voltage change due to the piezoelectric effect, a strain gauge that detects strain, and a variable capacitance element that detects a change in capacitance can be used. It is also possible to use a light detection element such as a photodiode that detects light blocked by a finger, a heat detection element that detects a temperature change, or the like.

  Further, as the touch sensor 33, a sheet-like transparent touch sensor may be used instead of the touch sensor array. In that case, the transparent tactile sensor is disposed so as to overlap the light beam controller 31d. For example, as a tactile sensor element, a sheet-like light detection element that detects a change in a light transmission state to an optical fiber, a sheet-like variable capacitance element that detects a change in capacitance at a contact portion, or a state of conduction between electrodes. A conductive sheet or the like that detects contact can be used.

  In the present embodiment, the touch sensor 33 outputs a detection signal when the user M touches the element display surface 31a. The light beam controller 31d and the touch sensor 33 are embedded in a transparent outer skin layer 31e made of, for example, a transparent resin.

(5) Method for Creating Stereoscopic Video Data A method for creating stereoscopic video data for displaying the stereoscopic video 31b on the stereoscopic display 30 will be described. FIG. 6 is a diagram for explaining a method of creating stereoscopic video data for displaying the stereoscopic video 31b. In FIG. 6, the illustration of the touch sensor 33 is omitted.

  A solid shape 31g to be visualized in the virtual space S inside the element display surface 31a is defined. This three-dimensional shape 31g is represented by shape data. Consider a light ray traveling in an arbitrary direction at an arbitrary point on the surface of the three-dimensional shape 31g. The positional relationship between the element display surface 31a and the three-dimensional shape 31g is uniquely determined by the definition of shape data.

  The position (coordinates) of the intersection when each light ray intersects the element display surface 31a, the angle between the light ray and the element display surface 31a, and the color are obtained. Further, it is determined at which position of which element display surface 31a each light ray intersects. Finally, stereoscopic image data for displaying the color of the intersection point on each pixel of the spatial light modulator 31c is created so as to reproduce the light beam traveling in the direction of the angle by the light beam controller 31d.

  Ideally, the position, angle, and color of the above intersection are obtained for the light rays traveling in all directions from the entire surface of the three-dimensional shape 31g, and three-dimensional image data representing the image to be displayed on each element display surface 31a is created. Actually, the virtual space S surrounded by the stereoscopic display surface 31 is discretized into a plurality of voxels, and the directions of the light rays emitted from the respective voxels are discretized. In the present embodiment, the direction of the light beam emitted from each voxel is controlled to a discretized direction by the light beam controller 31d.

  If one voxel in the virtual space S inside the element display surface 31a is a part of the three-dimensional shape 31g, a light ray traveling in a discretized direction from the voxel is obtained. In this way, the intersections between the light beams traveling in a plurality of directions discretized from each of the plurality of voxels on the surface of the three-dimensional shape 31g and the element display surface 31a are obtained, and the angle between the light beam and the element display surface 31a, Then, voxel colors are obtained, and stereoscopic video data is created based on their intersections, angles, and colors.

  For example, as shown in FIG. 6, the light emitted from one voxel b1 on the surface of the three-dimensional shape 31g is controlled by the lens L of the light controller 31d so as to be directed in the direction of the dotted arrow. Stereoscopic image data is created so that the color of the voxel b1 is displayed at the pixel at the intersection of these rays and the element display surface 31a.

  In addition, light rays emitted from the other voxel b2 on the surface of the three-dimensional shape 31g are controlled by the lens L of the light ray controller 31d so as to be directed in the direction of the solid arrow. Stereoscopic image data is created so that the color of the voxel b2 is displayed at the pixel at the intersection of these rays and the element display surface 31a.

  The above description has been made to facilitate understanding, but in practice, the reproducible light beam is limited by the relationship between each lens L of the light beam controller 31d and the number of pixels of the spatial light modulator 31c. The reverse algorithm to that described above is used. In other words, the light beam reproducible by each lens L of the light beam controller 31d is traced back through the pixels of the spatial light modulator 31c to obtain the color of the voxel at the intersection with the three-dimensional shape 31g to be displayed. The color to be displayed on the pixel is determined.

  When one light beam reproducible by the lens L of the light beam controller 31d intersects with a plurality of voxels of the three-dimensional shape 31g, the color of the voxel closer to the element display surface 31a is determined as the color to be displayed on the pixel. The This is because the point located in the back as viewed from the user is hidden by the point located in front. For example, as shown in FIG. 6, when one light beam reproducible by the lens L of the light beam controller 31d intersects a plurality of voxels b2 and b3 of the three-dimensional shape 31g, the voxel closer to the element display surface 31a. The color of b3 is determined as the color to be displayed on the pixel.

  In this way, stereoscopic video data for displaying the color of each voxel on the surface of the stereoscopic shape 31g on a plurality of pixels on the stereoscopic display surface 31 is created. By displaying an image on a plurality of pixels of the spatial light modulator 31c based on the stereoscopic image data, as a result, light rays from the stereoscopic shape 31g are reproduced.

  FIG. 7 is a diagram for explaining an image displayed on the spatial light modulator 31c of the stereoscopic display 30 based on the stereoscopic image data.

  For example, an image when the stereoscopic shape is viewed from the observation point V1 is displayed on the pixel “A” of the spatial light modulator 31c. Further, an image when the stereoscopic shape is viewed from the observation point V2 is displayed on the pixel “B” of the spatial light modulator 31c. Thereby, the user can see the three-dimensional shape from different angles when the eye is moved from the observation point V1 to the observation point V2.

(6) Operation of Video Display System Next, the operation of the video display system 100 according to the present embodiment will be described. FIG. 8 is a flowchart showing the operation of the main control unit 11 of the control device 10. FIG. 9 is an explanatory diagram of the operation of the video display system 100.

  The main control unit 11 of the control device 10 executes video display processing according to the video display program stored in the memory 13.

  First, the main control unit 11 determines whether or not the stereoscopic display 30 is gripped by the user M based on the detection signal of the touch sensor 33 transmitted from the stereoscopic display 30 of FIG. 2 (step S1).

  As shown in FIG. 9A, when the stereoscopic display 30 is held by the user M, the main control unit 11 determines that the stereoscopic display 30 is flat based on the images obtained by the observation devices 41 and 42. It is determined whether or not the vehicle has approached a predetermined range in front of the display 20 (step S2).

  As shown in FIG. 9B, when the three-dimensional display 30 held by the user M approaches within a predetermined range in front of the flat display 20, the main control unit 11 displays the screen of the flat display 20. It is determined whether or not an operation for specifying the displayed plane image has been performed (step S3). Here, the designation operation refers to an operation in which the user M designates a desired portion of the planar image displayed on the screen of the planar display 20 using the stereoscopic display 30. The designation operation is, for example, an operation of moving the three-dimensional display 30 so as to surround a part of the planar image displayed on the screen of the planar display 20.

  As shown in FIG. 9 (c), when the user M performs a plane video designation operation, the main control unit 11 performs the flat display 20 based on the images obtained by the observation devices 41 and 42. The designated portion of the plane image displayed on the screen is determined (step S4). In this case, the main control unit 11 recognizes the movement path of the three-dimensional display 30 based on the images obtained by the observation devices 41 and 42, and the three-dimensional display 30 based on the shape data stored in the shape data storage unit 12. The plane image displayed on the plane display 20 is recognized during movement, and the designated portion of the plane image is determined based on the positional relationship between the moving path of the stereoscopic display 30 and the plane image. In the example of FIG. 9C, the portion surrounded by the arrow in the planar image is the designated portion.

  Next, the main control unit 11 acquires shape data corresponding to the designated portion from the shape data storage unit 12, and transmits the acquired shape data to the stereoscopic display control unit 32 (step S5). Thereby, the stereoscopic display control unit 32 of the stereoscopic display 30 converts the received shape data into stereoscopic video data, and displays the stereoscopic video based on the stereoscopic video data on the stereoscopic display surface 31. In this way, the user M can acquire the designated portion of the flat image displayed on the flat display 20 in the stereoscopic display 30.

  When the main control unit 11 deletes the designated portion of the planar video displayed on the flat display 20, the designated portion of the planar video displayed on the flat display 20 moves to the stereoscopic display 30 as a stereoscopic video. In addition, when the main control unit 11 does not delete the designated portion of the planar video displayed on the flat display 20, the designated portion of the planar video displayed on the flat display 20 is copied to the stereoscopic display 30 as a stereoscopic video. In the example of FIG. 9D, the designated portion of the planar image displayed on the planar display 20 is moved to the stereoscopic display 30 as a stereoscopic image.

  It should be noted that whether to move or copy the designated portion of the planar video displayed on the planar display 20 to the stereoscopic display 30 can be preset in the control device 10. Alternatively, the user M may select to move or copy the designated portion by moving the stereoscopic display 30 by a predetermined method before the designation operation by the stereoscopic display 30.

  If the 3D display 30 is not gripped in step S1, the 3D display 30 is not approaching within a predetermined range in front of the flat display 20 in step S2, and the flat image designation operation is not performed in step S3. In this case, the main control unit 11 returns to the process of step S1.

(7) Effects of the Embodiment As described above, according to the video display system 100 according to the present embodiment, the user grasps the stereoscopic display 30 and approaches the flat display 20, and uses the stereoscopic display 30. By designating the portion of the planar image, the designated portion of the stereoscopic video is displayed on the stereoscopic display 30. Therefore, the user can easily obtain a desired portion of the flat image displayed on the flat display 20 as a three-dimensional image on the three-dimensional display 30 by an intuitive operation without performing a complicated operation. Thereby, the user can observe the stereoscopic image corresponding to the desired portion of the planar image in detail from an arbitrary direction.

(8) Other Embodiments (a) FIG. 10 is a block diagram showing another example of the configuration of the flat display 20. In the above embodiment, the infrared elements 23, 24, 34 and the observation devices 41, 42 are used to detect that the three-dimensional display 30 has approached a predetermined range in front of the flat display 20. However, the present invention is not limited to this. . For example, as shown in FIG. 10, the flat display 20 may include at least one of a touch sensor 26 and a proximity sensor 27.

  The touch sensor 26 outputs a detection signal when the stereoscopic display 30 contacts the flat display 20. The flat display control unit 22 transmits a detection signal output from the touch sensor 26 to the control device 10 in FIG. 2 via the input / output circuit 25. As a result, the control device 10 determines that the three-dimensional display 30 has approached a predetermined range in front of the flat display 20.

  The proximity sensor 27 outputs a detection signal when the three-dimensional display 30 approaches a predetermined range in front of the flat display 20. The flat display control unit 22 transmits a detection signal output from the proximity sensor 27 to the control device 10 of FIG. As a result, the control device 10 determines that the three-dimensional display 30 has approached a predetermined range in front of the flat display 20.

  (B) Although the camera which can detect infrared rays is used as the observation devices 41 and 42 in the above embodiment, an infrared sensor, a magnetic sensor, or an ultrasonic sensor may be used instead of the camera. As a three-dimensional position measuring apparatus using a magnetic sensor, for example, a three-dimensional magnetic sensor (http://www.kbk.co.jp/cesd/polhemus.htm) manufactured by Polhemus can be used. For a three-dimensional position measurement apparatus using an ultrasonic sensor, for example, Intersense's ultrasonic motion tracking system (http://www.intersense.com/uploadedFiles/Products/IS900.pdf) can be used.

  Further, the video display system 100 includes the flat display 20 having a large screen and the portable stereoscopic display 30, but is not limited thereto. For example, a three-dimensional display may be used instead of the flat display 20. Further, a portable flat display may be used instead of the stereoscopic display 30. In these cases, the designated portion of the planar video or stereoscopic video can be acquired as the planar video or stereoscopic video.

(9) Correspondence between each component of claim and each part of embodiment The following describes an example of the correspondence between each component of the claim and each part of the embodiment. It is not limited.

  In the embodiment described above, the flat display 20 is an example of the first video display device, the stereoscopic display 30 is an example of the second video display device, and the touch sensor 33 is the grip detection means or the second contact detection. Infrared elements 23, 24 and 34 and observation devices 41 and 42 are examples of approach detecting means, touch sensor 26 is another example of approach detecting means, and proximity sensor 27 is an approach detecting means. Yet another example. The infrared elements 23, 24 and 34 and the observation devices 41 and 42 are examples of designated operation detection means, position detection means or common position detection means, the control device 10 is an example of control means, and the infrared elements 23 and 24 are It is an example of a 1st imaged part, and the infrared element 34 is an example of a 2nd imaged part. The observation devices 41 and 42 are examples of a plurality of imaging units, the touch sensor 26 is an example of a first contact detection unit, the proximity sensor 27 is an example of a proximity detection unit, and the shape data storage unit 12 is a storage unit. It is an example.

  As each constituent element in the claims, various other elements having configurations or functions described in the claims can be used.

(10) Application Examples (a) In a conference held between remote locations, a desired product portion of a plurality of product flat images displayed on the screen of the flat display 20 is displayed on the attendee's hand. 30 can be displayed as a stereoscopic image, and can be examined from various viewpoints.

  (B) In shopping using the Internet, a desired product portion of a plurality of product planar images displayed on the screen of the flat display 20 is displayed as a three-dimensional image on the three-dimensional display 30 at hand of the user. You can check the details of the product from any angle.

  (C) In daily life, a desired portion of the flat image of the television program displayed on the flat display 20 can be acquired on the three-dimensional display 30 at the user's hand and viewed as a three-dimensional image.

  The present invention can be effectively used for displaying various videos.

DESCRIPTION OF SYMBOLS 10 Control apparatus 11 Main control part 12 Shape data memory | storage part 13 Memory 14,25 Input / output circuit 15,35 Communication part 20 Planar display 21 Display part 22 Planar display control part 23,24,34 Infrared element 26,33 Touch sensor 27 Proximity Sensor 30 3D display 31 3D display surface 31a Element display surface 31b 3D image 31c Spatial light modulator 31d Light controller 31e Transparent skin layer 31f Light shielding member 31g 3D shape 32 3D display control unit 41, 42 Observation device 100 Video display system b1, b2, b3 voxels C1, C2 observation center point L lens L1, L2 straight line M user Pa, Pb, Pc, Pd pixel S virtual space V1, V2 observation point VP1, VP2 virtual plane

Claims (10)

A first video display device for displaying video;
A second video display device for displaying video;
Grip detection means for detecting that the user grips the second video display device;
An approach detection means for detecting that the second video display device approaches a predetermined range of the first video display device;
Designation operation detecting means for detecting that a user has performed an operation of designating a portion of the video displayed on the first video display device;
Used based on the operation detected by the designated operation detecting means when the approach detecting means detects that the second video display apparatus has approached the predetermined range of the first video display apparatus A video display system comprising: control means for discriminating a video portion designated by a person and controlling the second video display device to display the designated video portion. The designation operation detection means includes position detection means for detecting a position of the second video display device with respect to the first video display device,
The video display system according to claim 1, wherein the control unit discriminates a video portion designated by a user based on the position detected by the position detection unit. The position detecting means includes
A first image pickup unit provided in the first video display device;
A second image pickup unit provided in the second video display device;
A plurality of imaging means for imaging the first image-capturing unit and the second image-capturing unit from different positions;
The video display system according to claim 2, wherein the control unit discriminates a video portion designated by a user based on images obtained by the plurality of imaging units. The approach detection means includes a position detection means common to the position detection means of the designation operation detection means, and the second video display device is based on the position detected by the common position detection means. 4. The video display system according to claim 2, wherein it is detected that the video display device approaches the predetermined range. The approach detection means includes
5. The video display system according to claim 1, further comprising a first contact detection unit that is provided in the first video display device and detects a contact of the second video display device. 6. . The approach detection means includes
6. The video display system according to claim 1, further comprising proximity detection means provided in the first video display device and detecting proximity of the second video display device. The grip detection means includes
The video display system according to claim 1, further comprising a second contact detection unit provided in the second video display device and configured to detect that a user's body has come into contact. The control means includes
A storage unit for storing data for displaying video;
Data stored in the storage unit is provided to the first video display device, data corresponding to a video portion designated by a user is acquired from the storage unit, and the acquired data is displayed in the second video display. A main control unit for the device,
The first video display device displays a video based on data given from the main control unit,
The video display according to any one of claims 1 to 7, wherein the second video display device displays a video portion designated by a user based on data given from the main control unit. system. The video display system according to claim 1, wherein the second video display device displays a part of the specified video as a stereoscopic video. Displaying a video on the first video display device;
Detecting that the user has gripped the second video display device;
Detecting that the second video display device approaches a predetermined range of the first video display device;
Detecting that a user has performed an operation of designating a portion of a video displayed on the first video display device;
When it is detected that the second video display device approaches the predetermined range of the first video display device, a portion of the video designated by the user is determined based on the detected operation. And a step of controlling the second video display device to display the designated video portion.

Images