JPH0628452A - Three-dimensional image processor - Google Patents

Abstract

PURPOSE:To execute an image display by always allowing a see-through visual point to coincide with an observation visual point. CONSTITUTION:In a display 5 for displaying a three-dimensional image subjected to seeing-through by a visual point coordinate system, an observation visual point sensor 12 for detecting an observation visual point of a facing observer is provided, and in accordance with the observation visual point detected by this observation visual point sensor 12, a computer 13 moves the visual point coordinate system of a display image, by which a see-through visual point of the three-dimensional image displayed on the display 5 is moved by allowing it to follow the observation visual point of the observer, and the see-through visual point is always allowed to coincide with the observation visual point for displaying image.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a three-dimensional image processing apparatus capable of displaying an image with the perspective point of view always matching the observation point of view.

[0002]

2. Description of the Related Art The so-called computer graphics (CG), which is a technique for converting graphics and images into data using a computer and vice versa, is so-called computer graphics (CG). As if to keep pace with, he is showing various developments with various methods. Such computer graphics were originally used and developed in CAD fields such as architectural design and mechanical design, but because of the advantage that images can be generated from data and visualized, they can be used as scientific and technological calculations as visual simulation. The results have been visualized and analyzed, or used for research and industrial aspects such as landscape simulation of cities and buildings, and also as tools for image production such as commercial film and movie production. Generally, when creating figure / image data from input shape data or optical data, two representation methods of line drawing and plane drawing are used. A line drawing is called a wireframe model because it represents the skeleton of an object with lines.
Since a surface drawing represents an object as a surface rather than a line, it is also called a surface model in which the surface of the skeleton is represented by a surface. However, whichever model is used, it is said that the most intuitive understanding can be obtained by the graphic representation according to the perspective drawing method in which the viewpoint is placed at the origin of coordinates to see through the object.

A three-dimensional image processing apparatus 1 shown in FIG. 5 shows a basic configuration for realizing computer graphics, and mainly includes a CPU 2 which controls the whole.
A ROM 3 storing a basic operation program or a RAM 4 storing application programs and data is connected to a bus. Display 5 displaying 3D image
For example, a CRT (cathode ray tube) is used to display the video signal sent through the display control unit 6 on the screen. The display control unit 6 is called a CRT controller having a DMA (Direct Memory Access) function, and is connected to the CG rendering unit 8 via a frame buffer 7 capable of storing a display image for one frame. . The CG rendering unit 8 has a processing function for more three-dimensionally expressing a three-dimensional image,
The three-dimensional image sent from the CG model control unit 9 is subjected to a shading process for shading according to the position of the light source, a coloring process for coloring a surface having different axial directions, and the like. The CG model control unit 9 sees through the model defined by the three-dimensional image data sent from the CPU 2 in accordance with the viewpoint coordinate system in which the viewpoint is set at the coordinate origin, and the three-dimensional image obtained by the see-through is the CG rendering unit 8 Send to.

[0004]

In the conventional three-dimensional image processing apparatus 1 described above, when the observer faces the center of the display 5 and observes the screen, the viewpoint of the viewpoint coordinate system and the observation viewpoint match. The three-dimensional image displayed on the display 5 can be observed without feeling unnatural. However, since there is only one observation viewpoint that does not make you feel unnatural, the observation viewpoint and the perspective viewpoint match,
If you move the observation position horizontally or vertically,
There is a difference between the perspective of the 3D image and the observer's point of view, and this difference causes a sense of discomfort in the image of the 3D image held by the observer. When you try to use computer graphics for building design that matches the cityscape, optimal layout of automobile instrumentation, etc., you will change the viewpoint only for the design target and observe it. There was a problem that we could not meet the demand that we wanted to do.

[0005]

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems and has a perspective coordinate system.
A display that displays a three-dimensional image, an observation viewpoint of an observer who observes the display of the display, an observation viewpoint sensor that detects the observation position of the observer, and an observation viewpoint detected by the observation viewpoint sensor, An image processing means for moving the viewpoint coordinate system of the three-dimensional image displayed on the display is provided.

[0006]

The present invention detects the observation viewpoint of an observer facing a display for displaying a three-dimensional image by an observation viewpoint sensor, and moves the viewpoint coordinate system of the display image according to the detected observation viewpoint. , Regardless of the observer's observation position, always displays a three-dimensional image seen through from the observer's viewpoint.

[0007]

Embodiments of the present invention will be described below with reference to FIGS. FIG. 1 is a schematic configuration diagram showing an embodiment of a three-dimensional image processing apparatus of the present invention, FIG. 2 is a circuit block diagram of the three-dimensional image processing apparatus shown in FIG.
3 is a flowchart for explaining the operation of the CPU shown in FIG.

A three-dimensional image processing apparatus 11 shown in FIG. 1 has a display 5 for displaying a three-dimensional image seen through a viewpoint coordinate system, and an observation viewpoint of an observer who observes the display on the display 5 is observed by the observer. The observation viewpoint sensor 12 for detecting from the position is provided, and the viewpoint coordinate system of the three-dimensional image displayed on the display 5 is moved according to the observation viewpoint detected by the observation viewpoint sensor 12. As shown in FIG. 2, the computer 13, which is an image processing means, has the CPU 2, the ROM 3, the RAM 4, the display control unit 6, the frame buffer 7, the CG rendering unit 8, and the C as the center.
The G model control unit 9, a sensor input unit 14 to be described later, and the like are built in, and are incorporated in the pedestal portion of the display 5. One observation viewpoint sensor 12 is arranged at each of the four corners around the display 5, and each emits infrared rays forward, and from the light reception interval of the reflected light reflected by the observation viewpoint mark 15 and returned, the observation viewpoint mark is obtained. Measure the distance to 15. The observation viewpoint mark 15 is composed of a polygonal mirror that diffusely reflects incident light, and a headband 16 worn by an observer on the head.
It is fixed to the center of the front part of the. Therefore, the observation position of the observer is detected as the distance from the four observation viewpoint sensors 15 to the observer's head.

The distances to the observation viewpoint marks 15 detected by the four observation viewpoint sensors 12 are fetched by the CPU 2 via the sensor input unit 14 shown in FIG. The observation viewpoint is detected in real time. In addition, the CPU 2 controls the CG model control unit 9 according to the observation viewpoint calculated from the four distance data.
Ordered to change the perspective. In the movement (coordinate conversion) of the viewpoint coordinate system, moving the observation viewpoint is nothing but moving the three-dimensional figure. For example, when the observation viewpoint is translated, the three-dimensional figure is translated in the opposite direction. Good luck
Further, when the observation viewpoint is rotated, the three-dimensional figure may be rotated in the opposite direction about the viewpoint.

By the way, an observer observing the display 5 wears the headband 16 on the head so that the observation viewpoint mark 15 is located at the center of the forehead.

At this time, as shown in steps (101) to (105) of FIG. 3, the CPU 2 first takes in the output of the observation viewpoint sensor 12 via the sensor input unit 14. Next, in step (102), the observation viewpoint is calculated from the output of the observation viewpoint sensor 12.

Next, in the decision step (103),
Determine whether the observation viewpoint matches the perspective viewpoint. As a result, if the observation viewpoint matches the perspective viewpoint, the process returns to step (101), but if not,
Assuming that the observer has moved the observation position, step (1
Follow 04). In step (104), the deviation of the perspective viewpoint from the observation viewpoint is obtained as a deviation vector indicating the magnitude and direction of the deviation.

When the shift vector indicating the shift of the perspective viewpoint with respect to the observation viewpoint is obtained, in the next step (105), the perspective viewpoint is moved along a vector having the same magnitude as the shift vector but the opposite direction. It should be noted that this movement of the perspective viewpoint is 3 with respect to the parallel movement of the viewpoint, as described above.
The three-dimensional image is rotated in the opposite direction, and the viewpoint is rotated by rotating the three-dimensional image in the opposite direction about the viewpoint. In this way, the viewpoint (origin) of the viewpoint coordinate system
Moves according to the observation viewpoint of the observer. Further, this movement is continued until the determination in the determination step (103) is affirmed, and finally, when the shift between the perspective viewpoint of the three-dimensional image and the observer's viewpoint is eliminated, the viewpoint is moved. Will stop. Thus, an observer who observes the display on the display 5 can always observe the three-dimensional image from the perspective of the display image, and does not feel uncomfortable with the image.

As described above, the three-dimensional image processing apparatus 11
According to this, the observation viewpoint sensor 12 for detecting the observation viewpoint mark 15 of the headband 16 worn by the facing observer on the head is provided on the display 5 for displaying the three-dimensional image seen through the viewpoint coordinate system, and the detection is performed. Since the viewpoint coordinate system of the display image is moved according to the observed viewpoint, it is possible to always display the three-dimensional image viewed from the observer's viewpoint, regardless of the observer's observation position. As a result, for example, by moving only the design object drawn as a perspective view in accordance with the observation position of the observer, and by finding the observation position where the design object is most in harmony with the surroundings in the background screen with the fixed viewpoint. , It is possible to freely design buildings that match the cityscape, optimal layout of automobile instruments, etc. using the screen of the display 5, and a new method in fields such as industrial design using computer graphics. Can be provided.

In the above embodiment, the observation viewpoint sensor 1
2 is fixed to the headband 16 as an example,
As in the three-dimensional image processing device 21 shown in FIG. 4, the observation viewpoint mark 15 may be attached to the center of the glasses 22 worn by the observer. In this case, the glasses 2 to be used
Reference numeral 2 denotes stereoscopic eyeglasses having a liquid crystal shutter for alternately blocking the left eye part and the right eye part at high speed in synchronization with a three-dimensional image signal that is stereo-converted into a left eye image signal and a right eye image signal. However, by wearing such stereoscopic glasses, the three-dimensional image displayed on the display 5 can be observed as a more realistic image with depth. Further, when the left-eye image signal and the right-eye image signal are made into stereo with different color schemes, stereoscopic glasses or the like in which color filters having different transmission colors in the left-eye part and the right-eye part are fixed can also be used. Further, when controlling so that the left-eye image and the right-eye image emit polarized lights having different directions, it is possible to use a polarizing lens instead of the color filter.

In each of the above embodiments, the observation viewpoint sensor 12 is installed at four positions on the display 5, but the observation viewpoint sensor 12 may be installed at two or three positions. However, the observation viewpoint sensor 12 is provided at two locations.
When installing, the position of the observer will be detected only in one of the horizontal and vertical directions.
If the observation position of the observer is to be grasped three-dimensionally, the observation viewpoint sensors 12 must be installed at at least three places.

As a technique for processing image information, there is an image processing technique called image processing (IP), which is similar to computer graphics. This differs from computer graphics in that the subject that is the source of the image is present, but various processing such as gradation correction, point calculation or geometric processing, filtering, extraction of lines and contours is performed on the input image. And output it as an image.
It is quite similar to computer graphics in that humans and computers interact with each other through figures and images. Therefore, the three-dimensional image processing device 11 of the present invention,
21 is applicable to such image processing as well as computer graphics.

[0018]

As described above, according to the present invention, the observation viewpoint of the observer facing the display for displaying the three-dimensional image is detected by the observation viewpoint sensor, and the display image is displayed in accordance with the detected observation viewpoint. Since the viewpoint coordinate system is moved, it is possible to always display a three-dimensional image viewed from the observer's viewpoint regardless of the observer's observation position. By moving only objects according to the observer's observation position and finding the observation position where the design object is most in harmony with the surroundings in the background screen with a fixed viewpoint, the building design that matches the cityscape and the automobile The optimal layout design of the instruments of
It is possible to freely use the screen of the display, and there is an excellent effect that a new method can be provided in the field of industrial design utilizing computer graphics (CG), image processing (IP) and the like.

[Brief description of drawings]

FIG. 1 is a schematic configuration diagram showing an embodiment of a three-dimensional image processing apparatus of the present invention.

FIG. 2 is a circuit block diagram of the three-dimensional image processing apparatus shown in FIG.

FIG. 3 is a flowchart for explaining the operation of the CPU shown in FIG.

FIG. 4 is a schematic configuration diagram showing another embodiment of the three-dimensional image processing apparatus of the present invention.

FIG. 5 is a circuit block diagram showing an example of a conventional three-dimensional image processing apparatus.

[Explanation of symbols]

 2 CPU 5 display 11, 21 three-dimensional image processing device 12 observation viewpoint sensor 13 image processing means (computer)

Claims (1)

[Claims] 1. A display for displaying a three-dimensional image viewed through a viewpoint coordinate system, an observation viewpoint sensor for detecting an observation viewpoint of an observer who observes the display on the display from an observation position of the observer, and A three-dimensional image processing apparatus comprising image processing means for moving a viewpoint coordinate system of a three-dimensional image displayed on the display according to an observation viewpoint detected by an observation viewpoint sensor.