JPH11316855A - How to display buildings using CG images - Google Patents

Abstract

(57) Abstract: A display method capable of displaying a person image together with an image of a building on a CG image, and a computer-readable recording medium storing a program for causing a computer to execute the display method To provide. SOLUTION: Three-dimensional shape data relating to a building Z is created in advance and stored in a computer 15, and
In a method of displaying a building by a CG image in which the building Z is displayed as a still image or a moving image by a CG image by moving the viewpoint position with respect to the three-dimensional shape data in a static or desired direction, a person image U1a is used in advance.
And the person image U1a is displayed in the CG image at the same scale as the building Z.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION The present invention relates to displaying a building as a still image or a moving image using a CG image on the basis of three-dimensional shape data on the building created in advance by a CAD system or the like. The present invention relates to a method of displaying a building by a CG image capable of displaying a human image such as an image of a building, and a computer-readable recording medium storing a program for causing a computer to execute the display method.

[0002]

2. Description of the Related Art When designing a house, the building style, floor area, floor plan, etc. are individually considered according to site conditions, user preferences, and desires. There is a problem in that it is difficult for the user to obtain a specific image of the details of the house he intends to build by merely presenting the drawing.

[0003] Therefore, conventionally, the design drawing of the house is CAD (C
omputer Aided Design) system, and then creates three-dimensional shape data of the house based on the design drawing, and further performs processing such as data integration and coloring on the three-dimensional shape data. A computer graphics image (hereinafter, referred to as a CG image) is displayed on a display device such as a screen, and the viewpoint position set for the three-dimensional shape data is input using an input means such as a mouse. By moving the computer in real time while moving in a desired direction, the same moving image as walking inside and outside the house is displayed on the display device, and a so-called walk-through is displayed on the CG image. (See Japanese Patent Application Laid-Open No. 9-106408).

According to the above display method, each part of the house is 3
Since it is displayed like a real thing as a three-dimensional video, the user can accurately judge whether the layout and arrangement of furniture are appropriate, and even the color of the interior material, the pattern and the texture of various materials, There are advantages such as confirmation on a CG image.

[0005]

The above-mentioned CG
In the method of displaying buildings using images, since the user does not know the scale of the CG image of the actual house, it is difficult to obtain a sense of the size of each room, the height of the ceiling, the height of the shelves, etc., and grasp the size, height, etc. Had a difficult problem. Also, C
Since only the room and the furniture are displayed on the G image, they tend to give a murky landscape impression.

[0006]

According to the present invention, there is provided a display method capable of displaying a human image such as an image of a user together with an image of a building on a CG image by solving the above-mentioned problems, and a display method thereof. It is an object of the present invention to provide a computer-readable recording medium on which a program to be executed by a computer is recorded. Therefore, C of claim 1 of the present invention
The method of displaying a building using a G image is such that the three-dimensional shape data relating to the building is created in advance and stored in a computer, and the viewpoint position with respect to the three-dimensional shape data is stationary or moved in a desired direction. Things C
In a method of displaying a CG image related to a building, which is displayed as a still image or a moving image using a G image, a human image is captured in advance, and the human image is displayed in the CG image at the same scale as the building. It is characterized by doing so. The stationary or moving of the viewpoint position can be instructed to the computer by input means such as a mouse, for example.

According to a second aspect of the present invention, there is provided a method for displaying a building by using a CG image, wherein the building is a building that a specific user intends to build, and the person image is a photograph of the user. The image is characterized in that it is an image that has been rendered.

According to a third aspect of the present invention, there is provided a method for displaying a building by using a CG image according to the first or second aspect.
The image is a three-dimensional image.

According to a fourth aspect of the present invention, in the display method of a building according to the second or third aspect, the movement of the user's body is detected and the CG image in the CG image is detected in accordance with the detected movement of the body. It is characterized in that display is performed so that a user's image moves.

According to a fifth aspect of the present invention, in the display method of the fourth aspect, the user wears a head-mounted display and looks at the CG image of the building by the head-mounted display. And displaying a CG image on a display device other than the head mounted display so that the image of the user moves in accordance with the movement of the body of the user.

According to a sixth aspect of the present invention, there is provided a computer-readable recording medium storing a program for causing a computer to execute the method for displaying a building by a CG image according to any one of the first to fifth aspects. It is characterized by the following.

[0012]

Embodiments of the present invention will be described below with reference to the drawings. First, it is provided in a house building company or the like.
The configuration of a display room (presentation room) for displaying images will be described. As shown in FIGS. 1 and 2,
The display room 1 has a vertically elongated window 3 with a light-shielding shutter 3a on a front wall 2 thereof, and a narrow vertical ventilation hole between the front vicinity wall 2 and a ceiling (not shown). Except for having the gap 4, it has a dark-room-like configuration in which external light hardly penetrates. In the vicinity of the upper end of the four walls 2 of the display room 1,
An overhanging portion 5 that extends horizontally to the indoor side is formed.
Small lighting fixtures 6 are provided at predetermined intervals on the lower surface of the display room 1, while large lighting fixtures (not shown) are attached to the ceiling (not shown) of the display room 1.

Behind the display room 1, the projection room 7 is separated by the wall 2.
Are formed. As shown in FIG. 3, a large screen 100 having a size of 100 inches or more, specifically, for example, about 125 inches (the number of pixels) is provided at the center of the wall 2 between the display room 1 and the projection room 7. Is about 1280 × 1024 dots). The screen 8 is provided with, for example, a process for efficiently collecting light (Fresnel lens) on the projection room 7 side, and a vertical stripe process (Lenticular lens) for spreading the light in the horizontal direction on the display room 1 side. And a Fresnel lenticular screen and the like.

A projector 11 (projector) having three projection tubes 11a is installed on a mounting table 10 arranged in the projection room 7. A reflection mirror 12 is disposed between the projector 11 and the screen 8. After a projection image from the projector 11 is reflected by the reflection mirror 12, the image is projected onto the screen 8 from the projection room 7 side. The projected image can be viewed from the display room 1 side. If the space in the projection room 7 can be sufficiently secured, the projector 11 may directly project onto the screen 8 without using the reflection mirror 12. Each of the display room 1 and the projection room 7 is provided with a door D that can be freely opened and closed.

As shown in FIG. 3, in the display room 1, a plurality of chairs 13 and a table 14 for a user U who watches a CG image on a screen 8 to be seated are appropriately arranged. As shown in FIG. 4, a workstation 15 (computer) for generating a CG image is provided at one corner of the display room 1.

The workstation 15 has a table 16
A CRT 17 (Cathode Ray Tube) mounted thereon, a keyboard 18, a mouse 19, a full-color printer 21, and an I / O / arithmetic unit 2 disposed below the table 16
3 relating to a house (building) scheduled to be constructed by the user U created by a CAD system (not shown) in advance.
CG image data is generated in real time in accordance with the dimensional shape data and the input operation of the keyboard 18 and the mouse 19 by the operator O who is a clerk of a house building company or the like, and based on this, the CRT 17 and the screen 8
The CG image relating to the house can be displayed as a still image or a moving image. The operation of the workstation 15 may be performed by the user U himself.

As shown in a perspective view of a virtual perspective view in FIG. 5, the input / output / arithmetic unit 22 includes a bus including a system bus slot, a graphics slot, a VME bus slot and the like, a graphics slot 22a, an SCS
Drive slots 22 including I-II drive slots, etc.
b, a power supply unit 22c, and the like. The bus and graphics slot 22a further includes a CPU,
It may include a memory or the like.

As shown in the block diagram of FIG. 6, the input / output / arithmetic unit 22 has a plurality of units, for example, 2 to 24 units.
About 23 CPUs (150MHz) and 64M capacity
A main memory 24 of about B to 16 GB, typically about 128 MB, and an I / O system group 25 are provided. These are a synchronous system bus 26 (1.2 GB / s, 25 GB).
6 bits) and an input / output bus 27 (320 MB / s) so that data can be transmitted and received.

The I / O system group 25 includes a graphics interface 28, a predetermined number of HIO slots 30,
Ethernet 31, VME64 bus 32 and SCS
An I-II interface 33 is provided. The graphics interface 28 includes an auxiliary image processing unit 34 (Re
The CRT 17 (the screen size is, for example, 21 inches) via the Quality Engine 2), and is also connected to the projector 11 (not shown). The auxiliary image processing unit 34 performs well-known processing such as anti-aliasing and texture mapping on the image data from the graphics interface 28,
It is output to RT17 and the like.

The HIO slot 30 is a slot (insertion port) for adding equipment for connecting input / output devices such as graphics and SCSI-II. Various expansion boards are additionally mounted on the vacant HIO slot 30. Therefore, the function can be improved. For example, by adding another auxiliary image processing unit 34 as graphics, two graphics processing systems can be provided, and the speed of output to a plurality of screens can be increased.

The Ethernet 31 is a LAN (Local A)
A connection port for connecting to a CAD system without using a physical medium such as a floppy disk by connecting to another computer, for example, a CAD system using the Ethernet 31. Transmission and reception of three-dimensional shape data and the like can be performed. The VME64 bus 32 is an extended standard for a certain type of computer, and guarantees the connectivity of various types of extended devices by arranging the shape of connection parts, the arrangement of signal lines, and the like. The hard disk 35 connected to the SCSI-II interface 33 stores a program for causing the workstation 15 to execute the method for displaying a building using CG images according to the present invention from a recording medium such as a CDROM (not shown) in advance. Installed.

As shown in FIG. 3, on a mounting table 36 arranged in the display room 1, a user U virtually enters a CG image using a so-called virtual reality technique to perform various operations. Head mount display (hereinafter referred to as HMD) 37 and 2
And two glove-type detectors 38 are provided. HMD3
7 and each glove-type detecting device 38 are connected to connecting wires 40 and 41, respectively.
And the relay control device 42 is connected to the workstation 15 via a connection line 43. Note that the HMD 37 and the glove-type detection device 38 may be directly connected to the workstation 15 without going through the relay control device 42. Also, in the display room 1, there is a 3D photograph for taking a three-dimensional photograph of the user U.
A three-dimensional camera 44 is arranged, and the three-dimensional camera 44 is connected to the workstation 15 by a connection line 45.

The configuration of the HMD 37 is well known, but will be briefly described below. As shown in FIG. 7, the HMD 37
An image display unit 46 positioned in front of both eyes of the user U in a mounted state, two headphones 47 mounted on both ears of the user U, a frame 48 connecting the image display unit 46 and the headphones 47, and a frame; And a detection sensor 50 that is attached to the upper part of the head 48 and detects the direction of the head of the user U.

As shown in FIG. 8, the image display unit 46 includes an optical system 51 composed of a lens and the like, and a display unit main body 52 composed of a liquid crystal display or a small CRT. By displaying CG images having parallax with each other, a virtual image is created at a position T (a position distant from the eye by the focal length F) in the figure. As a result, the user U is given a visual effect as if the target object exists at the position X in the figure.

As shown in FIG. 9, the glove-type detecting device 38 also has a well-known structure, and has a magnetic spatial position for detecting a position and a posture on the surface of the glove 53 worn on the hand of the user U. This is a sensor (for example, a data glove (trade name) manufactured by VPL) equipped with a posture detection sensor 54 and a plurality of optical fiber sensors 55 for detecting a bent state of each finger. The glove type detection device 38 is, for example,
A sensor using conductive ink instead of the optical fiber sensor 55 (for example, Cyber Globe (trade name) manufactured by Virtual Technologies) may be used.

As shown in FIG.
4 also has a well-known configuration, and scans an object, that is, the body surface of the user U, with a slit-shaped laser beam (not shown) emitted from a light emitting unit 57 that can be opened and closed by a lid 56, and reflects the reflected light. Is received by a CCD camera 58 to read a three-dimensional uneven shape to create a full-color three-dimensional image (for example, VIVID700 (trade name) of Minolta Co., Ltd.).

Display room 1 using workstation 15
When creating and displaying a CG image relating to a house Z scheduled to be built by the user U within the house, first, as shown in the flowchart of FIG.
In the D system, a plan view of the house Z is created (S
1). FIG. 12 is a plan view of the first floor of a two-story house as an example of the house Z, and FIG. 13 is a plan view of the second floor. Each plan view shows the plan shape, floor plan, and the like of the house Z.

Subsequently, the house CAD system is used for the house Z.
Create three-dimensional shape data (three-dimensional model)
S2 in 1). FIG. 14 shows a perspective view, a north elevation view, and a west elevation view of the house Z expressed based on the three-dimensional shape data.
16 to FIG.

Further, in the exterior CAD system, the house Z
While creating three-dimensional shape data representing the exterior (not shown) of a fence, a gate, etc. attached to the computer (S3 in FIG. 11), the general CAD
The system creates three-dimensional shape data related to a real neighboring environment (not shown) such as a real house adjacent to the house Z to be built, a house in a road or a distant view, and a building (S4).

Further, in the general CAD system, outdoor and indoor scene parts, for example, outdoor trees, vehicles such as automobiles,
Stones, bicycles, road signs, etc. (not shown), indoor furniture,
Three-dimensional shape data relating to furnishings, decorations, paintings, and the like is created in advance (S5), and these are stored in a library for scene parts (S6). The above is the generation of the image data by the CAD system to be performed prior to the display of the CG image. The house CAD system and the exterior CAD system are CAD systems provided with various databases for creating three-dimensional shape data relating to the house Z and the exterior, respectively.

When the house 15 creates and displays CG images of the house Z, the outside structure, the scenery parts, and the surrounding environment of the house Z based on the CAD data, various types of the house Z, the outside structure, and the like are used. The three-dimensional shape data created by the CAD system is read into the input / output and arithmetic unit 22 of the workstation 15 (S7 in FIG. 11). Since then
The processing for data integration and image adjustment is performed by the workstation 15. The processing method includes (a)
There are two types of processing: manual processing and (b) automation processing.

In the case of the manual operation (a), first, various shape data relating to the house Z, the exterior, the scenery parts, and the like are used for rendering and display processing of a CG image using rendering software. At this time, the file is converted into a readable file format (S8). Subsequently, for each surface converted from the CAD data, each surface or a group of a plurality of adjacent surfaces is selected with a mouse or the like, and material information is set, thereby performing coloring (S9).

In the present invention, it is mainly assumed that the shape conversion is performed by the automation processing of (b). In this case, in the CAD system, the three-dimensional shape data relating to the house Z is stored in advance in the building specification. Information is added. The building specification information includes the building type (for example, type I, type II, etc.) of the house Z, the color of the exterior material (the material of the exterior material is determined by the type of the house Z), the type and color of the roof material. For example, important information for determining the appearance of the house Z is included.

In the automation processing of the above (b), a work conversion and a coloring work are performed in the work station 15 by a conversion program (S10). Here, the converted three-dimensional shape data is output not as a perspective view (three-dimensional perspective view) but as a file. That is, in the perspective view, a portion that cannot be seen from the viewpoint is not drawn, but in the present invention, since it is an output for a CG image, all of the created three-dimensional data is output as a file.

In the file output, each part of the house Z, for example, a wall, a floor, a sash, etc., is stored as data separately on the CAD. Here, at the time of outputting the three-dimensional shape data of each part, information indicating which part is the shape data is represented by a part name or a number.
It is embedded as internal information in the shape data. An example is shown below. Part name (or number): wall 3D shape data (wall). . . . . . End of 3D shape data Site name (or number): sash 3D shape data (sash). . . . . . End of 3D shape data Site name (or number): floor 3D shape data (floor). . . . . . End of 3D shape data

On the other hand, information such as what material is used for each part of the house Z and what color each part presents is not included in the three-dimensional shape data but provided separately by a material information file. Is done. This material information file is prepared, for example, for each building type to which each house Z belongs, and the conversion specification program reads the building specification information included in the three-dimensional shape data of the CAD system. Then, a material information file that matches the building type of the house Z is selected.

Each material information file contains the names of the respective parts such as the above-mentioned walls and sashes, and the materials used as standard in each part (for example, if the part is a roofing material, it is a color vest and the color is Brown and the like and attribute information on the CG software corresponding to the material (for example, a reflection coefficient of 0.4, texture mapping of YANE, RGB of 600 mm × 400)
mm, and the sticking is from the bottom to the top of the Z axis) is stored as a correspondence table.

Further, a master file having all information, which is a master of these material information files, is provided as a backup file. Then, for example, when it is desired to change the material or color of a part of the house Z to a material other than the material stored in the material information file, the desired information is called from the master file and Can be replaced with part of the information.

For example, as shown in part A in FIG. 17, the building type of the building specification information for the house Z is type I, the exterior material is type I (color is off-gray), and the roof material is flat tile (color is black). , As the material information file,
Based on the building type, the type I shown in part B of FIG. 17 is selected. Here, type I (color is pale gray) is registered as a standard exterior material of the material information file for format I, which is different from the exterior material in the building specification information. In this case, information C1 relating to the exterior material corresponding to the building specification information is called from the master file shown in part C in FIG. 17, and stored instead of information B1 relating to the exterior material in the material information file. The file of the three-dimensional shape data and the material information file are hereinafter treated as a set.

After that, the workstation 15 also converts the three-dimensional shape data relating to the exterior, the scenery parts and the surrounding environment to the shape conversion and coloring work by manual work (a) or automatic processing (b). Is done,
Files relating to the converted house Z, exterior, scenery parts, etc. and the corresponding material information files are CG.
The entire configuration is created by performing integration processing of various files such that the house Z, the exterior, the scenery parts, and the like are read by the software and all of them can be displayed in a combined state on the same screen (FIG. 11). S11). Subsequently, the integrated file is subjected to an operation for adding a shade corresponding to the sun or the shade to the image of the house Z or the like by the radiosity method or the like, and various operations such as a lighting calculation and a daylight calculation are performed. Is performed (S12).

Subsequently, based on the file of the three-dimensional shape data, the virtual viewpoint position set for the three-dimensional shape data is set by the operator O using the CG image display software at the workstation 15. Mouse 1 by
When the camera is stopped or moved in a desired direction in response to an input operation at 9 or the like, real-time calculation is performed in accordance with the movement of the viewpoint position, and CG image data obtained by the calculation is output to the screen 8 and the CRT 17. By doing so, C reproduces a state in which the house Z, the exterior, the scenery parts, and the like are viewed from a desired position corresponding to the viewpoint position at each time.
The G image is displayed as a moving image or a still image, and a so-called walk-through is performed (S13).

Next, a description will be given of a procedure for moving the viewpoint position at the work station 15 during the walk-through. As shown in FIG. 18, a cursor G is displayed on the CRT 17, and this cursor G is moved up and down on the screen 17 a of the CRT 17 by, for example, selectively operating four cursor keys 18 a on the keyboard 18. It can be moved in the direction and / or left and right.

When the cursor G is moved upward on the screen 17a, the viewpoint position becomes higher. When the cursor G is moved downward, the virtual viewpoint position becomes higher. Is lowered, and when the cursor G is moved rightward or leftward, the direction of the viewpoint (the line of sight) turns rightward or leftward accordingly. Further, when the left button 19a attached to the mouse 19 is pressed, the viewpoint position moves forward, and the middle button 19a is moved.
Pressing b stops the movement of the viewpoint position in the front-back direction,
When the right button 19c is pressed, the viewpoint position moves backward.

FIG. 19 shows an example of the appearance of the house Z in the daytime displayed on the screen 8 as a CG image.
Here, a shadow is given to the outer wall W and the like by an operation based on the radiosity method and the like, and a portion with a dot in the figure is shaded. Move the cursor G on the CRT 17, and press the buttons 19a to 19c of the mouse 19.
By changing the direction of the viewpoint,
Or, if you move the viewpoint in the depth direction of the screen,
Actually, the moving image that gives the same audio-visual effect as walking around the outside and inside of the house Z scheduled to be constructed by the user U is C.
This moving image is generated as a G image, and is displayed in a shaded state.

By operating the cursor keys 18a and the buttons 19a to 19c of the mouse 19, for example,
Passing the entrance and moving the viewpoint position indoors,
Workstation 15 based on the three-dimensional shape data
, And based on the CG image data generated by the calculation, for example, as shown in FIG. 20, the state of the indoor I is displayed on the screen 8 and the CRT 17. Then, by sequentially moving or stopping the viewpoint position indoors, the rooms such as the Western-style room J shown in FIG. 21, the kitchen K shown in FIG. 22, and the bathroom Y shown in FIG. Is displayed.

The correspondence between the operation of moving the viewpoint position by the keyboard 18 and the mouse 19 and the switching of the display of the CG image will be described with reference to the plan view of FIG. For example, assuming that the viewpoint position is now at point P, that is, in the dining room M, and the line of sight is in the direction of arrow Q, the partition K of the kitchen K is displayed on the screen, although not shown.
1 is displayed. Here, if approaching in the direction of the kitchen K, the forward left button 19 on the mouse 19
What is necessary is just to press a. On the other hand, for example, if the direction of the viewpoint is changed to the direction of the living room N, the cursor G may be moved to the left with the cursor key 18a. Any still image generated during the walk-through can be printed in color by the printer 21 or the like, and the walk-through can be continuously performed during the printing.

The CG image on the screen 8 can be viewed as a two-dimensional image. However, if the CG image can be viewed as a three-dimensional image, the sense of space and the like can be easily grasped. Thus, it is possible to obtain an image that is more similar to a state in which the user walks inside and outside the actual house Z and observes. As a method for obtaining a three-dimensional image, as shown in FIG. 3, for example, there is a method in which each user U wears liquid crystal shutter glasses 60. The principle of obtaining a three-dimensional image using the liquid crystal shutter glasses 60 is well known, but will be briefly described below.

As shown in FIG. 24, the display device such as the screen 8 is supplied with the right-eye video signal R and the left-eye video signal L alternately, while opening the right-eye shutter 60a of the liquid crystal shutter glasses 60. Right eye shutter open signal R
O and a left-eye shutter open signal LO for opening the left-eye shutter 60b are alternately supplied to the right-eye shutter 60a and the left-eye shutter 60b. Then, the user U wearing the liquid crystal shutter glasses 60 alternately recognizes the right-eye video signal R and the left-eye video signal L with the right eye and the left eye, whereby the CG image is recognized as a stereoscopic image. Note that, instead of the liquid crystal shutter glasses 60, for example, well-known polarizing glasses (not shown) can be used to obtain a stereoscopic image.

Next, during the above-described walk-through, using a so-called virtual reality technique, any user U, for example, a housewife, in a CG image representing a house Z he or she intends to build. Operations and control procedures when a certain user U1 virtually enters and performs various tasks and walking will be described. In this case, in order to allow the other users U2 and U3 to appreciate the work and walking in the CG image of the user U1, it is necessary to display the image of the user U1 together with the image of the house Z on the screen 8 as a CG image. As shown in FIG. 10, it is necessary to take a three-dimensional photograph of the user U1 using the three-dimensional camera 44 in advance and load the three-dimensional image data into the workstation 15.

At this time, shooting by the three-dimensional camera 44
The image data is taken not only from the front of the user U1 as the subject, but also from a plurality of directions (preferably at least four directions) such as the left and right sides and the back, and image data of the photographed directions is input to the workstation 15 via the connection line 45. Then, these image data are pasted together at the workstation 15 to create three-dimensional image data representing the whole body of the user U1. Since the image of the user U1 and the image of the house Z need to be displayed on the screen 8 at the same scale, if the three-dimensional camera 44 does not have a function of measuring the body dimensions of the user U1, the height of the user U1 ( cm) into the workstation 15 using the keyboard 18.

When the user U1 virtually works or walks in the CG image, the user U1 captures the three-dimensional image data of the user U1 into the workstation 15, and then, as shown in FIG. The mold detection device 38 is mounted. In this state, when the operator O switches the display mode of the screen 8 and the CRT 17 from the normal mode in which only the house Z is displayed to the user participation mode, an image of the user U1 is displayed on the screen 8 and the CRT 17.

The switching of the display mode can be performed, for example, by the operator O pressing a predetermined key 18b on the keyboard 18. The initial display position of the image of the user U1 on the screen 8 and the CRT 17 is set at the center position of the screen 8 and the CRT 17 here. For example, when the kitchen K is displayed on the screen 8 in the above-described walk-through, and the user U1 is to be displayed in the kitchen K,
When the user presses the key 18b after adjusting using the cursor key 18a and the mouse 19 so that the position where the user U1 is to be displayed is at the center of the screen, the user U1 is positioned at the center of the screen 8 as shown in FIG. Image U1a
(Person image) is displayed.

The image U1a of the user U1 is combined with the image of the kitchen K by the workstation 15 based on the three-dimensional image data photographed by the three-dimensional camera 44 and displayed as a CG image. Other users U2, U3
Is wearing the liquid crystal shutter glasses 60, the image U1a of the user U1 is also recognized as a three-dimensional image.

Here, the orientation of the image U1a on the screen 8 is determined by the actual user U1 in the display room 1
Is adjusted by the workstation 15 so as to be in the direction projected on the plane including. For example, as shown in FIG. 25, when the real user U1 is facing left with respect to the plane including the screen 8, the image U1a of the user U1 is displayed on the screen 8 so as to face left. like,
When the plane including the screen 8 and the back of the user U1 are parallel, the back of the user U1 is displayed as the image U1a on the screen 8. Note that the actual body orientation of the user U1 is detected by the detection sensor 50 on the HMD 37 and input to the workstation 15.

As described above, when the real user U1 rotates around the vertical axis in the display room 1, the image U1a of the user U1 is displayed on the screen 8 so as to rotate accordingly. When U1 walks back and forth and left and right in the display room 1, the movement of the position of the user U1 is detected by the detection sensor 50 on the HMD 37 or the spatial position / posture detection sensor 54 on the glove type detection device 38, and the image is accordingly displayed. U
Dynamic display is performed so that 1a moves on the screen 8 in response to the actual movement of the user U1. In addition, when the real user U1 moves his / her hand or finger, the movement is detected by the glove-type detection device 38, and a display is performed so that the hand or finger of the image U1a on the screen 8 moves. The image U1a of the user U1 on the screen 8
Is displayed in a state where the HMD 37 and the glove type detection device 38 are not mounted, based on the three-dimensional image data input from the three-dimensional camera 44.

On the other hand, for the user U1 himself, the HMD
37, the situation in the kitchen K is displayed by a CG image. In this case, the viewpoint position of the CG image is the viewpoint position of the user U1, and the CG displayed on the screen 8
The viewpoint position differs from the viewpoint position of the image (set by the operator O using the cursor key 18a and the mouse 19 of the workstation 15 as described above). That is, assuming that the CG image displayed on the screen 8 in FIG. 25 is the first CG image, what is displayed by the HMD 37 is the second CG image having a different viewpoint position, and this second CG image Displays the view seen by the user U1 when it is assumed that the user U1 is standing at the position of the image U1a in the first CG image in the direction of the image U1a.

When the CG image of FIG. 25 is displayed on the screen 8, the HMD 37 worn by the real user U1
FIG. 26 shows the CG image displayed on the screen. As described above, the workstation 15 uses the screen 8 and the HMD 3
The two types of CG images having different viewpoint positions for 7 are generated in real time, and when one CG image is changed, the other CG image is changed correspondingly. In that case, HM
The initial image (the image in FIG. 26) displayed on D37 is the display content of the screen 8 at the time when the display mode of the CG image (FIG. 25) on the screen 8 is switched to the user participation mode and the time. And the real user U1
Is automatically determined depending on which direction is facing. Note that the viewpoint position (the direction of the line of sight) of the user U1 for generating the CG image for the HMD 37 is detected by the detection sensor 50.

The user U1 receives the CG displayed on the HMD 37.
While looking at the image, walking and work can be performed in the same manner as when actually in the kitchen K. For example, when the user U1 wants to reach for the shelf 61 in the CG image, the user U1 changes from the state shown in FIGS.
27 changes the body orientation, the orientation of the image U1a on the screen 8 is changed as shown in FIG.
As shown in FIG. 8, the HMD 37 worn by the user U1
Are switched according to the movement of the head of the user U1, and the shelf 61 is displayed diagonally above.

As shown in FIG. 27, when the real user U1 reaches his hand diagonally upward while the shelf 61 is displayed while watching the display contents of the HMD 37, the image U1a on the screen 8 is correspondingly displayed. Also, the situation where the hand of the user U1 extends obliquely upward toward the shelf 61, and the CG image showing the hand 62 of the user U1 extends obliquely upward is displayed on the HMD 37 as shown in FIG. In the display of the CG image for the HMD 37 by the workstation 15, the head of the user U1 is not normally displayed as in the case of observing the outside world with the naked eye. , According to the direction of the line of sight of the real user U1.

When the user U1 wants to open the door 61a of the shelf 61, he or she virtually picks up the handle 61b displayed on the HMD 37 and pulls it toward the user. As shown in FIG.
The state in which the door 61a is opened is displayed above, and FIG.
As shown in FIG.
In this way, the user U1 virtually enters the CG image and reaches for the shelf 61 of the kitchen K, for example, to determine whether the height of the shelf 61 is appropriate. Can be performed, and when he is in the kitchen K
By walking back and forth and right and left while looking at the CG image displayed on the MD 37, it is possible to more accurately determine whether or not the size of the kitchen K is appropriate, and at the same time, the other users U2 and U3 can use the screen. By observing the movement of the user U1 while watching the CG image displayed on the
Can be determined whether or not the configuration is appropriate.

Note that even when the image U1a of the user U1 is displayed on the screen 8, the operator O operates the cursor key 18a or the mouse 19 to
Walk-through can be performed as described above.
When ending virtual work or walking in the CG image, when the operator O presses the key 18b again,
The image U1a of the user U1 is deleted from the screen 8, and only the house Z (kitchen K) is displayed as a CG image.

The above-described work or walking in the CG image can be performed in a room other than the kitchen K or outside. For example, when a child room is displayed in a walk-through, a user who is a child For example, the user U who frequently uses each room or place can perform virtual work or walking in the CG image, such as U2 performing work or walking in the CG image. In this case, if the user wears only the glove type detection device 38 in addition to the HMD 37, the dissatisfaction that the movement of the image of the user U displayed on the screen 8 is limited to the degree of the rotation of the body about the vertical axis and the movement of the hand is dissatisfied. However, for example, by using a data suit 63 (for example, manufactured by VPL) as shown in FIG. 31, the movement of each part of the body is detected, and the workstation 15 performs a predetermined calculation accordingly. The image of the user U on the screen 8 can also be displayed so that each part of the body moves. Note that the data suit 63 has a part of the sensor shown in FIG.
About ten tens of motion detection sensors 63b are mounted on a suit body 63a covering the whole body other than the head of the user U.

A motion capture device (for example, Moti
OnHis (trade name) manufactured by On Analysis Co., Ltd.), the movement of each part of the body is detected without restricting the body by the suit body 63a, as in the case of wearing the data suit 63, and the screen 8 The image of the user U can be displayed so as to move.

In the above description, the screen 8 and the CRT
When the display of the image of the user U on the display unit 17 is started, the image of the user U is set to be automatically inserted in the center of the screen. By using an input device other than the mouse 19 such as a joystick, the operator O can set the initial display position of the image of the user U to an arbitrary position (for example, the right corner or the left corner of the screen) with the mouse 19.

In the above embodiment, when the image of the user U is displayed on the screen 8, the movement of the body of the user U is detected by the glove type detection device 38 or the like, and the image of the user U is displayed so as to move. However, the image of the user U may be displayed on the screen 8 in a fixed state (immobile state). Even in this case, the image of the user U is displayed at the same scale as the house Z, It can be used as a guide to determine the height and size of each part of the house. Instead of displaying the image of the user U itself, for example, an image of a model, a character, or the like stored in advance in the workstation 15 is displayed in a fixed state, for example, while clearly indicating body dimensions as necessary. Is also good. When displaying images of a house and a user as a two-dimensional image, a two-dimensional digital camera can be used in place of the three-dimensional camera 44 for capturing an image of the user. Further, the display method of the present invention can be applied to various buildings other than houses, such as office buildings.

As the display device, the projection is performed from the rear projection room 7 using the screen 8, but the projection room 7 may be omitted and the display on the screen 8 may be performed from the display room 1. Alternatively, a large-screen high-vision television or the like may be used as a display device instead of the screen 8. In addition to the above-described walk-through, in addition to the display room 1 provided in a home building company or the like, for example, the walk-through can be performed using a personal computer at the user's home. CAD
The data, walk-through program, etc. may be recorded in advance by a housing construction company or the like on an appropriate recording medium such as a CD-ROM or MO (magneto-optical) disk and distributed to the user. If the image of the user is to be displayed in a fixed state, the image of the user is photographed by a home building company or the like and recorded on the recording medium, or the user himself is photographed by a digital camera and the personal computer Should be entered.

[0067]

According to the first aspect of the present invention, there is provided a method for displaying a building by using a CG image, wherein three-dimensional shape data relating to the building is created in advance and stored in a computer, and a viewpoint position with respect to the three-dimensional shape data is determined. In the method of displaying a CG image related to a building in which the building is displayed as a still image or a moving image by a CG image by moving the building in a desired or stationary direction, a person image is captured in advance, and this person image is taken. Since the same scale as the building is displayed in the CG image, the CG
There is an advantage that the size of each room, the height of each part such as a ceiling, a shelf, and the like can be more accurately grasped by using the size of a human image displayed in the image as a guide, and the CG image has an advantage. By displaying a human image on the screen, an impression closer to a real living space can be given.

According to a second aspect of the present invention, there is provided a method for displaying a building by using a CG image, wherein the building is a building to be built by a specific user, and the person image is a photograph of the user. In addition to the advantages of claim 1, the user can experience the same experience as actually walking inside and outside a house he or she intends to build, and can plan the layout and increase the size of each room. It is possible to accurately determine whether or not the degree is appropriate.

A display method of a building by a CG image according to claim 3 is the display method according to claim 1 or 2, wherein
Since the image is a three-dimensional image, it can be displayed more realistically than when displaying the above-mentioned building as a two-dimensional image. Be able to judge.

According to a fourth aspect of the present invention, there is provided a method for displaying a building based on a CG image according to the second or third aspect, wherein the movement of the user's body is detected and the CG image in the CG image is detected in accordance with the detected movement of the body. Since the display is performed so that the user's image moves, there is an advantage that the depiction of the person in the CG image is further enhanced.

According to a fifth aspect of the present invention, there is provided a method of displaying a CG image relating to a building according to the fourth aspect of the present invention, wherein the user wears a head-mounted display and looks at the CG image of the building with the head-mounted display. The CG image is displayed on a display device other than the head mounted display so that the image of the user moves in accordance with the movement of the body of the user while moving the body of the user. When an operation of reaching for the shelf is performed while looking at the shelf in the CG image on the display, the movement is detected and the movement of the user's hand is displayed on the other display device,
The user himself / herself can use the head mounted display to check whether the height of the shelf is appropriate or not while viewing a CG image representing his / her hand.

The recording medium of claim 6 is a computer-readable recording medium that records a program for causing a computer to execute the method of displaying a building by a CG image according to any one of claims 1 to 5. By installing the program from the recording medium into the computer, the computer can execute the useful building display method described above.

[Brief description of the drawings]

FIG. 1 is a schematic horizontal sectional view showing a display room and a projection room for displaying a CG image according to the method of the present invention.

FIG. 2 is a perspective view showing a state where the display chamber is viewed from the rear.

FIG. 3 is a perspective view showing a state where the display chamber is viewed from the front.

FIG. 4 is a perspective view showing a corner where a workstation in the display room is installed.

FIG. 5 is a perspective view showing the input / output and arithmetic unit of the workstation in a see-through state.

FIG. 6 is a block diagram showing the input / output and arithmetic unit.

FIG. 7 is a side view showing a head mount display used when a user virtually enters the CG image and performs work or the like.

FIG. 8 is an explanatory view showing the operation principle of the head mount display.

FIG. 9 is a perspective view showing a glove type detection device used with the head mounted display.

FIG. 10 is a perspective view showing a state in which a three-dimensional photograph of a user is taken using a three-dimensional camera.

FIG. 11 is a flowchart showing a procedure for creating three-dimensional shape data relating to a house with a CAD system prior to creation and display of a CG image according to the present invention, and then converting the data into a state readable by rendering software.

FIG. 12 is a plan view showing the first floor of a two-story house created by a CAD system prior to the display of the CG image.

FIG. 13 is a plan view showing the second floor of a two-story house created by the CAD system.

FIG. 14 is a perspective view of a two-story house created by the CAD system.

FIG. 15 is a north elevation view of a two-story house created by the CAD system.

FIG. 16 is a west elevation of a two-story house created by the CAD system.

FIG. 17 is an explanatory diagram showing a procedure for creating a material information file used when performing shape conversion by automatic processing.

FIG. 18 is a front view showing a main part of the workstation.

FIG. 19 is a front view showing a screen displaying a house as a CG image with shading by the method of the present invention.

FIG. 20 is a front view showing a screen displaying the indoors of the house by a CG image.

FIG. 21 is a partial front view showing a screen on which a Western room in the house is displayed by a CG image.

FIG. 22 is a partial front view showing a screen on which the kitchen in the house is displayed by a CG image.

FIG. 23 is a partial front view showing a screen on which a bathroom in the house is displayed by a CG image.

FIG. 24 is an explanatory diagram showing the principle of obtaining a three-dimensional image using liquid crystal shutter glasses.

FIG. 25 is an explanatory diagram showing a state in which a user's image is displayed as a CG image together with the kitchen on the screen of the display room.

FIG. 26 is an explanatory diagram showing a state in which the situation in the kitchen is displayed as a CG image using the head mounted display worn by the user.

FIG. 27 is an explanatory diagram showing a CG image displayed on the screen when the user changes the body orientation in FIG. 25;

FIG. 28 is an explanatory diagram showing a CG image displayed on the head mount display corresponding to the display of FIG. 27;

FIG. 29 is an explanatory diagram showing a CG image displayed on the screen when the user has virtually opened the shelf door;

FIG. 30 is an explanatory view showing a CG image displayed on the head mount display corresponding to the display of FIG. 29;

FIG. 31 is a schematic perspective view showing a data suit worn by the user on the whole body.

FIG. 32 is an explanatory diagram showing the arrangement of sensors on the data suit.

[Explanation of symbols]

 15 Workstation (computer) 37 Head-mounted display U1 User U1a User's image (portrait) Z House (building)

──────────────────────────────────────────────────の Continued on the front page (51) Int.Cl. ⁶ Identification code FIG06F 15/60 680B

Claims (6)

[Claims] 1. A three-dimensional shape data relating to a building is created in advance and stored in a computer, and the viewpoint is stationary or moved in a desired direction with respect to the three-dimensional shape data. In a method of displaying a building using a CG image that is displayed as a still image or a moving image, a person image is captured in advance, and this person image is displayed in the CG image at the same scale as the building. A method for displaying a building by using a CG image. 2. The building according to claim 1, wherein the building is a building that a specific user intends to build, and the person image is an image of the user. Display method. 3. The method according to claim 1, wherein the CG image is a three-dimensional image. 4. The apparatus according to claim 2, wherein the movement of the user's body is detected, and display is performed such that the image of the user in the CG image moves according to the detected movement of the body. How to display buildings using CG images. 5. The user wears a head-mounted display, moves his / her own body while looking at a CG image of the building using the head-mounted display, and displays the image of the user in accordance with the movement of the user's body. The method for displaying a building according to a CG image according to claim 4, wherein the CG image is displayed on a display device other than the head mounted display so as to move. 6. The C according to claim 1, wherein
A computer-readable recording medium in which a program for causing a computer to execute a method of displaying a building using a G image is recorded.