JP2006065888A - Image display apparatus and method, and information providing apparatus and method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To realize an image display apparatus and its method which can display image of three dimensional virtual reality world with user interface that a user uses easily, and an information providing apparatus and its method to provide information to make it display in the image display apparatus. <P>SOLUTION: In the inside of a three dimensional virtual reality world, an image where a shop 302 is diagonally located for the direction of user's glance is displayed on the display; and if a user moves a pointer of a pointing device to the position of pointer 201 in the image and directs it, the user inside the three dimensional virtual reality world automatically performs moving action to the position in which just before the shop 302, that is, the shop 302 becomes the center of view. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image display apparatus and method for displaying an image in a three-dimensional space, and an information providing apparatus and method for providing information to be displayed on the image display apparatus.

  In recent years, a server computer, which is a central information processing apparatus, and a client computer, which is an information processing apparatus of a user terminal such as a home, are connected using a cable, a telephone line, a network, or the like. Information is provided on a display device capable of displaying a graphic on the client computer side when performing an information providing service for providing information to the user client computer or searching for information in the server computer on the user client computer The virtual reality world (virtual reality) is displayed in three dimensions as a conceptual model or metaphor expression of the service, and the user can use the information providing service or perform a search in a form close to the real world. can do.

  For example, in general, in an information navigation system using a three-dimensional space representation, service contents and components can be three-dimensionally represented in a form resembling the real world as compared to a two-dimensional space representation. The advantage is that when the user accesses the information navigation system, a friendly impression is given to the user.

  Specifically, in the 3D virtual reality world, there are various objects and facilities such as desks, product shelves, televisions, doors, etc., and the user can use a mouse, a trackball, a keypad, etc. By using a pointing device as an operation device, the movement direction in the three-dimensional virtual reality world is instructed, and the object moves around the represented three-dimensional virtual reality world to move objects and equipment inside the three-dimensional virtual reality world. To work on.

  Here, specifically, FIG. 9 shows a two-dimensional image of the inside of a certain three-dimensional virtual reality world as seen from above. In this three-dimensional virtual reality world, there are a plurality of stores 301, 302, 303, 304, 305, 306 for obtaining various information providing services on both sides of the user. The door is visible. The user proceeds in a straight line between the plurality of stores.

First, a user is stopped at the point 309 _1. The user's viewpoint is indicated by a solid arrow, and the user's movement is indicated by a dotted arrow.

In this respect 309 _1, the user may forward, are set so as to be able to move leftward, or in either direction in the right direction. The user sees the image at point 309 _1, are displayed on the display 20, an image shown in FIG. 10. The user can see the stores 301, 302, 303 on the left and the stores 304, 305, 306 on the right.

  In the image of FIG. 10, the user moves the pointer using a pointing device to one of the positions indicated by the forward arrow pointer 401, the left arrow pointer 402, and the right arrow pointer 403. The following operations can be performed by instructing.

Here, the user, for example, when the user clicks at the position of the pointer 402 on the left side of the arrow, moves to 309 point ₂ shown in FIG. An image viewed by the user at this time is shown in FIG. The user stands at a position away from the store 302, and the user's line of sight faces the store 302. Thus, you will see two on more 5 specialty stores 301,302,303,307,308 than the number of left shop seen at point 309 _1. Direction can move the point 309 _2, the pointer 404 before the direction of the arrow in the image of FIG. 11, the pointer 405 in the left direction of the arrow, is any direction indicated by the pointer 406 in the right direction of the arrow. User, in the image of FIG. 11, by moving the pointer, when indicating the position of the pointer 404 in the front direction of the arrow, moves to the point 309 ₃ of FIG. 9, the position of the pointer 405 in the left direction of the arrow when instructed, go to point 309 ₄ of FIG. 9, when indicating the position of the pointer 406 in the right direction of the arrow will move to the point 309 ₅ of FIG.

In the image of FIG. 11, the user sees the image when the user stops moving the point 309 ₃ indicate the position of the pointer 404 in the forward direction of the arrows are shown in FIG. 12. The point 309 _{3 at} this time is immediately before the store 302, and the three stores 301, 302, and 303 are seen. In this image, the pointer 409 indicating that opening the door of the store 302, the pointer 407 in the left direction of the arrow, and returns to the pointer 408, and the original of the standing point 309 ₂ position in the right direction of the arrow (zoom back) that It is possible to instruct by moving the pointer to any position of the pointer 410 indicating. If the position of the pointer 409 is indicated, the service contents of the store 302 can be accessed.

  Patent document 1 is known as a prior art.

Japanese Patent Application Laid-Open No. 07-098640

  By the way, in the above-described three-dimensional virtual reality world, there is a problem in the user's actual usability and the interface to the user because of trying to faithfully represent the real world.

  With regard to the movement of the user when moving around in the 3D virtual reality world, the user can freely move in the direction desired by the user, so it can be seen in which direction the object or equipment exists. It becomes difficult.

  In addition, when the user moves to a position not intended by the creator within the 3D virtual reality world, the field of view that the user is viewing becomes difficult to understand, and the direction to go next Difficult to distinguish.

  In addition, since the three-dimensional virtual reality world is displayed on a two-dimensional display device, a so-called CRT display, operations in the vertical and horizontal directions (X axis, Y axis) can be easily performed. Operation in the (axis) direction is very difficult in terms of expression and operation.

  As described above, there are a mouse, a trackball, a keypad, and the like as operation devices used for moving in the three-dimensional virtual reality world represented by the two-dimensional display device. However, it is not possible to freely control all elements like human limbs. Therefore, in a simulation game or the like, it is necessary to be very proficient in order to freely control the moving direction of the moving object using the operation device described above and to maintain a stable posture, viewpoint, and movement. In games, you can enjoy until you get used to it, but if you need an interface that many users can use as easily as possible, such as information provision services, it is easy even for first-time users. Need to be able to be used.

  Therefore, in view of the above situation, the present invention provides an image display device and method for displaying a 3D virtual real world image of a user interface that is easy for a user to use, and information to be displayed on the image display device. Providing an information providing apparatus and method therefor.

  The image display apparatus and method according to the present invention displays a three-dimensional image on the display means, and the object is viewed when the line-of-sight direction is inclined at a predetermined angle with respect to the user's traveling direction in the three-dimensional space. When the image is displayed on the display means and the instruction means indicating the position in the image displayed on the display means indicates the object displayed on the image or a pointer corresponding to the object, The above-described problem is solved by displaying the object so as to continuously move while changing the viewpoint position of the user to the position where the object is in the center of the user's field of view.

  The information providing apparatus and method according to the present invention also read at least image data and three-dimensional coordinate data for displaying the image data as a three-dimensional image from a storage unit in response to a request, and transmit the data to the image display apparatus. In the above image display device, if an object in the three-dimensional space displayed with the line-of-sight direction tilted by a predetermined angle with respect to the user's traveling direction or a pointer corresponding to the object is designated, the object is displayed. The image data required for controlling the display means so as to continuously move while changing the user's viewpoint position to a position that becomes the center of the user's field of view and the three-dimensional coordinate data corresponding to the image data are stored in the memory. The above-described problems are solved by reading from the means and transmitting to the image display device.

  According to the image display device and the method thereof according to the present invention, it is possible to display an image automatically operated on the object, and to perform one operation without performing a continuous operation with the instruction unit. Can automatically operate inside the 3D virtual reality world, so that it can easily operate on the object without being troubled by fine operations such as posture maintenance inside the 3D virtual reality world. Can do. Therefore, the physical burden on the user is reduced, and it is not necessary to become familiar with the operation of the pointing means such as a mouse. In addition, since the depth direction of the three-dimensional space can be easily expressed, the amount of software data for controlling the movement in the depth direction can be reduced, and the user can reduce the depth direction of the three-dimensional space in the image. Can be easily moved. Thereby, the user interface for the three-dimensional virtual reality world can be made easy to use.

  In addition, according to the information providing apparatus and the method thereof according to the present invention, an image automatically operated on the object can be displayed on the image display apparatus, and a continuous operation is performed on the image display apparatus. At least one operation can be automatically performed inside the three-dimensional virtual reality world, so it is easy without being bothered by detailed operations such as posture maintenance inside the three-dimensional virtual reality world. An operation on the object can be performed. Therefore, the physical burden on the user of the image display device is reduced, and it is not necessary to become familiar with the operation of the pointing means such as a mouse. In addition, since the depth direction of the three-dimensional space can be easily expressed, the amount of software data for controlling the movement in the depth direction can be reduced, and the user of the image display apparatus can The moving operation in the depth direction of the space can be easily performed. In addition, the user interface for the three-dimensional virtual reality world can be made easy to use.

  Hereinafter, specific embodiments to which the present invention is applied will be described in detail with reference to the drawings.

  First, before describing the specific contents of the present invention, an overall system including the image display apparatus and the information providing apparatus of the present invention will be described with reference to FIGS.

  In FIG. 1, a client computer 2 includes, for example, a service management server 13, a video server 12, and a service AP on the service supply side via a large-scale ATM network 3, a transfer conversation device 4, and an FDDI (Fiber Distribution Data Interface) interface 5. (Application) Connected to the server 14. The ATM is an asynchronous transfer mode. In the ATM, the fixed-length data is divided into 48-byte units regardless of the type of data, and a 5-byte header is added to the fixed-length data to generate 53 bytes. Cell is created and switching is performed on a cell-by-cell basis. The ATM network 3 is characterized by being able to transfer voice, video, and computer data in a mixed manner. The FDDI is a 100 Mbit / sec token passing system medium access system using an optical fiber.

  The video server 12 includes a server computer 7 and a data storage device 6 made of, for example, a hard disk or an optical disk, and the digital video data processed into a format such as MPEG described later is stored in the data storage device 6. The digital video data corresponding to the request from the client computer 2 is read from the data storage device 6 of the video server 12 and transferred.

  The service AP server 14 also includes a server computer 11 and a data storage device 10. The data storage device 10 stores data and scripts that are the basis of a three-dimensional image as application (AP) program data. The application program data corresponding to the request from the client computer 2 is read from the data storage device 10 of the service AP server 14 and transferred.

  The service management server 13 also includes a server computer 9 and a data storage device 8. The service management server 13 manages the video server 7 and the service AP server 11 as well as the correspondence with the client computer 2.

  A plurality of video servers 12 and service AP servers 14 can be provided, and the servers 12, 13, and 14 can be combined into one server.

  The request from the client computer 2 transferred through the ATM network 3 is sent to the above-described device via the FDDI interface 5 and a device called a transfer conversation device 4 that performs protocol conversion, automatic data distribution, data transfer rate conversion, and the like. It is transmitted to the server side.

  Data sent from the server side in response to a request from the client computer 2 is processed for display by the client computer 2 and displayed on the display of the monitor device 1, thereby a user interface using a graphic display. (Graphical user interface: hereinafter referred to as GUI) is constructed. Therefore, the user can perform an operation or receive a service while viewing the display on the display of the monitor device 1.

  Next, the configuration of the client computer 2 shown in FIG. 1 is as shown in FIG.

  In FIG. 2, an EISA board 36 is a board for connecting the client computer 2 and the ATM network 3, and a signal supplied to the EISA board 36 via the ATM network 3 is recorded / reproduced by the processing unit 41. Is temporarily stored in the controlled hard disk 43 and then read out according to the type of data and sent to the corresponding three-dimensional rendering engine 34, MPEG2 decoder 35, PC audio decoder 39, MPEG2 audio decoder 40, etc. .

  The 3D rendering engine 34 is a coordinate converter that converts 3D coordinate data of a 3D object into data (image data in a virtual reality space in 3D) for display on the display 20 of the monitor device 1. This is for constructing a GUI according to the application.

  The MPEG2 decoder 35 is a decoder that decompresses data compressed according to the MPEG2 standard. Note that MPEG (Moving Picture Image Coding Experts Group: a study organization for storing moving image coding) 2 is an international standard for moving image compression / decompression technology.

  In the RGB mixer 33, the data from the 3D rendering engine 34 and the data from the MPEG2 decoder 35 are data composed of R (red), G (green), and B (blue) of the three primary colors. , G, and B are generated.

  The NTSC encoder 32 converts the data from the RGB mixer 33 into an NTSC television standard signal. The video signal from the NTSC encoder 32 is displayed on the display 20 of the monitor device 1. 2, a pointer (cursor) 22 by a pointing device, an image 23 obtained by decoding MPEG2, and an image for GUI by a 3D rendering engine 34 (for example, three-dimensional or two-dimensional) The image 21) is displayed. The MPEG2 image and the GUI image can be combined and displayed.

  On the other hand, the PC audio decoder 39 generates, for example, sound effects using an ADPCM sound source. The MPEG2 audio decoder 40 expands MPEG2 compressed audio data. The data from the PC audio decoder 39 and the data from the MPEG2 audio decoder 40 are mixed by the audio mixer 38 to be an audio signal, and the audio signal is sent to the speaker 30. As for the sound output from the speaker 30, stereo sound or multi-channel sound is desirable. Recently, even for stereophonic sound, a system that can control a sound image in a three-dimensional manner by controlling the phase difference of sound has appeared, and these can be used.

  The GUI operation on the display 20 is performed based on point (instruction) information transmitted from a wireless mouse 31 as an example of a pointing device. The point information transmitted from the wireless mouse 31 is received by the wireless tuner 37, and the received pointer information is sent to the processing unit 41. The pointing device is not limited to the wireless mouse 31, and various devices such as a normal mouse, a trackball, a keypad, a joystick, and a touch panel whose coordinate position corresponds to the display 20 can be used. .

  The processing unit 41 includes a CPU (central processing unit), and is based on program data held in the program ROM in the memory 42 having a function as a program ROM and work RAM, via a bus (EISA BUS). While controlling each component, it controls to GUI based on the instruction information from the said wireless mouse 31, and communicates with a server computer as needed. 2 shows an example in which the 3D rendering engine 34, the MPEG2 decoder 35, and the like are provided as independent chips. The processing unit 41 performs various signal processing using these as software. It is also possible.

  The specific operation of providing the service online to the user when using the system of FIGS. 1 and 2 as described above will be described below.

  First, the user uses the pointing device of the client computer 2 to instruct the connection between the client computer 2 and the server-side computer (in this case, the computer 9 of the service management server 13) on the network.

  When the computer 9 of the server-side service management server 13 is connected on the network and supplied with a request from the client computer 2, the computer 9 controls the video server 12 and the service AP server 14 in response to the request. The following data and software are transferred to the client computer 2. That is, for example, a script that describes the behavior of the virtual reality world, three-dimensional coordinate data of the virtual reality world, audio data of the virtual reality world, a script that describes options to be instructed to the user from the client computer 2, and other processing Various data necessary for the transfer.

  The client computer 2 presents the virtual reality world based on the data and software received from the server side to the user by using the screen of the display 20 of the monitor device 1 or a speaker as necessary.

  While viewing the virtual reality world presented on the client computer 2, the user uses a pointing device to instruct the moving direction and the like to trick the inside of the virtual reality world, and operates the operation buttons and the like to inside the virtual reality world. Work on the object or facility.

  The client computer 2 responds to the user's operation by the viewpoint position, the line-of-sight direction, the sound, and the action or behavior of the object inside the virtual reality world according to the script, as if the user has entered the virtual reality world. In addition, the virtual reality world is presented to the user using the display 20 and the speaker of the monitor device 1. Also, according to the description of the script, the user is provided with various information, remarks, orders for articles, and the like.

  An image display apparatus according to the present invention is provided in the client computer 2 described above, and indicates a monitor apparatus 1 that is a display means for displaying a three-dimensional image, and a position in the image displayed on the monitor apparatus 1. And controlling the wireless mouse 31 to display an image when the object in the three-dimensional space is viewed at a predetermined angle on the monitor device 1 and displaying it in the image by the wireless mouse 31. A processing unit 41 which is a control means for controlling to automatically display an image on the monitor device 1 until the operation is stopped by automatically performing an operation according to the object. It is prepared.

  In order for the user to move inside the three-dimensional virtual reality world using the image displayed by the image display device described above, a plurality of points that can stop inside the three-dimensional virtual reality world are determined in advance. Yes. These multiple points are called standing points. The user operates the wireless mouse 31 that is a pointing device to indicate a desired position or object in an image displaying the 3D virtual reality world, so that the user stands at one standing point inside the 3D virtual reality world. Move and stop. The user moves around in the three-dimensional virtual reality world by moving a plurality of standing points. In this way, an image viewed by the user when moving inside the three-dimensional virtual reality world is displayed on the display image device.

  Here, the standing point will be specifically described with reference to FIG.

  3A shows a three-dimensional image when the product shelves 51 and 52 in the store in the three-dimensional virtual reality world are viewed obliquely, and FIG. 3B shows when the product shelves 51 and 52 are viewed from above. The two-dimensional image is shown. 3A and 3B, standing points 61, 62, 63, 64, and 65 indicated by a plurality of black circles that can move with respect to the product shelves 51 and 52 in the store are shown. The user's line-of-sight direction at points 61, 62, 63, 64, and 65 is indicated by solid arrows.

  When moving from one standing point to another standing point, as will be described later, a standing point that can be moved next is determined as operation information of the standing point. That is, the user can move only to a standing point that can be moved next based on the operation information set to the certain standing point, and the other point, that is, the three-dimensional virtual reality world. It is impossible to move to a place where no standing point is provided. Specifically, in the three-dimensional virtual reality world of FIG. 3, when the user is at the standing point 62, the user can move only to the standing point 61 or the standing point 63. Further, when at the standing point 64, it can move only to the standing point 63 or the standing point 65.

  In addition, there is a case where a point to be passed, that is, a passing point is predetermined between the standing point and the standing point. This passing point is a point that indicates the position to pass and the line-of-sight direction at the time of movement between the two standing points, and cannot be stopped even if instructed by operating the wireless mouse 31. It is a point that passes in a short time. For example, in B of FIG. 3, passing points 71 and 72 indicated by two white circles are set between the standing point 64 and the standing point 65. When the user moves from the standing point 64 to the standing point 65 or moves from the standing point 65 to the standing point 64 in the store in the three-dimensional virtual reality world, the passing points 71 and 72 are surely required. Will go through. A plurality of pieces of information are set for these passing points 71 and 72 as well as the standing point, and the user's line-of-sight direction at the passing points 71 and 72 is indicated by a solid arrow.

  Information set for the standing point and the passing point includes position information, line-of-sight information, speed information, and motion information. The position information is a position value in the three-dimensional coordinate system. The line-of-sight information includes the line-of-sight direction, the roll angle of the line of sight, and the viewing angle, and the speed information includes the maximum value of the moving speed, the maximum value of the line-of-sight direction rotation angular speed, the maximum value of the line-of-sight roll angle rotation angular speed, And the maximum value of the viewing angle increase speed, and the operation information includes the operation state to be performed next.

  The roll angle corresponds to a rotation angle when an airplane or the like turns in a three-dimensional space, for example. The operation information is described in a script. Specifically, the user sees the wireless mouse in an image that the user sees when stopped at a certain standing point, that is, an image displayed on the display 20. This is the next operation that occurs when the pointer is moved by operating 31 and the position or object (object) is indicated and the button is clicked, and it moves to the next standing point within the 3D virtual reality world. This is information for opening the door and entering the store.

  Since there may be multiple standing points or passing points having the same information, a preset value (default value) is prepared for each information, or a certain standing point or passing point is prepared. If the information on the standing point or passing point that moves next is the same, the information on the standing point or passing point that inherits the information on a certain standing point or passing point and It may be used.

  Note that points inside the three-dimensional virtual reality other than the standing point and the passing point are obtained by interpolation.

  When moving from one standing point or passing point to the next standing point or passing point, the speed information set for a certain standing point or passing point is used. It moves linearly at a constant speed that does not exceed the maximum value, and rotates at a constant speed that does not exceed the maximum value of the rotational angular velocity for the line-of-sight direction. It rotates at a constant speed not exceeding, and the viewing angle increases at a constant speed not exceeding the maximum value of the viewing angle increase speed.

  Thereby, the movement operation from a certain standing point or passing point to the next standing point or passing point can be made smooth. That is, the image displayed on the display 20 is an image close to an image seen when the user actually performs a moving operation in the real world.

  Next, a user's operation and viewpoint in the three-dimensional virtual reality world will be described.

  First, a user's viewpoint (viewpoint) is demonstrated using FIG.

  Conventionally, when a user travels in a straight line between stores on both sides, the user's line-of-sight direction is the same as the traveling direction. In contrast, in the present invention, the line-of-sight direction has a predetermined angle with respect to the traveling direction of the user. The user 105 in FIG. 4 proceeds in the direction indicated by the arrow A. At this time, the line of sight of the user 105 is not set in the same direction as the traveling direction, and is set to be inclined to the store row by an angle θ. This angle θ is about 30 to 60 degrees. In the example shown in FIG. 4, the line of sight of the user 105 is inclined 30 to 60 degrees in the rows of stores 301, 302, 303, and 304, and this user 105 is in the range indicated by the field of view W.

FIG. 5 shows a two-dimensional image as viewed from above, with respect to the columns of the stores 301, 302, and 303 and the user's actions and line of sight. User, the first, is stopped at the standing position point 105 ₁ in FIG. The user's viewpoint is indicated by a solid arrow, and the user's movement is indicated by a dotted arrow.

The standing point 105 ₁ in the user sees the image is displayed on the display 20 is an image shown in FIG. The user can see the stores 301, 302, and 303.

  Here, the user moves the pointer of the wireless mouse 31 to any one of the forward arrow pointer 201, the left arrow pointer 202 or the store 301, the right arrow pointer 203 or the store 303. The following operations can be performed by clicking the button.

  Here, the pointer indicates what operation should be performed at the position where the shape (symbol) changes depending on the position in the image displayed on the display 20. That is, the navigation is performed for the operation at the position where the pointer exists depending on the shape of the pointer. When the button of the wireless mouse 31 is clicked at a certain position in the display 20, the operation state indicated by the shape of the pointer at that position is shifted. An area where the button of the wireless mouse 31 can be clicked in the image is set in advance. By moving the pointer into the area and clicking the button of the wireless mouse 31, control for the next operation is performed. A command is sent to the processing unit 41, and the next operation is performed under the control of the processing unit 41, and an image viewed by the user is displayed on the display 20 by this operation. Even if the pointer is moved to an area other than the preset area where the operation can be performed by clicking, the click cannot be performed by the control of the processing unit 41.

Clicking the button at the position of the pointer 201 in the front direction of the arrow, moves to the standing point 105 ₂ of FIG. That is, the moving operation is automatically performed to the position immediately before the store 302 where the store 302 is in the center of the field of view. When the button is clicked at the position of the left arrow pointer 202 or the store 301, the store 301 automatically moves to the position immediately before the store 301 at the center of the view, and the right arrow pointer 203 is moved. Alternatively, when the button is clicked at the position of the store 303, the store 303 automatically moves to a position immediately before the store 303 at the center of the field of view.

An image that the user sees in a standing point 105 ₂ shown in FIG. The image in FIG. 7 is the same as the image shown in FIG. Thus, in one movement, is the same position as the standing point 309 ₃ of FIG. 9, it is possible to automatically move to the standing position point 105 ₂ of FIG.

In the image of FIG. 7, a pointer 204 indicating the opening of a door of the store 302, the pointer 205 in the left direction of the arrow, the pointer 206 in the right direction of the arrow, and returns to the original standing point 105 ₁ position (zoom back The pointer can be moved to any position of the pointer 207 indicating that the button of the wireless mouse 31 is clicked. By clicking the button at the position of the pointer 204, the service contents of the store 302 can be accessed. It should be noted that when the pointer is moved to the position of the pointer 204, the service content explanation (preview) of the store 302 may be automatically performed with characters and video. Further, by performing a click of a button at the position of the pointer 207, when the zoom back to standing point 105 _1, since return to the original state even viewing direction, etc., the user sees the image is an image of FIG.

  As shown in this embodiment, the user in the three-dimensional virtual reality world is determined by determining a standing point or passing point in which position information, line-of-sight information, speed information, and motion information that the user can easily move are set. In addition, the interface in the 3D virtual reality world is easy to use, for example, by automatically operating the movement within the 3D virtual reality world while limiting the user's movement.

  Moreover, the depth direction can also be easily expressed by arranging and displaying the object (object) obliquely with respect to the user's line-of-sight direction. The operation with the wireless mouse at this time is simply moving the pointer to an appropriate position on the screen and clicking the button, moving the 3D virtual reality world as if turning the pages of a magazine, Information services can be provided.

  Such a display method is very effective not only when performing window shopping in front of a plurality of stores, but also when, for example, performing a news service in three dimensions. Specifically, for example, as shown in FIG. 8, television monitors 501, 502, 503, and 504 displaying the contents of news are displayed obliquely. In this case, the contents of news and the like can be almost understood from the video displayed on the television monitor, so that a more sensory operation can be realized.

  According to the embodiment of the present invention as described above, if the object in the image when the object in the three-dimensional space is viewed at a predetermined angle is indicated by the instruction means, By displaying on the display means the image until the corresponding operation is automatically performed and stopped, the image automatically operated on the object can be displayed.

  That is, the image display apparatus according to the embodiment of the present invention includes a display unit that displays a three-dimensional image, an instruction unit that indicates a position in the image displayed on the display unit, and an object in the three-dimensional space. When control is performed so that an image viewed at a predetermined angle is displayed on the display means, and the object displayed in the image is indicated by the instruction means, an operation corresponding to the object is automatically performed. Control means for controlling the display means to display an image until it is stopped on the display means, so that a three-dimensional virtual operation can be performed by one operation without performing a continuous operation by the instruction means. Since the operation can be automatically performed in the real world, the operation on the object can be easily performed without being troubled by a fine operation such as posture maintenance in the three-dimensional virtual real world. Therefore, the physical burden on the user is reduced, and it is not necessary to become familiar with the operation of the pointing means such as a mouse. In addition, since the depth direction of the three-dimensional space can be easily expressed, the amount of software data for controlling the movement in the depth direction can be reduced, and the user can reduce the depth direction of the three-dimensional space in the image. Can be easily moved. Thereby, the user interface for the three-dimensional virtual reality world can be made easy to use.

  The image display method in the embodiment of the present invention displays a three-dimensional image on the display means, displays an image when the object in the three-dimensional space is viewed at a predetermined angle on the display means, If the instruction means for indicating the position in the image displayed on the display means indicates the object to be displayed in the image, the operation corresponding to the object is automatically performed until the object is stopped. By displaying the image on the display means, it is possible to automatically perform the operation inside the three-dimensional virtual real world by one operation without performing the continuous operation by the instruction means. It is possible to easily perform an operation on an object without being bothered by detailed operations such as posture maintenance in the real world. Therefore, the physical burden on the user is reduced, and it is not necessary to become familiar with the operation of the pointing means such as a mouse. In addition, since the depth direction of the three-dimensional space can be easily expressed, the amount of software data for controlling the movement in the depth direction can be reduced, and the user can reduce the depth direction of the three-dimensional space in the image. Can be easily moved. Thereby, the user interface for the three-dimensional virtual reality world can be made easy to use.

  In the embodiment of the present invention, when the object in the image when the object in the three-dimensional space is viewed at a predetermined angle is indicated by the instruction means, the operation corresponding to the object is automatically performed. By displaying on the display means the image until the operation is stopped, the image automatically operated on the object can be displayed.

1 is a schematic configuration diagram of a system including a client computer including an image display device according to the present invention and a server which is an information providing device according to the present invention. It is a schematic block diagram of a client computer provided with the image display apparatus which concerns on this invention. It is a figure for demonstrating a standing point and a passing point. It is a figure for demonstrating a user's viewpoint. It is a figure for demonstrating a user's operation | movement and viewpoint in a three-dimensional virtual reality world. It is a figure which shows the image which a user sees. It is a figure which shows the image which a user sees. It is a figure which shows the schematic image when performing a news service. It is a figure for demonstrating the operation | movement and viewpoint of the conventional user in a three-dimensional virtual reality world. It is a figure which shows the image which a user sees. It is a figure which shows the image which a user sees. It is a figure which shows the image which a user sees.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Monitor apparatus, 2 Client computer, 3 ATM network, 4 Transfer conversation apparatus, 5 FDDI, 6, 8, 10 Data storage apparatus, 7, 9, 11 Server computer, 12 Video server, 13 Service management server, 14 Service AP server 20 display, 21 and 23 images, 22 pointers, 30 speakers, 31 wireless mouse, 32 NTSC encoder, 33 RGB mixer, 34 3D rendering engine, 35 MPEG2 decoder, 36 EISA board, 37 tuner for wireless mouse, 38 audio mixer, 39 PC AUDIO, 40 MPEG2 audio decoder, 41 processing unit, 42 memory, 43 hard disk, 51, 52 product shelf, 61, 62, 63, 64, 65 standing point, 71, 72 Point, 301, 302, 303, 304 shops, ₁₀₅ 1, 105 ₂ standing point, 201,202,203,204,205,206,207 pointer, 501, 502, 503 and 504 television monitor

Claims (8)

Display means for displaying a three-dimensional image;
Instruction means for indicating the position in the image displayed on the display means;
The display unit is controlled to display an image when the object is viewed with the line-of-sight direction tilted by a predetermined angle with respect to the traveling direction of the user in the three-dimensional space, and is displayed in the image by the instruction unit. If the pointer corresponding to the object or the object corresponding to the object is designated, the display unit is controlled so as to continuously move while changing the viewpoint position of the user to a position where the object is in the center of the user's field of view. And an image display device.   2. The image display apparatus according to claim 1, wherein the control means controls to automatically display an explanation of the contents of the service to be provided when the instruction means moves to a predetermined position. Display a three-dimensional image on the display means;
Displaying an image on the display means when the object is viewed by tilting the line-of-sight direction by a predetermined angle with respect to the traveling direction of the user in the three-dimensional space;
If the instruction means for indicating the position in the image displayed on the display means indicates the object displayed in the image or a pointer corresponding to the object, the object is positioned at the center of the user's field of view. An image display method comprising: displaying a user's viewpoint position so as to continuously move to a certain position.   4. The image display method according to claim 3, wherein when the instructing means moves to a predetermined position, an explanation of the contents of the provided service is automatically displayed. Storage means storing at least image data and three-dimensional coordinate data for displaying the image data as a three-dimensional image;
Control means for controlling the image data and the three-dimensional coordinate data to be transmitted to the image display device in response to a request;
The control means, in the image display device, if an object in a three-dimensional space displayed with the line-of-sight direction tilted by a predetermined angle with respect to the user's traveling direction or a pointer corresponding to the object is indicated, Image data required to control the display means so that the object moves continuously while changing the viewpoint position of the user to a position where the object is in the center of the user's field of view, and three-dimensional coordinates corresponding to the image data An information providing apparatus that controls to transmit data to the image display apparatus.   The control means automatically displays the image data necessary for displaying an image until it moves to a position opposite to the object and stops, and three-dimensional coordinate data corresponding to the image data. 6. The information providing apparatus according to claim 5, wherein the information providing apparatus is controlled so as to be transmitted to the apparatus. At least the image data and the three-dimensional coordinate data for displaying the image data as a three-dimensional image are read from the storage unit in response to the request and transmitted to the image display device.
In the image display device, if an object in the three-dimensional space displayed with the line-of-sight direction tilted by a predetermined angle with respect to the user's traveling direction or a pointer corresponding to the object is designated, the object is Image data required for controlling the display means so as to continuously move while changing the viewpoint position of the user to a position that becomes the center of the field of view, and the three-dimensional coordinate data corresponding to the image data. And providing the information to the image display device.   Automatically transmitting to the image display device the image data required to display the image until it moves to a position opposite to the object and stops, and the three-dimensional coordinate data corresponding to the image data. The information providing method according to claim 7.

Images