JP2010218195A - Image generation system, program, information storage medium, and server system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image generation system capable of displaying a menu screen for selecting contents of types not existing in the prior art, and to provide a program, an information storage medium and a server system. <P>SOLUTION: The image generation system includes a menu object space setter for setting a menu object space with respective icon objects of the plurality of icon objects for selecting the contents to be arrangement-set in respective three-dimensional positions, a virtual camera control unit for controlling a virtual camera, and a display control unit for controlling an image viewed through the virtual camera in the menu object space, to be displayed as a menu screen. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image generation system, a program, an information storage medium, a server system, and the like.

  2. Description of the Related Art Conventionally, devices that play multimedia content such as video and music are known. In this content reproduction apparatus, a menu screen for the user to select desired content is required. As a conventional technique of such a menu screen display method, for example, a technique disclosed in Patent Document 1 is known.

  However, in the prior art of Patent Document 1, an icon selection screen for selecting content is expressed by so-called two-dimensional display. Therefore, there is a limit to the number of icons that can be displayed. On the other hand, if the number of icons is increased, the icon display area is reduced, and the user's icon selection operation becomes complicated.

JP 2005-354245 A

  According to some aspects of the present invention, it is possible to provide an image generation system, a program, an information storage medium, a server system, and the like that can display a menu screen for selecting an unprecedented type of content.

  According to one aspect of the present invention, there is provided a menu object space setting unit that sets a menu object space in which each icon object of a plurality of icon objects for selecting content is arranged and set at each three-dimensional position, and a virtual camera. The present invention relates to an image generation system including a virtual camera control unit that controls, and a display control unit that performs control to display an image seen from the virtual camera in the menu object space as a menu screen for content selection. The present invention also relates to a program that causes a computer to function as each of the above-described units, or a computer-readable information storage medium that stores the program.

  According to one aspect of the present invention, a plurality of icon objects are arranged and set in the menu object space. This icon object is an object for selecting content, and is arranged and set at each three-dimensional position in the menu object space. An image seen from the virtual camera in the menu object space is displayed as a menu screen for selecting content. In this way, it is possible to display a menu screen for selecting contents by arranging and setting a large number of icon objects as compared with, for example, a two-dimensional display, and an unprecedented type of menu screen can be displayed. It becomes possible.

  In the aspect of the invention, the display control unit may perform control to display an image in which the icon object is viewed as viewed from the virtual camera as the menu screen.

  In this way, the user can select an icon object that appears to move and select content corresponding to the icon object.

  In one aspect of the present invention, the display control unit may perform control to display an image in which the icon object looks close when viewed from the virtual camera when the user selects the icon object.

  In this way, the user can check and confirm the approach image of the selected icon object.

  In the aspect of the invention, the display control unit may perform control to display an image in which the selected icon object is stationary and other icon objects appear to move.

  In this way, since the icon object is viewed statically and the other objects appear to move, it is possible to display a screen with a sense of reality.

  In one aspect of the present invention, the virtual camera control unit performs control to move the virtual camera on a trajectory, and when the user selects the icon object, causes the virtual camera to approach the selected icon object. Control may be performed.

  By moving the virtual camera in the trajectory in this way, it is possible to display an image that the icon object appears to move as viewed from the virtual camera. Then, when the user selects the icon object moving in this way, an approach image of the icon object is displayed, and the user can see and confirm the approach image of the selected icon object.

  In the aspect of the invention, the virtual camera control unit may perform control to direct the direction of the virtual camera toward the center of the track with respect to the tangential direction of the track.

  In this way, it is possible to display an image in which not only the icon object but also the vicinity of the center of the trajectory can be seen from.

  In the aspect of the invention, the virtual camera control unit may perform control to move the virtual camera on a circular path.

  In this way, it is possible to cause the icon object to appear periodically within the visual field range of the virtual camera.

  In one aspect of the present invention, the user can select an icon object within a predetermined distance range from the virtual camera position or a predetermined number of icon objects close to the virtual camera position from the plurality of icon objects. An icon setting unit to be set for a simple icon object may be included.

  In this way, since an icon object close to the virtual camera can be selected, a smooth interface environment can be provided.

  In one aspect of the present invention, when the icon object is selected by a cursor operated by a user, the display control unit displays a marker superimposed on the selected icon object, or the moving speed of the icon object or Display control for changing the image may be performed.

  In this way, the user can easily visually recognize which icon object of the plurality of icon objects has been selected.

  In the aspect of the invention, the virtual camera control unit may control at least one of the position and direction of the virtual camera based on an operation of the operation unit by a user.

  In this way, the icon object can be selected by changing the position and direction of the virtual camera by the user's operation, so that an unprecedented interface environment can be provided.

  In one aspect of the present invention, the display control unit includes content popularity information, content evaluation information, content presentation frequency information, content recommendation information, content selection history information, content registration time information, and content. Display control may be performed in which an image of the icon object corresponding to the content changes according to at least one of the additional information added to.

  In this way, the image of the icon object displayed on the menu screen changes according to various information.

  In the aspect of the invention, the display control unit may perform control to display an image in which the information detail level of the icon object changes according to a positional relationship between the icon object and the virtual camera.

  In this way, according to the positional relationship between the icon object and the virtual camera, for example, when detailed information on the icon object is displayed, the user can obtain more information.

  In the aspect of the invention, the virtual camera control unit may control an angle of view of the virtual camera.

  In this way, menu screens with various display modes can be displayed.

  In the aspect of the invention, the display control unit may perform control to display an image in which the information detail level of the icon object changes according to the angle of view of the virtual camera.

  In this way, when detailed information of the icon object is displayed by controlling the angle of view of the virtual camera, the user can obtain more information.

  Moreover, in one aspect of the present invention, a sound control unit that performs control to output a sound according to the three-dimensional position of the icon object may be included.

  This makes it possible to output a sound reflecting the three-dimensional position of the icon object when the menu screen is displayed.

  In the aspect of the invention, the sound control unit may perform control to output a sound that changes in accordance with a positional relationship between the virtual camera and the icon object.

  In this way, the output sound changes depending on the positional relationship between the virtual camera and the icon object.

  In the aspect of the invention, the sound control unit may determine the first icon object when the first icon object is positioned on the near side of the second icon object as viewed from the virtual camera. Sound output control may be performed in which the associated sound is output with priority over the sound associated with the second icon object.

  In this way, the sound of the first icon object on the near side when viewed from the virtual side can be preferentially output, so that the sound reflecting the three-dimensional position of the icon object can be output.

  In the aspect of the invention, the menu object space setting unit may place and set the plurality of icon objects on a trajectory set in the menu object space.

  In this way, it is possible to display, as a menu screen, an image of the icon object placed and set on the orbit of the menu object space as viewed from the virtual camera.

  In the aspect of the invention, the virtual camera control unit may perform control to move the virtual camera on a camera trajectory along the trajectory in which the plurality of icon objects are arranged and set.

  In this way, it is possible to display an image in which the icon objects arranged along the trajectory appear to move as viewed from the virtual camera. Note that the camera trajectory in this case may be an outer orbit of the icon object or an inner orbit. It is also possible to make a part or all of the icon object trajectory coincide with the camera trajectory. If the icon object trajectory is a circular trajectory, the camera trajectory can also be a circular trajectory. The movement of the virtual camera on the camera trajectory may be a relative movement with respect to the icon object.

  In one aspect of the present invention, the menu object space setting unit belongs to a corresponding content group among a plurality of content groups on each orbit of the plurality of orbits set in the menu object space. A plurality of icon objects may be arranged and set.

  In this way, since the icon object is arranged and set in each orbit for each content group, the user's selection operation can be facilitated. Note that each camera trajectory may be provided along each trajectory corresponding to each content group, and the virtual camera may be moved on each camera trajectory.

  Moreover, in one aspect of the present invention, a position update unit that performs an update process of the arrangement positions of the plurality of icon objects may be included.

  In this way, the arrangement position of the icon object is updated, so that the appearance of the menu screen changes, and an unprecedented type of menu screen can be displayed.

  In the aspect of the invention, the position update unit may include content amount information, content popularity information, content evaluation information, content presentation count information, content genre information, content recommendation information, and content registration time information. And the update processing of the arrangement positions of the plurality of icon objects may be performed according to at least one of the additional information added to the content.

  In this way, the arrangement position of the icon object is updated according to various types of information, so that it is possible to facilitate the user's selection operation and the like.

  In the aspect of the invention, the position update unit may change the position of the icon object that is out of the visual field range when the icon object is out of the visual field range of the virtual camera.

  In this way, it is possible to perform control such as changing the position of the icon object that is out of the visual field range so that it is again within the visual field range.

  In the aspect of the invention, the icon object may be an icon object for selecting video content distributed via a network or each scene of the video content.

  In the aspect of the invention, the icon object may be an icon object for selecting a broadcast program.

  In the aspect of the invention, the icon object may be an icon object for selecting video content or music content recorded on a recording medium.

  According to another aspect of the present invention, there is provided a content distribution unit for distributing content, and a menu object space in which icon objects of a plurality of icon objects for selecting content to be distributed are arranged and set at respective three-dimensional positions. A menu object space setting unit that performs a process for setting the image, and a process for displaying an image seen from the virtual camera in the menu object space on the display unit of the terminal device as a menu screen for selecting content The present invention relates to a server system including a display processing unit.

  According to another aspect of the present invention, a plurality of icon objects are arranged and set in the menu object space. Then, an image seen from the virtual camera in the menu object space is displayed on the display unit of the terminal device as a menu screen for content selection. In this way, it is possible to display a menu screen for content selection by arranging and setting, for example, a large number of icon objects as compared to the case of two-dimensional display, and an unprecedented type of menu screen can be displayed. It becomes possible.

1 is a configuration example of an image generation system according to the present embodiment. Example of menu screen for content selection. An example of an icon object catch screen. An example of the scene open screen. An example of the scene playback screen. An example of object data of an icon object. 7A and 7B are explanatory diagrams of a method for moving the virtual camera on the trajectory. Explanatory drawing of the setting method of the direction of a virtual camera. FIG. 9A and FIG. 9B are explanatory diagrams of a method for setting icon objects that can be selected by the user. 10A and 10B are explanatory diagrams of a method for selecting an icon object. Explanatory drawing of the method of controlling the position and direction of a virtual camera by a user's operation. The flowchart which shows the detailed process example of this embodiment. FIGS. 13A to 13D are explanatory diagrams of a method for giving an image representing an image effect or a selection history to an icon object. FIGS. 14A to 14E are explanatory diagrams of a method for changing the information detail level of the icon object. FIGS. 15A and 15B are explanatory diagrams of a method for controlling the output sound based on the information on the three-dimensional position of the icon object. Explanatory drawing of the method which arrange | positions and sets an icon object on a track | orbit. FIG. 17A to FIG. 17C are explanatory diagrams of a method for arranging and setting icon objects of each content group on each trajectory. Explanatory drawing of the method of updating the arrangement position of an icon object based on content information amount etc. FIG. FIGS. 19A to 19C are explanatory diagrams of a method for changing the position of an icon object outside the visual field range. The structural example of the server system of this embodiment.

  Hereinafter, this embodiment will be described. In addition, this embodiment demonstrated below does not unduly limit the content of this invention described in the claim. In addition, all the configurations described in the present embodiment are not necessarily essential configuration requirements of the present invention.

1. Image Generation System FIG. 1 shows a configuration example of an image generation system (image display system) of this embodiment. The image generation system according to the present embodiment can be applied to various devices such as a game device, a content playback device (HDD player, DVD player), a television, a portable terminal device, and a personal computer. Note that the image generation system of the present embodiment is not limited to the configuration of FIG. 1, and various modifications such as omitting some of the components (each unit) or adding other components are possible.

  The operation unit 160 is for a user (player) to input operation data, and functions thereof are operation buttons, direction keys, levers, analog sticks, remote controllers, keyboards, pointing devices (such as a mouse), microphones, or It can be realized with a touch panel display.

  The storage unit 170 serves as a work area for the processing unit 100, the communication unit 196, and the like, and its function can be realized by a RAM (DRAM, VRAM) or the like. A program executed by the processing unit 100 and data necessary for executing the program are held in the storage unit 170.

  The object data storage unit 172 of the storage unit 170 stores object data for setting an object space. The virtual camera data storage unit 174 stores various control data of the virtual camera control unit 103. The image data storage unit 175 stores image data of objects such as icon objects. The sound data storage unit 176 stores data of various sounds (speech and music) associated with icon objects and the like. The drawing buffer 177 is a buffer for drawing an image. The content storage unit 178 stores information on various types of content such as video content, music content, and game content.

  The information storage medium 180 (a computer-readable medium) stores programs, data, and the like, and functions as an optical disk (DVD, Blu-ray disk, CD), HDD (hard disk drive), or memory (ROM, etc.). ) Etc. The processing unit 100 performs various processes of the present embodiment based on a program (data) stored in the information storage medium 180. That is, in the information storage medium 180, a program for causing a computer (an apparatus including an operation unit, a processing unit, a storage unit, and an output unit) to function as each unit of the present embodiment (a program for causing the computer to execute processing of each unit). Is memorized.

  The display unit 190 outputs an image generated according to the present embodiment, and its function can be realized by an LCD, a plasma display, a CRT, a touch panel display, an HMD (head mounted display), or the like. The sound output unit 192 outputs the sound generated by the present embodiment, and its function can be realized by a speaker, headphones, or the like.

  The auxiliary storage device 194 (auxiliary memory, secondary memory) is a storage device used to supplement the capacity of the storage unit 170, and can be realized by a memory card such as an SD memory card or a multimedia card.

  The communication unit 196 communicates with the outside (for example, another image generation system, a server system, or a host) via a wired or wireless network, and functions as a communication ASIC or a communication processor. It can be realized by hardware and communication firmware.

  A program (data) for causing a computer to function as each unit of the present embodiment is distributed from the information storage medium included in the server system to the information storage medium 180 (or the storage unit or auxiliary storage device) via the network and the communication unit 196. May be. Use of the information storage medium by such a server system can also be included in the scope of the present invention.

  The processing unit 100 (processor) performs various arithmetic processing, image generation processing, sound generation processing, and the like based on operation data from the operation unit 160, a program, and the like. The processing unit 100 performs various processes using the storage unit 170 as a work area. The functions of the processing unit 100 can be realized by hardware such as various processors (CPU, DSP, GPU, etc.), ASIC (gate array, etc.), and programs.

  The processing unit 100 includes a menu object space setting unit 102, a virtual camera control unit 103, a display control unit 107, a sound control unit 108, an icon setting unit 110, and a position update unit 112. Various modifications such as omission of some of these components (for example, icon setting unit and position update unit) and addition of other components (for example, game calculation unit and mobile unit calculation unit) are possible. is there.

  The menu object space setting unit 102 performs processing for setting various objects (objects composed of primitive surfaces such as polygons, free-form surfaces, or subdivision surfaces) in the object space (three-dimensional space). In other words, the position and rotation angle of the object in the world coordinate system (synonymous with direction and direction) are determined, and the rotation angle (rotation angle around the X, Y, and Z axes) is determined at that position (X, Y, Z). Place the object. Specifically, the object data storage unit 172 of the storage unit 170 stores object data such as the object position, rotation angle, moving speed, moving direction, and the like in association with the object ID. For example, it is updated by the position update unit 112 or the like.

  In this embodiment, the menu object space setting unit 102 performs a menu object space setting process. In the menu object space, the icon objects of the plurality of icon objects are arranged and set at respective three-dimensional positions.

  Here, the contents are multimedia contents such as video contents and music contents distributed from a server system, for example. Alternatively, it may be TV or radio broadcast content or game device game content. Alternatively, it may be video content or music content recorded on a content playback device such as an HDD player or an optical disc player. The icon object is an object (display object) for selecting (representing) these contents. This icon object has information on the three-dimensional position in the object space (three-dimensional space) as attribute information, but the shape is not limited to the three-dimensional shape, and even if it is a two-dimensional object (for example, a billboard) It may be a three-dimensional object. The icon object may represent an image such as a scene, or may represent a character such as a keyword.

  When the image generation system according to the present embodiment is applied to a game device or the like, the object space setting unit 102 includes a model object (a moving object such as a person, a robot, or a car), a map (terrain), a building, a course (road). ), Processing for arranging and setting various objects representing display objects such as trees and walls in the object space.

  The virtual camera control unit 103 performs, for example, a virtual camera (viewpoint) control process for generating an image that can be seen from a given (arbitrary) viewpoint in a menu object space. Specifically, a process for controlling the position (X, Y, Z) and direction (rotation angle around the X, Y, Z axes) of the virtual camera (process for controlling the viewpoint position and the line-of-sight direction) is performed. Alternatively, the virtual camera control unit 103 may control the angle of view of the virtual camera.

  The display control unit 107 performs control to display various images on the display unit 190. For example, an object such as an icon object is drawn based on the results of various processes performed by the processing unit 100, thereby generating an image and outputting the image to the display unit 190. Specifically, geometric processing such as coordinate transformation (world coordinate transformation, camera coordinate transformation), clipping processing, perspective transformation, or light source processing is performed. Based on the processing result, drawing data (the position of the vertex of the primitive surface) Coordinates, texture coordinates, color data, normal vector, α value, etc.) are created. Then, based on the drawing data (primitive surface data), the object (one or a plurality of primitive surfaces) after perspective transformation (after geometry processing) is converted into image data in units of pixels such as a drawing buffer 177 (frame buffer, work buffer, etc.). Draw in a buffer that can be stored. Thereby, an image that can be seen from the virtual camera (given viewpoint) in the object space is generated. Note that an image or the like visible from the virtual camera may be generated in the server system, and the display control unit 107 may perform control to display the image (video) distributed from the server system on the display unit 190.

  The sound control unit 108 performs sound processing based on the results of various processes performed by the processing unit 100, generates sound such as BGM, sound effects, or sound, and performs control for outputting the sound to the sound output unit 192. Do.

  The icon setting unit 110 performs processing for setting various states (attributes) of icons. For example, among a plurality of icon objects, an icon object that can be selected by the user (icon object that can be selected by the cursor) within a predetermined distance range (within a predetermined view volume and within a predetermined Z value) from the position of the virtual camera. Perform processing to set. Alternatively, a predetermined number of icon objects close to the position of the virtual camera may be set as icon objects that can be selected by the user.

  The position update unit 112 performs an update process of the arrangement position of the object. For example, update processing of the arrangement positions (three-dimensional positions) of a plurality of icon objects set in the menu object space is performed.

  Specifically, the position update unit 112 includes content amount information, content popularity information, content evaluation information, content presentation frequency information, content genre information, content recommendation information, content selection history information, content information Update processing of the arrangement positions of a plurality of icon objects is performed according to at least one of the registration time information and additional information added to the content (update time information of additional information). Here, the content amount information is the number of content and the data amount of content. Content popularity information is information representing the popularity of a user or the like who uses the service. The evaluation information for content is information representing evaluation given to the content by the user. The content presentation frequency information is information representing the content presentation frequency, for example, information on the number of times video content or music content has been played or the number of game content plays. The content genre information is information on the genre to which the content belongs. The content recommendation information is recommendation information for the content provided by the service provider (manufacturer) or the user. The content selection history information is information representing a content selection history when a user (another user or a friend user) selects the content. The content registration time information is content registration time and registration date information. The additional information of the content is, for example, a comment given to the content by the user, a synopsis of a scene, a commentary on a keyword, or the like.

  Further, the position update unit 112 may perform a process of changing the position of the icon object that is out of the visual field range when the icon object is out of the visual field range of the virtual camera (when the icon object becomes invisible from the virtual camera). . For example, the position of the icon object is changed so that an icon object that is out of the visual field range falls within the visual field range again.

  In the present embodiment, the menu object space setting unit 102 performs processing for setting a menu object space in which icon objects are arranged and set. The display control unit 107 performs control to display an image seen from the virtual camera in the menu object space as a menu screen. That is, control is performed to display a menu screen for selecting the content of the icon object.

  The icon object is an icon object for selecting, for example, video content distributed via a network and each scene (keyword related to the scene) of the video content. Alternatively, an icon object for selecting a broadcast program (television program, radio program) and an icon object for selecting video content or music content recorded on a recording medium (hard disk, optical disk, external memory card). Also good.

  For example, the display control unit 107 performs control to display, as a menu screen, an image that the icon object appears to move when viewed from the virtual camera. In this case, the virtual camera side may be moved, or the icon object side may be moved. When the user selects an icon object, an image in which the icon object looks close when viewed from the virtual camera is displayed. For example, the virtual camera is moved to the front position (near position) of the icon object to generate an image that can be seen from the virtual camera. Specifically, the selected icon object (pointed icon object) is stationary, and the other icon objects (background image) are displayed as moving images. For example, an image is generated in which an icon object faces the virtual camera and a background image such as another icon object appears to rotate.

  The virtual camera control unit 103 may perform control to move the virtual camera on a predetermined trajectory. For example, control is performed to move the virtual camera on the orbit. In this way, it is possible to cause the icon object to appear periodically within the visual field range of the virtual camera. Various orbits such as circular or elliptical or oval can be assumed as the circular orbit.

  When the user selects an icon object (points to the icon object), control is performed to bring the virtual camera closer to the selected icon object. For example, the virtual camera is moved to the front position (near position) of the icon object to generate an image that can be seen from the virtual camera. In this case, it is desirable that the virtual camera control unit 103 performs control so that the direction of the virtual camera is directed toward the center of the track with respect to the tangential direction of the track. For example, the direction of the virtual camera is directed in a direction between the direction from the virtual camera position toward the center of the trajectory (for example, a circular trajectory or an elliptical trajectory) and the tangential direction of the trajectory.

  Further, when an icon object is selected (pointed) by a cursor operated by the user, the display control unit 107 may superimpose a marker on the selected icon object. For example, an image in which a marker image and an icon object image are translucently combined is generated. Alternatively, when the icon object is selected with the cursor, display control may be performed to change the moving speed of the icon object (relative speed with respect to the virtual camera) or the icon object image. For example, the moving speed of the icon object is decreased, the color and brightness of the icon object are changed, and an image effect is applied. Whether or not the cursor has selected (pointed to) the icon object can be realized by determining whether or not the cursor position is within a predetermined range centered on the representative position of the icon object, for example.

  The virtual camera control unit 103 may control at least one of the position and direction of the virtual camera based on the operation of the operation unit 160 by the user. For example, the virtual camera is moved or the direction of the virtual camera is changed by a user operation.

  The display control unit 107 also includes at least one of the above-described content popularity information, content evaluation information, content presentation frequency information, content recommendation information, content registration time information, and additional information added to the content. Accordingly, display control in which the image of the icon object corresponding to the content changes may be performed. For example, the image (color, brightness, etc.) of the icon object is changed, or the image effect superimposed on the icon object is changed.

  The display control unit 107 may perform control to display an image in which the information detail level of the icon object changes according to the positional relationship (distance, direction, etc.) between the icon object and the virtual camera. For example, when the distance to the virtual camera is farther than the first distance, the icon object is displayed with the first information detail level, and when closer to the first distance, the icon object is displayed than the first information detail level. The icon object is displayed with the second information detail level having a high level of detail. The distance between the icon object and the virtual camera may be a depth distance (Z value) or a linear distance. The level of detail of information changes when the type of information displayed at the same time changes, or when the amount of information displayed is changed.

  The virtual camera control unit 103 may control the angle of view of the virtual camera. For example, the angle of view of the virtual camera is controlled based on the initial setting information and user operation. And the display control part 107 may perform control which displays the image from which the information detail level of an icon object changes according to the angle of view of a virtual camera. For example, when the angle of view is wider than the first angle of view, the icon object is displayed with the first information detail level, and when it is narrower than the first angle of view, it is more detailed than the first information detail level. The icon object is displayed with the second information detail level having a high degree.

  The sound control unit 108 may perform control to output a sound according to the three-dimensional position of the icon object. For example, a virtual sound field is generated based on the three-dimensional position of the icon object, and surround processing is performed to output a sound reflecting the three-dimensional position.

  The sound control unit 108 may perform control to output a sound that changes in accordance with the positional relationship between the virtual camera and the icon object. For example, when the distance between the virtual camera and the icon object is far, the sound level is decreased, and when the distance is close, the sound level is increased. In this case, it is desirable that the output sound is a sound associated with each icon object.

  Further, for example, it is assumed that the first icon object is located on the near side of the second icon object as viewed from the virtual camera. In this case, the sound control unit 107 performs control so that the sound associated with the first icon object is output with priority over the sound associated with the second icon object. For example, sound control is performed so that only the sound of the first icon object is output or the sound of the first icon object is larger than the sound of the second icon object.

  Further, the menu object space setting unit 102 may arrange and set a plurality of icon objects on a trajectory (on one or a plurality of trajectories) set in the menu object space. For example, the icon object is arranged on a circular or elliptical orbit such as a circular orbit (circular orbit) centered on a predetermined position. In this case, a plurality of icon objects belonging to the corresponding content group among the plurality of content groups may be arranged and set on each of the plurality of tracks. For example, a plurality of icon objects belonging to the first content group are arranged on the first trajectory, and a plurality of icon objects belonging to the second content group are arranged on the second trajectory.

  Further, the virtual camera control unit 103 may perform control to move the virtual camera (relative movement with respect to the icon object) on a camera trajectory along a trajectory along which a plurality of icon objects are arranged and set. The camera trajectory may be a trajectory along the outer periphery or inner periphery of the icon object trajectory, or a part or all of the icon object trajectory may coincide with the camera trajectory. Alternatively, each camera trajectory may be provided along each trajectory corresponding to each content group, and the virtual camera may be moved on each camera trajectory.

2. 2. Method of Present Embodiment 2.1 Display of Icon Object Menu Screen The menu screen for content selection so far has been two-dimensional display. For this reason, there is a limit to the number of icons displayed on one screen, and there has been a problem that when a large number of icons are displayed on the screen, the icons become small.

  Therefore, in the present embodiment, as shown in FIG. 2, the menu screen for content selection is displayed in three dimensions. Specifically, a menu screen is displayed in which a large number of icons (thumbnails) such as scenes and keywords appear to be in floating stars. As will be described later, behavior (history) such as user movement and comment writing is expressed to express the excitement of the entire user. For example, the name of the user's friend user, the movement trajectory of the friend user, the name of a user other than the friend, the movement trajectory of another user, and a comment writing mark (for example, the last five minutes) are displayed. In addition, an image effect (aura) representing the number of scenes played, the number of opens, etc. is displayed. A flare that expresses the excitement of the user community is also displayed at the center of the universe (orbit). In addition, BGM music that makes you feel relaxed in outer space flows, and the sound of the speech of the scene is played back randomly every predetermined number of seconds.

  For example, in FIG. 2, icon objects IOB1, IOB2, and the like representing scenes constituting the video content are displayed. In addition, icon objects IOB3, IOB4, and the like representing keywords associated with each scene are displayed. By selecting these icon objects, the user can select each scene or the like that is the content and view the playback video of the scene.

  Specifically, in the present embodiment, a menu object space in which icon objects IOB1 to IOB4 and the like for content selection are arranged is set. For example, data of the three-dimensional positions (or three-dimensional positions and directions) of these icon objects are prepared as object data. Then, a menu screen as shown in FIG. 2 is displayed on the display unit 190 by generating an image visible from the virtual camera in the menu object space.

  In this case, for example, it is desirable to display, as a menu screen, an image in which the icon objects IOB1 to IOB4 and the like are viewed from the virtual camera. That is, even if the user does not operate the operation unit 160, an image is displayed in which the icon object appears to flow from far away. Specifically, as will be described later, such an image is displayed by moving the virtual camera on a predetermined trajectory, for example, at a constant speed. By doing in this way, the user can bystand the image that the icon object disappears as it approaches from the next to the next without any operation.

  The user moves the cursor CS by operating the operation unit 160, and selects (points) an icon object that moves in the space. That is, while looking at the icon object image and keyword, the cursor CS is moved toward the icon object that is interested, and the target icon object is selected (supplemented, touched, clicked).

  When the icon object IOB1 is selected by the cursor CS, a catch screen (supplementary screen) of the icon object IOB1 (scene) is displayed as shown in FIG. In this catch screen, for example, a scene name, a scene icon image (thumbnail image), a scene aura, a comment of another user on the scene, and the like are displayed. For example, a predetermined number of comments are acquired from comments of other users on the network and displayed one by one.

  Specifically, when the icon object IOB1 is selected (pointed), the virtual camera that has moved on the trajectory moves to and approaches the front position (near the icon object IOB1). Then, a catch screen as shown in FIG. 3 is displayed on the display unit 190 by generating an image that can be seen from the virtual camera in such an approaching state.

  When the user performs a cancel operation in this state, the virtual camera returns to the original position on the orbit and the menu screen (space menu) shown in FIG. 2 is displayed again.

  In FIG. 3, the target icon object IOB <b> 1 is stationary and an image in which other icon objects appear to move is displayed. For example, an image is generated so that other icon objects can be seen around the stationary icon object IOB1. In this way, the icon object IOB1 is enlarged and displayed, and the icon object IOB1 can be clearly notified to the user by being stationary. Further, the other icon objects slowly move around the stationary icon object IOB1, thereby increasing the sense of reality of the icon object IOB1.

  When the user performs a selection determination operation on the catch screen (scene catch screen) in FIG. 3, an open screen (scene open screen) as shown in FIG. 4 is displayed. In this open screen, when the user performs an operation of scrolling the screen in the left direction (first direction in a broad sense) (operation instruction in the first direction in a broad sense), for example, another user's comment on the scene Will be listed. On the other hand, when the user performs an operation of scrolling the screen in the right direction (second direction in a broad sense) (operation instruction in the second direction in a broad sense), for example, on the open screen in FIG. Listed keywords are displayed.

  When the user performs a scene selection decision operation on the scene open screen of FIG. 4, a scene playback screen as shown in FIG. 5 is displayed. When the user performs a scene playback selection decision operation, the scene video (moving image) is played back so that the user can appreciate it.

  In the scene playback screen of FIG. 5, the user can input a comment for the scene by selecting the comment icon shown in A1. The input comment is displayed when another user is watching the scene.

  The user can express the excitement of the user by selecting the thumb-up icon indicated by A2. For example, when a user who sees a scene presses the thumb-up button, an image effect (aura or the like) representing the user's excitement (popularity) is displayed in association with the icon object of the corresponding scene on the menu screen of FIG. Become so.

  Further, when the “view one whole episode” icon shown in A3 is selected, the user can appreciate one episode of video content including the scene being reproduced. At this time, for example, billing processing by a server system described later is performed. In this way, when the user who sees the scene selects the A3 icon with an interest in the conversation before and after the scene, the user can be charged. Accordingly, it is possible to realize a billing process that makes it difficult for the user to feel uncomfortable, and to perform a billing process triggered by a scene, thereby realizing efficient billing.

  FIG. 6 shows an example of the object data of the icon object. This object data is stored in the icon object data storage unit 173 of the object data storage unit 172 in FIG. Specifically, the icon object data storage unit 173 stores three-dimensional position data (X1, Y1, Z1), (X2, Y2, Z2), and (X3, Y3, Z3) of the icon objects IOB1, IOB2, and IOB3. To do. Also, attribute information of the icon object is stored. As attribute information, various information such as icon object ID, icon object type information (scene, keyword), or image effect information can be assumed. In addition to the three-dimensional position data, icon object direction data (rotation angles about the X, Y, and Z axes) may be stored.

  As shown in FIG. 7A, in this embodiment, the virtual camera VC moves on the trajectory TR set in the object space for menu (three-dimensional space). For example, when the user is not performing any operation, the virtual camera VC moves at a constant speed on the trajectory TR. By doing so, as shown in FIG. 2, a menu screen as if floating in outer space can be displayed. The virtual camera VC may be stationary and the icon object may be moved. Further, the moving direction of the virtual camera VC may be reversed and can be rotated in reverse by a user operation.

  As shown in FIG. 7B, when the user selects the icon object IOB1, the virtual camera VC moves toward the selected icon object IOB1. Specifically, the virtual camera VC moves to a position facing the icon object IOB1 and facing the camera direction in the direction of the center CT of the trajectory TR. As a result, a catch screen as shown in FIG. 3 is displayed on the display unit 190.

  When the catch screen of FIG. 3 returns to the menu screen of FIG. 2, the virtual camera VC returns to the original position on the trajectory TR as shown in FIG. 3 and 7B can be realized by a billboard display in which a two-dimensional billboard polygon serving as the icon object IOB1 is directly opposed to the virtual camera.

  In FIG. 7B, for example, the virtual camera VC is rotated at a slow speed around an axis along the viewing direction of the virtual camera VC. By doing so, as described with reference to FIG. 3, the icon object IOB1 appears to be stationary, and the other icon objects move and appear to generate an image. As a result, the presence of the icon object IOB1 increases.

  As shown in FIG. 8, when the virtual camera VC moves on the trajectory TR, it is desirable to direct the direction VD (line-of-sight direction) of the virtual camera VC toward the center CT side. That is, the direction VD of the virtual camera VC is directed to the center CT side from the tangential direction TD of the trajectory TR. By doing so, not only the icon object IOB1, but also an image of a crowded place on the trajectory CT is displayed, and the effect of rendering the image can be improved. At this time, for example, by arranging a flare or the like indicating the excitement of the user community in the vicinity of the center CT, the effect of rendering the image can be further improved.

  In this embodiment, as shown in FIG. 9A, an icon object within a predetermined distance range from the position of the virtual camera VC is set as an icon object that can be selected by the user. Specifically, when the user selects (points) an icon object on the menu screen of FIG. 2, only the icon object in the view volume VVL whose depth distance (Z) from the virtual camera VC is within a predetermined range can be selected. To.

  For example, when a large number of icon objects are displayed on the menu screen, if all the icon objects become selectable (pointable) by the cursor CS, a distant icon object that is not intended by the user is selected. This may confuse the user.

  In this regard, as shown in FIG. 9A, if only icon objects within a predetermined distance range (within the view volume VVL) can be selected by the cursor CS, the user can select only icon objects close to the viewpoint. , Provide a smooth operation interface with little confusion.

  Note that selectable icon object settings are not limited to the method of FIG. For example, only a predetermined number of icon objects close to the virtual camera may be set to be selectable. Specifically, as shown in the processing example of FIG. 9B, icon objects are extracted in the order from the virtual camera (step S1). Then, it is determined whether or not the number of extracted icon objects has reached a predetermined number (step S2). If not, the process returns to step S1 to extract the next closest icon object. When the number of extracted icon objects reaches a predetermined number, the predetermined number of extracted icon objects are set as icon objects that can be selected by the user (step S3). In this way, the user can select only a predetermined number of icon objects close to the viewpoint of the virtual camera, and can provide a smooth operation interface with less confusion.

  In addition, when an icon object is selected by a cursor operated by the user, it is desirable to perform an image representation that indicates the selection. For example, in FIG. 10A, when the icon object IOBA is selected with the cursor CS, the marker MK is superimposed on the selected icon object IOBA (semi-transparent composition). By doing so, the user can visually recognize which icon object of the many icon objects has been selected, and can improve the user interface environment.

  Instead of displaying the marker MK as shown in FIG. 10A, the image of the icon object IOBA itself may be changed as shown in FIG. 10B. For example, the color or brightness of the selected icon object IOBA is changed or blinked. Even in this way, the user can visually recognize which icon object of the many icon objects has been selected. Further, for example, when the cursor CS operated by the user selects (points) an icon object, the operation unit 160 may be vibrated.

  In addition, although the case where a virtual camera moves automatically was demonstrated above, you may change the position and direction of a virtual camera according to a user's operation.

  For example, in FIG. 11, when the user operates the controller 161 which is the operation unit 160, the position PV and the direction DV of the virtual camera VC change according to the user's operation. For example, when the user operates a direction instruction key, an analog stick, or an operation button of the controller 161, the position PV and the direction DV of the virtual camera VC are controlled. In this way, the user can select a desired icon object by moving freely in the object space for menus such as outer space, as if he / she got on the spaceship, and never before An interface environment can be provided.

  FIG. 12 shows a flowchart of a detailed processing example of the present embodiment. First, as described in FIG. 7A, the virtual camera is moved on the track at a predetermined speed (step S11). That is, it is moved by a predetermined distance within one frame. At this time, as shown in FIG. 8, the visual line direction of the virtual camera is directed toward the center side.

  Next, as described with reference to FIG. 9A, an icon object that is within a predetermined distance range (within a predetermined view volume) from the position of the virtual camera is set as an icon object that can be selected by the user (step S12).

  Next, it is determined whether or not the icon object set in the selectable state in step S12 is selected by the cursor operated by the user (step S13). For example, it is determined whether or not the cursor is located within a predetermined distance from the representative position (center position) of the icon object. When an icon is selected with the cursor, as shown in FIG. 10A, a marker is superimposed on the icon object to inform the user that the icon object has been selected (step S14).

  Next, it is determined whether or not the user has performed an icon object selection decision operation (step S15). When the selection decision operation is performed, an icon object catch screen as shown in FIG. 3 is displayed (step S16). Then, in this catch screen, it is determined whether or not the user has performed a scene (or keyword) selection determination operation. When the selection determination operation is performed, the scene (or keyword) is opened as described with reference to FIG. A screen is displayed (steps S17 and S18).

  According to the method of the present embodiment described above, a menu screen on which a large number of icon objects are displayed on one screen can be displayed as shown in FIG. That is, the number of icon objects that can be displayed at one time can be significantly increased compared to a two-dimensional display menu screen in which the number of icon objects displayed is limited.

  In the menu screen of FIG. 2, the icon object on the back side is displayed small from the position of the virtual camera that is the viewpoint of the user, and the icon object on the near side is displayed large. Therefore, since the user can ignore a large number of icon objects on the back side, the user's convenience can be improved. In particular, the user convenience can be further improved by limiting the selectable icon objects as described with reference to FIGS.

  In FIG. 2, the icon object on the near side is displayed large, so that the user's selection operation is facilitated and the user interface environment can be improved. Even if the user does not operate, the icon object moves from one to the next in the field of view of the user who is watching. Then, the user can enjoy the contents of the icon object as shown in FIG. 5, for example, by viewing the icon image of the moving icon object, confirming the contents, and selecting the icon object that is interested. it can. Therefore, the user can select and enjoy the content of interest in a passive state without performing an active operation, and can provide an unprecedented type of menu screen.

2.2 Image Change of Icon Object In the present embodiment, the icon object image displayed on the menu screen of FIG. 2 may be changed based on various information.

  For example, in FIG. 13A, an effect image corresponding to the user's popularity degree for the scene and the evaluation given by the user is superimposed on the icon object IOB on which the icon image of the scene is drawn. For example, as the degree of popularity and evaluation increases, the type of effect image is changed, and the color and brightness of the effect image are changed. By doing this, on the menu screen of FIG. 2, the icon object of the content with high popularity and evaluation will be noticed by the user, and the popularity and evaluation will be further increased.

  Further, in FIG. 13B, an image effect representing the number of times the scene is reproduced and recommendation information for the scene from the content providing side is superimposed and displayed on the icon object IOB on which the icon image of the scene is drawn. For example, as the number of times of reproduction increases, the type of the effect image is changed, and the color and brightness of the effect image are changed. Alternatively, an effect image is added to content recommended by the content provider such as newly arrived scene content. By doing so, on the menu screen of FIG. 2, the number of times of reproduction is large, or the icon object of the recommended content on the content providing side becomes noticeable to the user, the number of times of reproduction is further increased, and the content is provided Can lead users to the recommended content.

  13C and 13D, an image representing the selection history of icon objects by other users is displayed in association with the icon object. Specifically, an image representing a selection history of other users for a predetermined number of people in the latest several minutes is displayed in association with an icon object.

  For example, in FIG. 13C, a general-purpose user other than the friend user selects the icon object in the order of IOBA, IOBB, and IOBC, and the trajectory image of the selection history is the first color (for example, red). It is displayed. Further, in FIG. 13D, a trajectory image of a selection history indicating that the user's friend user has selected icon objects in the order of IOBD, IOBE, and IOBF is displayed in the second color (for example, green). .

  In this way, on the menu screen of FIG. 2, the user can visually grasp what kind of icon object content the other user has selected with interest. Then, it is possible to select icon objects in the same order as the selection history of other users and enjoy the content, and to provide a menu screen of an unprecedented type.

  The method for changing the icon object image on the menu screen is not limited to the method shown in FIGS. For example, the image of the icon object may be changed based on time information (time and date) for newly registering content. For example, for a newly registered content, an image effect is added to an icon object corresponding to the content so as to be noticed by the user. Alternatively, the image effect to be added to the icon object may be different between content with an old registration time and new content.

  Further, the image of the icon object may be changed based on the additional information added to the content. For example, when another user's comment, which is additional information, is written on the content, an image effect is added to the content to be commented. By doing so, the icon object of the content to which additional information such as a comment is given becomes visible to the user, and the user can be guided to the content.

2.3 Control of Information Detail Level of Icon Object In this embodiment, the information detail level of the icon object displayed on the menu screen of FIG. 2 may be controlled. Specifically, the information detail level of the icon object is changed according to the positional relationship (distance, direction, etc.) between the icon object and the virtual camera, the angle of view of the virtual camera, and the like.

  For example, in FIG. 14A, the distance between the virtual camera VC and the icon object IOB is close. Specifically, the depth distance (Z value) of the icon object IOB viewed from the virtual camera VC is short. In this case, the information detail level (detail level of presented information) of the icon object IOB is increased. For example, in addition to the icon image of the scene (content in a broad sense) represented by the icon object IOB, additional information such as comments of other users for the scene is displayed. Alternatively, the level of detail (number of pixels) of the icon image may be increased.

  In FIG. 14B, the distance between the virtual camera VC and the icon object IOB is a medium positional relationship. In this case, the information detail level of the icon object IOB is set to a medium level. For example, only the icon image of the scene representing the icon object IOB is displayed. Alternatively, the level of detail of the icon image may be medium.

  In FIG. 14C, the distance between the virtual camera VC and the icon object IOB is long. In this case, the information detail level of the icon object IOB is lowered. For example, only the scene name is displayed without displaying the icon image of the scene represented by the icon object IOB. Alternatively, the level of detail of the icon image may be lowered.

  In this way, when the distance between the virtual camera and the icon object is short, detailed information about the icon object (content) is displayed, so that the user can obtain more information. On the other hand, when the distance between the virtual camera and the icon object is long, the level of detail of the information on the icon object is low, so that a situation where the display becomes complicated can be prevented.

  That is, in the present embodiment, as shown in FIG. 2, since the icon objects are arranged three-dimensionally on the menu screen, the display area of the icon objects close to the viewpoint on the screen is large, while the icon objects far from the viewpoint are displayed. The display area of becomes smaller. Therefore, even if the information detail level of the icon object close to the viewpoint is increased, information can be transmitted to the user by using the large display area. On the other hand, a large number of icon objects far from the viewpoint are displayed, but the situation where the display becomes complicated can be prevented by reducing the level of detail of information.

  In FIG. 14D, the field angle of the virtual camera VC is narrow. In this case, the information detail level of the icon object IOB is increased. For example, in addition to the icon image of the scene, additional information such as a comment is displayed.

  On the other hand, in FIG. 14E, the angle of view of the virtual camera VC is wide. In this case, the information detail level of the icon object IOB is lowered. For example, only the icon image of the scene is displayed without displaying additional information such as comments.

  The angle of view of the virtual camera VC may be set, for example, on the display mode setting screen of the menu screen, or the angle of view may be changed according to the operation of the operation unit by the user and the situation at that time.

  When the angle of view of the virtual camera is reduced as shown in FIG. 14D, the display area of the icon object on the screen is increased. Therefore, even if the information detail level of the icon object is increased, information can be transmitted to the user by using the large display area. On the other hand, when the angle of view of the virtual camera is increased as shown in FIG. 14E, the display area of the icon object on the screen is reduced, but the display becomes complicated by reducing the information detail level of the icon object. Can be prevented.

  Although the method for changing the information detail level according to the distance from the icon object and the angle of view of the virtual camera has been described above, the information about the icon object is obtained using parameters equivalent to these distance and angle of view or different parameters. The degree of detail may be changed.

  As a method for changing the level of detail of information, a first method for changing the type of information displayed at the same time and a second method for changing the information amount of the information displayed can be considered.

  Specifically, in the first method, when the distance between the virtual camera and the icon object is far or the angle of view is wide, only the subtitle “18th Episode Deadly Fight” is displayed. On the other hand, when the distance between the virtual camera and the icon object is short or when the angle of view is narrow, a subtitle “18th Episode Deadly Fight” and a user comment “This scene is the best” are displayed simultaneously. That is, the number of displayed information is increased from one to two, for example.

  In the second method, when the distance between the virtual camera and the icon object is long or the angle of view is wide, a summary is displayed as “Two people yesterday ...”. On the other hand, when the distance between the virtual camera and the icon object is short or when the angle of view is narrow, a summary is displayed as “Two people knew the mystery of the school yesterday”. That is, the information amount of the displayed information is increased so that only the first five characters of the synopsis are displayed and the entire sentence is displayed.

2.4 Sound Control According to 3D Position of Icon Object In this embodiment, sound control according to the 3D position of the icon object may be performed. That is, a sound corresponding to the three-dimensional position of the icon object in the menu object space of FIG. 2 is output.

  For example, in FIG. 15A, it is detected that the icon object IOB1 is approaching the virtual camera VC based on the three-dimensional position of the icon object IOB1 and the position of the virtual camera VC. In this case, a sound corresponding to the icon object IOB1 is output. Specifically, when the icon object IOB1 represents a scene, the scene name (content name) and the comment of another user with respect to the scene are output by voice. Alternatively, if BGM music is associated with the icon object IOB1, the BGM music is output.

  Further, when a plurality of icon objects approach the virtual camera, a sound subjected to surround sound processing may be output based on the three-dimensional position of these icon objects. For example, the sound of the icon object located on the left of the virtual camera can be heard from the left side, and the sound of the icon object located on the right side can be heard from the right side.

  In FIG. 15B, the first icon object IOB1 is positioned on the near side of the second icon object IOB2 when viewed from the virtual camera VC. Further, the second icon object IOB2 is located on the near side of the third icon object IOB3 when viewed from the virtual camera VC.

  In this case, the sound associated with the first icon object IOB1 is output with priority over the sound associated with the second icon object IOB2. Further, the sound associated with the second icon object IOB2 is output with priority over the sound associated with the third icon object IOB3.

  For example, in the case of the positional relationship of FIG. 15B, only the sound for the first icon object IOB1 closest to the virtual camera VC is output. Alternatively, the sound of the first icon object IOB1 is made louder than the sound of the second icon object IOB2. The sound of the second icon object IOB2 is set to be louder than the sound of the third icon object IOB3.

  In this way, a sound reflecting the three-dimensional position of the icon object can be output, giving the user the feeling of being in the outer space surrounded by the content planet, The feeling can be improved.

2.5 Arrangement of Icon Objects on Trajectory In this embodiment, icon objects may be arranged on a trajectory set in the menu object space. In this case, various trajectories such as a circular trajectory, an elliptical trajectory, and a straight trajectory are conceivable.

  For example, in FIG. 16, icon objects IOB11 to IOB15 are arranged on the trajectory TR1, and icon objects IOB21 to IOB25 are arranged on the trajectory TR2. These trajectories TR1 and TR2 are set in the menu object space. The setting of the trajectory may be performed by the content providing side, or may be performed by the user in the initial setting or the like.

  In FIG. 16, a camera trajectory TRC1 is provided along the trajectory TR1 of the icon object. Specifically, the camera track TRC1 is provided on the outer periphery of the track TR1. The virtual camera VC moves on the camera trajectory TRC1. By doing so, it is possible to generate an image in which the icon object appears to move as viewed from the virtual camera VC. The movement in this case may be a relative movement, and includes the case where the icon object moves. Further, the camera trajectory TRC1 may be provided along the inner periphery of the trajectory TR1, or the camera trajectory TRC1 may be provided so as to coincide with a part or all of the trajectory TR1. In FIG. 16, the camera trajectory TRC2 is also set along the trajectory TR2. The virtual camera VC can be moved from the camera trajectory TRC1 to TRC2 or moved from TRC2 to TRC1 by a user operation or the like.

  Note that the trajectories as shown in FIG. 16 may be arranged in a layered structure in the direction perpendicular to the paper surface. For example, the first to i-th trajectories are set in the first layer, and the (i + 1) -th to j-th trajectories are set in the second layer, which is the upper layer of the first layer. Then, the virtual camera can be moved between the first layer and the second layer.

  In the present embodiment, a trajectory may be prepared for each content group, and icon objects belonging to each content group may be arranged and set in each trajectory.

  For example, in FIG. 17A, trajectories TR1, TR2, and TR3 are set (prepared) corresponding to 1CH, 4CH, and 6CH, which are television broadcast channels (content groups in a broad sense). Then, on the track TR1 corresponding to 1CH, icon objects IOB11 to IOB14 and the like for selecting a 1CH broadcast program (broadcast content) are arranged. Further, icon objects IOB21 to IOB24 for selecting a 4CH broadcast program are arranged on the track TR2 corresponding to 4CH, and an icon for selecting a 6CH broadcast program on the track TR3 corresponding to 6CH. Objects IOB31 to IOB34 are arranged.

  In this way, when the image generation system of this embodiment is applied to a broadcast reproduction apparatus such as a television, for example, the menu screen of this embodiment of FIG. 2 can be used as a broadcast program selection screen.

  For example, in FIG. 17A, camera trajectories TRC1, TRC2, TRC3 are provided corresponding to the trajectories TR1, TR2, TR3 of icon objects. The user can move the virtual camera VC on the tracks TRC1, TRC2, and TRC3 and between the tracks TRC1, TRC2, and TRC3 using a remote controller that is an operation unit. Then, the broadcast program provided by each broadcast channel is selected by moving the virtual camera VC on the camera trajectory corresponding to the desired broadcast channel trajectory.

  In this case, as described with reference to FIGS. 7A to 8, the virtual camera may automatically move on the camera trajectory without any user operation. For example, when the user performs a channel switching operation with the remote controller, the virtual camera moves to the camera trajectory corresponding to the channel after switching, and then moves at a constant speed on the camera trajectory. In this case, the camera trajectories TRC1, TRC2, and TRC3 along which the virtual camera moves are outer tracks or inner tracks of the tracks TR1, TR2, and TR3 on which the icon objects (contents) are arranged. Alternatively, part or all of the camera trajectories TRC1, TRC2, TRC3 and the icon object trajectories TR1, TR2, TR3 may coincide.

  In this way, the user can simplify the broadcast program selection operation and improve user convenience. In addition, a plurality of broadcast programs can be provided in each channel, and the number of broadcast programs provided in each channel can be increased.

  In FIG. 17B, trajectories TR1, TR2, and TR3 are set corresponding to sports, music, and news that are content genres (content groups). And on the track TR1 corresponding to sports, icon objects IOB11 to IOB14 for selecting content classified as sports are arranged. Further, on the trajectory TR2 corresponding to music, icon objects IOB21 to IOB24 for selecting content classified as music are arranged, and the content classified as news is selected on the trajectory TR3 corresponding to news. Icon objects IOB31 to IOB34 and the like are arranged. Camera trajectories TRC1, TRC2, TRC3 are provided corresponding to the icon object trajectories TR1, TR2, TR3.

  In this manner, when the image generation system of the present embodiment is applied to a content playback device (video playback device, music playback device) such as an HDD player or an optical disk player, or a broadcast playback device such as a television set, FIG. The menu screen of this embodiment can be used as a selection screen for video content and music content.

  For example, the content reproduction apparatus system automatically recognizes the genre of video content and music content recorded on an HDD or an optical disk. Then, based on the automatically recognized genre, the content is automatically arranged on the track of the corresponding genre.

  In this way, the genre of the content is automatically recognized and arranged on each orbit. Therefore, even when a large amount of content is recorded on the HDD or the optical disk, the user can easily find the desired content using the genre as a clue, and the convenience of the user can be improved. For example, when the user wants to appreciate sports genre content, the virtual camera VC is moved on the camera trajectory TRC1 corresponding to the sports genre trajectory TR1 of FIG. Then, by moving the virtual camera VC on the trajectory TRC1, a desired content is found and viewed. In this case, the virtual camera VC may be moved at a constant speed on the camera trajectory as shown in FIGS. The camera trajectory is provided on the outer periphery, inner periphery, etc. of the trajectory in which the icon object (content) is arranged.

  In FIG. 17C, tracks TR1, TR2, and TR3 are set corresponding to January, February, and March, which are content recording times and broadcast times (content groups). On the track TR1, icon objects IOB11 to IOB14 and the like for selecting content recorded or reproduced in January are arranged. Further, icon objects IOB21 to IOB24 for selecting contents recorded or reproduced in February are arranged on the track TR2, and the contents recorded or reproduced in March are selected on the track TR3. The icon objects IOB31 to IOB34 are arranged. Camera trajectories TRC1, TRC2, TRC3 are provided corresponding to the trajectories TR1, TR2, TR3.

  Also in this case, the system side automatically recognizes the time information (time and date) when the content is recorded or reproduced, and automatically arranges the corresponding content in each trajectory based on the automatically recognized time information. You may do it. In this way, the user can search for desired content using the time information as a clue, and the convenience for the user can be improved.

  Further, in the present embodiment, based on content amount information, popularity information, evaluation information, presentation frequency information, genre information, recommendation information, content registration time information, and additional information added to content (additional information update time information). Then, the update process of the arrangement position of the icon object may be performed.

  For example, in FIG. 18, in January, February, and March, content recording is performed by a content playback device such as an HDD player. As the amount of recorded content increases, the number of trajectories in which icon objects are arranged increases accordingly. It will increase.

  For example, at the time of January, only the trajectory TR1 is set, and the icon objects of the content recorded in January are sequentially arranged on the trajectory TR1. In this case, the favorite content having a high degree of popularity, high evaluation, or a large number of times of reproduction (presentation number in a broad sense) is arranged at a predetermined position (position with high priority) on the trajectory TR1. Also, an update process is performed in which the arrangement positions of the icon objects are sorted according to the content genre.

  In February, a new trajectory TR2 for February is additionally set, and icon objects of contents recorded in February are sequentially arranged on the trajectory TR2. Also in this case, the update processing of the arrangement position of the icon object is performed according to popularity, evaluation, number of reproductions, genre, and the like.

  In March, a new orbit TR3 for March is additionally set, and icon objects of contents recorded in March are sequentially arranged on the orbit TR3. Also in this case, the update process of the arrangement position of the icon object is performed according to popularity, evaluation, genre, and the like.

  As described above, in FIG. 18, the icon object arrangement position update process is performed based on the content amount information, the content popularity information, the evaluation information, the presentation count information, the genre information, the registration time information, and the like. In this way, since the arrangement positions of the icon objects are organized based on these pieces of information, the user's selection operation can be facilitated. Therefore, the interface environment for the menu screen can be improved, and user convenience can be improved. Also in FIG. 18, camera trajectories TRC1, TRC2, and TRC3 are provided corresponding to the trajectories TR1, TR2, and TR3.

  Further, the update processing of the icon object arrangement position may be performed based on the recommendation information of the content, the additional information on the content, or the like.

  For example, the position of the content recommended by the content provider is placed near the user's virtual camera so that it stands out. Specifically, when new content is added, the icon object placement position is updated so that the icon object of the new content is placed in a conspicuous position. In this way, it is possible to guide the user to the content icon object recommended by the content provider or the like.

  Alternatively, the update processing of the icon object placement position may be performed in accordance with additional information such as a comment of another user added to the content, a synopsis of a scene, or a keyword commentary. For example, when a comment or the like is written, the icon object placement position is updated so that the icon object of the content to which the comment is to be written is placed in a conspicuous position. In this way, content to which additional information such as comments is added can be selected more easily, and the excitement of the user community can be produced.

  Various methods can be considered as a method for updating the arrangement position of the icon object. For example, when the icon object is outside the visual field range of the virtual camera, the position of the icon object that is out of the visual field range may be changed.

  Specifically, in FIG. 19A, the icon object IOB is outside the visual field range of the virtual camera VC. That is, the icon object IOB is moved outside the view volume of the virtual camera VC. In this case, as shown in FIG. 19A, the icon object IOB that is outside the visual field range is moved so that it is again within the visual field range of the virtual camera VC, or the virtual camera VC can be moved in a short time. Keep within the field of view.

  In FIG. 19B, not all the areas are prepared as the menu object space, but only a partial area RG is prepared. When the virtual camera VC goes out of the region RG as shown at B1 in FIG. 19B, the virtual camera VC is moved to the position B2 in FIG. The virtual camera VC is inserted into

  For example, on the menu screen shown in FIG. 2, an icon object approaching the user's viewpoint disappears outside the user's visual field range at a high speed. For this reason, it may be difficult for an unfamiliar user to select an icon object, and the icon object may fail to be selected. Once the icon object has failed to be selected, it is necessary to wait for the icon object to go around in the trajectory and appear in front of the user again, which may impair user convenience.

  In this regard, in the methods of FIGS. 19A to 19C, an icon object that has passed outside the user's visual field range is again within the user's visual field range in a short time. Therefore, the user can select the icon object that has failed to be selected again without waiting for much time, and the convenience can be improved.

  Note that when the icon object approaches the user's viewpoint, the relative movement speed of the icon object with respect to the virtual camera may be controlled to be slow. In this way, it is possible to reduce the situation where the user fails to select the icon object in front of him.

2.6 Stereoscopic Display In this embodiment, the menu screen of FIG. 2 may be a so-called stereoscopic display. By doing so, the user's sense of reality can be further improved.

  Here, various known methods can be adopted as the stereoscopic viewing method. For example, a method using glasses or a method not using glasses may be used. As a method not using glasses, a volume type such as a varifocal mirror method or holography may be used, or a parallax type such as a lenticular method, a parallax barrier method, or an integral method may be used.

  Specifically, an anaglyph process is performed on the original image to generate a left-eye image and a right-eye image, and the user views the image with glasses with color filters, thereby realizing a stereoscopic display such as a menu screen. . Alternatively, stereoscopic display may be realized by providing an optical device such as a lenticular lens on the screen of the display unit 19 or the like. Alternatively, the left-eye image and the right-eye image may be alternately displayed for each frame, and the user may realize stereoscopic display by viewing the screen with glasses equipped with a liquid crystal shutter or the like.

  By performing the stereoscopic display of the menu screen in FIG. 2 as described above, it is possible to further increase the virtual reality of the user who feels as if he is floating in outer space. Further, for example, when the catch screen shown in FIG. 3 is displayed, the depth value of the icon object is set to the near side of the screen so that the icon object can be seen to pop out from the screen. Thereby, the variety degree of the image displayed can be increased.

3. Server System FIG. 20 shows a configuration example of a server system (content distribution system) of this embodiment. In FIG. 20, a plurality of terminal devices 20-1 to 20-n are connected to the server system 200 via the network 10. Then, the server system 200 distributes the content to the terminal devices 20-1 to 20-n via the network 10.

  Here, the network 10 (distribution network, communication line) is, for example, a communication path using the Internet. In addition to a dedicated line (dedicated cable) for direct connection, a LAN using Ethernet (registered trademark), a telephone communication network, A communication network such as a cable network may be included. The communication method may be wired / wireless.

  The terminal devices 20-1 to 20-n are client terminals such as game devices (home game devices), content playback devices, televisions, portable terminal devices, personal computers, and the like.

  The server system 20 includes a processing unit 210, a storage unit 270, and a communication unit 296. Note that various modifications such as omitting some of these components or adding other components (for example, an operation unit) are possible.

  The processing unit 210 performs content distribution processing and system management processing. The functions of the processing unit 210 can be realized by a processor such as a CPU, a program that runs on the processor, or the like. This program is stored in a computer-readable information storage medium.

  The storage unit 270 (database) functions as a work area for the processing unit 210 and the communication unit 296, and the function can be realized by a RAM, an HDD, or the like.

  The communication unit 296 performs communication processing with the terminal devices 20-1 to 20-n (hereinafter referred to as the terminal device 20 as appropriate), and the function can be realized by a communication ASIC or firmware.

  The processing unit 210 includes a content distribution unit 212, a management processing unit 214, a charging processing unit 216, a menu object space setting unit 218, and a display processing unit 230. Various modifications may be made such as omitting some of these components or adding other components.

  The content distribution unit 212 performs content (scene content) distribution processing. Specifically, in accordance with a request from the terminal device 20, content information is read from the content storage unit 272 and distributed to the terminal device 20 via the communication unit 296 and the network 10. This content distribution is, for example, a bucket relay method in which content data received from a content distribution source node is buffered in a storage unit, and the buffered content data is retransmitted to a content distribution destination node by a relay method. Also good.

  The management processing unit 214 performs various server management processes. The management information is stored in the management information storage unit 274. Various information (ID, password, billing information, etc.) about the user is stored in the user information storage unit 276.

  The billing processing unit 216 performs billing processing for content distribution. For example, when a user selects a scene and then requests distribution of video content including the scene, the user is charged.

  The menu object space setting unit 218 performs processing for setting the menu object space. Here, in the menu object space, each icon object of a plurality of icon objects for selecting content to be distributed is arranged and set at each three-dimensional position. Note that the terminal device may be in charge of part or all of the arrangement setting process of the menu object space.

  The display processing unit 230 performs processing for displaying an image seen from the virtual camera in the menu object space on the display unit of the terminal device 20 as a menu screen. Further, processing for displaying various screens such as a catch screen, an open screen, and a scene playback screen on the display unit of the terminal device 20 is performed. For example, various screens such as a menu screen may be created on the server side, and the terminal device 20 may display various screens on the display unit of the terminal device 20 by accessing URLs of the created various screens. Alternatively, the server side creates image data (video data) of various screens such as a menu screen and transmits the image data to the terminal device 20, thereby displaying various screens such as the menu screen on the display unit of the terminal device 20. May be. In addition, creation processing and display processing of various screens may be realized by distributed processing on the server side and the terminal device side.

  In addition, a part or all of the processes of the virtual camera control unit 103, the display control unit 107, the sound control unit 108, the icon setting unit 110, and the position update unit 112 described in FIG. Also good. That is, a block having the same function as each block included in the processing unit 100 and the storage unit 170 in FIG. 1 may be provided in the processing unit 210 and the storage unit 270 of the server system 200.

  Although the present embodiment has been described in detail as described above, it will be easily understood by those skilled in the art that many modifications can be made without departing from the novel matters and effects of the present invention. Accordingly, all such modifications are intended to be included in the scope of the present invention. For example, a term described together with a different term having a broader meaning or the same meaning at least once in the specification or the drawings can be replaced with the different term anywhere in the specification or the drawings. Further, display methods for various screens such as menu screens, virtual camera control methods, icon object control methods, and the like are not limited to those described in the present embodiment, and equivalent methods are also included in the scope of the present invention. It is.

IOB icon object, VC virtual camera,
10 network, 20-1 to 20-n terminal device,
100 processing unit, 102 object space setting unit for menu,
103 virtual camera control unit, 107 display control unit, 108 sound control unit,
110 icon setting unit, 112 position updating unit, 160 operation unit, 170 storage unit,
172 Object data storage unit, 173 Icon object data storage unit,
174 Virtual camera data storage unit, 175 image data storage unit,
176 sound data storage unit, 177 drawing buffer, 178 content storage unit,
180 information storage medium, 190 display unit, 192 sound output unit,
194 Auxiliary storage device, 196 communication unit, 200 server system, 210 processing unit,
212 content distribution unit, 214 management processing unit, 216 billing processing unit,
218 object space setting unit for menu, 230 display processing unit, 270 storage unit,
272 content storage unit, 274 management information storage unit, 276 user information storage unit,
296 Communication Department

Claims (29)

A menu object space setting unit for setting a menu object space in which each icon object of a plurality of icon objects for selecting content is set to be arranged at each three-dimensional position;
A virtual camera control unit for controlling the virtual camera;
A display control unit that performs control to display an image seen from the virtual camera in the menu object space as a menu screen for content selection;
An image generation system comprising: In claim 1,
The display control unit
An image generation system that performs control to display an image that the icon object appears to move as viewed from the virtual camera as the menu screen. In claim 1 or 2,
The display control unit
When the user selects the icon object, the image generation system performs control to display an image in which the icon object looks close when viewed from the virtual camera. In claim 3,
The display control unit
An image generation system that controls to display an image in which the selected icon object is stationary and other icon objects appear to move. In any one of Claims 1 thru | or 4,
The virtual camera control unit
An image generation system, wherein control is performed to move the virtual camera on a trajectory, and when the user selects the icon object, control is performed to bring the virtual camera closer to the selected icon object. In claim 5,
The virtual camera control unit
An image generation system for controlling the direction of the virtual camera toward the center of the trajectory with respect to a tangential direction of the trajectory. In any one of Claims 1 thru | or 6.
The virtual camera control unit
An image generation system that controls to move the virtual camera on a circular orbit. In any of claims 1 to 7,
Icon setting that sets, among the plurality of icon objects, icon objects that are within a predetermined distance range from the position of the virtual camera or a predetermined number of icon objects that are close to the position of the virtual camera as icon objects that can be selected by the user An image generation system including a section. In any one of claims 1 to 8,
The display control unit
An image characterized in that when an icon object is selected by a cursor operated by a user, a marker is superimposed on the selected icon object, or display control is performed to change the moving speed or image of the icon object. Generation system. In any one of Claims 1 thru | or 9,
The virtual camera control unit
An image generation system that controls at least one of a position and a direction of the virtual camera based on an operation of an operation unit by a user. In any one of Claims 1 thru | or 10.
The display control unit
According to at least one of content popularity information, content evaluation information, content presentation frequency information, content recommendation information, content selection history information, content registration time information, and additional information added to content, An image generation system that performs display control in which an image of the icon object corresponding to content changes. In any one of Claims 1 thru | or 11,
The display control unit
An image generation system that controls to display an image in which the information detail level of the icon object changes according to a positional relationship between the icon object and the virtual camera. In any of claims 1 to 12,
The virtual camera control unit
An image generation system that controls an angle of view of the virtual camera. In claim 13,
The display control unit
An image generation system that controls to display an image in which the information detail level of the icon object changes according to the angle of view of the virtual camera. In any one of Claims 1 thru | or 14.
An image generation system comprising: a sound control unit that performs control to output sound according to the three-dimensional position of the icon object. In claim 15,
The sound control unit
An image generation system that controls to output a sound that changes in accordance with a positional relationship between the virtual camera and the icon object. In claim 15 or 16,
The sound control unit
When the first icon object is located in front of the second icon object as viewed from the virtual camera, the sound associated with the first icon object is the second icon object. An image generation system characterized by performing sound output control that is output with priority over the sound associated with. In any one of Claims 1 thru | or 17,
The menu object space setting unit includes:
An image generation system, wherein the plurality of icon objects are arranged and set on a trajectory set in the menu object space. In claim 18,
The virtual camera control unit
An image generation system that performs control of moving the virtual camera on a camera trajectory along the trajectory along which the plurality of icon objects are arranged and set. In any one of Claims 1 thru | or 19.
The menu object space setting unit includes:
An image generation system, wherein a plurality of icon objects belonging to a corresponding content group among a plurality of content groups are arranged and set on each orbit of a plurality of trajectories set in the menu object space. In any of claims 1 to 20,
An image generation system, comprising: a position update unit that performs an update process of the arrangement positions of the plurality of icon objects. In claim 21,
The position update unit
At least one of content amount information, content popularity information, content evaluation information, content presentation frequency information, content genre information, content recommendation information, content registration time information, and additional information added to content In response, an image generation system that performs update processing of the arrangement positions of the plurality of icon objects. In claim 21 or 22,
The position update unit
When the icon object is out of the visual field range of the virtual camera, the position of the icon object that is out of the visual field range is changed. In any one of Claims 1 thru | or 23.
The image generation system, wherein the icon object is an icon object for selecting video content distributed via a network or each scene of the video content. In any one of Claims 1 thru | or 23.
The image generation system according to claim 1, wherein the icon object is an icon object for selecting a broadcast program. In any one of Claims 1 thru | or 23.
The image generation system according to claim 1, wherein the icon object is an icon object for selecting video content or music content recorded on a recording medium. A menu object space setting unit for setting a menu object space in which each icon object of a plurality of icon objects for selecting content is set to be arranged at each three-dimensional position;
A virtual camera control unit for controlling the virtual camera;
As a display control unit that performs control to display an image seen from the virtual camera in the menu object space as a menu screen for content selection,
A program characterized by causing a computer to function.   A computer-readable information storage medium, wherein the program according to claim 27 is stored. A content distribution unit for distributing content;
A menu object space setting unit for performing processing for setting a menu object space in which each icon object of a plurality of icon objects for selecting content to be distributed is arranged and set at each three-dimensional position;
A display processing unit for performing processing for displaying an image seen from the virtual camera in the object space for menu on the display unit of the terminal device as a menu screen for content selection;
A server system comprising:

Images