JP3866474B2 - GAME DEVICE AND INFORMATION STORAGE MEDIUM - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a game device or the like that detects the operation of a player and performs a game operation in accordance with the detected data.
[0002]
[Prior art]
2. Description of the Related Art A video game device including an imaging device such as a CCD camera is known as a game device that allows a player to enjoy a game using the whole body. In such a video game device, first, the player is imaged by the imaging device. Then, a feature extraction process is performed in which the background is removed from the photographed image and only the player is extracted, and then the shape (body shape) and operation of the player are recognized using the image subjected to the feature extraction process.
[0003]
An example of such a video game apparatus is disclosed in Japanese Patent Laid-Open No. 7-155467. In the video game apparatus disclosed in Japanese Patent Application Laid-Open No. 7-155467, an instruction pattern with white or red is displayed near the four corners of the screen, and the player who has seen the instruction pattern holds it in his left and right hands. A flag raising game is performed in which the white or red flag is raised and lowered to determine whether the instruction pattern matches the flag color raised or lowered by the player.
[0004]
Such conventional video game devices have the following technical problems. That is, since the player is picked up by a CCD camera, it takes a lot of calculation time for feature extraction processing for detecting the player's movement, and it is difficult to achieve the processing speed required for game execution. Is a point. For this reason, the recognition (pattern recognition) of the flag raising / lowering of the player in the video game apparatus disclosed in the above-mentioned Japanese Patent Application Laid-Open No. 7-155467 is whether or not the flag color data exceeds a predetermined (area) in a predetermined area. The player's movement itself is not detected.
[0005]
By the way, a game device that performs a dance game is known as one of game devices that allow a player to enjoy a game using the whole body. This game device includes an input device having a plurality of switches that are turned ON / OFF by the player's own weight and the like, and the player plays a game on the input device. In other words, a game device for performing this dance game is configured to be able to calculate the game progress and score by detecting whether or not the player has stepped on (ridden) the switch at a given timing. . Therefore, although the game is a dance game, the game is realized and established by detecting the input timing to the input device, not the device that detects and determines the player's dance itself.
[0006]
[Problems to be solved by the invention]
As described above, the video game device disclosed in Japanese Patent Application Laid-Open No. 7-155467 and the conventional game device for performing a dance game are simple such as raising a flag in a given area or stepping on a given switch. The game was progressing with simple actions and simple input. Therefore, the game content is monotonous and the input operation is specified as a certain operation such as stepping on a switch. That is, whether or not the game is played using the whole body is left to the player side. In other words, since the game device simply determines whether or not the switch is pressed, the player's operation does not lead to the progress or score of the game, so it is a problem that it ends up being labored. there were.
[0007]
An object of the present invention is to provide a game device and the like that can perform a game progress and score process according to movement using the whole body without limiting the input operation.
[0008]
[Means for Solving the Problems]
  To solve the above issues,1st inventionIs a game device for executing a given game, which includes a motion detection means (for example, the image sensor 20 in FIG. 6) for detecting the motion of the player, and stores a given questioning motion. Operation of the player based on at least one of the direction, size and speed of the storage means (for example, the question data 530 in FIG. 6) and the player action detected by the action detection means And similarity determining means (for example, the action specifying unit 118 and the similarity determining unit 116 in FIG. 6) for determining the similarity with the given questioning action stored in the storage means.Game device.
[0009]
  Also,14thThe present invention is an information storage medium storing computer-executable software including information for executing a given game (for example, the game program 510 of FIG. 6), and relates to a given questioning operation Information (for example, determination criterion data 536 in FIG. 6) and at least one of the direction, size, and speed of the player's motion detected by the motion detection means (for example, the image sensor 20 in FIG. 6). Based on the similarity determination information (for example, the game program of FIG. 6; steps S4 to S14 in the flowchart of FIG. 16) for determining the similarity between the action of the player and the given questioning action. IncludeAn information storage medium.
[0010]
  thisFirstOr14thAccording to the present invention, the motion of the player is detected by the motion detection means, and the detected motion of the player and the given questioning motion are compared and determined. Therefore, the player is freed from the need to press a switch during play in order to make the game device identify that he / she has moved, and enjoys a bodily sensation game using the whole body without any restriction on input operations. be able to. Further, since the similarity is determined using the direction, size, and speed of the motion as elements, it is possible to objectively determine whether the player is performing well or not. The effect of the present invention can be further enhanced by making a given game a dance game.
[0011]
  Also,The second invention is,1st inventionIn the game apparatus, the similarity determination meansBut, For each given time interval in the given questioning action, determine the similarity between the player action and the given questioning action corresponding to the given time intervalIt is a game device.
[0012]
  thisSecondAccording to the invention, since the similarity of the player's motion is determined every given time interval, it is not necessary to always make a determination on the player's motion, and the processing can be reduced. Further, by accumulating similarities at given time intervals, that is, similarities having direction, size, and speed as elements, it is possible to objectively evaluate the entire operation of the player.
[0013]
  Also,3rd invention is 1st or 2nd inventionIn the game device, the timing notification means for notifying the given timing by the visual or auditory effect, and whether the action of the player detected by the action detection means matches the given timing. Timing judging means for judging whether or notIt is a game device.
[0014]
  thisThirdAccording to this invention, for example, the operation is the same as a given question operation, but it is possible to deduct points because the timing is not correct. Note that it is strict for the player to strictly determine whether or not the timing is correct, and therefore, an allowable time width of, for example, about 0.2 seconds may be provided. Also, the degree of coincidence of whether or not the timing is right, for example, “1” is calculated when the timing is right, and “0.8” is calculated when the time is 0.05 seconds off, and the degree of coincidence is calculated as a coefficient. It is good also as adding to the determination result of similarity. In this case, for example, when raising the left hand, it is possible to relieve the action such as touching, such as raising the right hand for a moment.
[0015]
  Also,The fourth invention is,Any one of the first to third inventionsIf there are two or more player motions detected by the motion detection means at the same time, the degree of similarity is based on at least one of the direction, size, and speed of each of the player motions. A motion specifying unit (for example, the motion specifying unit 118 in FIG. 6) for specifying a motion to be determined, and the similarity determination unitButThe similarity between the player action specified by the action specifying means and the given questioning action is determined.It is a game device.
[0016]
  this4thAccording to the invention, even when there are two or more operations at the same time, it is possible to specify the operation to be determined and determine the similarity. It should be noted that the elements used to specify this motion are changed according to the questioning motion, for example, when the large motion is required, the size is used as a reference, and when the quick motion is required, the speed is used as a reference. As good as In addition, by specifying an action in a direction different from the questioning action, the evaluation of the player's action may be reduced.
[0017]
  Also,The fifth invention is,Third inventionIn the game apparatus, when there are a plurality of player actions detected by the action detecting means, the action judged by the timing judging means to be suitable for the given timing is determined as a similarity determination target. And an action specifying unit (for example, the action specifying unit 118 in FIG. 6) for specifying as an operation to beButAnd determining the similarity between the action of the player specified by the action specifying means and the given questioning action.It is a game device.
[0018]
  this5thAccording to this invention, when there are a plurality of actions, it is possible to specify an action that is a determination target of similarity by using whether the timing is correct or not as a determination criterion. Therefore, in other words, it is possible to exclude an operation whose timing is not correct from the similarity determination target.
[0019]
  Also,The sixth invention is,Any of the first to fifth inventionsIn the game apparatus, the similarity determination meansButThe player's action and the given questioning action corresponding to the detection area for each of a plurality of detection areas (for example, the first to fourth areas in FIG. 10) obtained by dividing the detection range of the action detection means. Determine the similarity ofIt is a game device.
[0020]
  Also,The seventh invention is,Of the fourth or fifth inventionIn the game device, the action specifying meansBut, For each of a plurality of detection areas obtained by dividing the detection range of the motion detection means, an action to be determined for similarity is specified, and the similarity determination meansButFor each detection area, the similarity between the action of the player specified by the action specifying means and the given questioning action corresponding to the detection area is determined.It is a game device.
[0021]
  Also,The fifteenth invention,14th inventionIn the information storage medium, the similarity determination informationBut, For each of a plurality of detection areas obtained by dividing the detection range of the action detection means, information for determining the similarity between the player's action and the given questioning action corresponding to the detection areaAn information storage medium.
[0022]
  this6th, 7th or 15th inventionAccording to the above, the determination of the similarity between the player's action and the questioning action can be made for each detection area, such as the similarity of the entire detection area. Can be eliminated, and the processing can be reduced. In addition, the efficiency of processing can be improved by specifying the detection area to be determined.
[0023]
  Also,The eighth invention is,7th inventionIn the game apparatus, the similarity determination meansButIn the case where the player's motion spans a plurality of the detection regions, the evaluation is determined in consideration of the player's motions in the respective detection regions.It is a game device.
[0024]
  this8thAccording to the invention, for example, when the determination criterion of the similarity is the magnitude of the action, even if the action is across the detection area, the judgment is performed in consideration of the magnitude of each action in the detection area. For this reason, it is possible to prevent erroneous determination due to a large operation.
[0025]
  Also,The ninth invention,Any of the sixth to eighth inventionsIn the game apparatus, a result display unit for each region that displays a determination result for each detection region by the similarity determination unit is provided.It is a game device.
[0026]
  this9thAccording to this invention, the player can recognize which region corresponds to good or bad movement, and can know a more specific determination result.
[0027]
  Also,The tenth invention is,Any of the first to ninth inventionsIn the game apparatus, the similarity determination meansButThe determined similarity is changed according to a given condition detected by the motion detecting means.It is a game device.
[0028]
  Also,The eleventh invention is,Any of the sixth to eighth inventionsIn the game apparatus, the detection area is changed according to a given condition detected by the motion detection means.It is a game device.
[0029]
  Also,The twelfth invention,10th or 11th inventionIn the game device, the given conditionButAnd the condition relating to the player's body shape detected by the motion detection meansIt is a game device.
[0030]
  thisAny of 10th to 12thAccording to the invention, a given condition detected by the motion detection means without requiring the player's operation input, for example,According to the twelfth invention,The similarity and the detection area can be automatically changed according to the player's body shape (height, limb length, etc.), the player's position, and the like. For this reason, the difference in the determination result of the similarity due to the body shape and the like can be corrected. Here, the detection area change includes a change in the number of detection areas, a change in the size of the detection area, a change in the position of the detection area, and the like.
[0031]
  Also,The thirteenth invention is,Any of the first to twelfth inventionsIn the game apparatus, the motion detection meansButDetecting the player's movement using an artificial retina chipIt is a game device.
[0032]
  this13thAccording to the invention, since the motion detection means detects the motion of the player using the artificial retina chip, it can easily perform processing such as feature extraction processing related to the detection, and can perform processing of the entire device. Since decentralization can be achieved, the processing speed of the entire apparatus can be increased.
[0033]
DETAILED DESCRIPTION OF THE INVENTION
Preferred embodiments of the present invention will be described below with reference to the drawings. In the following, a case where the present invention is applied to a dance game will be described as an example, but the present invention is not limited to this.
[0034]
1 and 2 are diagrams showing an example of a business game apparatus 700 to which the present invention is applied. FIG. 1 is an external front view of the case of the game apparatus 700, and FIG. 2 is a cross-sectional view of the game apparatus 700 showing the positional relationship between the player 800, the image sensor 720 provided in the case, and the display 730. is there.
[0035]
The game device 700 includes an image sensor 720 for detecting the operation of the player 800, a display 730 for displaying a game screen, an operation unit 710 for inputting a game start instruction and the like, and a dance BGM and rhythm. It has a speaker 740 for outputting sound or the like for capturing, and a light 760 for illumination. The game apparatus 700 determines whether or not the movement of the player 800 detected by the image sensor 720 is the same action as the dance that has been given (hereinafter referred to as “question dance”), and the like. It is a game device that performs score calculation.
[0036]
In addition, the game apparatus 700 advances the game by repeatedly executing two types of modes: a storage mode for storing the dance in the player and a dance mode for determining the player's dance.
[0037]
3 to 5 are diagrams illustrating an example of a screen displayed on the display 730 during the game.
[0038]
FIG. 3 is a diagram showing an example of a screen in the storage mode, and a mode display 732 indicating the storage mode is displayed on the upper right of the screen. On the screen in the memory mode, a dance showing a correct movement is indicated by a movement of an instructor character (hereinafter referred to as an instructor character) 770. (Actually, a left-right flipped motion is displayed, but for the sake of simplicity, it will be described that the motion of the instructor character is the correct motion.) While the screen of this memory mode is displayed, the player Remember.
[0039]
In addition, a score display 734, a level gauge 735, a timing gauge 736, and a window 738 are displayed in common on the screens of the storage mode and the dance mode. The score display 734 shows the cumulative score up to now. The level gauge 735 indicates the player's dance level obtained by accumulating the determination results of the player's dance (motion). If the level gauge 735 is determined to be a correct motion, the level is increased. If the level gauge 735 is determined to be an illegal motion, The level goes down. The timing gauge 736 is configured such that the indicating hand is rotated and displayed at a speed corresponding to the tempo of the dance, and plays a role of a kind of metronome. The window 738 displays an image that simulates the operation result of the player detected by the image sensor 720.
[0040]
FIG. 4 is a diagram showing a screen example of the dance mode, and the mode display 732 displays that it is the dance mode. On the screen in the dance mode, the correct dance by the instructor character 770 is displayed, and the movement of the player is detected by the image sensor 720, and it is determined whether or not the dance movement is correct.
[0041]
FIG. 5 is a diagram illustrating an example of a screen on which a determination result is displayed in the dance mode. In FIG. 5, the determination result display 737 on the right side of the screen displays “Pole” characters determined to be correct movement. In the dance mode, it is determined whether or not the player's dance (movement) is correct at every given time interval, every questioned dance movement, every BGM tempo, etc., and the determination result is displayed. As a determination result, “good” indicating almost correct, “difficult” indicating slightly correct, and “no” indicating that the operation is not correct at all are displayed in addition to “pole”.
[0042]
The game device 700 advances the dance game by repeatedly executing the memory mode and the dance mode. However, in the player, since free movement is reflected in the score, the input operation is not limited. You can enjoy an intuitive dance game using
[0043]
Next, the principle of detecting / determining the player's motion will be described. An example of a functional block diagram in the game device of the present embodiment is shown in FIG. The functional block includes an operation unit 10, an image sensor 20, a processing unit 100, a display unit 30, a speaker 40, and an information storage medium 500.
[0044]
The operation unit 10 includes buttons for instructing input of the start of a dance game, difficulty level of the questioned dance, and the like, and the input instruction signal is output to the processing unit 100. In the game device 700 of FIG. 1, the operation unit 710 corresponds to this.
[0045]
The image sensor 20 includes a light receiving unit 22, a light reception control unit 24, and an image analysis unit 26, and is realized by an artificial retina chip or the like. The image sensor 720 in the game apparatus 700 in FIG. Applicable. Since the technique of motion detection by the image sensor 20 has been developed as a conventional technique, a detailed description thereof is omitted, but in order to clarify the difference from the gist of the present invention, an outline thereof will be described. .
[0046]
The image sensor 20 performs an image detection process for detecting an image, a feature extraction process for the detected image (for example, an edge detection process for detecting a contour line of an object in the image, and a resolution obtained by reading out pixels collectively. Variable processing, pattern matching processing for extracting an object from the image, random access processing for detecting only an arbitrary portion in the image, and the like). The image sensor 20 detects the movement of the player based on the processed image. Specifically, the image sensor 20 performs the following processing.
[0047]
The light receiving unit 22 includes a plurality of light receiving elements arranged in a two-dimensional array, and the light detection sensitivity of each light receiving element is controlled by the light receiving control unit 24. That is, since the light detection sensitivity of the light receiving unit 22 is controlled by the light receiving control unit 24, the light receiving unit 22 displays a processed image that has been subjected to various processes such as an edge detection process that detects only the contour line of the image object. It can be obtained with light reception. The processed image obtained by the light receiving unit 22 is output to the image analyzing unit 26 as a processed image signal.
[0048]
The image analysis unit 26 receives the processed image signal output from the light receiving unit 22 and detects a two-dimensional movement by optical flow or the like for each input processed image signal. That is, based on temporal and spatial changes in the brightness of each pixel, the direction and intensity of movement for each pixel is detected. Then, the image analysis unit 26 identifies a portion having strong motion from the detected optical flow, and calculates the direction, magnitude, and speed of the two-dimensional motion as the entire portion. Specifically, it is obtained by a vector average of optical flows included in the entire portion having strong motion. The image sensor 20 detects the movement of the object as described above. Hereinafter, the motion detected by the image sensor 20 will be described as a motion vector including elements of the starting position, direction, size, and speed.
[0049]
That is, the image sensor 20 constantly monitors and detects the motion vector of the player, and outputs the detected motion vector to the processing unit 100 as needed. Further, the image sensor 20 detects the player image itself as well as the motion vector, and outputs the player image to the processing unit 100 together.
[0050]
The processing unit 100 mainly includes a game calculation unit 110, an image generation unit 130, and a music generation unit 140. The game calculation unit 110 reads out the game program 510 from the information storage medium 500 and executes a dance game, and operates (dances) the instructor character in the object space based on the character action data 534, or from the image sensor 20. Processing related to game progress and score calculation, such as similarity determination processing for comparing the input motion vector with the determination reference data 536, is performed.
[0051]
The game calculation unit 110 includes a question dance setting unit 114, an action specifying unit 118, and a similarity determination unit 116.
[0052]
Before starting the dance game, the question dance setting unit 114 determines a question dance, a BGM song, and a tempo from the question data 530 according to the difficulty level selected and input from the operation unit 10. Perform the process. Specifically, the character motion data 534 for operating the instructor character as a correct dance and the determination criterion data 536 for determining the player's dance are determined to correspond to the question dance, and the question The music to be the BGM of the dance is determined from the music data 532, and finally the tempo is determined so as to match the speed of the questioned dance and the speed of the music. In the following, for the sake of brevity, the explanation will be made assuming that there are only two types of dances, Dance A and Dance B.
[0053]
FIG. 7 is a diagram illustrating an example of the character action data 534. In FIG. 7, character action data 534 stores position data in the object space corresponding to each part of the instructor character in dance A and dance B for each key frame. For example, in the position data of the first frame corresponding to an instructor character part a (for example, the right hand elbow) in Dance A, the X coordinate is Xa1, the Y coordinate is Ya1, and the Z coordinate is Za1. In the position data of the second frame, the X coordinate is Xa2, the Y coordinate is Ya2, and the Z coordinate is Za2. The operation of the instructor character between frames is interpolated.
[0054]
FIG. 8 is a diagram illustrating an example of the determination reference data 536. In FIG. 8, determination criterion data 536 includes determination criterion data of direction, size, and speed corresponding to each region in dance A and dance B for each given timing (time). Here, the region refers to a region obtained by dividing the range detectable by the image sensor 20 into four. Specifically, the range that can be detected by the image sensor 20 is shown in FIG. 9, and in this range, the upper left area is the first area, the upper right area is the second area, the lower left area is the third area, The lower region is referred to as a fourth region, and FIG. 10 is a diagram illustrating the partition of each region with a dashed line. 9 and 10 show the contour of the player for the sake of convenience in order to show the detection range of the image sensor 20, but what is actually detected by the image sensor 20 is a motion vector. For this reason, when there is no motion in the player in FIGS. 9 and 10, no motion vector is detected.
[0055]
In FIG. 8, for example, the determination reference data at the time t1 of the first region in the dance A has a direction α11, a magnitude β11, and a speed γ11. The determination reference data at time t2 has a direction of α12, a size of β12, and a speed of γ12. The reason why the criterion data is stored for each area is that, as will be described later, the similarity to the player's dance (motion) is determined for each area.
[0056]
The given timing (time) such as the time t1 and the time t2 is a timing when the player's dance is determined, and the player's operation is determined based on the determination reference data for each region at this time. The Therefore, the given timing (time) can be arbitrarily determined in accordance with the questioned dance and the tempo of the song determined by the questioned dance setting unit 114, every given time interval, or the like. If this given timing is matched with the quest tempo and the tempo of the song, it is possible to determine whether or not the operation of the player matches the tempo.
[0057]
The action specifying unit 118 performs a process of specifying a motion vector corresponding to each region from among the motion vectors input from the image sensor 20 as needed. The motion vector data specified for each region is hereinafter referred to as player motion data.
[0058]
FIG. 11 is a diagram illustrating an example of player operation data. When the player makes a plurality of movements, for example, as shown in FIG. 12A, when the player moves his hands at the same time, the image sensor 20 is as shown by an arrow in FIG. A plurality of motion vectors related to the elbows of both hands and the tips of both hands are detected. That is, the number of motion vectors input from the image sensor 20 dynamically changes according to the player's motion. The motion specifying unit 118 determines which region from the first region to the fourth region is a motion vector according to the starting position of the motion vector among these motion vectors, and a plurality of motions within the same region. When a vector exists, one motion vector is specified by the direction, magnitude, and speed of the motion vector. Note that the motion vector for each region can be specified for the motion vector across regions by the above method, but for the motion vector across regions, the motion vector is divided for each region, and the divided motion vectors are respectively It may be specified as a motion vector corresponding to the region.
[0059]
For example, as shown in FIG. 13A, when both hands are extended at the same time in the second region, the motion vector from the image sensor 20 is indicated by an arrow in FIG. 13B, for example. A plurality of motion vectors related to the elbows of both hands, the tips of both hands, and the like are output. The motion specifying unit 118 performs motion in the second region according to given conditions such as the largest motion vector, the fastest moving vector, and the most laterally moving vector among these motion vectors. Specify one motion vector.
[0060]
The direction, magnitude, and speed of the motion vector for each area specified by the action specifying unit 118 are player action data. That is, the player operation data is updated as needed. Note that, when a plurality of motion vectors exist in each region at the same time, one motion vector is specified. However, an average of motion vectors existing in the region may be used. Further, in the case of dances in which two or more movements are performed simultaneously in the same area, determination criterion data 536 corresponding to each movement at the timing is prepared, and the number of player motion data for the area is set to the movement It is good also as a number according to the number of. This makes it possible to more accurately determine a dance in which two or more operations are performed simultaneously in the same region.
[0061]
The similarity determination unit 116 determines the similarity between the determination reference data 536 corresponding to the question dance and the player action data. In other words, for example, when the question dance is dance A and time t1 is reached, the similarity between the determination reference data 536 at time t1 of dance A and the player action data at that time is determined for each region. The As a specific similarity determination method, a pattern matching method that comprehensively considers the direction, size, and speed is used. For beginner dance, the similarity is determined only by the direction element. For advanced users, the present invention can be applied to any method, such as a method of determining similarity for all elements of direction, size, and speed.
[0062]
In the similarity determination, the timing may be one element. In other words, if the timing is completely different, a strict determination (for example, 0 points) is made. If it is within the allowable time, the score of the determination result is halved. If the timing is correct, the score of the determination result is doubled. It is also possible to do it. For example, by setting this timing in accordance with the tempo of the music, it is possible to determine whether or not the player's operation matches the tempo.
[0063]
FIG. 14 shows an example when the timing is correct, and FIG. 15 shows an example when the timing is not correct but is detected within the allowable time. 14 and 15 both show the passage of time in the right direction, the bold line portion on the time axis shows the time zone of the allowable time, and times t1, t2, and t3 show the timing. 14 and 15, the player performs an operation of lowering the extended hand, bending the elbow of the lowering hand, and further extending the bent hand, and displays a motion vector (arrow) corresponding to each operation. The sensor 20 detects. At this time, in FIG. 14, the operation is performed in accordance with the timings of the times t1, t2, and t3. In FIG. 15, the operation is not performed in the allowable time of the times t1, t2, and t3. Indicates what has been done.
[0064]
An implementation method using this timing as one element of similarity determination is based on the following principle. The similarity determination unit 116 holds the determination reference data 536 at the given timing (time t2) in advance before the given timing (for example, time t2). Next, when the time reaches within the allowable time at the given timing (time t2), the determination of the similarity between the determination reference data 536 and the player motion data is started. Then, the determination result is associated with time and temporarily stored in a memory or the like. At this time, if a determination result with a similarity higher than the stored similarity is obtained, the determination result to be stored is Update. This process is continued until the allowable time has elapsed. After the allowable time elapses, the similarity determination unit 116 determines whether or not the time of the stored determination result matches the given timing (time t2), and according to the degree of coincidence with the given timing. Change the judgment result. That is, this degree of match is a weight for the similarity of the determination results. This is realized by the above method.
[0065]
The image generation unit 130 performs processing for generating an image such as the game execution screen described with reference to FIGS. The processing includes generating an image of an instructor character who dances in the object space set by the game calculation unit 110 as seen from a given viewpoint, and an image for displaying the score display 734 and the timing gauge 736. A process of generating, a process of generating a window 738 for displaying the operation result in a simulated manner, and the like are included, and the generated image is displayed on the display unit 30.
[0066]
The music generation unit 140 generates music based on the music data 532 similarly determined by the question dance setting unit 114 at the tempo determined by the question dance setting unit 114 and performs a process of outputting the music to the speaker 40. Note that the music data 532 has been described as music serving as the BGM of the question dance, but it may be a sound for taking a rhythm. In this case, the music generation unit 140 is determined by the question dance setting unit 114. The sound that matches the tempo is generated.
[0067]
The functions of the processing unit 100 described above can be realized by hardware such as a CISC type or RISC type CPU, DSP, or an image capture dedicated IC.
[0068]
The display unit 30 displays the image generated by the image generation unit 130, and is realized by, for example, a CRT, LCD, plasma display, or the like, and corresponds to the display 730 in the game apparatus 700 of FIG.
[0069]
In addition to the game program 510 relating to the dance game, the information storage medium 500 stores the above-described question data 530 including the music data 532, the character action data 534, and the determination reference data 536. The functions of the information storage medium 500 can be realized by hardware such as a CD-ROM, game cassette, IC card, MO, FD, DVD, memory, and hard disk. As described above, the processing unit 100 performs various processes based on programs, data, and the like stored in the information storage medium 500.
[0070]
Next, the operation of the game device according to the present embodiment will be described. FIG. 16 is a flowchart showing an example of processing operation in the game device of the present embodiment.
[0071]
In FIG. 16, first, when a difficulty level or the like is input from the operation unit 10, the question dance setting unit 114 sets a question dance according to the difficulty level (step S1). At this time, the question dance setting unit 114 determines the music data 532 corresponding to the question dance, the character action data 534, the judgment reference data 536, and the tempo of the music to be the question dance and BGM.
[0072]
Next, the game calculation unit 110 and the image generation unit 130 perform processing related to the storage mode, that is, operation display of the question dance by the instructor character (step S2).
[0073]
Next, when the dance mode is started (step S3), the motion specifying unit 118 specifies a motion vector corresponding to each region from the motion vector input from the image sensor 20 (step S4), and player motion data is obtained. Create (step S5). Next, when the similarity determination unit 116 determines that the allowable time for determining the similarity has been reached (step S6), it sets the similarity determination flag to OFF (step S7), The similarity is determined by comparing with the determination reference data 536 (step S8). Here, the similarity determination flag is a flag for determining whether or not the similarity is fixed, and is stored in a memory or the like.
[0074]
Next, the similarity determination unit 116 determines whether or not to replace the similarity determined in step S8 with the determined similarity in order to determine the highest similarity within the allowable time. Perform (step S9). If it is determined not to update, the process proceeds to step S4. If it is determined to update, the process proceeds to step S4 after the similarity is updated (step S10). The similarity is stored in a memory or the like together with the determined time.
[0075]
If it is determined in step S6 that it is not within the allowable time, the similarity determination unit 116 determines whether or not the similarity determination flag is ON (step S11), and if it is determined that it is ON, The process proceeds to step S2. If it is determined that the similarity is not ON, the similarity determination unit 116 determines whether or not the similarity determination time determined in step S8 or updated in step S9 matches a given timing. The degree of match is determined (step S12). Then, by changing the similarity according to the degree of match, the similarity at the given timing is determined, and the determination result is displayed on the display unit 30 via the image generation unit 130. In addition, the game calculation unit 110 performs score processing related to the determined similarity (step S13).
[0076]
Next, after the similarity determination unit 116 sets the similarity determination flag to ON (step S14), the game calculation unit 110 determines whether or not the question dance has ended (step S15) and determines that it has not ended. If so, the process proceeds to step S2, and if it is determined that the process has been completed, a score process for calculating and displaying the final score is performed (step S16), and the game is terminated.
[0077]
Next, an example of a hardware configuration capable of realizing the present embodiment will be described with reference to FIG. In the apparatus shown in the figure, a CPU 1000, a ROM 1002, a RAM 1004, an information storage medium 1006, a sound generation IC 1008, an image generation IC 1010, and I / O ports 1012, 1014, and 1028 are connected to each other via a system bus 1016 so that data can be input and output. ing. A display 1018 is connected to the image generation IC 1010, a speaker 1020 is connected to the sound generation IC 1008, a control device 1022 is connected to the I / O port 1012, and a communication device 1024 is connected to the I / O port 1014. The image sensor 1026 is connected to the I / O port 1028.
[0078]
The information storage medium 1006 mainly stores a program, image data for expressing a display object, sound data, play data, and the like, and corresponds to the information storage medium 500 in FIG. For example, when the computer realizing the present embodiment is a computer, a CD-ROM, DVD, or the like as an information storage medium for storing a game program or the like is a home game device. A cassette or the like is used. Further, when realized as an arcade game device, a memory such as a ROM or a hard disk is used. In this case, the information storage medium 1006 is a ROM 1002.
[0079]
The control device 1022 corresponds to a game controller, an operation panel, and the like, and is a device for a player to input an instruction such as a game difficulty level and an execution start to the device main body.
[0080]
In accordance with a program stored in the information storage medium 1006, a system program stored in the ROM 1002 (such as device initialization information), a signal input from the control device 1022, the CPU 1000 controls the entire device and performs various data processing. . The RAM 1004 is a storage means used as a work area of the CPU 1000 and stores the given contents of the information storage medium 1006 and the ROM 1002 or the calculation result of the CPU 1000.
[0081]
Further, this apparatus is provided with a sound generation IC 1008 and an image generation IC 1010 so that game sounds and game images can be suitably output. The sound generation IC 1008 is an integrated circuit that generates music such as BGM or voice for dance rhythm based on information stored in the information storage medium 1006 or the ROM 1002, and the generated music is output from the speaker 1020. The The image generation IC 1010 is an integrated circuit that generates pixel information to be output to the display 1018 based on image information sent from the RAM 1004, the ROM 1002, the information storage medium 1006, and the like. Note that the display 1018 needs to have a light emitting function, and for example, a CRT, LCD, plasma display, or the like is suitable.
[0082]
The image sensor 20 is constituted by an artificial retina chip or the like, and detects the movement of the player, the image of the player, and the like.
[0083]
The communication device 1024 exchanges various types of information used inside the device with the outside. The communication device 1024 is connected to other devices to send and receive given information according to game programs, etc., or via a communication line. It is used for sending and receiving information such as game programs and new question data.
[0084]
The various processes described with reference to FIGS. 1 to 15 include an information storage medium 1006 that stores a program for performing the process shown in the flowchart of FIG. 16, a CPU 1000 that operates according to the program, an image generation IC 1010, and a sound. This is realized by the generation IC 1008 or the like. Note that the processing performed by the image generation IC 1010 or the like may be performed by software using the CPU 1000 or a general-purpose DSP.
[0085]
FIG. 1 and FIG. 2 described above show an example in which the present invention is applied to an arcade game device. In this case, a CPU, an image generation IC, a sound generation IC, and the like are mounted on a system board built in the apparatus. Information related to the dance game such as the game program 510 and the question data 530 in FIG. 6 is stored in a memory which is an information storage medium on the system board. Hereinafter, information related to the dance game is referred to as stored information.
[0086]
FIG. 18A shows an example in which the present invention is applied to a computer system. The player enjoys a dance game by dancing (operating) toward the image sensor 1220 while viewing the image displayed on the display 1200. In this case, the stored information is stored in a CD-ROM, DVD, or the like, which is an information storage medium that can be attached to and detached from the main unit.
[0087]
FIG. 18B shows an example in which the present invention is applied to a game system including a host device 1300 and terminals 1304-1 to 1304-n connected to the host device 1300 via a communication line 1302. . In this case, the stored information is stored in an information storage medium 1306 such as a magnetic disk device, a magnetic tape device, or a memory that can be controlled by the host device 1300, for example. When the terminals 1304-1 to 1304-n have a CPU, an image generation IC, a sound generation IC, and an image sensor and can generate game images and game sounds (BGM, etc.) in a stand-alone manner, the host device 1300 , A game image, a game program for generating a game sound, and the like are delivered to the terminals 1304-1 to 1304-n. On the other hand, if it cannot be generated stand-alone, the host device 1300 generates a game image and a game sound, which are transmitted to the terminals 1304-1 to 1304-n and output at the terminal.
[0088]
As described above, according to the present invention, since a player's free movement is directly reflected in the score or the like, it is possible to provide a bodily sensation game apparatus using the whole body without any limitation in input operation.
[0089]
The present invention is not limited to the one described in the above embodiment, and various modifications can be made. For example, in the above embodiment, a dance game has been described as an example. However, how to detect a player's motion and how to determine the similarity of the questioning motion is one of the gist of the present invention. The present invention can be applied to a game such as a gesture game that requires determination of the player's action.
[0090]
In addition, the range that can be detected by the image sensor 20 has been described as being divided into four regions. However, as four or more regions, the degree of similarity with respect to a fine operation may be determined, or a region less than four may be used. . In addition, the number of areas may be changed during the questioning dance, for example, in an interlude of a song, such as one area. Furthermore, the number, size, and position of the areas may be changed according to the type of the question dance, the standing position of the player detected by the image sensor, the length of the player's limbs, and the like.
[0091]
Further, although it has been described that the motion vector is specified for each region, it is possible to specify four motion vectors in the order of the magnitude of motion or the speed of speed in all the regions.
[0092]
Although only the movement of the hand is shown and described for the actions performed by the player, the player may move left and right without stopping with the movement of both hands and both feet, or squatting or jumping. Also good. That is, any player's movement is determined based on a motion vector related to the movement, and thus the movement of the player is not limited.
[0093]
In addition, the determination of the similarity has been described first by determining the one with the highest similarity determination result within the allowable time, and then performing weighting according to the degree of coincidence with a given timing. The reverse may be possible. That is, first, the degree of match with a given timing may be determined within the allowable time, and the degree of similarity with a motion vector having a high degree of match may be determined.
[0094]
Further, the similarity determination result may be changed according to the body shape such as the height of the player and the length of the limbs. As a realization method, first, before starting the dance game, the player is announced to take a pose with both hands and both legs extended, and the game is based on an image with both hands and legs of the player detected by the image sensor 20 detected. The calculation unit 110 detects the height and limb length of the player. Specifically, the range occupied by the player in the image, for example, the left and right widths of the range are the length of the hand and the height is the height of the back. And it can implement | achieve by weighting according to a player's height and the length of a limb with respect to the similarity determination result of the dance (motion) in dance mode.
[0095]
Moreover, since the similarity determination by the similarity determination unit 116 is performed for each region, the determination result for each region may be displayed. For example, as in the example of one screen shown in FIG. 19, the display color of the area of the window 738 is changed according to the determination result of each area, or “O” and “X” are displayed in the area. Also good. In this case, the player can immediately recognize which region of the dance that has just been danced is bad and which region is good.
[0096]
【The invention's effect】
According to the present invention, since the free movement by the player is directly reflected in the score or the like, it is possible to provide a game device or the like that uses the whole body and has no restriction on the input operation.
[0097]
Further, since the degree of similarity is determined based on the direction, size, and speed of the player's motion, it is possible to objectively determine a subjective determination such as whether the player's movement is good.
[0098]
Further, since the determination of the similarity is determined at a given timing or the similarity is determined for each detection area, the processing can be reduced.
[Brief description of the drawings]
FIG. 1 is an external front view of a housing of a business game apparatus 700 to which the present invention is applied.
FIG. 2 is a cross-sectional view of a business game apparatus 700 to which the present invention is applied.
FIG. 3 is an example of a screen in a storage mode.
FIG. 4 is an example of one screen in a dance mode.
FIG. 5 is an example of one screen in a dance mode.
FIG. 6 is an example of a functional block diagram of the game device according to the present embodiment.
7 is a diagram showing an example of character action data 534. FIG.
8 is a diagram illustrating an example of determination criterion data 536. FIG.
FIG. 9 is a diagram illustrating a range that can be detected by the image sensor 20;
FIG. 10 is a diagram showing a first region to a fourth region.
FIG. 11 is a diagram illustrating an example of player operation data.
FIG. 12A is a diagram illustrating an example when a player makes a plurality of movements; (B) is a figure which shows the motion vector of the player of the same figure (a) which the image sensor 20 detected.
FIG. 13A is a diagram showing an example when there are a plurality of movements in the same region. (B) is a figure which shows the motion vector of the player of the same figure (a) which the image sensor 20 detected.
FIG. 14 is a diagram for explaining similarity determination for an operation that is in timing.
FIG. 15 is a diagram for explaining determination of similarity when the timing is not correct but the operation is within an allowable time.
FIG. 16 is a flowchart showing an example of a processing operation in the game device of the present embodiment.
FIG. 17 is a diagram illustrating an example of a hardware configuration capable of realizing the exemplary embodiment.
FIG. 18 is a diagram showing examples of various types of apparatuses to which the present invention is applied.
FIG. 19 is a diagram illustrating an example of a screen when a determination result for each region is displayed.
[Explanation of symbols]
10 Operation part
20 Image sensor
100 processor
110 Game calculation part
114 Questions Dance Setting
116 Similarity determination unit
118 Action identification unit
130 Image generator
140 Music generator
30 Display section
40 Speaker
500 Information storage medium
510 game program
530 Questions data
532 music data
534 Character action data
536 Criteria data

Claims (19)

Analyzes process the image obtained from the light receiving unit, a game apparatus having an operation detecting means that detect at any time a partial movement player operates as the motion vector respectively appearing in the image,
Storage means for storing determination reference data for determining whether or not the action of the player is the same as a given questioning action based on a motion vector detected by the action detecting means ;
The motion vector that is detected by the operation detecting means, is compared with the determination reference data stored in the storage means every given time interval, the similarity of the operation of the player and the given question operation and similarity determining means you determine,
A game device comprising:   In claim 1,
  The criterion data is data for each time interval of a motion vector representing the questioning action,
  A game device in which the similarity determination means compares the motion vector detected by the motion detection means with corresponding determination reference data at each time interval. In claim 1 or 2,
The storage means stores the determination reference data in association with each area obtained by dividing the detection range of the motion detection means,
A specifying unit for specifying a motion vector to be determined for each of the regions from among the motion vectors detected by the motion detection unit;
The similarity determination unit compares the motion vector specified by the specifying unit with the determination reference data stored in the storage unit for each of the regions, so that the player's operation and the given question operation Game device for determining the degree of similarity. Analyzes process the image obtained from the light receiving unit, a game apparatus having an operation detecting means that detect at any time a partial movement player operates as the motion vector respectively appearing in the image,
Dividing the detection range of the motion detection means into judgment reference data for determining whether the player's motion is the same as a given question motion based on the motion vector detected by the motion detection means Storage means for storing in association with each area ,
A specifying means for specifying a motion vector to be determined for each of the regions from among the motion vectors detected by the motion detecting means ;
Wherein for each of the regions, by comparing the determination reference data stored in said storage means and the motion vector identified by the identifying means, to determine the similarity of the operation of the player and the given question operation and the similarity determination means that,
A game device comprising: In claim 3 or 4,
A game apparatus comprising region-specific result display means for displaying the determination result by the similarity determination means for each area .   In any of claims 3 to 5,
  The specifying unit includes a determining unit that determines a region to which the motion vector belongs based on a starting position of the motion vector in the detection range, and based on the determination result, a motion to be determined for each region. A game device that identifies a vector.   In any of claims 3 to 6,
  When there are a plurality of motion vectors detected by the motion detection means in the same area, the specifying means determines the motion vector based on at least one of the direction, the size, and the speed of each motion vector. A game device that identifies a motion vector to be determined. In any of claims 3 to 7,
By visual or audible presentation effect a timing notification means that notifies a given timing,
Motion vectors are detected by the operation detecting means, and a timing determining means you determine if it matches the given timing,
With
The specifying means, when there are a plurality of motion vectors detected by the motion detecting means in the same region, a motion vector determined by the timing determining means to be suitable for the given timing, as the similarity determining means. A game device that identifies a motion vector as a similarity determination target.   In any of claims 3 to 7,
  With a timing notification means for notifying a given timing by visual or auditory effects,
  The similarity determination means repeatedly determines the similarity at a given time interval for a given allowable time including at least the given timing, and 1) of a plurality of determination results within the allowable time Based on the highest similarity among them, and 2) the degree of coincidence between the timing at which the motion vector having the highest similarity is detected and the given timing, the similarity between the player's action and the questioning action at that timing Judge the degree,
  Game device.   In any one of Claim 1 to 9,
  A play level is associated with the questioning action in advance,
  The motion detection means detects the direction, magnitude, and speed of the motion as an element of the motion vector,
  The game apparatus in which the similarity determination means changes which element of the motion vector elements determines the similarity according to the play level associated with the questioning action to be compared.   In any one of Claim 1 to 10
  Player range detection means for controlling the motion detection means before starting the game to detect a range occupied by the player motion part of the detection range;
  Weighting means for changing the determination result by the similarity determination means by weighting based on the range detected by the player range detection means;
  A game device comprising:   In any one of Claim 1 to 11
  A game apparatus comprising screen display control means for performing control to simultaneously display an image of a character performing an action based on the questioning action and an image of a player obtained by the light receiving unit.   A computer-readable information storage medium including an operation detection unit that analyzes an image obtained from a light receiving unit and detects a motion of a player as needed by using each partial motion appearing in the image as a motion vector,
  Determination criterion data for determining whether or not the action of the player is the same as a given questioning action based on the motion vector detected by the action detecting means;
  The motion vector detected by the motion detection means is determined for each given time interval. A program for causing the computer to function as similarity determination means for determining the similarity between a player's action and the given questioning action by comparing with constant reference data;
  An information storage medium that stores information.   In claim 13,
  The determination reference data is stored in association with each region obtained by dividing the detection range of the motion detection unit,
  The program is
  While further causing the computer to function as specifying means for specifying a motion vector to be determined for each of the regions from among the motion vectors detected by the motion detecting means,
  The similarity determination means determines the similarity between the player's action and the given questioning action by comparing the motion vector specified by the specifying means with the determination reference data for each of the regions. An information storage medium which is a program for causing the computer to function.   An information storage medium readable by a computer having an operation detection means for analyzing a player's operation at any time by analyzing each of the partial movements appearing in the image by analyzing the image obtained from the light receiving unit. ,
  Dividing the detection range of the motion detection means into judgment reference data for determining whether or not the motion of the player is the same as a given question motion based on the motion vector detected by the motion detection means Are stored in association with each area,
  A specifying unit for specifying a motion vector to be determined for each of the regions from among the motion vectors detected by the motion detection unit;
  Similarity determination means for determining the similarity between a player's action and the given questioning action by comparing the motion vector specified by the specifying means and the determination reference data for each of the regions,
  An information storage medium storing a program for causing the computer to function.   In any of claims 13 to 15,
  The program is
  A timing notification means for notifying a given timing by visual or auditory effects;
  Timing determination means for determining whether or not the motion vector detected by the motion detection means matches the given timing;
  As the computer functions as
  When the specifying means has a plurality of motion vectors detected by the motion detecting means in the same region, the similarity determining means determines a motion vector determined by the timing determining means as being in accordance with the given timing. An information storage medium, which is a program for causing the computer to function so as to specify an action vector as a similarity determination target by   In any of claims 13 to 15,
  The program is
  By causing the computer to function as a timing notification means for notifying a given timing by visual or auditory effects,
  The similarity determination means repeatedly determines the similarity at a given time interval for a given allowable time including at least the given timing, and 1) of a plurality of determination results within the allowable time Based on the highest similarity among them, and 2) the degree of coincidence between the timing at which the motion vector having the highest similarity is detected and the given timing, the similarity between the player's action and the questioning action at that timing An information storage medium which is a program for causing the computer to function so as to determine the degree.   In any of claims 13 to 17,
  A play level is associated with the questioning action in advance,
  The program is
  The motion detection means detects the direction, magnitude and speed of the motion as an element of the motion vector;
  According to the play level associated with the questioning action to be compared, which element of the motion vector determines the similarity is determined by the similarity determination unit.
  An information storage medium that is a program for causing the computer to function as described above.   In any of claims 13 to 18,
  The program is
  An information storage medium which is a program for causing the computer to function as screen display control means for performing control to simultaneously display an image of a character performing an action based on the questioning action and a player image obtained by the light receiving unit.

Images