JP2013044889A - Music player - Google Patents

Abstract

To provide a performance device capable of changing a musical sound in accordance with a movement of a performer's body regardless of a performance member used for performance.
A performance device includes a sound generation unit that generates a predetermined musical sound and a stick that is used by a player to give a sound generation instruction to the sound generation unit by detecting a predetermined performance operation of the player. And a belt unit 20 that detects a predetermined physical movement of the performer and notifies the sound generation unit 30, and the sound generation unit 30 is configured to receive a sound generation instruction from the stick unit 10. A musical tone corresponding to the physical movement of the performer notified from the unit 20 is generated.
[Selection] Figure 1

Description

  The present invention relates to a performance device.

2. Description of the Related Art Conventionally, there has been proposed a performance device that generates a sound corresponding to a performance operation when the player performs a predetermined performance operation. For example, a performance device that emits percussion instrument sounds with a configuration composed only of stick-shaped members is known. In this performance device, a sensor is provided on a stick-shaped member, and the player holds the member by hand and shakes it. Then, the sensor detects the performance action and generates a percussion instrument sound.
According to such a virtual performance device, the musical sound of the musical instrument can be generated without the need for an actual musical instrument, so that the performance can be enjoyed without being restricted by the performance place or the performance space.

  As a virtual performance device as described above, for example, in Patent Document 1, an acceleration sensor is provided on a stick-shaped member, and an output (acceleration value) obtained from the acceleration sensor by shaking this member reaches a predetermined threshold value. Then, a performance device configured to generate a musical tone is disclosed.

JP 2007-256736 A

  By the way, in such a virtual performance device, there are many cases where different musical tones are prepared for each different performance operation of the performer. The performance device disclosed in Patent Document 1 is also configured to determine the direction of a stick-like member using a geomagnetic sensor and to generate a musical tone having a different timbre according to this direction. That is, it is possible to change the musical tone in the direction in which the stick-shaped member is shaken.

  Here, with a virtual performance device that allows you to enjoy playing without the need for real instruments, it is possible to expand the performance range of the performer compared to real instruments, so that the musical sound that is produced Various changes are required depending on the form of performance. In this regard, in the performance device disclosed in Patent Document 1, since the musical tone is changed only by the performance form of the stick-shaped member used by the performer, the change in the musical tone to be generated is limited. .

  Therefore, the present invention is a performance device capable of changing musical sounds in an unprecedented manner, more specifically, it is possible to change musical sounds in various ways irrespective of the performance action given to members used for performance. An object is to provide a performance device.

  In order to achieve the above object, a performance device according to an aspect of the present invention detects a performance member, a sound generation unit that generates a predetermined musical sound, and a predetermined performance action given by a performer to the performance member. A sound generation instruction means for giving a sound generation instruction to the sound generation means; and a detection means for detecting a predetermined physical motion of the player and notifying the sound generation means of the detection result. The means is characterized in that a musical sound corresponding to the body movement is generated based on the detection result.

  According to the present invention, it is possible to variously change the musical sound to be generated according to the movement of the performer's body that is not related to the performance action given to the member used for the performance.

It is a figure which shows the outline | summary of the performance apparatus of one Embodiment of this invention. It is a block diagram which shows the hardware constitutions of the sound generation part of a performance apparatus. It is a block diagram which shows the hardware constitutions of the stick part of a performance apparatus. It is a figure which shows the external appearance of a stick part. It is a block diagram which shows the hardware constitutions of the belt part of a performance apparatus. It is a flowchart which shows the flow of a process of a stick part. It is a flowchart which shows the flow of a process of a stick part. It is a figure which shows the relationship between the sensor synthetic value of a stick part, and the transmission timing of a note-on event. It is a flowchart which shows the flow of a process of a stick part. It is a flowchart which shows the flow of a process of a belt part. It is a flowchart which shows the flow of a process of a belt part. It is a flowchart which shows the flow of a process of a belt part. It is a flowchart which shows the flow of a process of a sound generation part. It is a flowchart which shows the flow of a process of a sound generation part.

  Embodiments of the present invention will be described below with reference to the accompanying drawings.

  FIG. 1 is a diagram showing an outline of a performance device 1 according to an embodiment of the present invention. As shown in FIG. 1A, the performance device 1 of the present invention includes a stick unit 10, a belt unit 20, and a sound generation unit 30.

The stick portion 10 is a stick-like member extending in the longitudinal direction, and corresponds to a performance member of the present invention. The performer performs a performance operation by holding up one end (base side) of the stick unit 10 and performing a swing-down operation centering on the wrist or the like. In order to detect such a player's performance, an acceleration sensor 12 is provided at the other end (front end side) of the stick unit 10 (see FIG. 3 described later).
The belt unit 20 has a mounting unit (not shown) and is mounted on the performer's body (in this embodiment, the performer's waist). Moreover, the belt part 20 functions as the detection means of the present invention, and detects the movement of the performer's body.
The sound generation unit 30 functions as the sound generation means of the present invention and generates a musical sound.

  In such a performance device 1, a performance by the performer is performed by the sound generation unit 30 generating a predetermined musical sound in response to a performance operation using the stick unit 10, that is, a swing-down operation of the stick unit 10. .

  At this time, in the performance device 1 of the present invention, as shown in FIG. 1 (2), various musical sounds are generated according to the movement of the performer's body. For example, in the present embodiment, the sound generation unit 30 sounds a musical sound with a higher volume according to the advance of the performer and generates a musical sound with a lower volume according to the backward movement of the performer. In addition, the sound generation unit 30 generates a tone having a tone different from the landing state when the performer jumps, for example, a tone of a different instrument. It should be noted that the player's body movement and various musical sounds corresponding to the movement can be set as appropriate. In other words, different musical sounds may be generated according to the movement of the performer's body or the rotation of the performer.

  Next, specific configurations of the stick unit 10, the belt unit 20, and the sound generation unit 30 constituting the performance device 1 of the present invention will be described.

  First, the configuration of the sound generation unit 30 will be described with reference to FIG. FIG. 2 is a block diagram illustrating a configuration of the sound generation unit 30. As shown in FIG. 2, the sound generator 30 includes a CPU (Central Processing Unit) 31, an interface (I / F) 32, a ROM (Read Only Memory) 33, a RAM (Random Access Memory) 34, a display unit 35, and an input unit. 36 and a sound system 37.

  The I / F 32 of the sound generation unit 30 accepts data from the stick unit 10 (for example, note-on event) and data from the belt unit 20 (for example, advance flag), stores the data in the RAM 34, and accepts data to the CPU 31. To be notified. In the present embodiment, the infrared communication device 17, the infrared communication device 27, and the infrared communication device 38 are provided in each of the stick unit 10, the belt unit 20, and the sound generation unit 30. The I / F 32 receives the infrared rays emitted from the infrared communication device 17 of the stick unit 10 and the infrared rays emitted from the infrared communication device 27 of the belt unit 20 by the infrared communication device 38, so that the stick unit 10 and the belt unit 20 receive the infrared rays. Receive data.

  The CPU 31 controls the performance device 1 as a whole, in particular, controls the sound generator 30, detects operations of key switches (not shown) constituting the input unit 36, and notes from the stick unit 10 received via the I / F 32. Various processing such as sound generation based on on-event is executed.

  The ROM 33 controls the performance device 1 as a whole, in particular, the sound generation unit 30, the detection of operation of a key switch (not shown) constituting the input unit 36, and a musical tone based on a note-on event received via the I / F 32. Stores various processing programs such as pronunciation. The ROM 33 stores waveform data of various timbres, for example, wind instruments such as flutes, saxophones, and trumpets, keyboard instruments such as pianos, stringed instruments such as guitars, bass drums, hi-hats, snares, cymbals, and toms. Includes waveform data area to store.

  The RAM 34 stores programs read from the ROM 33, data and parameters generated in the course of processing. The data generated in the process includes the operation state of the switch of the input unit 36, the note-on event received via the I / F 32, the state of the player's physical movement (forward flag and displacement), and the like.

  The display unit 35 is composed of, for example, a liquid crystal display device, and displays the selected tone color and volume, the state of the player's body movement (displacement from the reference position), and the like as an image. The input unit 36 has various switches (not shown) and accepts input of various information from the performer.

  The sound system 37 includes a sound source unit 371, an audio circuit 372, and a speaker 373. The sound source unit 371 reads out waveform data from the waveform data area of the ROM 33 in accordance with an instruction from the CPU 31, and generates and outputs musical sound data. The audio circuit 372 converts the musical sound data output from the sound source unit 371 into an analog signal, amplifies the converted analog signal, and outputs the amplified analog signal to the speaker 373. As a result, a musical tone is output from the speaker 373.

  Next, the configuration of the stick unit 10 will be described with reference to FIG. FIG. 3 is a block diagram showing the configuration of the stick unit 10. As shown in FIG. 3, the stick unit 10 includes a CPU 11, an acceleration sensor 12, an interface (I / F) 13, a ROM 14, a RAM 15, and an input unit 16.

The acceleration sensor 12 is a capacitive or piezoresistive element type triaxial sensor disposed inside the tip side opposite to the root side held by the player of the stick unit 10, and is an X, Y, Z The sensor combined value obtained by combining the acceleration value indicating the acceleration generated in each of the three axis directions and the acceleration value of each of the three axis components is output.
Referring to FIG. 4, in the present embodiment, the axis that coincides with the longitudinal axis of the stick portion 10 is defined as the Y axis, parallel to the substrate (not shown) on which the acceleration sensor 12 is disposed, and the Y axis. The axis orthogonal to the X axis is the X axis, and the axis orthogonal to the X axis and the Y axis is the Z axis. The acceleration sensor 12 obtains acceleration values of the respective components of the X axis, the Y axis, and the Z axis, and calculates a sensor composite value obtained by combining the respective acceleration values. Here, the player holds one end (base side) of the stick unit 10 and performs a swing-up and swing-down operation around the wrist or the like, thereby causing the stick unit 10 to rotate. When 10 is stationary, the acceleration sensor 12 calculates a value corresponding to the gravitational acceleration 1G as a sensor composite value, and when the stick unit 10 is rotating, the acceleration sensor 12 A value larger than the gravitational acceleration 1G is calculated as a composite value.
The sensor composite value is obtained, for example, by calculating the square root of the sum of the squares of the acceleration values of the X-axis, Y-axis, and Z-axis components.

Returning to FIG. 3, the CPU 11 acquires the acceleration value and the sensor composite value output from the acceleration sensor 12, generates a note-on event according to the acceleration value and the sensor composite value, and takes note through the I / F 13 and the infrared communication device 17. A process of transmitting an on event to the sound generator 30 is executed. Here, the note-on event is command information for instructing the tone generator 371 to generate a musical tone. In this embodiment, in addition to the tone color and pitch information of the musical tone to be generated, the musical tone volume is further increased. Such information shall be included.
As described above, by transmitting the note-on event to the sound generation unit 30 based on the sensor composite value of the stick unit 10, the sound generation unit 30 can generate a predetermined musical sound based on the performance operation using the stick unit 10. it can.

  The ROM 14 stores processing programs for various types of processing executed by the CPU 11, that is, processing programs such as acquisition processing of acceleration values and sensor composite values output from the acceleration sensor 12, generation processing of note-on events, transmission processing of note-on events, and the like. To do. The RAM 15 stores values obtained or generated in the processing such as acceleration values and sensor composite values. The I / F 13 outputs data to the infrared communication device 17 in accordance with an instruction from the CPU 11. The input unit 16 includes various switches (not shown) and receives input of various information from the performer.

  Then, with reference to FIG. 5, the structure of the belt part 20 is demonstrated. FIG. 5 is a block diagram illustrating a configuration of the belt unit 20. As shown in FIG. 5, the belt unit 20 includes a CPU 21, an acceleration sensor 22, an interface (I / F) 23, a ROM 24, a RAM 25, and an input unit 26.

  The acceleration sensor 22 is a capacitance type or piezoresistive type three-axis sensor disposed inside the belt portion 20, and an acceleration value indicating acceleration generated in each of the three axial directions of X, Y, and Z. Is output. Here, in the present embodiment, the horizontal plane is the XY plane, and the axis that coincides with the front axis of the player wearing the belt unit 20 among the XY plane is the Y axis and the axis that is orthogonal to the Y axis. Is an X axis, and an axis orthogonal to the X axis and the Y axis is a Z axis. That is, the acceleration value of the X-axis component acquired by the acceleration sensor 22 indicates the lateral acceleration value of the player wearing the belt unit 20, and the acceleration value of the Y-axis component is the player wearing the belt unit 20. The acceleration value of the Z-axis component indicates the acceleration value of the player wearing the belt unit 20 in the vertical direction.

The CPU 21 acquires the acceleration value output from the acceleration sensor 22, detects the player's body movement using the acceleration value, calculates the player's current position, and performs the player's current position via the I / F 23 and the infrared communication device 27. A process of transmitting various data such as the body movement and the current position of the performer to the sound generator 30 is executed.
Here, in this embodiment, CPU21 detects the movement operation | movement and jumping movement to the front-back direction as a motion of a player's body. At this time, as will be described later, the moving motion in the front-rear direction is detected using the acceleration value of the Y-axis component of the acceleration sensor 22, and the jumping motion is detected using the acceleration value of the Z-axis component of the acceleration sensor 22. To do. Further, it is preferable that the CPU 21 also detects the amount of movement in the front-rear direction when detecting the movement operation in the front-rear direction. In order to be able to produce musical sounds different in accordance with the moving amount.

  The ROM 24 is a processing program for various processes executed by the CPU 21, that is, an acceleration value output process output from the acceleration sensor 22, a player's body motion detection process using the acceleration value, and a player's current position calculation process. A processing program for transmitting various data such as the player's body movement and the player's current position is stored. The RAM 25 stores values acquired or generated in processing such as acceleration values, amounts of movement in the front-rear direction, reference positions, and current positions. The I / F 23 outputs data to the infrared communication device 27 in accordance with an instruction from the CPU 21.

  The input unit 26 includes a switch (not shown) and receives input of various information from the performer. For example, the input unit 26 receives an input of the reference position from the performer at the start of performance. Note that the CPU 21 calculates the current position of the performer based on the reference position and the movement amount received via the input unit 26.

The following describes the processing of the performance apparatus 1 of the present embodiment. First, with reference to FIG. 6, a description will be given of a process executed in the stick 10.
As shown in FIG. 6, the CPU 11 of the stick unit 10 executes an initialization process including clearing of data in the RAM 15 (step S1). When the initialization process (step S1) ends, the CPU 11 acquires the sensor value (acceleration value) of the acceleration sensor 12 and stores it in the RAM 15 (step S2). As described above, in this embodiment, the acceleration value in the triaxial direction of the stick unit 10 is employed as the acceleration value. Note that the CPU 11 preferably also acquires a sensor composite value obtained by combining the acceleration values in the three-axis directions in the process of S2. At this time, the sensor composite value may be calculated by the CPU 11 from the acceleration values in the three-axis directions, or may be calculated by the acceleration sensor 12.

  Subsequently, the CPU 11 executes a sound generation timing detection process (step S3). Although details will be described later with reference to FIG. 7, in the sound generation timing detection process, the CPU 11 detects a sound generation timing based on the value of the sensor composite value, that is, generates a note-on event based on the sensor composite value, and Send. When the sound generation timing detection process (step S3) ends, the CPU 11 executes a parameter communication process (step S4). In the parameter communication process, data related to the tone color and pitch of the musical tone to be generated, transmitted from the sound generation unit 30 in response to the parameter communication process (step S65 in FIG. 13) in the sound generation unit 30 described later, is transmitted via the I / F 13. Accept and store in RAM 15. The CPU 11 creates a note-on event based on the transmitted tone color and pitch. Conversely, the input unit 16 may transmit parameters such as the set tone color and volume volume value to the sound generation unit 30 via the I / F 13.

Next, details of the sound generation timing detection process (step S3 in FIG. 6) in the stick unit 10 will be described with reference to FIG.
As shown in FIG. 7, the CPU 11 reads out the sensor composite value stored in the RAM 15 (step S11). Next, the CPU 11 determines whether or not the acceleration flag stored in the RAM 15 is “0” (step S12). Here, the acceleration flag is information for determining whether or not the stick unit 10 is stopped. The acceleration flag “1” indicates that the stick unit 10 is operating, and the acceleration flag “0”. Indicates that the stick unit 10 is stopped (that is, the sensor composite value is gravitational acceleration 1G).

  If YES is determined in step S12, the CPU 11 determines whether the sensor composite value is larger than a value corresponding to (1 + a) G (step S13). Here, a is a positive number. Since the process of step S13 is performed when YES is determined in step S12, the fact that the answer is YES in step S13 indicates that the stopped stick unit 10 is shaken by the player, and the sensor composite value is based on the gravitational acceleration 1G. It shows that it has grown.

  If YES is determined in the step S13, the CPU 11 sets the acceleration flag in the RAM 15 to “1” (step S14), and ends the sound generation timing detection process. On the other hand, if NO is determined in step S13, the CPU 11 ends the sound generation timing detection process.

  If NO is determined in step S12, that is, if the acceleration flag is “1”, the CPU 21 determines whether the sensor composite value is smaller than a value corresponding to (1 + b) G (step S15). Here, b is a small positive number smaller than a. When it is determined YES in S15, the CPU 11 executes a note-on event generation process (step S16). Although details will be described later with reference to FIG. 9, in the note-on event generation process, the CPU 11 generates a note-on event and transmits it to the sound generation unit 30. Thus, the stick unit 10 of the present embodiment generates a note-on event based on the value of the sensor composite value.

  Here, when the performer swings the stick unit 10, the sensor composite value gradually increases. When the performer swings the stick unit 10, the player generally operates in the same manner as the operation of hitting the drum. Therefore, the performer stops the operation of the stick unit 10 immediately before hitting the stick on the virtually set drum surface. Therefore, the sensor composite value gradually decreases from a certain time. Since the performer assumes that the musical sound is generated at the moment when the stick is hit on the surface of the virtual drum, it is desirable that the performer can generate the musical sound at the timing assumed by the performer.

  Therefore, in the present embodiment, the logic shown in FIG. 7 is adopted in order to produce a musical sound at the moment when the player strikes the stick on the virtual drum surface or slightly before that. This point will be specifically described with reference to FIG. The sound generation timing (generation of a note-on event) is assumed to be when the sensor composite value decreases and becomes smaller than (1 + b) G that is slightly larger than the gravitational acceleration 1G. However, the sensor composite value may vibrate and reach (1 + b) G due to an action that the player does not expect. Therefore, in order to eliminate unexpected vibrations, it is a condition that the sensor composite value once rises and exceeds (1 + a) G (a is sufficiently larger than b). That is, when the sensor composite value once becomes larger than (1 + a) G (see time t1) and thereafter the sensor composite value decreases and becomes smaller than (1 + b) G (see time t2), the sound generation timing is set. When it is determined that the sound generation timing as described above has arrived, a note-on event is generated in the stick unit 10 and transmitted to the sound generation unit 30. In response to this, the sound generation unit 30 executes sound generation processing to generate a musical sound.

Further, it is also possible to detect the sound generation timing (generate a note-on event) without using the sensor composite value as in the sound generation timing detection process of FIG. For example, the sound generation timing may be detected by detecting the end of the swing-down operation of the stick unit 10 based on the acceleration value of the component in the Z-axis direction of the acceleration sensor 12.
More specifically, the acceleration value of the component in the Z-axis direction of the acceleration sensor 12 shows a negative value due to gravitational acceleration in a stationary state. When the operation of swinging down the stick unit 10 is started, the acceleration value changes in the plus direction, and after changing to a certain plus value (at the time when the maximum speed is reached), the acceleration value changes in the minus direction. Then, the acceleration value continues to change in the minus direction, takes a lower minus value exceeding the value of the gravitational acceleration, and then turns in the plus direction again. The time point when the gravitational acceleration value is exceeded and becomes a lower negative value, that is, immediately before the operation of the stick unit 10 is stopped (end of the swing-down operation) may be detected as the sound generation timing.

  Returning to FIG. 7, when the note-on event generation process (step S <b> 16) ends, or when it is determined NO in step S <b> 15, the CPU 11 ends the sound generation timing detection process.

  Next, the details of the note-on event generation process (step S16 in FIG. 7) in the stick unit 10 will be described with reference to FIG. The note-on event is transmitted to the sound generation unit 30 by the note-on event generation processing shown in FIG. 9, and then the sound generation processing (see FIG. 14) is executed in the sound generation unit 30, thereby generating musical sound data and the speaker 373. The sound is pronounced.

  As shown in FIG. 9, the CPU 11 refers to the maximum value of the sensor composite value stored in the RAM 15 and determines the volume level of the musical sound based on the maximum value (step S21). Thereafter, the CPU 11 generates a note-on event including the volume level determined in step S21 (step S22). Next, the CPU 11 transmits the generated note-on event to the sound generator 30 via the I / F 13 and the infrared communication device 17 (step S23). Thereafter, the CPU 11 resets the acceleration flag in the RAM 15 to “0” (step S24), and ends the note-on event generation process.

Subsequently, referring to FIG. 10, description is given of processing executed in a belt unit 20.
As shown in FIG. 10, when the power is turned on, the CPU 21 of the belt unit 20 performs an initialization process including clearing of data in the RAM 25 (step S31). In the initialization process, the reference position data in the RAM 25 is cleared and the current position is set as the reference position. When the initialization process (step S31) ends, the CPU 21 reads the sensor value (acceleration value) of the acceleration sensor 22 and stores it in the RAM 25 (step S32). Then, CPU 21 executes the forward traveling determination process (step S33). Although details will be described later with reference to FIG. 11, in the forward determination process, the CPU 21 determines the movement (forward or backward) of the performer from the acceleration value in the Y-axis direction stored in the RAM 25 in step S32.

  Subsequently, the CPU 21 executes a jump determination process (step S34). Although details will be described later with reference to FIG. 12, in the jump determination process, the CPU 21 determines the movement (jumping) of the player's body from the acceleration value in the Z-axis direction stored in the RAM 25 in step S32. Next, the CPU 21 executes parameter communication processing (step S35). In the parameter communication process, the reference position set in step S31 and the data for determining the player's body movement determined in step S33 or step S34 (forward flag, backward flag, displacement amount, jump flag described later) The sound is transmitted to the sound generator 30 via F23 and the infrared communication device 27.

Next, with reference to FIG. 11, details of the forward determination process (step S <b> 33 in FIG. 10) in the belt unit 20 will be described.
As shown in FIG. 11, the CPU 21 calculates a displacement amount from the acceleration value in the Y-axis direction read out in step S32 of FIG. 10 (step S41). Here, the amount of displacement can be calculated by integrating the acceleration value twice. At this time, the CPU 21 also calculates the positive / negative displacement amount according to the direction of acceleration in the Y-axis direction. In the present embodiment, the acceleration sensor 22 outputs the acceleration value in the Y-axis direction with the front direction of the player wearing the belt unit 20 being positive. Therefore, the amount of displacement of the performer in the front direction is a positive value, and the amount of displacement of the performer in the back direction is a negative value.

  Subsequently, the CPU 21 determines whether or not the displacement amount calculated in step S41 is larger than “0” (step S42). If YES is determined in the step S42, the CPU 21 sets “1” in the advance flag (step S43). On the other hand, if NO is determined in step S42, the CPU 21 determines whether the displacement calculated in step S42 is smaller than “0” (step S44). If YES is determined in the step S44, the CPU 21 sets “1” in the reverse flag (step S45). When the process of step S43 or step S45 ends, the CPU 21 sets the displacement calculated in step S41 in the RAM 25 (step S46), and ends the forward determination process.

  On the other hand, when it is determined NO in step S44, the CPU 21 resets the forward flag and the backward flag to “0” (step S47), and ends the forward determination process. The advance flag is information for determining whether the player is moving forward, the advance flag “1” indicates that the player is moving forward, and the advance flag “0” is the player. Indicates that is not moving forward. Similarly, the reverse flag is information for determining whether the performer is retreating, the retreat flag “1” indicates that the performer is retreating, and the retreat flag “0” is the performance. Indicates that the person is not retreating.

Next, the details of the jump determination process (step S34 in FIG. 10) in the belt unit 20 will be described with reference to FIG.
As shown in FIG. 12, the CPU 21 determines whether or not the jump flag stored in the RAM 25 is “1” (step S51). Here, the jump flag is information for determining whether the performer is jumping, the jump flag “1” indicates that the performer is jumping, and the jump flag “0” indicating that the player is not in jumping (which is in the landing).

  If NO is determined in step S51, the CPU 21 determines whether the acceleration value in the Z-axis direction read in step S32 of FIG. 10 is smaller than the jump determination acceleration value α (step S52). The jump determination acceleration value α can be set to an arbitrary value. Here, in the present embodiment, the acceleration sensor 22 of the belt unit 20 outputs the acceleration value in the Z-axis direction with the gravitational direction being positive, so the jump determination acceleration value α is approximated to, for example, “0”. By determining the value to be used, it can be determined whether or not the performer has jumped. Therefore, when it is determined YES in step S52, the CPU 21 sets “1” in the jump flag (step S53) and ends the jump determination process. On the other hand, if NO is determined in step S52, the CPU 21 ends the jump determination process.

  If YES is determined in the step S51, the CPU 21 determines whether or not the acceleration value in the Z-axis direction read in the step S32 in FIG. 10 is larger than the landing determination acceleration value β (step S54). . Note that the landing determination acceleration value β can also be set to an arbitrary value. For example, when the acceleration is 1G, an impact at the time of landing can be detected. For this reason, if it is determined YES in step S54, the CPU 21 sets “0” in the jump flag (step S55), and ends the jump determination process. On the other hand, when it is determined NO in step S54, the CPU 21 ends the jump determination process.

Next, with reference to FIG. 13, processing executed in the sound generation unit 30 will be described.
As shown in FIG. 13, the CPU 31 of the sound generation unit 30 executes initialization processing including clearing data in the RAM 34, clearing the image displayed on the screen of the display unit 35, clearing the sound source unit 371, and the like when the power is turned on. (Step S61). Next, the CPU 31 executes a switch process (step S62). In the switch processing, for example, the volume volume value and tone color desired by the performer are specified according to the switch operation of the input unit 36 and stored in the RAM 34.

  Subsequently, the CPU 31 determines whether the I / F 32 has newly received a note-on event (step S63). If it is determined Yes in step S63, the CPU 31 executes a process of instructing the sound source unit 371 to generate a musical tone having the set volume volume value and the set tone based on the received note-on event. (Step S64).

  Subsequently, the CPU 31 executes parameter communication processing (step S65). Although details will be described later with reference to FIG. 14, in the parameter communication processing, the CPU 31 performs communication of predetermined data with the stick unit 10 and the belt unit 20. For example, the CPU 31 transmits the pitch or timbre data selected in the switch process (step S 62) to the stick unit 10 via the I / F 32 and the infrared communication device 38. Further, the CPU 31 stores the tone color data or volume volume value received from the stick unit 10 in the RAM 34. Further, the CPU 31 receives data for determining the player's body movement transmitted from the belt unit 20 via the I / F 32 and the infrared communication device 38 and stores the data in the RAM 34. Based on the data stored in the RAM 34, the CPU 31 controls the musical sound to be generated. When the parameter communication process (step S65) is completed, the CPU 31 executes other processes, for example, an update of an image displayed on the screen of the display unit 35 (step S66).

Next, details of the parameter communication process (step S65 in FIG. 13) in the sound generation unit 30 will be described with reference to FIG.
As shown in FIG. 14, the CPU 31 first determines whether or not a parameter has been received from the stick unit 10 or the belt unit 20 (step S71). If NO is determined here, the process ends. On the other hand, when it is determined YES, the CPU 31 determines whether or not the parameter is received from the belt unit 20 (step S72). If NO is determined here, that is, if a parameter is received from the stick unit 10 instead of the belt unit 20, the received parameter is stored in the RAM 34 as described above (step S73), and the parameter communication process is terminated.

  On the other hand, if YES is determined, the CPU 31 determines the content of the parameter transmitted from the belt unit 20. First, it is determined whether or not the forward flag received from the belt unit 20 is “1” (step S74). If YES is determined in the step S74, the CPU 31 positively corrects the set volume volume value (step S75). At this time, it is preferable that the CPU 31 positively corrects the volume volume value according to the amount of displacement received from the belt unit 20. The positive correction according to the amount of displacement may be that the volume volume value is corrected to be higher as the amount of displacement is larger, and the current position is specified from the amount of displacement, and the distance between the reference position and the current position is determined. Accordingly, the volume volume value may be corrected higher as the distance is longer.

  On the other hand, if NO is determined in step S74, the CPU 31 determines whether or not the reverse flag received from the belt unit 20 is “1” (step S76). If YES is determined in the step S76, the CPU 31 negatively corrects the set volume volume value (step S77). At this time, it is preferable that the CPU 31 negatively corrects the volume volume value in accordance with the amount of displacement received from the belt unit 20 as in step S75.

  On the other hand, if NO is determined in step S76, the CPU 31 determines whether the jump flag received from the belt unit 20 is “1” (step S78). If YES is determined in the step S78, the CPU 31 changes the set tone color, for example, a tone color of a musical instrument different from that at the time of landing or a tone color higher than that at the time of landing (step S79).

  When the process of step S75, step S77, or step S79 ends, or if NO is determined in step S78, the CPU 31 performs sound generation control (step S80) and ends the parameter communication process. In the sound generation control, the CPU 31 appropriately changes the volume and tone color of the musical sound being sounded. In other words, the CPU 31 changes the volume of the tone that is sounded based on the volume volume value corrected in step S75 or S77, or changes the tone of the tone that is sounded based on the tone changed in step S79. change.

According to the performance device 1 of the present embodiment as described above, the sound generation unit 30 generates a musical sound according to the note-on event received from the stick unit 10. At this time, the sound generator 30 generates musical sounds having different volumes and timbres according to the body movement of the performer detected by the belt unit 20.
Thereby, according to the performance apparatus 1, it is possible to reflect the movement of the performer's body, which is not related to the performance operation by the stick unit 10, in the change of the musical sound, and the performer performs the performance operation using the stick unit. Without being restricted by this, it is possible to freely reflect the musical sound that produces the performance.

In particular, in the performance device 1, when the performer moves forward, that is, when the current position is ahead of the reference position, a musical sound having a louder volume than that when the current position is the reference position is pronounced. If the current position is backward, that is, if the current position is behind the reference position, a tone having a lower volume than that when the current position is the reference position is generated.
Thus, the volume can be changed according to the distance between the performer and the audience, and a powerful performance can be realized.

Further, in the performance device 1, when the performer is jumping, a musical tone having a tone different from that when the performer is landing is generated.
As a result, a musical tone having a tone different from the others can be generated at a performance location that the player wants to appeal, and a new performance that is impossible with an actual musical instrument can be realized.

  Further, in such a performance device 1, since the stick unit 10, the belt unit 20, and the sound generation unit 30 including the sound system 37 are connected by infrared communication, the sound system 37 is connected to the stick unit 10. This eliminates the need for mounting, and the stick unit 10 held by the performer can be downsized.

  As mentioned above, although embodiment of this invention was described, embodiment is only an illustration and does not limit the technical scope of this invention. The present invention can take other various embodiments, and various modifications such as omission and replacement can be made without departing from the gist of the present invention. These embodiments and modifications thereof are included in the scope and gist of the invention described in this specification and the like, and are included in the invention described in the claims and the equivalent scope thereof.

For example, in the above embodiment, forward and backward are determined using the logic shown in FIG. 11, but the present invention is not limited to this. For example, threshold values such as a forward determination acceleration value and a reverse determination acceleration value may be provided, and when the threshold value is exceeded, it may be determined as forward or reverse. Further, by applying a filter that extracts only the frequency of the walking frequency (about 1, 9 Hz) to the acceleration value output from the acceleration sensor 22, it is determined whether or not the user has walked, and the vehicle proceeds forward from the direction of the acceleration value at that time. Or it is good also as judging reverse.
Similarly, the jump determination process shown in FIG. 12 is merely an example, and the player's jump and landing may be determined by other methods.

Moreover, in the said embodiment, although the acceleration sensor 22 is provided in the belt part 20 and it is supposed that the player's body acceleration is detected, it is not restricted to this. For example, various sensors such as an angular velocity sensor and a magnetic sensor that can detect the orientation of the performer's body may be provided.
This makes it possible to distinguish between when the performer moves forward facing right and when the performer moves forward facing forward, and properly grasp the difference between the player's current position and the reference position. Can do.

  Moreover, in the said embodiment, although it is supposed that the motion of a player's body is detected using the belt part 20, the structure which detects a motion of a player's body is not restricted to the belt part 20. FIG. For example, the movement of the performer's body may be detected based on an image (moving image) captured by a camera that captures the performer.

  Moreover, in the said embodiment, although the stick part 10 was taken as an example as a performance member used by a player and the virtual percussion instrument like an air drum was demonstrated, it is not restricted to this. That is, the present invention can be applied to various virtual musical instruments such as an air guitar and an air violin, and performance members can be appropriately changed according to the virtual musical instrument to be applied.

Hereinafter, note the invention described in the scope of the initial claims application of the present application.
[Appendix 1]
A performance member;
A pronunciation means for generating a predetermined musical sound;
A sounding instruction means for giving a sounding instruction to the sounding means by detecting a predetermined performance action given by a player to the performance member;
Detecting means for detecting a predetermined physical movement of the performer and notifying the sounding means of the detection result;
With
It said sound generating means, based on the detection result, Could tone corresponding to the body movement,
A performance apparatus characterized by that.
[Appendix 2]
The sounding means generates a tone of a different tone according to the body movement, or a tone of a different volume,
Playing device according to Note 1, wherein the.
[Appendix 3]
The detection means includes a mounting portion to be mounted on the performer, and an acceleration sensor that acquires an acceleration value in the front-rear direction of the performer,
The sounding means sounds a musical tone having a different volume according to the amount of movement of the performer in the front-rear direction calculated from the acceleration value;
Playing device according to note 1 or 2, characterized in that.
[Appendix 4]
The detection means includes a mounting portion to be worn by the performer, and an acceleration sensor that acquires an acceleration value in the up and down direction of the performer,
The sounding means sounds a musical tone of a different tone according to the player's jumping motion detected from the acceleration value;
The performance device according to any one of appendices 1 to 3, characterized in that:
[Appendix 5]
The performance member extends in the longitudinal direction, and includes an acceleration sensor that acquires acceleration values in three axial directions.
The sound generation instruction means gives a sound generation instruction to the sound generation means based on a sound generation timing acquired based on an acceleration value of the acceleration sensor arranged inside the performance member.
The performance device according to any one of appendices 1 to 4, characterized in that:
[Appendix 6]
The performance member includes the pronunciation instruction means,
The sound generation means, the performance member and the detection means are connected to be communicable,
The performance device according to any one of appendices 1 to 5, characterized in that:

  DESCRIPTION OF SYMBOLS 1 ... Performance apparatus (performance apparatus), 10 ... Stick part (performance member, pronunciation instruction means), 11 ... CPU (sound generation instruction means), 12 ... Accelerometer (acceleration sensor), 13. ..Interface, 14 ... ROM, 15 ... RAM, 16 ... Input unit, 17 ... Infrared communication device, 20 ... Belt part (detection means), 21 ... CPU (detection means) ), 22 ... Acceleration sensor (acceleration sensor), 23 ... Interface, 24 ... ROM, 25 ... RAM, 26 ... Input unit, 27 ... Infrared communication device, 30 ... Sound generator (sound generator), 31 CPU (sound generator), 32 interface, 33 ROM, 34 RAM, 35 display unit, 36 input unit, 37 ... Sound system (pronunciation means) 71 ... tone generator (sound means), 372 ... audio circuit (sound generating means), 373 ... speaker (sound generator), 38 ... infrared communication device

Claims (6)

A performance member;
A pronunciation means for generating a predetermined musical sound;
A sounding instruction means for giving a sounding instruction to the sounding means by detecting a predetermined performance action given by a player to the performance member;
Detecting means for detecting a predetermined physical movement of the performer and notifying the sounding means of the detection result;
With
The sound generation means sounds a musical sound corresponding to the body movement based on the detection result;
A performance apparatus characterized by that. The sounding means generates a tone of a different tone according to the body movement, or a tone of a different volume,
The performance device according to claim 1. The detection means includes a mounting portion to be mounted on the performer, and an acceleration sensor that acquires an acceleration value in the front-rear direction of the performer,
The sounding means sounds a musical tone having a different volume according to the amount of movement of the performer in the front-rear direction calculated from the acceleration value;
Playing device according to claim 1 or 2, characterized in that. The detection means includes a mounting portion to be worn by the performer, and an acceleration sensor that acquires an acceleration value in the up and down direction of the performer,
The sounding means sounds a musical tone of a different tone according to the player's jumping motion detected from the acceleration value;
The performance device according to any one of claims 1 to 3, wherein: The performance member extends in the longitudinal direction, and includes an acceleration sensor that acquires acceleration values in three axial directions.
The sound generation instruction means gives a sound generation instruction to the sound generation means based on a sound generation timing acquired based on an acceleration value of the acceleration sensor arranged inside the performance member.
Playing apparatus according to any one of claims 1 to 4, characterized in that. The performance member includes the pronunciation instruction means,
The sound generation means, the performance member and the detection means are connected to be communicable,
The performance device according to any one of claims 1 to 5, wherein:

Images