JPH09281963A - Music control device - Google Patents

Abstract

(57) Abstract: A musical sound to be reproduced by controlling movement of a human body of a performer is controlled without attaching a detection device to the body of the performer. An input device 6 includes a photo sensor and detects a movement of a hand passing over it in a non-contact manner. Main C
The PU 1 adds the tempo, the volume, and the volume of the music according to the detection information from the input device 6 when the music data stored in the RAM 5 is called and the music generator 7 automatically reproduces the music. Control the degree of effect.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a tone control device for controlling a tone to be reproduced.

[0002]

2. Description of the Related Art Some electronic musical instruments are provided with a tone control device for detecting a movement of a player's human body to control a tone. In a conventional electronic musical instrument equipped with such a musical sound control device, one in which a detection device is attached to the body is known. For example, when playing a keyboard instrument such as a synthesizer, a detection device that detects the movement of the arm is attached to the cuffs,
The output of the detection device is connected to the musical instrument body with a cable, and the detection signal output from the detection device is input to the internal CPU to control the musical sound data according to the movement of the arm.

[0003]

However, in such a conventional tone control apparatus, the performer must perform the performance with the detector attached to his body, which physically interferes with the performance and psychologically. However, there was a problem that I could not concentrate on the performance. An object of the present invention is to detect the movement of the human body of the performer and control the musical sound to be reproduced, without attaching a detection device to the body of the performer.

[0004]

SUMMARY OF THE INVENTION The present invention comprises an automatic performance means for automatically reproducing a musical tone based on musical tone data,
It is configured to include a motion detection unit that detects the motion of the human body or a part thereof or an operated object in a non-contact manner to generate detection information, and a control unit that controls the musical sound data according to the detection information. There is. Therefore, according to the present invention, the control means controls the musical sound reproduced by the automatic performance means in accordance with the movement of the player's hand, baton, or the like. Therefore, it is possible to detect the movement of the human body of the performer and control the musical sound to be reproduced, without attaching the detection device to the body of the performer.

[0005]

DETAILED DESCRIPTION OF THE INVENTION Referring to FIGS.
An example in which the first to tenth embodiments of the musical sound control device according to the present invention are applied to an electronic musical instrument having a keyboard will be described. FIG. 1 shows a configuration of an electronic musical instrument of each embodiment except the fifth embodiment. The main CPU 1 which is the control means controls the musical tone control device by exchanging information with each unit connected via the bus. The keyboard 2 inputs pitch data and velocity data to the CPU 1 by a player's key depression operation. The control switch group 3 inputs to the CPU 1 the setting of the performance mode and the selection of the tone color in accordance with the operation. R
The OM 4 stores the operation program of the CPU 1 and also stores the initial value data at the time of initialization. The RAM 5, which is a storage unit, temporarily stores musical tone data input by operating the keyboard 2 or musical tone data that is sequence data transmitted from an external device by a write command of the CPU 1, and by a read command of the CPU 1. The stored tone data is output.
The input device 6 is a motion detecting unit composed of a photo sensor, detects the motion of the player's hand, and inputs the detection signal to the CPU 1. The musical tone generating device 7 performs sound generation processing or mute processing based on an instruction from the CPU 1. That is, the CPU 1 constitutes an automatic performance means for causing the musical sound generating device 7 to reproduce the musical sound based on the musical sound data. The D / A converter 8 converts the digital audio signal output from the musical sound generating device 7 into an analog audio signal. The amplifier 9 amplifies the converted acoustic signal and supplies it to the speaker 10.

FIG. 2 is a main flow showing the operation of the CPU 1 common to the respective embodiments. When the electronic musical instrument is powered on, system initialization processing is performed (step S1), and then event processing is performed based on the operation of the keyboard 2 (step S2). Next, an automatic performance process for giving an instruction to the musical sound generating device 7 is performed based on this event process (step S3). Furthermore, control switch group 3
Switch processing for searching the state of (step S
4). After that, other processing is performed (step S5), the process proceeds to step S2, and each processing up to step S5 is repeatedly executed.

In the event processing, as shown in FIG. 3, sensor event processing (step S6), sounding / silence event processing (step S7), and other event processing (step S8) are executed, and the main flow of FIG. Return. In the switch process, as shown in FIG. 4, the control switch group 3 is searched to determine whether or not the state of the sensor mode switch (not shown) has been changed (step S9). If there is a change, it is determined whether or not the change is to turn on the sensor mode (step S10). If the change is to turn off the sensor mode, the sensor invalid process is performed (step S1).
1) If the change is to turn on the sensor mode,
The sensor is validated (step S12). on the other hand,
If there is no change in the state of the sensor mode switch in step S9, other processing is performed (step S13). After the sensor invalid process, the sensor valid process, or other process, the process returns to the main flow of FIG.

FIG. 5 is a view showing the operating section in the first embodiment. A photo sensor 11 is provided near the keyboard 2. When the player's hand passes the photo sensor 11 back and forth in the direction of the arrow in the figure, the photo sensor 11 detects the passing and inputs a detection signal (detection information) to the CPU 1. As a result, the CPU 1 can recognize the movement of the player's hand.

Next, a first embodiment of the present invention will be described with reference to FIGS. 6 and 7. FIG. 6 is a flow of sensor event processing in the first embodiment. In this process, it is determined whether or not there is an event in which the player's hand passes over the photo sensor 11 (step S21), and when it passes, an event flag (hereinafter, simply “flag”).
Is "0" (step S2)
2). When the flag is "0", it means that the hand first passed over the photo sensor 11 (in the case of the forward movement), and the timer measurement process is performed (step S23). Next, in FIG. 6, the flag is set to "1" (step S
24) exit this routine. The timer measurement process is
This is processing for enabling the general-purpose timer interrupt shown in FIG. 22 and updating the general-purpose time count. Therefore, the general-purpose time count is updated even after exiting this routine. If the flag is "1" in step S22 when there is the next event, it means that the hand has passed the photo sensor 11 for the second time (in the case of returning). In this case, the timer measurement is ended, and the elapsed time (reciprocating time of the hand) t1 from the time when the hand first passes to the second time is obtained (step S25).

Next, 60 seconds is divided by t1 to obtain the tempo T1.
Is calculated (step S26). Then, the calculated tempo T1 is compared with the currently set tempo T0,
It is determined whether or not T1 and T0 match (step S28). If T1 and T0 do not match, the tempo data is rewritten to T1 (step S29), the timer is cleared (step S30), and the flag is reset to "0" (step S31). As a result, the time count update interval in the automatic performance timer interrupt shown in FIG. 23 changes. On the other hand, T1 and T
If 0 matches, the timer is cleared without rewriting the tempo data (step S30), and the flag is reset to "0" (step S31). After resetting the flag to "0", the process returns to the flow of FIG. If there is no event that the player's hand passes over the photo sensor 11 in step S21, this routine is exited without performing timer measurement processing.

FIG. 7 is a flow chart of sounding / silence event processing in the first embodiment and other embodiments described later. In this process, it is determined whether or not there is a sounding or mute event (step S32). If there is an event, it is determined whether the event is a keyboard event (step S33). If it is a keyboard event, it is further determined whether or not the keyboard event is a key pressing event (step S34), and if it is a key pressing event, the key pressing information is read from the RAM 5 (step S35),
Sound generation processing is performed based on the key depression information (step S3).
6). If it is not the key depression event in step S34, it is determined whether or not it is the key release event (step S37). If it is the key release event, the key release information is read from the RAM 5 (step S38), and the key release event is released. A muffling process is performed based on the key information (step S39).

In step S33, if the sounding / muting event is not a keyboard event, ROM4, R
It is determined whether or not the sequence event is based on the data in the memory such as AM5 or the external device (step S4).
0). If it is a sequence event, it is determined whether it is an event timing (step S41). If it is an event timing, it is determined whether it is a sounding event (step S42). If it is a sounding event, it is applicable. Call pitch information from the memory (step S4
3), the sounding process is performed based on the pitch information (step S44). If it is not a sounding event in step S42, it is determined whether or not it is a mute event (step S45). If it is a mute event, the corresponding pitch information is called from the memory (step S46), and the mute processing of the pitch information is performed (step S47). If it is not a sequence event in step S40, it is determined whether or not the power is off (step S4).
8) If it is off, muffling processing is performed on all the sounds being sounded (step S49). After the tone generation process or the mute process, this routine is exited.

When any of the following cases applies, this routine is exited without performing the tone generation processing and the mute processing. That is, when it is not the event of sounding and muffling in step S32. In the case where it is neither a key depression event in step S34 nor a key release event in step S37. If it is not the event timing in step S41, or if it is the event timing but not the sounding event in step S42 and is not the mute event in step S45. If the power is not turned off in step S48.

According to the first embodiment described above, without attaching the detection device to the body of the performer, by moving the hand on the photosensor 11 without contacting the photosensor 11 as if conducting, the song The tempo can be controlled freely. Moreover, since the inexpensive photo sensor 11 is used, the cost of the product can be reduced.

In the first embodiment described above, the movement of the player's hand is detected by the photo sensor 11, but the movement detecting means is not limited to the photo sensor 11. For example, CdS, PbS, PbSe
Like the photoconductive cell that uses the photoconductive phenomenon, the distance sensor that uses the ultrasonic Doppler effect, the sensor that uses the laser beam, and the capacitance detection sensor that uses the capacitance change due to the proximity of the hand. It may be a motion detecting means.

In the first embodiment, the player's hand detects that the player's hand passes over the photo sensor 11, but the object detected by the photo sensor 11 is not limited to the hand. It may be another part or the whole body or an object such as a baton.

Next, a second embodiment of the present invention will be described. FIG. 8 shows the operation unit in the second embodiment, and two photosensors 12 and 13 are provided on the keyboard 2. The configuration of each photosensor is the same as that of the first embodiment. Therefore, when the player's hand passes over the photosensors 12 and 13 in the direction of the arrow in the figure,
The two photosensors 12 and 13 detect the passage of the hand, respectively, and the CPU 1 determines that the two photosensors 12 and 13 have passed.
The movement of the hand can be recognized by the detection signals from 13 and 13.

FIG. 9 is a flow of sensor event processing in the second embodiment. In this process, it is determined whether or not there is an event in which the player's hand passes over one of the photosensors 12 or 13 (step S51), and when it passes, it is determined whether or not the flag is "0". (Step S52). If the flag is "0", it means that the hand has passed over one of the photosensors, the timer measurement process is executed (step S53), and the flag is set to "1" (step S54). ). After this, this routine is exited. The timer value is shown in Fig. 22.
It is updated by the general-purpose timer interrupt shown in, and the timer value continues to be updated even after leaving the routine. When there is an event that the hand passes the photo sensor 11 in step S51, the flag is set to "1" in step S52.
The case is when the hand passes the other photo sensor 11. In this case, the timer measurement is ended and the elapsed time (passing time) t1 from when the hand passes one photo sensor to when the hand passes the other photo sensor is calculated (step S55).

Next, the reference values t0 and t1 are compared. The reference value t0 is a value obtained by the following mathematical formula. t0 = 60 / T0 × 0.5 (where T0 is the current tempo) In this case, the time for the hand to reciprocate between the two photosensors 15 and 16 corresponds to one beat. Therefore, the calculated value t
Since 1 is a one-way time and corresponds to a half beat, it is multiplied by "0.5" in this mathematical expression. And t1 / t
The reciprocal of 0, that is, t0 / t1 is calculated (step S5).
6). Next, the calculated value and the volume setting reference Vo
l. And to select the corresponding volume value. Volume setting reference Vol. Is as follows. Vol. 1 2.0 or more Vol. 2 1.6-less than 2.0 Vol. 3 1.2 to less than 1.6 Vol. 4 less than 1.2

It is judged whether or not the selected volume value is different from the current setting value (step S58), and if different, the volume value is changed to a new value (step S5).
9). Next, clear the timer (step S60),
The flag is reset to "0" (step S61). If the selected volume value is the same as the current setting value in step S58, the current volume value is held (step S62), the timer is cleared (step S60), and the flag is reset to "0". (Step S61). After resetting the flag, exit this routine. In step S51, the photo sensor 12
If neither hand pass nor hand pass is detected, this routine is immediately exited.

As described above, according to the second embodiment,
The sound volume can be freely controlled by moving the hand on the photosensor 11 without touching the photosensor 11 as if conducting, without attaching the detection device to the player's body. In this case, the volume is controlled by obtaining the passing speed at which the hand passes between the two photo sensors 12 and 13. The volume increases when the passing speed is fast, and decreases when the passing speed is slow. In general, the natural movement when conducting a command is that when f (forte) is set to increase the sound, the hand is swung fast, and when p (piano) is set to decrease the sound, the hand is swung gently. Therefore, the performer can easily control the sound volume by passing a hand between the two photosensors in the same natural motion as when actually conducting the command.

Next, a third embodiment will be described. In this embodiment, as in the first embodiment, one photo sensor 11 is used to detect the movement of the hand. However, the hand passing over the photo sensor 11 is the photo sensor 1.
Detect how close to 1. FIG. 10 is a diagram showing the structure of the photo sensor 11. The photo sensor 11 includes a light emitting portion 11a and a light receiving portion 11b, and is shown in FIG.
As shown in, when the passing hand position 14 is close to the photo sensor 11, the irradiation light 15 directed from the light emitting unit 11a to the hand is reflected at the hand position 14, and the reflected light 16 having a large reflection amount y1 is generated. It is incident on the light receiving portion 11b. On the other hand, when the position 14 of the passing hand is distant from the photo sensor 11, as shown in FIG. 10B, the reflected light 16 having a small reflection amount y1 is incident on the light receiving unit 11b. Therefore, when the performer moves his hand up and down, a detection signal corresponding to the distance from the photo sensor 11 is input to the CPU 1.

FIG. 11 is a flow chart of sensor event processing in the third embodiment. In this process, it is determined whether or not there is a sensor passing event (step S7).
1) If there is a passing event, the light reflection amount y1 is measured by the detection signal from the light receiving unit 11b (step S72). The reflection amount y1 is compared with the reference value X (step S73), and it is determined whether the reference value X and the reflection amount y1 match (step S74). If they match, the current volume value is held (step S75),
Exit this routine. If they do not match, X-y1
= Z is calculated, and the volume value corresponding to the value of Z is determined (step S76). The volume value Vol. Is as follows. Vol. 1 Z <-5 Vol. 2-5≤Z <0 Vol. 3 Z = X = 0 Vol. 40 <Z <5 Vol. The volume value is updated according to the value of 5 5 ≦ Z Z (step S7).
7) Exit this routine. In step S71, if there is no sensor passing event, this routine is immediately exited.

As described above, according to the third embodiment,
It is possible to freely control the sound volume without contacting the photosensor 11 without attaching a detection device to the player's body. In this case, the cost can be reduced because the volume is controlled by one photo sensor. Furthermore, since it is only necessary to move an object such as a hand or a stick up and down on the photo sensor, it is possible to easily control the volume even if the user is not accustomed to the commanding operation.

Next explained is the fourth embodiment of the invention. In this embodiment, the timing of the sequence data is controlled by shaking the hand or baton. FIG. 12 is a flow of sensor event processing in the fourth embodiment. In this process, it is determined whether or not there is a sensor passing event (step S81), and if there is a passing event, the musical tone generating device 7 is so arranged as to mute the currently sounding sound.
(Step S82). Then, the corresponding address of the note-on event to be generated next is called (step S83), and the musical tone generator 7 is instructed to generate sound based on the called note-on event (step S83).
84). Thereafter, the address of the next note-on event is set (step S85), and this routine is exited. If there is no sensor passing event in step S81, this routine is immediately exited.

As described above, according to the fourth embodiment,
Since the song is played back at the timing of swinging the hand or the baton, you can feel as if you were actually conducting the performance. Also in this case, the photo sensor allows the hands and batons to be shaken in a non-contact manner, so that the user can freely conduct the command without feeling discomfort.

In this case, the performance effect can be further enhanced by controlling the volume by operating the pedal.

Next explained is the fifth embodiment of the invention. FIG. 13 shows the system configuration of the fifth embodiment. The keyboard driving device 17 drives the keyboard 2 to press and release keys in response to a command of control information from the CPU 1. Since the other components are the same as the system configuration of the other embodiment shown in FIG. 1, they are denoted by the same reference numerals and the description thereof will be omitted. FIG. 14 is a flow of sensor event processing in the fifth embodiment. In this process, it is determined whether or not there is a sensor passing event (step S91), and if there is a passing event, the musical tone generating device 7 is instructed to mute the sound currently being sounded (step S92). Next, the keyboard driving device 17 is instructed to release the currently depressed key (step S93). Then, the corresponding address of the note-on event to be generated next is called (step S94), and the musical tone generator 7 is instructed to generate sound based on the called note-on event (step S95). Further, the keyboard driving device 17 is instructed to press a key having a pitch corresponding to the note-on event instructing the pronunciation (step S96). Thereafter, the address of the next note-on event is set (step S97), and this routine is exited. Step S91
At, if there is no sensor passage event, this routine is immediately exited.

As described above, according to the fifth embodiment,
The song is played back in time with the hand or baton swing, and the key corresponding to that tone is pressed or released in synchronization with the playback of the sound. You can feel like. Also in this case, the photo sensor allows the hands and batons to be shaken in a non-contact manner, so that the user can freely conduct the command without feeling discomfort.

Next explained is the sixth embodiment of the invention. In this embodiment, as in the configuration of the second embodiment shown in FIG. 8, using two photosensors, a photosensor (first sensor) 12 and a photosensor (second sensor) 13, the time signature of the song to be reproduced. Even if is different, the tempo can be freely changed by conducting operations. In this case, 2
Either the beat system or the 3-beat system is selected by the control switch group (beat selecting means) 3. The 4-beat system is a 2-beat system, and the 6-beat system is a 3-beat system or a triple 2-beat system, and each song is roughly classified into a 2-beat system or a 3-beat system.

FIG. 15 (A) shows the movement of the hand of the two-beat system passing over the first sensor 12 and the second sensor 13 by arrows. However, as will be described later, in the case of the two-beat system, the event of the second sensor is invalid.
Therefore, to measure the tempo, the time required for the hand to reciprocate from the first beat passing from the left to the right in the drawing to the second beat passing from the right to the left is measured. FIG.
(B) shows the movement of the 3-beat system hand passing over the first sensor 12 and the second sensor 13 by arrows. In this case, the event of the first sensor 12 is the first event. Therefore, the first event is the second
If it is an event of the sensor 13, the event is invalidated. Further, in measuring the tempo in this case, the hand passes the first sensor 12 obliquely from the upper left to the lower left.
From the beat to the second beat passing the first sensor 12 from the left to the right, and from the second beat when the hand passes the second sensor 13 from the left to the right, the second sensor 13 is slanted from the bottom. Measure the time to the third beat passing in the upper left.

FIG. 16 is a flow of sensor event processing in the sixth embodiment. In this process, it is determined whether or not there is a sensor passing event (step S10).
1) If there is an event, it is determined by the setting of the control switch group 3 whether or not the tune is in the triple beat system (step S102) and in the double beat system (step S103). In the case of the 3-beat system, it is determined whether or not it is the event of the first sensor (step S
104). On the other hand, in the case of the 2-beat system, after setting the information of the second sensor to be invalid (step S10)
5) The process proceeds to step S104 to determine whether or not the event is the first sensor event. For example, there are 3 songs to play
It is assumed that it is a time signature. In this case, step S104
In, it is determined whether or not it is the event of the first sensor, and if it is the event of the first sensor, it is determined whether or not the measurement is started (step S106). If it is the first event for which the measurement has not started yet, the process proceeds to step S107 and the measurement of the time from the end of the first beat is started. Next, the first sensor flag is turned on (step S108), and this routine is exited.
Since the timer value is updated by the general-purpose timer interrupt shown in FIG. 22, the timer value continues to be updated even after the routine is exited.

If there is a next sensor passing event, it is determined in step S104 whether or not it is the event of the first sensor. If it is the event of the first sensor, it is determined in step S106 whether or not the measurement is started. In this case, however, since the measurement is already started, from the end of the first beat to the start of the second beat. The time measurement is completed (step S109), the tempo is calculated based on the measured time, and the tempo is stored in the RAM 5 (step S11).
0). The tempo calculation method is the same as in the first embodiment. Next, as compared with the current tempo already stored in the RAM 5, if the tempo is different, it is rewritten to a new tempo (step S111). As a result, FIG.
The interval for updating the time count in the timer interrupt for automatic performance shown in 3 changes. Then, the timer for measuring the tempo is reset (step S112), and the measurement is started for the next beat (step S112).
107), the first sensor flag is turned on (step S108), and this routine exits.

When the next sensor event occurs, it is determined in step S106 whether or not the event is the event of the first sensor 12. If it is not the event of the first sensor 12, it is determined whether or not the second sensor 13 is invalid (step S113). In this case, the second sensor 13 is effective because it has three beats. Therefore, it is determined whether or not the event is the second sensor 13 (step S114). If it is the event of the second sensor 13, it is determined whether or not the first sensor flag is on (step S115). If the first sensor flag is on, the immediately preceding event is the first sensor 1 of the second beat.
2nd event, new event is the 2nd sensor 1
It is an event in which the hand of the second beat passed 3. In this case, the first sensor flag is turned off (step S11
6), the measurement is continued as it is (step S117).

If the first sensor flag is off in step S115, the immediately preceding event is the event of the second sensor 12 at the third beat, and the new event is the event of the second sensor 13 at the third beat. It is an event that has passed. In this case, the measurement of the time from the end of the second beat to the start of the third beat is ended (step S109), the tempo is calculated according to the measured time, and the tempo is stored in the RAM 5 (step S).
110). Next, as compared with the current tempo already stored in the RAM 5, if the tempo is different, it is rewritten to a new tempo (step S111). And
The timer for measuring the tempo is reset (step S112), the measurement is started for the next beat (step S107), the first sensor flag is turned on (step S108), and the routine exits.

On the other hand, if the tune has two beats, it is determined in step S104 whether or not it is the event of the first sensor. If it is the event of the first sensor, the measurement is started. It is determined whether or not (step S
106). If it is the first event for which the measurement has not started yet, the process proceeds to step S107 and the measurement of the time from the end of the first beat is started. Next, the first sensor flag is turned on (step S108), and this routine is exited. Next, when this flow is entered, step S1
At 04, it is determined whether or not it is the event of the first sensor. If it is the event of the first sensor, it is determined in step S106 whether or not the measurement is started. In this case, however, since the measurement is already started, from the end of the first beat to the start of the second beat. The time measurement is completed (step S109), the tempo is calculated based on the measured time, and RA is calculated.
It is stored in M5 (step S110).

Next, as compared with the current tempo already stored in the RAM 5, if the tempo is different, it is rewritten to a new tempo (step S111). Then, the timer for measuring the tempo is reset (step S112), the measurement is started for the next beat (step S107), the first sensor flag is turned on (step S108), and the routine exits. When there is the next sensor event, it is determined in step S106 whether or not it is the event of the first sensor 12. If it is not the event of the first sensor 12, it is determined whether or not the second sensor 13 is invalid (step S1).
13). In this case, the second sensor 13 is invalid because it has two beats. In this case, this routine is exited.

As described above, according to the sixth embodiment,
Since the photo sensor allows you to swing your hands and baton without contact, you can freely control the tempo of the song to be played and played without any discomfort. In particular, when conducting a three-beat tune, by removing the first passage of the second sensor 13 from the event of measurement termination, the tempo in beats can be set in a triangular manner as when actually conducting. Can be controlled.

In the sixth embodiment, the tempo of the music is controlled, but the control target is not limited to the tempo. For example, other automatic performance elements such as sounding timing may be controlled.

Next explained is the seventh embodiment of the invention. In this embodiment, if there are consecutive events within a certain time as sensor event processing,
A process different from the normal process is performed according to the number of times of the event. In this case, as a different process other than the normal process,
Switch process A, switch process B, and switch process C, which are a plurality of switch processes in the control switch group 3.
There is a volume setting, a program change setting, a start / stop, etc., respectively, or each time according to the user's desire. Although not shown in the figure, the RAM 5 is provided with a 3-bit shift register used as a counter and a time area for storing event time. In the initialization process of step S1 of FIG. 2, the counter is set to "00".
It is reset to "0" and the time area is cleared.

FIG. 17 is a flow of sensor event processing in the seventh embodiment. In this process, it is determined whether or not there is a sensor passing event (step S12).
1) If there is an event, it is determined whether or not the counter of the RAM 5 is "000", that is, the reset state (step S122). If it is “000”, the current time t0 is stored in the RAM 5 (step S
123). Next, the counter is incremented (step S124), and this routine exits.

Next, if there are consecutive events at time t1, it is determined whether or not the counter of the RAM 5 is "001" (step S125). If "001", Ta = t1-t0 is calculated (step S12).
6), it is determined whether Ta is smaller than a preset predetermined value Tx (step S127). If Ta is smaller than Tx, normal processing is performed (step S1).
28) and clear the counter (step S129).
After this, this routine is exited. If Ta is greater than or equal to Tx in step S127, the counter is incremented, the next event is waited for (step S130), and this routine exits.

Next, when there are consecutive events at time t2, it is determined whether the counter of the RAM 5 is "010" (step S131). If "010", Tb = t2-t0 is calculated (step S13).
2), it is determined whether Tb is smaller than a predetermined value Tx set in advance (step S133). If Tb is smaller than Tx, switch A processing is performed (step S134), and the counter is cleared (step S13).
5). After this, this routine is exited. Step S13
If Tb is greater than or equal to Tx in 3, the counter is incremented, the next event is waited for (step S136), and this routine is exited.

Next, if there are consecutive events at time t3, it is determined whether or not the counter of the RAM 5 is "011" (step S137). If “011”, Tc = t3−t0 is calculated (step S13).
8), it is determined whether Tc is smaller than a predetermined value Tx set in advance (step S139). If Tc is smaller than Tx, switch B processing is performed (step S140), and the counter is cleared (step S14).
1). After this, this routine is exited. Step S13
If Tc is greater than or equal to Tx in 9, the counter is incremented and the next event is waited for (step S142), and this routine is exited.

Next, if there are consecutive events at time t4, it is determined whether or not the counter of the RAM 5 is "100" (step S143). If “100”, Td = t4−t0 is calculated (step S14).
4), it is determined whether Td is smaller than a preset predetermined value Tx (step S145). If Td is smaller than Tx, switch C processing is performed (step S146), and the counter is cleared (step S14).
7). After this, this routine is exited. Step S14
If Td is greater than or equal to Tx in 5, the counter is cleared (step S148) and the routine exits.

As described above, according to the seventh embodiment,
By passing a hand, a baton, or the like over the photo sensor, the normal operation control in the other embodiments described above is performed in a non-contact manner, and a plurality of specific switch processes in the control switch group 3 are performed. It can be performed without contact.

Next explained is the eighth embodiment of the invention. A feature of this embodiment is to avoid an error caused by noise or a malfunction of the sensor when an arbitrary process is performed by passing the sensor over a single sensor twice with a hand or a baton. FIG. 18 is a flow of sensor event processing in the eighth embodiment. In this process,
It is determined whether there is a sensor passing event (step S151), and if there is an event, it is determined whether the flag is on (step S152). This flag is reset to off in the initialization processing of step S1 in FIG. If the flag is off, counting of the timing clock Ta is started in order to measure the time until the next sensor event (step S153). That is, the general-purpose timer interrupt shown in FIG. 22 is enabled. Next, the flag is turned on (step S154), and this routine is exited. Note that the timing clock Ta is continuously updated in the RAM 5 even after exiting the routine.

If there is a next sensor passing event, it is determined whether or not the flag is on (step S15).
2) If the flag is on, the current timing clock Ta is called from the RAM 5 (step S15).
5). Then, it is determined whether or not Ta is equal to or longer than the preset time Tx (step S156). This T
x is set to be sufficiently smaller than the time for a hand or baton to pass over the photo sensor. When Ta is Tx or more, the count is stopped (step S15).
7) Then, the normal process set in advance corresponding to the event is executed (step S158). Next, the count value is cleared (step S159), the flag is reset to off (step S160), and this routine is exited. On the other hand, if Ta is smaller than Tx in step S156, the event is invalidated as a false event caused by noise, sensor malfunction, etc., and this routine is immediately exited without performing normal processing.

As described above, according to the eighth embodiment,
The time between an arbitrary sensor event and the next sensor event is measured, and if the measured time is shorter than a preset predetermined time, the next sensor event is invalidated. For example, when a hand or a baton passes over one photo sensor twice, as shown in FIG. 19A, after the passage of Ta from the input of the first event input signal E1, the next event input signal E2 Is input. Also,
Ta at this time is a value larger than Tx. Therefore, in this case, the normal process in step S158 of FIG. 18 is performed. However, for example, when the hand or baton first passes through the photo sensor, a false signal En may be input after the event input signal E1 due to noise or other causes, as shown in FIG. In this case, since Ta is smaller than Tx, this false signal En is invalidated and the next event input signal E2 is captured as a true sensor event.

In the eighth embodiment, one sensor is passed twice with a hand or a baton to perform an arbitrary process.
It can also be applied to the case where the structure is made to pass twice.

Next explained is the ninth embodiment of the invention. In this embodiment, a hand, baton, or the like is moved on the reflective photosensor to add the aftertouch effect in real time according to the amount of light reflection. 20
It is a flow of a sensor event process in the ninth embodiment. It is determined whether or not there is light reflection (step S1
61) If there is reflection, the reflection amount Y is measured (step S162). Then, the measured reflection amount Y is compared with the level reference values Tx0, Tx1, and Tx2 (step S163). Then, the level is set according to the range of Y. That is, when Y <Tx0 (step S164), the level 0 is determined (step S16).
5). If Tx0 ≦ Y <Tx1 (step S
166), and level 1 is determined (step S167).
If Tx1 ≦ Y <Tx2 (step S16)
8), the level 2 is decided (step S169). Y ≧
In the case of Tx2 (step S170), level 3 is determined (step S171). Next, the determined level information is written in the RAM 5 (step S172),
Exit this routine. If there is no light reflection in step S161, this routine is immediately exited without writing level information. In case of level 0, after touch effect is not added, level 1 to level 3
The effect of aftertouch gradually increases in the order of.

As described above, according to the ninth embodiment,
While playing automatically, you can add aftertouch effect in real time by moving your hand, baton, etc. up and down on the sensor.

Next explained is the tenth embodiment of the invention. In this embodiment, when a sensor event is detected by passing a hand, a baton, or the like over the sensor, the event signal waveform is analyzed to detect the passing speed, and processing according to the passing speed is performed. FIG. 21 (A) is shown in FIG.
Like FIG. 0 (A), it is a diagram showing a state in which a hand is passed over the photo sensor 11, the irradiation light 15 from the light emitting unit 11a is reflected by the hand, and the reflected light 16 is incident on the light receiving unit 11b. In this case, depending on the passing speed, the CPU
The event signal waveforms captured in 1 are different. When the event signal is passed relatively quickly, the event signal in FIG. 21B has steep rising and falling waveforms as shown in (a). When this signal waveform is differentiated, its absolute value becomes the waveform of (b), which is a pulse signal of V1 level. If the event signal is passed late, the event signal has a gentle rising and falling waveform as shown in (c). When this signal waveform is differentiated, its absolute value becomes the waveform of (d), which is a pulse signal of V2 level smaller than V1.

As described above, according to the tenth embodiment, if the set value is set to increase as the level of the differential waveform increases by utilizing the property of the event signal waveform, the musical tone is generated depending on the speed at which the hand passes. It is possible to control the tempo, the volume, or the degree of the effect added to the musical sound. In this case, the sensor event can be detected by one photo sensor, which has an effect of reducing the cost.

In the above embodiment, the tone data is controlled by differentiating the event signal waveform, but the rising and falling edges of the signal are not necessarily linear. Therefore, the tone data may be controlled by performing the differential processing a plurality of times to obtain the acceleration and jerk.

Also, the event signal waveform may be analyzed to analyze the mental state of the performer. For example, the power spectrum is obtained by Fourier transforming the event signal waveform. When the frequency with the highest level of the power spectrum in the steady process is f, the level of 2f is f
It is said that the person's (the player in this case) mental state is in the most relaxed and stable state when it is 1/2 of the level. Therefore, the “fluctuation degree”, which is the deviation between the average value of the power spectrum and the observed value, is calculated to analyze the mental state of the performer. If it is determined that the mental state is unstable as a result of the analysis, for example, the echo effect added to the musical sound is strengthened or the level of the high range is lowered to stabilize the musical state of the performer. To control.

[0057]

According to the present invention, the control means controls the musical sound reproduced by the automatic performance means in accordance with the movement of the player's hand, baton, or the like. Therefore, it is possible to detect the movement of the human body of the performer and control the musical sound to be reproduced, without attaching the detection device to the body of the performer.

[Brief description of drawings]

FIG. 1 is a first to a fourth embodiment and a sixth to a first embodiment of the present invention.
The block diagram which shows the system configuration | structure in 0 embodiment.

FIG. 2 is a main flowchart showing an operation of a CPU common to each embodiment of the present invention.

FIG. 3 is a flowchart of event processing in FIG.

FIG. 4 is a flowchart of a switch process in FIG.

FIG. 5 is a plan view showing an operation unit according to the first embodiment.

FIG. 6 is a flowchart of sensor event processing according to the first embodiment.

FIG. 7 is a flowchart of sounding / silence event processing in each embodiment.

FIG. 8 is a diagram showing an operation unit according to the second embodiment.

FIG. 9 is a flowchart of sensor event processing according to the second embodiment.

FIG. 10 is a diagram showing a structure of a photo sensor according to a third embodiment.

FIG. 11 is a flowchart of sensor event processing according to the third embodiment.

FIG. 12 is a flowchart of sensor event processing according to the fourth embodiment.

FIG. 13 is a block diagram showing a system configuration according to a fifth embodiment of the present invention.

FIG. 14 is a flowchart of sensor event processing according to the fifth embodiment.

FIG. 15 is a diagram showing the movement of a hand passing over a photo sensor in the sixth embodiment.

FIG. 16 is a flowchart of sensor event processing according to the sixth embodiment.

FIG. 17 is a flowchart of sensor event processing according to the seventh embodiment.

FIG. 18 is a flowchart of sensor event processing according to the eighth embodiment.

FIG. 19 is a timing chart showing an event input signal according to the eighth embodiment.

FIG. 20 is a flowchart of sensor event processing according to the ninth embodiment.

FIG. 21 is a diagram illustrating an event in the tenth embodiment, and FIG. 21A is a diagram showing a state in which a hand is passed over a photo sensor. FIG. 6B is a diagram showing a signal wave generated by passage.

FIG. 22 is a flowchart of a general-purpose timer interrupt.

FIG. 23 is a flowchart of an automatic performance timer interrupt.

[Explanation of symbols]

 1 Main CPU 2 Keyboard 3 Control Switch Group 4 ROM 5 RAM 7 Musical Sound Generator 11 Photo Sensor 12 Photo Sensor 13 Photo Sensor 14 Irradiated Light 15 Reflected Light

Claims (14)

[Claims] 1. An automatic performance means for automatically reproducing the musical sound based on the musical sound data, and a motion detecting means for non-contactly detecting the motion of a human body or a part thereof or an operated object to generate detection information. And a control means for controlling the musical sound data according to the detection information. 2. The movement detecting means generates the detection information by detecting a change in light that is blocked or transmitted or a light that is reflected by the movement of the human body, a part thereof, or an object. The musical sound control device according to claim 1. 3. The detection information is digital information on or off by comparing the amount of change of the light with a predetermined threshold value or analog information indicating the amount of change of the light. Tone control device. 4. The control means comprises a waveform analysis means for analyzing a signal waveform of the detection information, and controls the musical sound data according to the signal waveform analyzed by the waveform analysis means. The musical sound control device according to claim 1. 5. The waveform analysis means differentiates the signal waveform to analyze the speed of movement of the human body or a part thereof or an object, and the control means analyzes the musical sound data according to the speed of movement. 5. The musical tone control device according to claim 4, which is controlled. 6. The waveform analyzing means Fourier-transforms the signal waveform to obtain a power spectrum of movement of the human body or a part thereof or an object, and analyzes the mental state of the performer by the fluctuation degree of the power spectrum. 5. The musical tone control apparatus according to claim 4, wherein the control means controls the musical tone data according to the analysis result. 7. The musical tone control apparatus according to claim 1, wherein the control means controls the tempo of the musical tone data according to the detection information. 8. The automatic playing means comprises a time signature selecting means for selectively classifying a music piece to be reproduced as a two-beat system or a three-beat system, and the motion detecting means has two light emitting parts and two light receiving parts. When the musical composition to be reproduced is classified into the three-beat system, the control means comprises the musical tone data according to two detection information cycles generated by each optical sensor by a conducting operation. The tempo of the musical sound data is controlled according to the cycle of the detection information generated twice by only one of the optical sensors when the music to be reproduced is classified into the two beats. 8. The musical sound control device according to claim 7, wherein 9. The musical tone control apparatus according to claim 1, wherein the control means controls the volume of the musical tone data according to the detection information. 10. The musical tone control apparatus according to claim 1, wherein the control means controls the degree of the effect added to the musical tone data according to the detection information. 11. The automatic performance means comprises a storage means for storing sequence data of musical tones, and the control means controls timing of calling the musical tone data from the storage means according to the detection information. 7. The musical sound control device according to claim 1. 12. The automatic playing means includes a keyboard for determining a pitch according to an operation, and a keyboard driving means for automatically pressing or releasing the keyboard according to control information. 12. The musical tone control apparatus according to claim 11, wherein when controlling the timing of calling the musical tone data according to the detection information, the musical tone control device sends control information of key depression or key release to the keyboard driving means. 13. The control unit performs a normal process and a plurality of processes other than the normal process when the motion detecting unit continuously generates a plurality of pieces of detection information within a fixed time. 13. The musical sound control device according to claim 1. 14. The control means invalidates the next detection information when the motion detection means generates the next detection information within a preset time after generating the detection information. The musical sound control device according to any one of claims 1 to 13.