JPH01309087A - Tone series pattern extracting method and play result display device and play result grading device using same - Google Patents

Abstract

PURPOSE:To extract only a part that a student plays with confidence from an input tone series by comparing tone series patterns of converted tone series data and tone series data corresponding to a reference tone series with each other as to specific features. CONSTITUTION:Song information, etc., is converted into tone series data having a dimension of code length, the toner series patterns of the tone series data and tone series data corresponding to the reference tone series are compared with each other as to the specific features, and a phrase which is most similar to the reference tone series is extracted from the input tone series according to the comparison result. Namely, a similar pitch tone series extracting circuit 7 while shifting reference pitch tone series data PDline(ref) and input pitch tone series data PDline(full) in time base reference point compares tone series parts of the same length with the reference tone series after conversion into a tone series pattern of elements connected in time series in the same time zone, thereby extracting tone series parts according to similarity to the reference pitch tone series. Consequently, the algorithm of grading is approximated to the algorithm by a music tutor as much as possible.

Description

[Detailed Description of the Invention] This invention provides a method for performing or singing (hereinafter referred to as performance, etc.) by a performer or singer (hereinafter referred to as performer, etc.).
The present invention relates to a method for extracting only the part of a tone string that a performer or the like is confident of performing from a string of notes played, and a performance result display device and a performance result scoring device using this method.

As is well known, when teaching singing practice or practice on piano, electronic organ, etc., the teacher generally first performs a model performance, then has the students perform, etc., and then reviews the results of the student's performance etc. The teacher then provides musical criticism, and by repeating the above process, the teacher provides performance guidance.

However, in the case of this type of performance instruction, the student's progress is greatly influenced by the qualifications and abilities of the teacher, and since the number of excellent teachers is limited, the number of students is also limited to a relatively small number. .

In order to solve this problem, various devices have been proposed that automatically score performances performed by students instead of teachers.

By the way, when a student performs a model performance or according to the score, if he or she realizes that he or she has played incorrectly during the performance, the student usually returns to the point just before the incorrect part and performs the incorrect part. In contrast to redoing
It is known from experience that if a player does not notice a mistake during a performance, he will continue playing until the end.

On the other hand, if a performance is performed that includes such errors, the teacher will be able to
Parts that have already been replayed correctly by the student are unconsciously deleted, only the parts that the student played with confidence are extracted from the entire performance, and these extracted parts are compared with the model performance. This will give the best advice to the students.

In other words, it is not possible to improve the same teaching effect by pointing out parts where students have already noticed mistakes in their performance. I will work to effectively improve this.

However, in conventional automatic performance scoring devices of this type, the pitches or arrangement order of notes for a model performance are stored in advance, and then the pitches and notes input from a microphone or keyboard according to the student's performance, etc. are stored in advance. The input order of notes is successively compared with the stored note array and pitch array, or in the same way, the length of each note constituting the note array is calculated from the previously stored note array and pitch array. As a reference, the pitches are read out sequentially, and it is determined whether the timing of each read pitch matches the timing of each input pitch within a predetermined tolerance range, and the performance melody is determined by this. As mentioned above, if there is a section in the middle of a performance performed by a student where a student notices a performance error and replays it, even if the performance before and after that section is Even if the performance is performed correctly, the score will be extremely low, and there are problems such as not being able to give the students the optimal criticism needed to improve their playing skills, which may discourage students from practicing. This may result in loss.

This invention was made in order to solve the above problem, and its main purpose is to make the algorithm for grading as much as possible by the music teacher (human) in this type of automatic grading device. It is about approximation.

The purpose of the first invention related to this application is that, as mentioned above, if there is a part of the student's performance that has been replayed after noticing an error, such erroneous part can be automatically corrected. The purpose of the present invention is to provide a method for extracting from an input tone sequence only the parts played by the student with confidence that they are correct.

In order to achieve the above object, the first invention converts performance or singing information into one or two-dimensional or more dimensional tone string data having at least the dimension of note length, and then converts the tone string data and a reference tone string. The sound string data corresponding to the reference sound string is compared with respect to predetermined features between the sound string patterns, and based on the comparison result, a phrase most similar to the reference sound string is extracted from the input sound string. It is.

Next, the purpose of the second invention related to this application is to compare the similar phrases extracted by the above-mentioned first invention with the reference sound sequence, so that the student can be confident that the phrase is correct. The student's performance is compared with a pre-memorized model tone sequence, and from this, among the parts of the student's performance that the student has already recognized, any incorrect performance parts included in the student's performance are deleted, and the student's The purpose is to make the students aware of only the parts of the performance that they unconsciously made incorrectly.

In order to achieve the above object, in the device of the second invention, each constituent tone sequentially generated by playing or singing is sequentially converted into a single tone having a dimension of at least note length.
or a single note data detecting means for converting and detecting the single note data 1' in two or more dimensions; storing the detected single note data for each dimension and in the order of occurrence to form input note string data corresponding to performance or singing; input sound string data forming means;
The input sound string data of each dimension and the reference sound string data of the corresponding dimension are compared between the sound string parts that exist in the same time period while shifting the reference points of the time axes of both, and the ones with the highest degree of similarity are selected. Similar sound string part extracting means for extracting one or more sets of similar sound string parts selected in sequence from the input sound string data; Reference sound string data of a corresponding dimension from each of the extracted similar sound string parts; data superimposition means for extracting the matching portions and superimposing them on each other to form the most similar sound string data corresponding to the most similar phrase; means for printing or displaying the formed most similar sound string data; ; It is characterized by comprising the following.

Next, the purpose of the third invention related to this application is to compare the similar phrase obtained using the first invention with a model performance or an original performance performed by a student. This prevents extremely low scoring results even if there is a replayed part in the middle of a student's performance, and this makes it easier for actual music teachers (humans) to The goal is to obtain scoring results that are as close as possible.

In order to achieve the above object, in the third invention,
Its constituent elements include a single note data detection means that sequentially converts each constituent note sequentially generated by playing or singing into one or two or more dimensional single note data having a dimension of at least note length and detects the same; the detected single note; an input sound string data forming means for storing data in each dimension and in the order of occurrence to form input sound string data corresponding to performance or singing; input sound string data of each dimension and reference sound string data of the corresponding dimension; of,
The reference points of both time axes are shifted from each other, and sound string parts existing in the same time period are compared, and one or more sets of similar sound string parts are selected in descending order of similarity from the input sound. Similar sound string part extracting means for extracting from the sequence data; Extracting parts that match the reference sound string data of the corresponding dimension from each of the extracted similar sound string parts, and superimposing these parts on each other to form the most similar phrase. a data superimposition means for forming corresponding most similar sound string data; a total number of sound data included in the formed most similar sound string data among each constituent sound data of the reference sound string data; The present invention is characterized by comprising a scoring calculation means for determining the ratio of the data to the total number of each component sound data for necessary dimensions, and scoring the human horn sound sequence using at least the values of these ratios as a scoring element. .

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

FIGS. 1 to 37 are drawings for explaining an embodiment (hereinafter referred to as the first embodiment) that incorporates the first to third aspects of the invention. In the following, melody performance will be described as a representative example, but the same applies to other performance modes such as rhythm performance and chord performance.

First, before proceeding to a detailed explanation of the operation of the apparatus shown in the first embodiment, the basic operation flow of this apparatus will be schematically explained with reference to the overall diagram shown in FIG.

In FIG. 1, when a start command (not shown) is given, the reference pitch sequence generating circuit 1 generates each pitch data PD (r
er ) (see FIG. 25(B)) is output in a time-divisional manner in synchronization with the sounding timing of each note, and upon receiving this data PD (ref), the musical tone forming circuit 2 is driven, and the sound is output from the speaker 3. The standard melody will be pronounced.

Next, the student memorizes this pronounced standard melody in his/her head and plays the standard melody using the keyboard 4, relying on his/her memory.

The key press detection circuit 5 outputs a key press timing signal 5kon = (see FIG. 26(B)), which is a minute width "1" pulse, every time any key is pressed on the keyboard 4, and at the same time In synchronization with this, pitch data PD (in) corresponding to each pressed key on the keyboard 4 (see Fig. 26 (A))
are output, and these signals are supplied to the pitch string formation circuit 6.

The pitch string formation circuit 6 discriminates the length of each note based on the signal 5kon- for each of the original pitch data (see FIG. 27(A)) that is sequentially supplied in a time-division manner, and Pitch data smaller than minute note length, which cannot be an element, is regarded as jitter and removed. Then, the remaining pitch data are stored in the order of occurrence, and the input pitch string data PD1ine (['ull) (Fig. 27 (
See B).

Then, this data PDline (1'ull) is
Similar pitch sequence extraction circuit 7 and matching pitch partial superposition circuit 8
and 112 columns.

The similar tone high pitch string extracting circuit 7 uses the reference tone high tone string data PDIlne output from the reference tone high tone string generating circuit 1.
Crel") and the input pitch string data PDline (full) output from the input pitch string forming circuit 6 are set at the same time while shifting the reference points of their time axes, just as if trains were passing each other. After converting into a tone string pattern in which each constituent tone in the band is chronologically connected, the tone string portions of the same length as the reference tone string are compared, and among these tone string portions, the reference tone high tone string and the tone string are compared. The most similar items are extracted coarsely in order.

(See FIGS. 27 to 30) Then, these extracted maximum sets of similar pitch string partial data are added to the input pitch string data PDline (
1'ull) is converted into shift number data PDIlnesml-1 to -k (see FIGS. 27(C) to (J)) and output.

At the same time, the similar pitch string extracting circuit 7 extracts matching pitch number data PDeq-1 between each of the extracted similar pitch string partial data and the reference pitch string data PD ne (re(')). ~-k is output.

The matching pitch partial alignment circuit 8 uses the shift number data P D 1in output from the similar pitch string extracting circuit 7.
e sml -1 to -, the input pitch string data PDline (
f'ull), each similar pitch string partial data is played back, each reproduced similar pitch string partial data is compared with the reference pitch string data PDIine (ref'), and a match is found between the two. These pitch data are sequentially superimposed to form the most similar pitch string data PDsample. (See FIG. 35) Next, the input note length string forming circuit 9 determines the input pitch tone based on the signal S kon'' (see FIG. 26(C)) output from the input pitch string forming circuit 6. Column data PD
1ine (1'ul l) is formed into note length data that corresponds to each constituent note, and this data is sequentially stored in the order of occurrence to create input note length note string data L D 1ine (1'
form ul I). (Refer to FIG. 31(B)) In the similar note length note string extraction circuit 10, the reference note length note string data LDline (re
f) (see FIG. 25(C)) and the input note length note string data (the third
1 (see Figure 1 (B))), in the same way as in the case of pitch, shift the reference points of the time axes of each other and compare the tone sequence parts existing in the same time period, and compare them in order of similarity. demand. (See Figures 32 to 34) Then, each similar note length note string partial data is converted into input note length note string data LDline (
Shift count data LDlines for ['all)
Convert to ml-1 to -k and output.

At the same time, the similar note long note string extraction circuit 10 extracts each similar note long note string partial data and reference note long note string data LDline (
Matching note length note number data LDeq-1 to -k representing the number of matching note length notes with tel') are output.

In the matching note length partial superimposition circuit 11, the shift count data L D 1 output from the similar note length tone sequence extraction circuit 10 is used.
ine sml -1 to - and the input note length note string data LDline (1'ull) output from the input note length note string forming circuit LDline (f'all), each similar note length note string partial data is generated. This reproduced similar note length note string partial data is sequentially converted into reference note length note string data LD.
IIne (rel'), a matching note portion between the two is found, and the most similar note length note string data LDsa taiple is formed by superimposing them on each other. (
(See FIG. 36) Next, the most similar pitch string data PDsample output from the matching pitch partial combination circuit 8 and the most similar note length note string data LDsample output from the matching note length partial combination circuit 11. is supplied to the display circuit 13,
The CR that configures the display circuit 13 based on these data
The performance results of the students are displayed on the screen of the T display, as shown in FIG.

Here, on the display screen, a staff notation, a pitch string, and a note length string are displayed in three columns (upper and lower), and high-intensity flashing is displayed for incorrectly played parts in each column. It is done.

Therefore, when looking at this display, students can first check where they unconsciously made a mistake in their melody performance by viewing the staff notation, and then displaying the middle and lower pitch pitch strings and note length strings. By checking this, you can clearly see whether the error is in pitch or note length.

Next, the individual pitch matching discrimination circuit 14 determines the pitch of each pitch constituting the reference pitch string data based on the reference pitch string data P D 1ine (re[') and the most similar pitch string data PDsample. determine whether it matches the reference melody or not, and divide the determination result into 1 for each pitch.
Individual pitch matching discrimination data PDeq- expressed as a bit signal
Output bit.

In the matching pitch number detection circuit 15, the individual pitch matching discrimination circuit 1
Based on the data PDeq-bit output from 4,
The number N1 of matching notes with respect to the reference pitch string data is determined, and matching number data D (Nl) is output.

In the individual note length coincidence discrimination circuit 16, the reference note length tone string data L
Based on D 1lne (red' ) and the most similar note length note string data L[)sample, it is determined whether or not both notes match for each note, and the determination result is expressed as a 1-bit signal for each note. Individual code length matching discrimination data LDeq-b
Output it.

The matching note length number detection circuit 17 calculates the number N2 of matching notes between the reference note length note string data and the most similar note length note string data LDsample based on the individual note length-matching discrimination data LDeq, Data D representing the number of musical notes (N2
) is output.

The similar pitch sequence number detection circuit 18 uses each matching pitch number data PDeq- output from the similar pitch sequence extraction circuit 7.
Based on 1 to -k, the number of sets N of similar pitch string partial data
3 and outputs data D(N3) representing this number N3.

The note length similar note string number detection circuit 19 uses each matching note length note number data LDe output from the similar note length note string extraction circuit 10.
Based on q-1 to -k, the number N4 of sets of similar note length tone sequence partial data is determined, and data D (N4) representing this number N4 is obtained.
Output.

The reference tone pitch number data path 20 receives the reference tone treble string data PDli output from the reference tone treble string data generation circuit 1.
ne Crer ), the number N5 of constituent notes of the reference pitch string data is determined, and data D (
N5) is output.

The reference note length number data path 21 receives the reference note length tone string data LDIIne output from the reference note length tone string generation circuit 12.
(ref'), find the number N6 of constituent notes of the reference note length note sequence data, and obtain data D (N
6) is output.

The performance time/time difference detection circuit 22 uses the individual pitch-matching discrimination data P output from the individual pitch matching discrimination circuit 14.
Deq-bit and the most similar note length tone string data LDsaa+ple output from the matching note length partial superposition circuit 11
, the reference note length note string data L D l 1neCver ) output from the reference note length note string generation circuit 12 and the individual note length coincidence discrimination data LDeq-bit output from the individual note length coincidence discrimination circuit 16 . Then, the model performance time T and performance error time ΔT are determined, and data D (T) and T(ΔT) representing these are output.

Next, the similarity calculating circuit 23 calculates the matching pitch number data D (Nl), matching note length number data D (N2), pitch similar note string set number data D (N3), and note length similar note string set number data D (N3). data D (N4), standard pitch number data D (N5), standard note length number data D (N6), model performance time data D (
Similarity score data Dscore is obtained based on the performance time difference data D (ΔT) and the performance time difference data D (ΔT), and is displayed on the score display 24.

The calculation formula for determining the similarity score X based on each of the above data is as follows.

X= ([100X (Nl/N5)X (N2/N6
)X(T-lΔT+)/TI-Yl÷5×5
Here, Nl, the number of matching pitches N2; the number of matching note lengths N3; the number of note strings with similar pitches N4; the number of note strings with similar note lengths N5; the reference pitch number N6; the reference note length number T; model performance time ΔT: Performance time difference Y, N3 or N4 In this way, in this similarity score calculation method, the main scoring elements for calculating the similarity score are the number of matching pitches N1 and the number of matching note lengths N2, As in the conventional example mentioned above, even if there are errors that are replayed during the student's melody performance, these errors will not affect the final score. It is possible to obtain grading results that are extremely close to the feelings of a music teacher.

Next, the basic operation flow of the present apparatus described above will be explained in detail with reference to the drawings from FIG. 2 onwards.

Since the operation of this device is controlled by various control signals output from the control circuit 25, the detailed configuration of the control circuit 25 will be explained first with reference to FIGS. 19 to 23.

As shown in FIG. 19, the control circuit 25 is configured to selectively designate any one of first to second similar pitch tone string detection circuits or first to second similar note length tone string detection circuits, which will be described later. To control the similar film designation signal generation circuit 2510 that outputs the similar film designation signals 55m1-1 to -(n+1), and the shift register in the designated similar pitch tone string detection circuit and similar note length tone string detection circuit. shift signal 5shil't
In order to latch the input pitch pitch string data and the input note length string data to the shift signal generation circuit 2520 that outputs the same, and the shift register in the specified similar pitch pitch string detection circuit and similar note length string detection circuit. latch signal S
a latch signal generation circuit 2530 that outputs 1atch;
a load signal generation circuit 2540 that outputs a minute width “1” pulse in response to each rising edge of each similar film designation signal Ss+*l −1 to −(n+1) output from the similar film designation signal generation circuit 2510; , the shift signal generation circuit 2
520 to switch and supply the shift signal 5shift't outputted from the similar film designation signal generation circuit 2510 to each shift register in the similar pitch tone sequence detection circuit and the similar note length tone sequence detection circuit of the similar stage designated by the similar film designation signal generation circuit 2510. selector 2550 and the latch signal 5IaLch output from the latch signal generation circuit 2530 to the similar pitch sequence detection circuit and similar note length sequence detection circuit of each similar stage designated by the similar film designation signal generation circuit 2510. and a selector 2560 for switching supply.

Details of the similar film designation signal generation circuit 2510 are shown in FIG. As shown in the figure, a similar film designation signal generation circuit 2510
is an RS flip-flop 2511 that is set by a judgment enable signal Sjudge outputted from the input pitch sequence forming circuit 6 and reset by a 1+2 bit output of a decoder 2515, which will be described later, and an output from the latch signal generation circuit 2530. A D-type flip-flop 2512 is forcibly reset by a latch signal 5lateh, and is configured to receive the 0 output in response to the rise of the output "1" of an AND gate 2513, which will be described later. flip flop 2
511 Q output and the above-mentioned flip-flop 2512
an AND gate 2513 whose opening and closing are controlled by the 0 output of
A counter 2514 that counts the pulses output from 513 and is reset by the n+2 bit output of a decoder 2515, which will be described later, and this counter 2514
The decoder 2515 decodes the counting output of the decoder 2515, and each bit output of the decoder 2515 is a load signal Sl.

ad-1 to -(n+1).

Details of shift signal generation circuit 2520 are shown in FIG.

As shown in the figure, the shift signal generation circuit 2520 is connected to a decoder 2515 in the similar film designation signal generation circuit 2510.
OR gate 25 for taking the logical sum of the output of each bit of
21, a monomulti 2522 that outputs a minute width "1" pulse in response to the rising edge of the output "1" of the monomulti 2521, and a monomulti 2522 that outputs a minute width "1" pulse output from the monomulti 2522 for a minute time. A delay circuit 2523 for delaying by dL, and a latch signal 5la that is set by the “1” pulse output from this delay circuit 2523 and output from the latch signal generation circuit 2530.
RS flip-flop 2 reset by Lch
524, and an AND gate 2526 which is controlled to open and close by the Q output of this RS flip-flop 2524 and which controls the opening and closing of the clock signal Sφ output from the clock generator 2525, and the output of this AND gate 2526 becomes the shift signal 5shift.

Details of the latch signal generation circuit 2530 are shown in FIG.

As shown in FIG.
A shift count counter 2531 that is reset by a coincidence output Seq of a coincidence determination circuit 2533 (described later) and a reliable key press signal S push outputted from the input pitch sequence forming circuit 6 are counted. The key pressed number counter 2532, which is reset by the determination end signal S end outputted from the similar film designation signal generation circuit 2510, matches the counted value of the shift number counter 2531 with the counted value of the key pressed number counter 2532. A coincidence determination circuit 2533 performs discrimination, and a coincidence signal from this coincidence determination circuit 2533 is output as a latch signal 5IaLch.

As a result, when each circuit described above operates, the determination enable signal S is generated as shown in the time chart of FIG.
When the "1" pulse arrives at the judge, one "1" pulse is first output to the load signal 5load-1, and then, after a delay time dt determined by the delay circuit 2523, the shift signal S shi ft-1 is output. A number of "1" pulses corresponding to the number of key presses are outputted, and the load signals 5load-2 to -4 and the shift signal 5 are output in the same manner.
Similar pulses are output from shift -2 to -4,
After a predetermined number of pulse trains are output to the final shift signal 5shift 4, when the time required for a certain similarity calculation has elapsed, the determination end signal S end is finally set to "1".
A pulse will be output.

Note that the time chart in FIG. 23 shows the case where mouth=3 in FIG. 19.

Next, details of each circuit shown in FIG. 1 will be explained along the flow of data processing while referring to each control signal explained above.

First, the details of the input pitch series forming circuit 6 are shown in FIG.

In the figure, an RS flip-flop 601 is set by a minute width "1" pulse outputted from a differentiating circuit 609, which will be described later, and reset by a determination end signal S end outputted from the control circuit 25.

The AND gate 602 is connected to the RS flip-flop 60
Opening/closing is controlled by the 0 output of 1, and the key press timing signal 5kon - output from the key press detection circuit 5 is passed.

The gate circuit 603 is connected to the 0 of the RS flip-flop 601.
Opening/closing is controlled by the output, which causes the key press detection circuit 5
The input pitch data PD (in) output from the input pitch data PD (in) is passed through.

The match determination circuit 604 includes a shift register 607, which will be described later.
Input pitch data PD stored in the first stage of
(in) and the input pitch data PD (In) output from the gate circuit 603. If it is determined that the two match, the EQ ratio output is "1". .

The OR gate 605 takes the logical sum of the output of the AND gate 602 and the output of the coincidence determination circuit 604, and the output of this OR gate 605 is the reliable key press signal S.
Push.

The monomulti 606 is output from the OR gate 605.
It outputs a very small width "1" pulse in response to the rise of "1", and the output of this monomulti 606 is the inverted pitch data acquisition signal S kon".

The shift register 607 takes in the input pitch data that has passed through the gate circuit 603 into its first stage in response to the inverted data take-in signal 5kon' output from the monomulti 606, and sequentially moves each stage to the right in the figure. It is configured to shift in the opposite direction.

The mono multi 608 is configured to be able to trigger repeatedly in response to the rise of the "1" output of the mono multi 606, and each time it is triggered, a relatively long "1" pulse (for example, 2. 5 seconds), and the output of this mono multi 608 is the 5 pl signal during the performance.
It becomes ay.

The differentiating circuit 609 is configured to output a minute width "1" pulse in response to the rise of the output "1" of the monomulti 608, and the output of this differentiating circuit 609 becomes the determination enable signal Sjudge.

The OR gate 610 takes the logical sum of the determination end signal S end and the initial clear signal Sic, and the output of the OR gate 610 causes the shift register 6
7 are all cleared, and at the same time, the output of this OR gate 610 is output as a clear signal 5clr.

As a result, when each of the circuits described above operates, as shown in the time chart of FIG.
07 is for capturing the input pitch data output from the gate circuit 603 in response to the rising of the data acquisition signal inverted Skon'' output from the monomulti 606.
As shown in Figure 26 (A) and Figure 27 (A), if there is incorrect pitch data due to jidda etc. in the input original pitch data, these input pitches The data will not be taken into the shift register 607, and as shown in FIG.
In each stage of 7, erroneous input pitch data is removed, and only pitch data corresponding to a note length that is long enough to be used as a musical element is taken in. The pitch data taken into each stage is output in parallel, and this parallel output is the input pitch string data PDline.
(f'u11).

Next, details of the input note length string forming circuit 9 are shown in FIG.

In the figure, the OR gate 901 receives the determination end signal 5e.
The logical sum of nd and the initial clear signal StC is output.

The OR gate 902 outputs the logical sum of the initial clear signal Sic and the judgment enable signal Sjudge.

The differentiating circuit 903 outputs a minute width "1" pulse in response to the rising edge of the data acquisition signal 5kon' output from the pitch string forming circuit 6.

The AND gate 904 is controlled to open and close by the playing signal 5play, and allows the minute width "1" pulse outputted from the differentiation circuit 903 to pass therethrough.

The RS flip-flop 905 receives the data acquisition signal 5k.
It is set at the rising edge of on' and reset at the output of the OR gate 902.

The tempo clock oscillator 906 has a predetermined period (for example, 1
00m5,500μs) tempo clock is output.

In this example, the frequency is configured to be variably controllable.

A counter 907 is enabled by the Q output of the RS flip-flop 905 and counts the tempo clock TCL output from the tempo clock oscillator 906. Furthermore, it is repeatedly reset by the minute width "1" output of the AND gate 904 delayed via the shift register 908.

The shift register 908 is shift-controlled by a minute width "1" pulse outputted from the ant game 1-904, and is configured to take in the count output of the counter 907 as note length data into the first stage. Also, this shift register 908 is connected to the OR gate 9.
Cleared by output of 01.

As a result, when each circuit described above operates, each stage of the shift register 908 stores data in each stage of the shift register 607 in the input pitch string forming circuit 6, as shown in FIG. 31('B). The note length data corresponding to the pitch data that has been input is sequentially imported, and the parallel output data of each stage is the input note length string data L D
1ine (f'ul I).

Next, the details of the similar pitch string extracting circuit 7 are shown in FIG.

As shown in the figure, the similar pitch string extracting circuit 7 is arranged such that input pitch string data PDIine (1'u11) and reference pitch string data PDIine (re(')) are supplied in parallel (R The tfi is formed by the first to k-th similar pitch sequence detecting circuits 700-1 to 701)-k.

The first to second similar pitch sequence detection circuits 700-1 to 700-- include
As mentioned above, input pitch string data PDlina (1
'ull) and reference pitch pitch sequence data P D 1ine (
If we judge the degree of similarity between two objects that exist in the same time zone while shifting the reference points of their respective time axes, as if trains were passing each other, then the first... It detects the second to second most similar pitch string data parts,
These detected similar pitch string parts are respectively the 27th pitch string.
As shown in FIGS. (C) to (J), first to second similar pitch series partial data PDline 5m1-1 to PDline 5m1-1 to - representing the number of shifts for input pitch series data are output.

In addition, each similar pitch tone string detection circuit 700-1 to 700-k
, each detected similar pitch string partial data P D
In 1ine sml -1 to -, matching pitch number data PDeq-1 to -k indicating how many notes match the reference pitch string data are output.

Next, the details of the first similar pitch string detection circuit 700-1 are shown in FIG. In the same figure, the shift register 701 is
In response to the rising edge of the load signal S 1oad-1, the input pitch string data P D 1ine (('ul l) output from the input pitch string forming circuit 6 is loaded. Also, the shift signal 5shi In response to the "1" pulse included in ['t -1, the shift is controlled to the left in the figure, and the contents of all stages are simultaneously cleared by the clear signal 5clr.

The parallel pitch coincidence determination circuit 702 is configured to perform the shift register 7.
Pitch series partial data PDIins (1 to 7) output in parallel from the first to seventh stages of 01 and reference pitch series data PD output from the reference pitch series generation circuit 1.
Iine (rel') is determined to match at each stage, and "1" and "0" signals corresponding to each determination result are output to terminals EQI to EQ7.

The pitch success/failure detection circuit 703 detects the number of matches between the two based on the respective scattered outputs EQI to EQ7 of the parallel pitch match determining circuit 702, and outputs the corresponding pitch-match number data.

The counter 704 is reset by the determination enable signal Sjudge, counts the number of "1" pulses included in the shift signal 5shift, and outputs shift number data.

The match number comparison circuit 705 compares the pitch match number data latched by a latch circuit 707, which will be described later, with the pitch match number data output from the pitch success/failure detection circuit 703, and determines the pitch. Only when the pitch match number data output from the success/failure detection circuit 703 is larger than the pitch match number data latched by the latch circuit 707, "1" is output.

The AND gate 706 is controlled to open and close by the output of the -success/failure comparison circuit 705, and thereby the shift signal 5sh
If't -1 is passed.

The latch circuit 707 receives a judgment enable signal Sjudge.
and the AND gate 70
In response to the "1" pulse output from the pitch-success/failure detection circuit 703, the pitch matching number data output from the pitch-success/failure detection circuit 703 is latched.

The launch circuit 708 similarly receives the determination enable signal Sju
The counter 7 is reset by dge, and each time a “1” pulse is output from the AND gate 706
Latch the shift number data output from 04.

The latch circuit 709 is reset by the clear signal S clr, and latches the pitch matching number data latched in the latch circuit 707 every time a "1" pulse arrives in the latch signal S 1atch.

The latch circuit 710 is similarly reset by the clear signal 5clr, and each time a "1" pulse arrives during the latch signal 5latch, the latch circuit 708
Latch the shift count data latched in .

The output of the latch circuit 709 becomes the matching pitch number data PDeq-1, and the output of the latch circuit 710 becomes the shift number data PDli-esml-1.

As a result, if each of the circuits described below (1) operates normally,
In the shift I register 701, FIG.
The shift control is performed sequentially as shown in FIG. 28(J), and in the parallel pitch match determination circuit 702,
As shown in FIG. 3, a match is determined between data PDline (ref) and data PDline (1 to 7).

In the example of FIG. 28, pitch string partial data PDline (1 to 7) corresponding to shift 0 times is detected as the most similar pitch string partial data, and as a result, data PDline 5m1 output from the latch circuit 710. -1
The content of is "0", and the content of data PDeq-1 is "3".

Next, details of the similar pitch sequence detection circuit 700- are shown in FIG. In the same figure, the shift register 751 loads human horn tone high pitch string data PDline (full) in response to the load signal 5load-k, and also shifts in response to the "1" pulse included in the shift signal 5shlrt-k. Furthermore, the contents of all stages are cleared simultaneously by a clear signal 5clr. Also,
Each data in the first to seventh stages of the shift register 751 is configured to be individually resettable.

Next, parallel pitch matching determination circuit 752. Pitch matching number construction circuit 753. Match number comparison circuit 755. anime game) 756
．． Counter 754. Each operation of the latch circuit 759 and the latch circuit 760 corresponds to the operation of the pair 59 in the first similar tone high pitch string detection circuit 700-1, and each operation of the latch circuit 760 corresponds to the operation of the first similar tone high tone string detection circuit, respectively. 700
-1, and will not be described repeatedly here.

The match determination circuits 761-1 to 761-(k-1) are
The shift number data output from the counter 754 and the similar pitch sequence detection circuits 700-1 to 70 at each previous stage
Shift count data P sent from 0-(k-1)
D 1ine 5m1-1~P D linesml
-(k-1), and outputs "1" only when it is determined that both data match.

The OR gate 762 includes each of the matching determination circuits 761-1 to 761-1.
761- Output the logical sum of the outputs of (k, 1).

The gate circuit 763 is controlled to open and close by the output J from the OR gate 762, thereby supplying each coincidence output of the parallel pitch coincidence determination circuit 752 to the reset terminal R of the first to seventh stages of the shift register 751. do.

AND gate 764 is controlled to open and close by the output of OR gate 762 which is inverted by inverter 765, thereby inhibiting the output of AND gate 756.

The latch circuit 757 receives a judgment enable signal Sjudge.
and the AND gate 7
In response to the "1" pulse passing through 64, the pitch-success/failure data output from the pitch-success/failure detection circuit 753 is latched.

Similarly, the latch circuit 758 receives the determination enable signal S j
counter 7 in response to a “1” pulse reset by hedge and passed through AND gate 764.
The shift count data output from 54 is latched.

As a result, when each of the above circuits operates, Fig. 27(B)
As shown in (J), the input pitch data stored in each stage of the shift register 751 is sequentially shifted to the left in the figure in response to the "1" pulse of the shift signal 5shlf't-, and at the same time In the parallel pitch coincidence determination circuit 752, as shown in FIGS. 29 and 30, a match determination process is performed between the pitch series partial data and the reference pitch series data for each number of shifts.

Here, FIGS. 28, 29, and 30 are the first
．． Second. Third similar high pitch string detection circuit 700-1.700
-2.Each parallel pitch matching determination circuit 70 in 700-3
2,752.

As is clear from these figures, each parallel pitch matching determination circuit 752 in the second to second similar pitch sequence detection circuits
, the similar tone pitch string partial data PDline (1 to
7) When the shift timing arrives, the reference pitch string data PDline (rel
') are individually reset by the output of the gate circuit 763.

As a result, a portion that matches the reference pitch string data included in the already detected similar pitch string partial data will not be recognized as being duplicated with another similar pitch string partial data.

Furthermore, when the shift timing of the similar tone pitch string partial data already detected in each preceding stage similar tone pitch string detection circuit arrives, the AND gate 764 is inhibited by the output of the OR gate 762, and therefore the similar tone pitch string detection circuit is started. In the circuit 700-k, data whose degree of similarity is always one level lower than the similar tone high pitch string partial data PDline (1 to 7) that has already been detected in the first to eleventh similar tone high pitch string detection circuits is always selected. It will be detected.

Next, details of the matching pitch partial superimposition circuit 8 are shown in FIG. In the same figure, a shift register 801 has a load signal S
In response to 1oad-(:k+1), input pitch string data PDIIne (['ull) is loaded.

Then, in response to the "1" pulse generated by the shift signal 5shi['L-(k+1), the shift control is performed in the downward direction in the figure, and the contents of each stage are simultaneously cleared by the clear signal 5clr.

The parallel pitch coincidence determination circuit 802 receives pitch string partial data PDline (1 to 7) output in parallel from the first to seventh stages of the shift register and the pitch string partial data PDline (1 to 7) output from the reference tone pitch string generation circuit 1. Reference pitch pitch string data PDIIn
s (rer) at each stage,
The determination result is output to terminals EQI to EQ7 as a 1-bit signal for each stage.

The counter 803 is reset by the determination enable signal Sjudge, and is also reset by the shift signal 5shi.
['t - (k +1) is counted, thereby outputting shift count data corresponding to the shift count of the shift register 801.

The match determination circuits 804-1 to 804- each receive the shift number data output from the counter 803 and the shift number data PDIIne5m1- output from each of the similar tone pitch sequence detection circuits 700-1 to 700-k. 1
~PDllne 5QII- is determined to match, and outputs "1" only when it is determined that both match.

The OR gate 805 includes each of the match determination circuits 804-1 to 804-1.
The output of OR gate 804- is logically summed, and the output of this OR gate 805 controls data superimposition processing, which will be described later.

The AND gates 806-1 to 806-7 are controlled to open and close by the output of the OR gate 805, and each output of the parallel pitch matching determination circuit passes through them.

The latch circuits 807-1 to 807-7 are latched controlled by each coincidence output of the parallel pitch coincidence determination circuit 802 supplied via the analogues 806-1 to 806-7, respectively, and thereby the shift register Among the outputs from the first stage to the seventh stage output from the 801, the reference pitch string data PDI[ne (ref')
Only the matching part is latched every time the valley is shifted. And these latch circuits 807-1 to 807-
Each series of pitch data latched to 7 constitutes the most similar pitch string data PDsamρ1e.

As a result, when each of the circuits described above operates, as shown in FIG.
From each similar tone sequence data detected in 1 to 700-k, only the parts that match the reference pitch sequence data are extracted and superimposed on each other to create the most similar pitch sequence data PDsample. is formed.

Next, the details of the similar note length string extracting circuit 10 are shown in FIG.

In the figure, first to second similar note length tone string detection circuits 100
The configuration of 0-1 to 1000- includes the first to th similar pitch sequence detection circuits 700-1 to 700- shown in FIG.
In other words, each similar note length string detecting circuit outputs shift count data LDline sml corresponding to a plurality of similar note length note string partial data selected in order of similarity. -1~LDIine
5m1-, note length-success/failure data L Deq-1~L
Deq-k is output.

Details of the first similar note length string detection circuit 1000-1 are shown in FIG. In the figure, a shift register 1001, a code length-dispersion detection circuit 1003. Counter 1004. - Success/failure comparison circuit 1005. Antogame) 1006. Latch circuit 1007. Latch circuit 1008, latch circuit 1009.
The configuration of the latch circuit 1010 is the same as the first similar pitch sequence detection circuit 700-1 shown in FIG. Therefore, the explanation will not be repeated here.

On the other hand, regarding the configuration of the parallel note length coincidence discrimination circuit 1002, the parallel pitch-coincidence discrimination circuit 70 shown in FIG.
The configuration is slightly different from 2. That is, FIG. 25(C)
As shown in the figure, each component note of the reference note length note string data LDIlne (ref') output from the reference note length note string generation circuit 10 is exactly an eighth note, a quarter note, and a dotted quarter note, respectively.

It has a fixed standard length, such as a half note.

On the other hand, the note length string partial data output from the first to seventh stages of the shift register 701 have errors Δ1 to Δ9, respectively, as shown in FIGS. 31(B) to (J). Here, for convenience of explanation, the values of errors Δ1 to Δ9 attached to each note are assumed to be errors within a predetermined tolerance range that can be recognized as each corresponding note.

Therefore, when the parallel pitch coincidence determination circuit 702 accurately determines the coincidence between the corresponding stages in the rain sound sequence data, it is almost impossible for both data to completely coincide.

Therefore, in the parallel note length coincidence determination circuit 1002, the tone sequence data LDIIne (re(')) and the tone sequence data P
When comparing with DIine (1 to 7), if the error from the reference note length data is within a predetermined tolerance range for each stage, it is considered that they match. In other words, terminals EQI to EQ7 have terminals A1 to A, respectively.
A matching output is obtained only when the difference between 7 and 81 to B7 is within a predetermined tolerance range.

As a result, when each circuit shown in FIG. 9 operates, in the shift register 1001, the circuits shown in FIG.
As shown in FIG.
As shown in Figure 2, the standard note length tone string data LDIIne (
ref') and note length tone sequence partial data PDIlne (1~
7) is performed, and it is determined for each stage whether the length of each note is within a predetermined allowable range.

Then, the note length/dispersion detection circuit 1003 outputs numerical data corresponding to each number of notes, and at the same time the counter 10
1) The number of shifts is outputted to 4, and finally the latch circuit 1009 and the latch circuit 1010 output the number of matching notes and the number of shifts corresponding to the note length note string partial data with the largest number of matching notes LDeq-1. ,LDline
5m1-1 is output.

Next, details of the similar note length tone sequence detection circuit 1000- are shown in FIG. In the figure, shift register 105
1. Note length-success/failure detection circuit 1053° counter 1054.
- Success/failure comparison circuit 1055. ANDGATE 1056. Latch circuit 1057. Latch circuit 1058. Latch circuit 1
059. Latch circuit 1060. Match determination circuit 1061-
1-1061-(k-1), ORGATE 1062. Gate circuit 1063. ANDGATE 1064. Inverter 1
The configuration of 065 is the same as that of the similar pitch sequence detection circuit 700- shown in FIG. 6, except that the type of data handled is changed from pitch data to note length data. The configuration of the note length match determination circuit 1052 is the same as that of the first similar note length tone sequence detection circuit 1000-1, so a repeated explanation will be avoided here.

As a result, when each of the circuits described above operates, for example, the second . Third similar note long string detection circuit 1000-2.1000
-3, as shown in FIGS. 33 and 34, a match determination operation is performed between the reference note length note string data LDlineCrer) and the note length note string partial data PCIIns (1 to 7), and at this time, the above-mentioned Similar to the case of pitch data, the already selected similar pitch string data is excluded from the matching determination target.

Then, the second similar note length note string detection circuit 1000-2 extracts the note length note string partial data with the second largest number of matching notes, and the third similar note length note string detection circuit 1000-3 extracts the third similar note length note string partial data. The note length note string partial data is extracted.

Then, each extracted note length tone string partial data is input note length tone string data L D 1ine (full
LDIln
It is output as esail-1 to LDIIne 5m1-, and the number of matching tones in each tone string data is output as LDe.
It is output as q-1 to LDeq-.

Next, details of the matching code length partial overlapping circuit 11 are shown in FIG. In the figure, a shift register 1101, a counter 1103 . In the match determination circuits 1104-1 to 1104-,
Thiogate 1105. ANDGATE 1106-1~11
06-7, regarding the configuration of the U-nochi circuits 1107-1 to 1107-7, □ The only difference is that the data to be handled has changed from pitch data to note length data, and the single pitch partial overlap shown in FIG. Since it is exactly the same as the matching circuit 8, and the configuration of the parallel note length match determination circuit 1102 is the same as the corresponding circuit in each of the similar note length string detection circuits 1000-1 to 1000-, the explanation will be repeated here. shall be avoided.

As a result, when the circuit described above operates, in the latch circuits 1107-1 to 1107-7, as shown in FIG. Second. Each -several note in the note length string partial data detected by the third similar note length string detection circuit is superimposed on each other, so that the most similar note length string data L
Dsample will be formed.

Next, details of the performance result display device 13 are shown in FIG. 17.

In the figure, a reference melody generation circuit 1301 generates each pitch data PD (tel') and note length data LD (rel
), and outputs a switching signal S cos in response to each output timing.

The multiplexer 1302 outputs the most similar pitch string data LD.
Each piece of pitch data constituting the sample is selectively output in response to the switching signal Seos.

The multiplexer 1303 selectively outputs each note length data forming the most similar note length tone string data LDsan+ple in response to the switching signal S cos.

The pitch match determination circuit 1304 is connected to the multiplexer 13.
It is determined whether the input pitch data PD (In) sequentially outputted from 02 and the reference pitch data PD (ref) outputted from the reference melody generation circuit 1301 match, and "1" is set only when the two do not match. Output.

The code length match determination circuit 1305 is connected to the multiplexer 13.
It is determined whether the input note length data LD (In) sequentially output from 03 and the reference note length data LD (rer) output from the reference melody generation circuit 1301 match, and it is set to "1" only if they do not match. Output.

Then, the pitch match determination circuit 1304. The outputs of the note length match determination circuit 1305 and the OR gate 1306 are C as a pitch blinking signal, a note length blinking signal, and a staff score blinking signal, respectively.
It is supplied to the RT controller 1307.

The pitch display data ROM 1308 outputs pitch display data corresponding to the reference pitch data PD (re['), which is sequentially output from the reference melody generation circuit 1301 in a time-sharing manner.

The note length display data ROM 1309 contains reference note length data LD (ref
' ), outputs the corresponding note length display data.

The musical note display data ROM 1310 stores reference pitch data PD (
rel') and the reference note length data LD (rev), the corresponding staff display data is output.

In the CRT controller 1307, the pitch blinking signal,
Based on the note length blinking signal, staff score blinking signal, pitch display data, note length display data, and note display data, the CRT 131
As shown in FIG. 18, on the screen of No. 1, the musical staff is divided into tiers, middle tiers, and lower tiers, and the staff notation, pitch, and note length corresponding to the standard melody are displayed, respectively.

Then, the pitch display and note length display displayed in the middle and lower rows will flash the incorrect part in the display, and the staff display in the upper row will display either pitch or note length.
If the number is incorrect, a blinking display is performed in the same way.

As a result, the CRT1311 screen allows performers or singers to reliably recognize mistakes in their performances, and improve their performance technique effectively by practicing only those mistakes. It becomes possible to improve the performance.

In addition, with the three types of displays on the display screen, it is possible to reliably recognize whether the pitch or note length is incorrect, and it is also possible to display only the error location based on the standard melody. Therefore, as shown in Figure 26 (A), for parts where the performer has already recognized the wrong part and replayed it, the 1st grade is not displayed and the performer unconsciously It is possible to reliably notify only the incorrect performance location.

Next, details of the performance time/time difference detection circuit 22 are shown in FIG. In the figure, a selector 2201 selects between the most similar pitch sequence data PDsample output from the individual pitch coincidence determination circuit 14 and the reference pitch sequence data PD1i.
The pitch-dispersed data PDeq corresponding to the number of notes that match ne (ref') is configured to be able to control switching individually for each stage.
UT7 has data PDsample or data P
The contents of each stage of D 11ne (ref') are output.

The gate circuit 2204 is controlled to open and close by a latch signal S IaLch, and corresponds to the number of notes in which the most similar note length data LDsample output from the individual note length coincidence discrimination circuit 16 and the reference note length note string data LDIIne (red') match. The code length-dispersed data LDeq is passed through.

The or gates 2202-1 to 2202-7 have the above-mentioned pitch -
It outputs the logical sum of the scattered data PDeq and the mark length-success/failure data LDeq for each stage, and the latch circuits 2203-1 to 2203-1 to be described later are output from these OR gates.
2203-7 is latch controlled.

The latch circuits 2203-1 to 2203-7 are specially latch-controlled by the outputs of the OR gates 2202-1 to 2202-7.
The note length data output from each output 0UT1 to 0UT7 of 2 is latched.

The adder circuit 2205 includes the latch circuits 2203-1 and 2203-2.
Add all the note length data latched to 203-7,
Output these sums.

The addition circuit 2206 adds the reference note length tone string data LDII.
All of the note length data constituting ne (ref') is added, and the total sum is output. The output of this adder circuit 2206 becomes the aforementioned performance time data D (T).

A subtraction absolute value circuit 2207 calculates the difference between the addition data output from the addition circuit 2205 and the addition data output from the addition circuit 2206, and further outputs the absolute value, and this absolute value is the performance time difference. The data becomes D(ΔT).

As a result, when each of the circuits described above operates, the latch circuits 2203-1 to 2203-7 detect the part where the pitch is incorrect in the most similar pitch string data P Dsample, as shown in FIG. If the note length is also incorrect in the similar note length note string data LDsample, the blank area corresponding to the note length error will be replaced by the correct note length data existing at the corresponding place in the standard note length note string data. This will be corrected.

In other words, pitch is a particularly important element when practicing melodies, and therefore, the note length of a note pressed at the wrong pitch is treated as the correct note length when determining the note length, and this allows the correct pitch to be pressed. Judging the note lengths only for key tones results in accurate scoring that is more similar to that of a music teacher.

Next, the details of the pitch similar tone sequence number detection circuit 18 are shown in FIG. In the figure, a zero data generation circuit 1801 has a ka
Outputs zero data in parallel.

The coincidence determination circuit 1802 is configured to match the zero data generation circuit 180.
zero data outputted in parallel from 1 and pitch-dispersed data PD outputted from the similar pitch sequence extraction circuit 7.
Matching with eq-1 to PDeq- is individually determined, and each determination result is outputted to terminals EQ1 to EQk as a 1-bit signal.

The mismatch number detection circuit 1803 includes the match determination circuit 180.
2, the number of “0” signals output from EQ1 to EQk is detected, and this is calculated as pitch similar sound sequence set number data D (N
Output as 3).

Next, the details of the note length similar tone sequence detection circuit 19 are shown in FIG. In the figure, a zero data generation circuit 1901 outputs two pieces of zero data in parallel.

The coincidence determination circuit 1902 is configured to match the zero data generation circuit 190.
zero data output from 1 in parallel, and note length - output in parallel from the similar note length note string extraction circuit 10.
Matching with the scattered data LDeq-1 to LD eq -k is individually determined, and each determination result is output to terminals EQI to EQk as a 1-bit signal.

The mismatch number detection circuit 1903 includes the match determination circuit 190
The number of signal "0" outputted from 2 is detected and outputted as note length similar sound sequence set number data D (N4).

Next, details of the reference pitch number data path 20 are shown in FIG.

In the figure, a zero data generation circuit 2001 outputs 14 pieces of zero data in parallel.

The coincidence determination circuit 2002 is a match determination circuit 2002
14 zero data output from 1 and the reference tone treble string data P D output from the reference tone treble string generation circuit 1.
line (re[') for each stage individually, and the result of the determination is sent to the terminals EQl-EQ14.
Outputs in parallel depending on the bit signal.

In the mismatch number detection circuit 2003, the match determination circuit 20
The number of "0"s is detected among the outputs outputted from 02 and outputted as reference pitch number data D (N5).

Next, the details of the reference code length number data path 21 are shown in FIG. In the figure, a zero data generation circuit 2101 outputs 14 pieces of zero data in parallel.

The coincidence determination circuit 2102 is connected to the zero data generation circuit 210.
14 zero data output from 1, and the reference note long tone string data L output from the reference note long tone string generation circuit 12.
D IIne (ref) is individually determined for each stage, and the results of the determination are output in parallel as 1-bit signals to terminals EQI to EQ14.

The mismatch number detection circuit 21 determines whether "
0” is detected, and this is used as the reference mark length number data D (N6
).

Next, in the similarity calculation circuit 23, the single tone pitch number data D (Nl) obtained in this way, the matching note length number data D
(N2), pitch similar note string set number data D (N3), note length similar note string set number data D (N4).

Standard pitch number data D (N5), standard note length number data D
(N6), performance time difference data D (ΔT), and performance time data D (T), the score for the melody performance performed by the student is calculated using the following calculation formula.

Score X = + [100X (Nl/N5)X (N2
/N6)x (T-1ΔT l )/T] -Y)÷
5×5 However, N1; - Number of pitches N2; Number of matching note lengths N5; Reference number of pitches N6; Reference number of note lengths T; Model performance time ΔT; Performance time difference Y; Number of similar pitch series sets N3 or Score data Dscore obtained by the above calculation formula
is supplied to the score display 24, so that the performance score is displayed on the score display 24, for example, as shown in FIG.

Thus, in the melody performance training device shown in this embodiment, the melody played by the student on the keyboard 4 is transmitted through the key press detection circuit 51, the input pitch string forming circuit 6, and the input note length string forming circuit 9. It is converted into two-dimensional tone sequence data consisting of pitch and note length, and then this tone sequence data is converted into a pattern for each dimension via a similar tone sequence extraction circuit 7.10 and a matched part superimposition circuit 8.11. Since we use a method that performs recognition processing and ultimately extracts the phrase that is most similar to the standard melody, it is possible to extract the phrases that the music teacher (human) unconsciously feels from the melodies played by the students. It becomes possible to reliably extract only similar melodic parts.

In other words, when comparing a certain melody against a standard melody, human senses not only judge whether the two match or not, but also make analog judgments such as whether they are similar or not. According to this embodiment, it is possible to reliably extract only those portions that are somewhat similar to such a reference melody from the input performance melody.

Further, according to this embodiment device, the most similar pitch or note length data P Dsample, L Dsample output from the matching portion superimposing circuits 8 and 11, respectively.
Based on this, the system further displays which parts of the extracted similar melodies actually differ from the standard melody, so by displaying the error parts, the performer or It becomes possible for the student to know with certainty the location of the incorrect performance that he or she unconsciously made.

Further, according to the device of this embodiment, the matching portion compensation circuit 8
, 11, the most similar sound sequence data P Dsamp
le, L Dsample as the basic data, and these data are converted into one-note pitch number data D (Nl), matching note length number data D (N2), and pitch similar note string set number data D (N
3), note length similar note sequence set number data D (N4), standard pitch number data D (N5), standard note length number data D (N6)
, performance time difference data D (ΔT), model performance time data D (T), etc., to calculate performance scores, it is possible to obtain scoring results that are extremely close to the sense of a music teacher.

In other words, by taking the ratio between the number of -number pitches N1 and the reference pitch number N5 and the ratio between the number of matching note lengths N2 and the reference note length number N6, it is possible to distinguish between the somewhat similar melody part and the standard mentioned above. It can express the difference from the melody,
Furthermore, by calculating the ratio of the model performance time T and the performance time difference ΔT to the model performance time T, it is possible to determine how much error the total performance time of the vaguely similar melody parts described above can be increased relative to the reference melody performance time. Furthermore, by knowing the number N3 of pitch-similar note sequence sets and the number of note-length similar note sequence sets N4, it is possible to know how many parts of the performance melody are redrawn. It is. Therefore, by using these as grading elements, it is possible to obtain grading results that are extremely close to the senses of music teachers (humans).

In addition, in the embodiment described above, the performance results are displayed for the melody performance performed by the keyboard 4, or points are obtained for the performance results, so that each single note data corresponding to the input melody is displayed. Although the key press detection circuit 5 known in so-called electronic musical instruments is shown as a means for obtaining the key press detection circuit 5, the application of the present invention is not limited thereto. It is also possible to display or score similar performance results.

In this case, instead of the key press detection circuit 5, a pitch data detection circuit 26 as shown in FIG. 24 may be provided. 24th
In the figure, a fundamental wave detection circuit 2601 detects a fundamental wave included in an input audio signal or musical tone signal, converts it into a corresponding analog voltage, and outputs it.

The A/D conversion circuit 2602 is connected to the fundamental wave detection circuit 260.
Converts the analog voltage output from 1 into a digital signal.

The pitch reference data generation circuit 2603 generates CI, C1#, D
A series of reference pitch data consisting of I...Cn is output in parallel.

Permissible determination circuits 2604-1 to 2604-p are connected to the A/D
The input pitch data output from the conversion circuit 2602 and each reference pitch data output from the pitch reference data generation circuit 2603 are compared in magnitude, and the pitch difference corresponding to the comparison result is determined to be a predetermined pitch difference. "1" is output to each terminal EQ only when the value falls within the allowable range.

The gate circuits 2605-1 to 2605-p are controlled to open and close by the respective outputs of the permissible discrimination circuits 2604-1 to 2604-p, respectively, thereby allowing pitch data corresponding to 01 to Cn to pass through.

The OR gate 2606 is connected to each gate circuit 2605-1.
.about.2605-p. That is, this OR gate 2606 selectively outputs tone string data corresponding to the input audio signal.

The O gate 2607 calculates the logical sum of each bit of the OR gate 2606, and thereby detects that some tone string data has been input.

The monomulti 2608 outputs a minute width "1" in response to the output "1" of the OR gate 2607, and this "1"
The pulse corresponds to the key press timing signal 5kon shown in FIG.
-, and the output of the OR gate 2606 becomes the input pitch data PD(In) shown in FIG.

Furthermore, in the above embodiments, the key press detection circuit 5 and the pitch data detection circuit 26 are shown as converting each input note into two-dimensional data consisting of pitch and note length. , the application of the present invention is not limited to this, but for example to the pitches described above.

Of course, in addition to the note length, detection may be performed by converting the accent dimension, timbre dimension, or volume dimension, etc.

For example, to give a concrete explanation using tones as an example, the first
The tone sequence pattern of the reference tone high pitch sequence generating circuit 1 shown in the figure and the tone sequence pattern sequentially input to the shift register 607 shown in FIG. , piano, violin, trumpet, etc., and then configure them into the tone string pattern in that order.

That is, what is input from the shift register 607 is digital pitch information, but the formant data that each constituent note of the tone string has is inputted from the shift register 607.
It is only necessary to configure it so that it is input to 07,
More specifically, each constituent tone of the tone sequence is sequentially filtered through each bandpass filter (for example, with a center frequency of 500 Hz).
, 1000Hz, 3000Hz three band filters)
The analog voltage level output from each bandpass filter is converted into digital information, and its value is, for example, r
If the values are 4J, r3J, and r2J, the digital data may be input into the shift register sequentially for each constituent sound.

A device configured in this manner can be used, for example, for training in timing alignment of each musical instrument sound by an orchestra.

Furthermore, using the same idea as this type of thing, we extract relatively leading formants such as cat's cry, dog's cry, bird's cry, etc. Pattern extraction can be easily realized in a similar manner.

Furthermore, the sound volume can be easily realized by converting each volume level of each constituent sound of the sound string into digital information and inputting the digital information to the shift register 607.

With the device configured in this way, as the song progresses,
It is suitable for use in training to produce emotional feelings.

Furthermore, when configuring a chord or rhythm practice device, the following steps may be taken. That is, each detected performance information is filtered by a plurality of parallel bandpass filters similar to those described above, thereby converting the constituent note data of each chord into digital data, and each detected digital All you have to do is input the data into the shift register.

Furthermore, when constructing an accent practice device, it is sufficient to similarly detect dynamics data from inputted performance data, convert this into digital data, and then input it to the shift register.

In this way, in addition to the above-mentioned timbre, it can be suitably used for training to produce a negative layer of emotion.

Furthermore, in the above embodiment, for notes whose pitch has already been incorrect in the one-hour performance time difference detection circuit 22,
The note length is considered to be correct, and the score is based on the unique characteristics of the melody, that is, the pitch.However, if the note length is incorrect, the pitch is considered to be correct. If configured, it is of course possible to obtain performance scoring results that place emphasis on rhythm.

Next, details of another embodiment (hereinafter referred to as the second embodiment) including the first and third inventions of this application will be described in the third embodiment.
This will be explained with reference to FIGS. 8 to 40.

The device of this second embodiment has the appearance of a portable keyboard device, and its functions include not only the functions of a normal electronic musical instrument but also the functions of a scale roulette game, a scale golf game, a scale tennis game, etc. It is equipped with various scale game functions, and in addition to these games, it is also equipped with a melody lesson function according to the present invention. Furthermore, control of this electronic musical instrument is performed by a so-called microprocessor, and its Sysnum configuration is
Shown in Figure 8.

In the same figure, the system program ROM 27 contains C.
A system program that defines various operations performed in the PU 28 is stored.

The working RAM 29 is used as a working area when executing the various system programs mentioned above.

The pitch data ROM 30 stores, for example, two pieces of information that constitute a melody to be composed when performing a composition operation process to be described later.
A plurality of sets of pitch data for measures are stored, and one of them is selectively read out using random number data during the composition operation processing described later.

The note data ROM 31 stores a plurality of sets of note data, for example, a series of squares for two measures, composed in the same way as the pitch data ROM 30, and similarly to the pitch data ROM 30, these melodies are created using random number data. It will be read out alternatively.

The musical score data RAM 32 temporarily stores, for example, a two-bar melody composed by a melody composition operation process to be described later.

The keyboard section 33 includes a keyboard and a key press detection circuit for detecting keys pressed on the keyboard, and outputs so-called pitch data, key-on timing signals, etc. from the keyboard section 33.

The operating section 34 includes an operation mode selector switch, a power supply switch, and other various switches for switching various operations of this device, and the outputs of these switches are outputted.

The score display section 35 is composed of a character display device constituted by, for example, a liquid crystal display, and the scores obtained by the scoring process described later are displayed on this character display device.

The musical tone forming section 36 is constituted by a conversion processing device that converts pitch data into a musical tone signal, which is well known in this type of electronic musical instrument.
The musical tone signal outputted from 6 is amplified via an amplifier 37 and then outputted from a speaker 38.

Next, the basic operation of this embodiment device is shown in the general flowchart of FIG.

First, the execution contents of each step shown in this general flowchart will be individually explained in detail.

Step (1); In response to the mode changeover switch being switched to melody lesson on the operation unit 34,
Compose a melody for each measure. In this composing operation, the pitch data ROM 30 and the note data ROM 3
1, two measures of pitch data and note data are read out at random using random number data,
The melodies for 2' measures combined by these are stored in the musical score data RAM 32.

The details of this composing motion are disclosed in Japanese Patent Application No. 56-158437 and Japanese Patent Application No. 1324-1983 by the present applicant.
No. 94, Japanese Patent Application No. 1983-125603, Japanese Patent Application No. 56-1
No. 32493, etc., so it will not be described in detail here.

Step (2); The musical tone forming unit 36 transfers the composed two-measure melody data stored in the musical score data RAM 32.
The signal is sequentially transferred to the music signal in a time-division manner and converted into a musical tone signal.

The converted musical tone signal is then amplified via an amplifier 37 and then outputted from a speaker 38.

Step (3); Determine whether or not any key switch Δ· has been operated on the operation unit 34, and the determination result is Y.
In the case of ES, the process proceeds to step (8), and in the case of NO, the process proceeds to step (4).

Step (4): Determine whether any key has been pressed on the keyboard section 33. If the determination result is YES, proceed to step (6); if NO, proceed to step (5).
).

Step (5): Determine whether or not no key has been pressed for 3 seconds or more in the keyboard section 33. If the determination result is YES, proceed to step (7); if NO, proceed to step (7); returns to step (3).

Step (6); A score calculation is performed on the key press data (consisting of pitch data and note length data) input from the keyboard section 33 for the performance results performed according to the first embodiment. , and outputs the score obtained thereby to the score display section 35.

The details of the answer processing (6) are shown in FIG. 40.

Step (7): A model performance process similar to step (2) is performed.

Step (8); Determine whether or not the pressed key on the operation unit 34 is the start key, and the determination result is Y.
In the case of ES, the process returns to step (1), and in the case of NO, the melody lesson ends.

Next, details of the answer processing performed in step (6) will be explained according to the flowchart of FIG. 40.

Step (601): Initialize the location where the pitch data and note length data input from the keyboard section 33 are taken.

Step (602); Jitter is removed from the key press data sequentially fetched from the keyboard section 33, and the remaining data is fetched into a predetermined area in the initially set working RAM 29. Note that the length of the note that can be considered as jitter is:
It is assumed that the key press corresponds to a short time key press of about 100 as.

Step (603): The key press data obtained by the latest key press to the past 12 tones are retained, and the old data before that is deleted.

Step (604): Determine whether input of key press data from the keyboard section 33 has been completed, and if the determination result is YES, proceed to step (605); if NO, proceed to step (602) Return to

Step (605); Pitch string data stored in the musical score data RAM 32 from among a series of pitch string data and note string data stored in a set area in the working RAM 29.

Extract the note string data most similar to the note length note string data.

Note that when extracting this similar sound string, the pattern processing operation described in the first embodiment is performed, so a repeated explanation will be avoided here.

Step (606); As explained in the first embodiment, the notes are correct for the performance part where the pitch is incorrect compared to the most similar note sequence and the reference note sequence stored in the score data RAM. The note length is corrected by treating the note as a normal note.

Step (607); The model performance time of the standard melody stored in the musical score data RAM 32 and the step (607);
605); Compare the performance time indicated by the most similar sound sequence extracted in the above, and calculate the error time and use it as a scoring element. For example, here specifically, if the total performance time after note length correction is shorter than the model performance time,
Two points will be deducted every 0.1 seconds, and if the time is too long, a flat five points will be deducted.

Step (608): Calculate the pitch correct answer rate according to the formula: score x number of correct answers ÷ number of questions.

Step (609); Each note data for two measures stored in each data RAM 32 and the step (605)
) is compared in size for each note with the note data of the most similar note sequence extracted in 5 points will be deducted uniformly, and the score will be determined based on the variation in notes.

Step (610): Each note data stored in the musical score data RAM 32 is individually matched with each note data constituting the most similar note string extracted in the step (605), and one note is extracted. 5 points will be deducted for each mistake.

Step (611): Add up all the scores obtained in each of the above steps, and truncate the portion less than 5 points to calculate the total score.

Step (612); The total score data obtained in step (611) is sent to the score display section 35, thereby displaying numerical values on a predetermined display device.

Next, the operation of the flowchart consisting of each step explained above will be systematically explained.

First, in the operation section 34 shown in FIG. 31, the mode changeover switch is set to the melody lesson side. Then the third
In the flowchart of FIG. 9, steps (1),
(2) are executed in sequence, and automatically composed melody sounds (for example, two measures) are produced from the speaker 38.

Next, the student or performer performs a melody on the keyboard section 33 based on the melody sounds heard.

Then, step (3) - step (4) → step (
6), the answer processing program is executed. In the answer processing program (6), as shown in FIG.
First, after step (601) is executed, steps (602) - step (603) - step (604) - (602) are repeatedly executed while the key depression state continues in the keyboard section 33, and as a result, the working RAM 29 In the predetermined setting area, pitch string data and note string data from which jitter and the like have been removed are formed.

Next, when the performance on the keyboard section 33 is finished, each step (605) to step (612) described above is executed, and as a result, the score display section 35 displays the scoring result for the melody returned from the keyboard section 33. That will happen.

Next, when the execution of step (6) is completed, steps (3) - step (4) -> step (5) - step (7) are repeated again, and the same melody is sounded from the speaker 38 again.

In other words, if the melody asked and the melody answered are different, in order to be able to practice the same melody repeatedly, the same melody will be repeated unless the start key is pressed at the end of the answer process (6). This is to ensure that it is pronounced repeatedly.

Next, when the start key is pressed on the operation unit 34, the execution result of step (3) becomes YES, and then step (8) → step (1) - step (2) are executed, and the newly composed song is played. The melody is on speaker 38
By repeating the above steps, it is possible to repeatedly perform the same melody or a different new melody. Then, each time the answer is completed, the score display section 35 repeatedly displays the score corresponding to the performance result on the keyboard section 33, thereby allowing the student to effectively improve his melody practice.

Thus, according to the second embodiment, automatically composed short melody sounds are memorized, and answers to the melodies are stored in the keyboard section 33.
By repeating the operation of playing through the melody and checking the scores for the performance results, it becomes possible to conduct this type of melody lesson very effectively without a teacher.

As is clear from the explanations of the first and second embodiments explained below, according to the first invention related to this application, when a music teacher usually grades some kind of melody, the music teacher unconsciously extracts the melody. It is possible to automatically extract melodic parts that are vaguely similar to the model melody, and if a student notices an incorrect part in the middle of playing the melody and plays it again, the mistake can be automatically extracted. Furthermore, the replayed portions are automatically deleted, making it possible to reliably extract only the melody portions necessary for scoring, etc.

Further, according to the second invention related to this application, in the melody part played by the student, the above-mentioned rewritten and corrected part is deleted, and the part that the student unconsciously misunderstood is removed. This allows you to effectively improve your melody practice.

Furthermore, according to the third invention related to this application, it is possible to obtain scoring results that are extremely close to the senses of a music teacher, and by displaying such analogical scores, it is possible to provide more effective criticism to students. This is possible.

4. Brief Description of the Drawings ' Fig. 1 is a block diagram showing the overall configuration of a tone string pattern extraction method, a performance result display device, and a performance result scoring device using the same, including the first to third inventions related to this application. Figure 2 is a block diagram showing details of the input pitch string formation circuit, Figure 3 is a block diagram showing details of the input note length string formation circuit, and Figure 4 shows details of the similar pitch string extraction circuit. Block diagram: Figure 5 is a block diagram showing details of the first similar pitch sequence detection circuit; Figure 6 is a block diagram showing details of the first similar pitch sequence detection circuit; Figure 7 is a partial pitch section. FIG. 8 is a block diagram showing details of the similar note length note string extraction circuit; FIG. 9 is a block diagram showing details of the first similar note length note string detection circuit; FIG. 10 is a block diagram showing details of the first similar note length note string detection circuit. 11 is a block diagram showing details of a similar note length tone sequence detection circuit; FIG. 11 is a block diagram showing details of a matching note length partial superposition circuit; FIG. 12 is a block diagram showing details of a performance time/time difference detection circuit; Fig. 13 is a block diagram showing the details of the circuit for detecting the number of pitch similar note sequences, Fig. 14 is a block diagram showing the details of the note length similar note sequence number detection circuit, and Fig. 15 is a block diagram showing the details of the circuit for detecting the number of note length similar note sequences. Figure 16 is a block diagram showing details of the standard note length number configuration circuit. Figure 17 is a block diagram showing details of performance result display circuit. Figure 18 is performance result displayed on CRT. C indicating the state of
A diagram of the RT screen, FIG. 19 is a block diagram showing details of the control circuit, FIG. 20 is a block diagram showing details of the similar film designation signal generation circuit, FIG. 21 is a block diagram showing details of the shift signal generation circuit, Fig. 22 is a block diagram showing details of the latch signal generation circuit, Fig. 23 is a time chart showing the states of each control signal output from the control circuit 25, and Fig. 24 shows an example of the pitch detection means. A block diagram, FIG. 25 is a diagram showing an example of each tone string data corresponding to the reference melody, FIG. 26 is a time chart showing the states of various timing signals corresponding to the input melody, and FIGS. 27 to 30 are Input pitch string formation circuit.

An explanatory diagram showing the details of the tone sequence data processing performed in the similar pitch note sequence extraction circuit, and Figures 31 to 34 show the flow of note sequence data processing performed in the input note length forming circuit and the similar note length note sequence extraction circuit. FIG. 35 is an explanatory diagram showing the flow of tone sequence data processing carried out in the one-note pitch partial alignment circuit, and FIG. 36 is an explanatory diagram showing the flow of tone sequence data processing carried out in the coincident note length partial alignment circuit. FIG. 37 is an explanatory diagram showing the flow of note length data correction processing performed in the performance time/time difference detection circuit. FIG. 38 is a portable keyboard including the first and third inventions related to this application. A block diagram showing the system configuration of the entire device, FIG. 39 is a general flowchart schematically showing operations related to the melody lesson among the operations of each mode of the device, and FIG. 40 is an answer processing program in the general flowchart. 2 is a flowchart showing details of the process.

1.......Reference tone high tone string generation circuit 2...
...Musical tone formation circuit 3 ...Speaker 4 ...Keyboard 5 ...Key press detection circuit 6 ... ...Input pitch string formation circuit 7...
...Similar pitch sequence detection circuit 8...
-Several pitch partial multiplication circuit 9...Input note length tone string forming circuit 10...Similar note length tone string extraction circuit 1
1... Matching code length partial overlapping circuit 12...
・Reference note length string generation circuit 13...Performance result display circuit 14...Individual pitch matching discrimination circuit 15...
・-Discrete string number detection circuit 16...Individual note length coincidence discrimination circuit 17...
- Matching note length number detection circuit 18... Pitch similar note sequence number detection circuit 19...
. . . Note length similar note sequence number detection circuit 20 . . . Reference note sequence number detection circuit 21 . . . Reference note sequence number detection circuit 22 . . . Performance time/time difference detection circuit 23 ...
. . . Similarity calculation circuit 24 . . . Score display 25 . . . Control circuit 26 . . . Pitch data detection circuit PD (in) .・Input pitch data PDI
Ine (f'ull)...Input pitch string data PDline (ref')...
・・Reference pitch pitch sequence data PD (ref')・・・・
...Reference pitch data PD11ne sn+l-1
~P Dllne 5m1-k ・-Shift number data PDeq-1 to PDeq-k corresponding to the first to second similar tone high pitch string partial data, respectively......First to
Pitch-scattered data P that corresponds to the similar pitch string partial data PDSalple・・・・・・Most similar pitch string data PDeq・・・・・・Pitch-scattered Data L
DIIne (f'ull)...Input note length string data LDline (ref)...
...Reference note long note string data LDIIne sn+I-1
~LDllne sml -k ・-・−・−・−Shift count data LDeq-1 to LDeq-k corresponding to the first to first similar note long note string note length data, respectively 1~
Note length-scattered data L Dsample... Most similar note length note string data LDeq... Note length-scattered data corresponding to the th similar note length note string partial data Data D
5core・・・・・・Score data PDlin
e (1 to 7)...Input pitch string partial data LD (ref')...Reference note length data LD (in)...・Input note length data DC
NI)・・・・・・・・・-Number sound item number data D (N2
)・・・・・・Matching code length number data D (N3)・
・・・・・・Pitch similar tone sequence set number data D (N4)
......Note length similar sound sequence set number data D (N5
)......Reference pitch number data D (N6)...
・・・・・・Standard note length number data S kon・・・・・・
...Key press signal 5kon-...Key press timing signal 5kon'...Data import signal inversion 5kon'...Data import Signal 5play・・・・・・Playing signal S ju
dge......Judgment enable signal Sφ...
・・・・・・Clock bitterness S end・・・・・・
...Judgment end signal 5load... Load signal 5 shil't... River shift signal 5IaLch... Latch signal S push... Secure key press signal 55m1.・・・
... Similar film designation signal Seq ... Match signal 5clr ... Clear signal StC ... Initial clear signal S cos.
...Switching signal patent applicant Yamaha Corporation

Claims (1)

[Claims] 1. Converting performance or singing information into one- or two-dimensional or more-dimensional tone sequence data having at least the dimension of note length; and then converting the tone sequence data and tone sequence data corresponding to a reference tone sequence. A sound sequence pattern extraction method comprising: comparing sound sequence patterns with respect to predetermined features; and extracting a phrase most similar to a reference sound sequence from an input sound sequence based on the comparison result. 2. Single note data detecting means for converting and detecting each constituent note sequentially generated by playing or singing into one or two or more dimensional single note data having a dimension of at least note length; an input tone string data forming means that stores input tone string data for each dimension and in the order of occurrence to form input tone string data corresponding to performance or singing; The input sound string is compared with one or more sets of similar sound string parts that are selected in descending order of similarity by shifting the reference points of the time axes from each other and comparing sound string parts that exist in the same time period. Similar sound string part extracting means for extracting from the data; Extracting parts that match the reference sound string data of the corresponding dimension from each of the extracted similar sound string parts, and superimposing these parts on each other to correspond to the most similar phrase. A performance result display device comprising: a data superimposition means for forming the most similar sound string data; and a means for printing or displaying the formed most similar sound string data. 3. The input note string data forming means removes, from the detected single note data, single note data having a certain note length or less and which cannot be a musical element. The performance result display device described. 4. Single note data detection means for converting and detecting each constituent note sequentially generated by playing or singing into one or two or more dimensional single note data having a dimension of at least note length; an input tone string data forming means that stores input tone string data for each dimension and in the order of occurrence to form input tone string data corresponding to performance or singing; The input sound string is compared with one or more sets of similar sound string parts that are selected in descending order of similarity by shifting the reference points of the time axes from each other and comparing sound string parts that exist in the same time period. Similar sound string part extracting means for extracting from the data; Extracting parts that match the reference sound string data of the corresponding dimension from each of the extracted similar sound string parts, and superimposing these parts on each other to correspond to the most similar phrase. a data superimposition means for forming the most similar sound sequence data; the total number of sound data included in the formed most similar sound sequence data among the constituent sound data of the reference sound sequence data; and the reference sound sequence data. A performance result grading device characterized by comprising a grading calculation means for determining the ratios of 1 to the total number of each constituent tone data for necessary dimensions, and grading an input tone sequence using at least the values of these ratios as grading elements. 5. The input note string data forming means removes, from the detected single note data, single note data having a certain note length or less and which cannot be a musical element. Performance result scoring device described in .