JP3430418B2 - Score display device - Google Patents

Description

Description: BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a musical score display device. 2. Description of the Related Art There is known an apparatus for displaying a musical score image in synchronization with the reproduction of music. In such an apparatus, for example, musical score image data corresponding to music to be reproduced is recorded on a recording medium such as a compact disk (CD-G) or a laser disk (LD) having a graphics display function. When such a recording medium is reproduced, the musical score image data is displayed in synchronization with the reproduction of the music sound. [0003] However, in the above-mentioned conventional example, since the score image data is recorded on the same recording medium, it is necessary to display the score image data in synchronization with the reproduction of the music sound. However, there is a problem that the recording medium on which the musical score image data is recorded must be newly released, and the software of the recording medium already released cannot be used. An object of the present invention is to make it possible to display musical score image data in synchronism with a music sound reproduced from a recording medium while utilizing software of a recording medium already on the market, and to fast-forward. And so on. According to the present invention, a music sound signal recorded on a recording medium such as a compact disk is reproduced, and at each reproduction time point, absolute time data indicating the reproduction time point is obtained. Has a function to output time data
Music playback means such as a compact disc player. Next, score data storage means for storing score data indicating an image image of the score at each progress position corresponding to each of a plurality of progress positions of the score display, such as for each score and each screen number in the score. Having. Next, a score image is displayed based on the score data.
Musical score display means for indicating the progress position of musical score display to the user.
It has a progress position changing means for changing. In addition, the music reproducing means corresponds to each of a plurality of progress positions of the musical score display.
The display of the score image is switched during the playback of the music sound signal of
The playback point to be played is indicated, and the progress position changing means
When the progress position of the score display is changed,
The apparatus has a time-of-progress-position data storage means for storing time data indicating a reproduction time point to be reproduced . Then, the time data sequentially outputted from the music reproducing means in correspondence with the music sound signal reproduced by the music reproducing means is sequentially compared with the time data in the time-of-progress-position data storage means, thereby reproducing the music. There is provided first control means for reading out the score data at the progress position corresponding to the time data sequentially outputted from the means from the score data storage means and displaying the score data on the score display means. Further, the travel position is changed by the traveling position changing means.
Read the score data of the advanced position from the score data storage means.
And display it on the score display means, and its progress position
At the time the score image displayed by the score display means switches
The music reproduction means advances the time data of the music sound signal to be reproduced.
Second control means read from the row position hourly data storage means
It has a step. [0010] The time read by the second control means.
Change the playback position to find the music sound signal corresponding to the data
Having means. The first control means compares the time data successively output from the music reproduction means with the time data in the time-of-progress-position data storage means successively, so that the music sound signal in the music reproduction means is obtained. The music data synchronized with the reproduction of the music data can be read from the music data storage means and displayed on the music display means. In this case, since the time data is always compared, the musical score display can be synchronized with, for example, an operation such as fast forward or fast reverse of the music reproducing means. In addition, the second system
The control means is changed by the user by the progress position changing means.
Time data corresponding to the progress position of the score display is displayed for each progress position
Read from the time data storage means, and the playback position change means
Music corresponding to the time data read by the second control means
By locating the sound signal, it is possible to cope with an arbitrary change in the musical score display. Embodiments of the present invention will be described below with reference to the drawings. <Structure of Embodiment> FIG. 1 is a diagram showing the overall structure of an embodiment of the present invention, in which a score display function is realized as a function of an electronic musical instrument having a CD player reproducing function. Reference numeral 104 denotes a CD, which is set in a holder (not shown). It should be noted that the CD 104 may be recorded with music software generally distributed on the market. The TOC memory 100 is a memory for storing TOC (Table of Contents) data in a lead-in area which is automatically read when the CD 104 is set. The CD operation unit 101 includes a playback switch PLA.
Y (also used as a pause switch), stop switch STOP, fast-forward switch FF, "0" to
It is composed of a numeric keypad “9” and the like, and is operated to control the progress of CD playback when performing normal CD playback without displaying a score. The CD control unit 102 is, for example, a microprocessor, and performs overall control of reproduction of music sound of the CD 104. The CD control unit 102 includes a subcode signal processing circuit 109, a musical instrument control unit 115, and a TOC memory 1.
Transmission and reception of various data are carried out between 00 and the like. Also CD
When driving the CD 104, the control unit 102
03, and outputs a drive control signal. The drive unit 103 controls the number of rotations of a disk motor that drives the CD 104 to rotate.
Drive control is performed such that the linear velocity of each track of No. 4 becomes constant. The drive unit 103 performs focus servo, tracking servo, and the like of the pickup 105 that irradiates a track of the CD 104 with a laser beam. On the surface of the CD 104 irradiated with the laser beam, projections called pits are cut, and PCM signals (Palse Code Modulation signals) are recorded by these pits. And the pickup 105
Detects the presence or absence of a pit based on the amount of reflected light of the irradiated laser beam, and outputs an electric signal corresponding to the presence or absence of the pit and its length to the demodulation circuit 108. The demodulation circuit 108 detects a frame synchronizing signal from the electric signal output from the pickup 105, identifies a break of each symbol word, and further performs EFM (Eight to Fourteen Modulation) 14 in each frame. The bit symbol word is subjected to EFM demodulation and converted into an 8-bit symbol word. Then, the demodulation circuit 108 outputs the symbol word including audio data to the audio data signal processing circuit 110 and the symbol word including the subcode to the subcode signal processing circuit 109 among the EFM-demodulated symbol words. The audio data signal processing circuit 110
While taking in the input audio data, error correction processing and de-interleaving processing are performed based on the Reed-Solomon code, and one frame unit is obtained.
Each sample of the 6-bit digital audio data is restored. Then, this digital audio data is
/ A converter 111 is output. The D / A converter 111 converts the input digital audio data into an analog audio signal and outputs it. This analog audio signal is an LPF having a cutoff frequency that is half the sampling frequency.
The signal is supplied to an amplifier 113 and a speaker 114 via a (low-pass filter) 112 and is emitted outside. The sub-code signal processing circuit 109 performs error detection and correction processing, de-interleaving processing on the 8-bit sub-code, and restores the sub-code. Then, the subcode signal processing circuit 109 outputs the restored subcode data to the CD control unit 102. When the user performs a normal CD reproduction without displaying a score, the CD control unit 102
Based on the operation state of the operation unit 101 and the subcode input from the subcode signal processing circuit 109 when the CD 104 is set in the holder or during the reproduction of the CD 104, each progress operation of the CD reproduction is controlled. When the user performs a CD reproducing operation while displaying a musical score, the CD control unit 102 transmits absolute time data from the musical instrument control unit 115 based on the operation of the musical instrument operation unit 116 described later by the user. If it has been received, the cue reproduction is performed from the music position corresponding to the absolute time data (minute, second, frame), and if the reproduction stop instruction is received from the musical instrument control unit 115, the CD reproduction is stopped. Further, the CD control unit 102 extracts absolute time data (minutes, seconds, frames) from a bit called a bit Q , which will be described later, in the subcode input from the subcode signal processing circuit 109 during reproduction. Also, in the song /
It extracts bits called bits P representing the interval between songs by a value of “0” or “1”, and sequentially outputs them to the musical instrument control unit 115. As shown in the figure, the musical instrument operation unit 116 includes a numeric keypad for designating the music number of the musical score, a SET key for fixing the musical number, a “+” key for advancing the musical score display, And a STOP key for stopping the display of the musical score and the reproduction of the CD synchronized therewith. Also,
Although not particularly shown, the musical instrument operation unit 116 also has various setting keys for setting the tone color and other parameters when playing the musical instrument. The musical instrument control unit 115 is, for example, a microprocessor. The musical instrument control unit 115 reads out the musical score data stored in the memory card 121 connected via the connector 120 based on the operation of the musical instrument operating unit 116 by the user, and reads the musical score data. In addition to executing the control operation for transferring the data to the display register 122 and causing the display driver 123 to display the data on the score display unit 124, the CD control unit 102 is also instructed to stop the reproduction of the CD 104 or the absolute time data synchronized with the display of the score data. Output. In parallel with the above-described control operation, the musical instrument control unit 115 generates musical tone waveform data based on a user's playing operation on the keyboard 117 and outputs the generated musical tone waveform data from the speaker 119 via the sound system 118. The control operation as a normal electronic keyboard instrument is also executed. Next, in the sub-code, a bit Q in which absolute time data is stored and a bit P in which data indicating the middle of a song / between songs are stored will be described. Now, CD104
In the above, digital data is recorded in units called frames, and in each frame, in addition to audio data which is a CD playback sound, control data called sub-code consisting of 8 bits per frame is stored. The 8-bit sub-code per frame is assembled with 98 frames as one sub-coding frame. In the 98 frames, the 8-bit sub-codes of the first frame and the second frame are as shown in FIG. This is a sync pattern for the subcode signal processing circuit 109 to recognize one subcoding frame. Then, meaningful data is represented by a subcode group of (8 bits × 96 frames) in the third to 98th frames. Here, as information particularly relevant to the present invention, bits called bits P and Q are stored in the subcode of each frame. Now, as shown in FIG. 3, the function of the bits Q and P will be described by taking a CD 104 containing three pieces of music as an example. In the CD 104, as shown in FIG. 3, various data are recorded from the inner circumference to the outer circumference of the CD 104. The innermost area (area having a diameter of 46 mm to 50 mm) is called a lead-in area. In the subcode of this area, information called TOC (Table of Contents), which corresponds to the table of contents of all the songs recorded on one CD, is recorded. This information is stored when the CD 104 is set in the holder. The data is read out to the TOC memory 100 and the C
Based on the operation of the D operation unit 101, it is used for control of CD music selection and the like. Since this information is not particularly related to the present invention, a detailed description thereof will be omitted. In the CD 104, an area called a program area exists outside the lead-in area, as shown in FIG. In this program area, audio data is recorded in frame units, and bits P and Q in the subcode in each frame are recorded as shown in FIG. The bit P is data indicating between a music piece and a music piece. The bit P is "1" when the frame is between music pieces and there is no audio data, and is "0" when the frame is music piece and there is audio data. Is set to "". Various time information is recorded in the bit Q. Now, as described above, 98 frames (the time of one frame is 136.05 μsec) are treated as one sub-coating frame. Therefore, the unit of the time for one sub-coating frame (136.05 μsec × 98), that is, 1 /
Time information in units of 75 seconds is represented by bit Q. FIG. 2 is a diagram showing a data structure of a bit Q in a program area per one subcoding frame. In FIG. 2, Q ₁ , Q ₂ ,.
₉₆ corresponds to each bit Q of the third frame, the fourth frame,..., The 98th frame in one subcoding frame. First, the flags Q _{1 to} Q ₄ are used for discrimination of the number of audio data channels, presence / absence of emphasis, and the like. The next 4 bits of Q _{5 to} Q ₈ are “000”.
Is set to 1 ". [0039] follows, 8-bit Q ₉ to Q ₁₆ represents a track number (music number), the following 8 bits of Q ₁₇ to Q ₂₄ is the index, track number The following three 8 bits are relative time data, and the elapsed time from the start of each music is expressed in minutes, seconds, and frame numbers, and is 1/75 seconds. The next 8 bits are all 0. The next three 8 bits are absolute time data, and the elapsed time from the start of the program area to the time of the sub-coating frame. Is represented by minute, second and frame number, and 1
The display is updated every / 75 seconds. Here, as described above, one sub-coding frame is formed by 98 frames, and one sub-coding frame corresponds to 1/75 second, so that a series of 75 sub-coding frames is used. Are the same second data. The above-mentioned frame numbers are obtained by sequentially numbering 0 to 74 to 75 sub-coding frames in the same second data. The last 16 bits include an error detection code (CRC).
C code). The present embodiment is characterized in that the display of the musical score data and the reproduction of the CD are synchronized by using the above-described absolute time data (minute, second, frame). Next, the data format on the memory card 121 in which the musical score data is stored will be described.
As shown in FIG. 4, the data on the memory card includes a header portion, and subsequently, a plurality of screens of bitmap score data indicating a score image image for each song. Note that the score data for one screen displays a score for several measures. As shown in FIG. 5, the header section includes a score number (song number), a screen number in the score indicated by the score number, and a screen number corresponding to the screen number in the score indicated by the score number. The start address of the score data (FIG. 4) and the absolute time data (minute,
(Second, frame). <Operation of Embodiment> The operation of the embodiment having the above configuration will be described below. When performing normal CD reproduction without displaying a score, the user operates the CD
04 is instructed. When performing a CD playback operation while displaying a score, the user inputs a score number (song number) using the numeric keypad of the musical instrument operation unit 116, and finally presses the SET key. As a result, the musical instrument control section 115 executes the control program shown in the operation flowchart of FIG. 6, first, in step S601, 1 is assigned to the screen number register M. Next, in step S602, it is determined whether or not the numeric keypad has been set. If the user presses the SET key after setting the number using the numeric keypad, the determination in step S602 becomes YES, and the number is substituted into the score number register N in the next step S603. On the other hand, if the user presses only the SET key without performing the number setting using the numeric keypad, the process proceeds to step S60.
The determination at 2 is NO, and the value "1" indicating the first music is substituted into the musical score number register N in step S604. Next, in step S605, the header section stored in the memory card 121 is accessed to correspond to the score number indicated by the score number register N, and to correspond to the screen number = 1 indicated by the screen number register M. The absolute time data of the address to be read is read out, and a cue reproduction instruction is output to the CD control unit 102. With this, CD
The control unit 102 searches for the beginning of the song corresponding to the instructed absolute time data and starts playback. In step S606, the memory card 12
1 is accessed, and the head address of the score data corresponding to the score number indicated by the score number register N and corresponding to the screen number = 1 indicated by the screen number register M is read. Then, the musical score data for one screen is sequentially read from the address on the memory card 121 indicated by this address, and is transferred to the display register 122. As a result, the display driver 123 displays the musical score data for one screen held in the display register 122 on the musical score display section 124. As described above, the score data for one screen displays a score for several measures. Subsequently, in the musical instrument control section 115, the processing of steps S607 to S615 is repeatedly executed.
First, in step S607, the value of the absolute time data of the current reproduction timing sequentially transferred from the CD control unit 102 is set next to the screen number indicated by the screen number register M in the score number indicated by the score number register N. It is determined whether or not the value of the absolute time data stored in the header section of the memory card 121 has been reached corresponding to the screen number. If this determination is NO, step S610,
The determination in step S607 is repeated via the determinations in S614 and S615. Then, in the repetition of the above processing, the value of the absolute time data of the current reproduction timing transferred from the CD control unit 102 is replaced with the value of the screen number indicated by the screen number register M in the score number indicated by the score number register N. When the value of the absolute time data stored in the header section of the memory card 121 is reached corresponding to the next screen number and the determination in step S607 is YES ,
Steps S608 and S609 are executed. In step S608, the value of the screen number register M is incremented by one. Then, in step S609,
The header part stored in the memory card 121 is accessed, and the head of the score data at the address corresponding to the score number indicated by the score number register N and corresponding to the next screen number indicated by the updated screen number register M is accessed. The address is read. Then, the musical score data for one screen is sequentially read from the address on the memory card 121 indicated by this address, and is transferred to the display register 122. As a result, the display driver 123 displays the score data of the next screen held in the display register 122 on the score display section 124. In this way, the musical score screen display can be successively updated in synchronization with CD playback. Next, in the repetition of the processing of steps S607 to S615, the user sets "+"
When the key is pressed, the determination in step S610 becomes YES. Then, as in the case of steps S608 and S609, the value of the screen number register M is incremented by +1 in step S611.
Then, the musical score data corresponding to the screen number advanced by one in step S612 is read out to the display register 122, and is newly displayed on the musical score display section 124 by the display driver 123. Further, in step S613, the header stored in the memory card 121 is accessed, and the next screen number indicated by the updated screen number register M corresponds to the score number indicated by the score number register N. Is read out, and a cue reproduction instruction is output to the CD control unit 102. As a result, the CD control unit 102 locates the reproduction position corresponding to the updated musical score screen and reproduces it. Thereafter, the processing returns to the repetition of the processing of steps S607 to S615 via step S614. In this way, the user can use the “+” key to sequentially advance the display of the musical score by one screen and synchronize the CD playback with it. Subsequently, in the repetition of the processing of steps S607 to S615, when the user operates the fast-forward switch FF of the CD operation unit 101 to fast-forward the CD reproduction, thereafter, the CD control unit 102 sends the musical instrument control unit 115
Is stored in the screen number register M
Is a value corresponding to the screen number following the screen number indicated by. As a result, steps S607 → S608 →
By repeating the processing of S609 to S615 until the determination of step S607 becomes NO, the screen of the musical score display is sequentially switched, and the screen number register M of the screen number register M is changed to correspond to the value of the absolute time data from the CD control unit 102. The value is updated, and a score display screen synchronized with fast-forwarding of CD playback is displayed. Further, in the repetition of the processing of steps S607 to S615, the CD playback reaches the end of the music and C
When the value “1” indicating the interval between music pieces has been transferred from the D control unit 102 as the data of the bit P, the determination in step S615 is YES. As a result, in step S616, an instruction to stop CD playback is output to the CD control unit 102, and the contents of the display register 122 are cleared. Thereby, the CD control unit 102 stops the CD reproduction, and the display of the musical score on the musical score display unit 124 is cleared. Further, in the repetition of the processing of steps S607 to S615, the user operates the STO
When the P key is pressed, the determination in step S614 becomes YES. Also in this case, as in the case described above, the process of step S616 for stopping the reproduction of the CD and clearing the musical score display is executed. <Other Embodiments> In the embodiment described above, the score display is performed by one.
Although the present invention has a configuration for realizing a function of advancing screen by screen, the present invention is not limited to this. A function of returning the display of the score one screen at a time, a function of advancing or returning the display of the score a plurality of screens, It is also possible to configure to have a function of changing the screen to an arbitrary designated screen, a function of changing the display of the score to another score number (song number), and the like. In the above-described embodiment, the absolute time data read from the CD 104 at the time of reproducing the CD is used to synchronize the display of the musical score with the reproduction of the CD. However, the relative time data may be used. The present invention is not limited to a CD as long as it can output time data during reproduction.
DI, DAT (digital audio tape), DCC
The present invention can also be applied to recording media such as (digital compact cassette), MD (mini disc), LD (laser disc), and the like. Further, as a medium for storing the header section and the musical score data, various storage media other than the memory card can be used. According to the present invention, the time data sequentially output from the music reproducing means is sequentially compared with the time data in the time-of-progress-position data storage means, whereby the music sound in the music reproducing means is compared. The musical score data synchronized with the reproduction of the signal can be displayed. In this case, since the time data is always compared, it is possible to synchronize the musical score display with, for example, operations such as fast forward and fast reverse of the music reproducing means. The user can change the progress position of the score display by the progress position changing means.
In this case, the display of the musical score and the reproduction of the music sound signal can be synchronized with the changed progress position. Further, according to the present invention, the music score data storage means and the progress position per hour data storage means are provided by, for example, a memory card or the like, so that software of a recording medium on which a music sound signal which has been conventionally sold is recorded can be used. The music score image data can be displayed in synchronization with the music sound reproduced from the recording medium while utilizing the music image as it is.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is an overall configuration diagram of an embodiment of the present invention. FIG. 2 is a configuration diagram of a bit Q in a program area. FIG. 3 is a diagram showing recorded contents of a CD. FIG. 4 is a diagram showing a data format on a memory card. FIG. 5 is a diagram showing a data format of a header part. FIG. 6 is an operation flowchart of the embodiment of the present invention. [Description of Signs] 100 TOC memory 101 CD operation unit 102 CD control unit 103 Servo control circuit 103 Disk motor 103 Pick-up feed motor 104 CD 105 Optical pickup 108 Demodulation circuit 109 Subcode signal processing circuit 110 Audio data signal processing circuit 111 D / A converter 112 Low-pass filter (LPF) 113 Amplifier 114, 119 Speaker 115 Musical instrument control unit 116 Musical instrument operation unit 118 Sound system 121 Memory card

Claims (1)

(57) [Claim 1] A music reproducing means having a function of reproducing a music sound signal recorded on a recording medium and outputting time data indicating the reproduction time at each reproduction time; corresponding to each of the plurality of advancing position of the musical score display specified by the score ID and screen number, and musical score data storing means for storing musical score data indicating a picture image of the musical score of the respective traveling position, based on the musical score data Notation display to display score image
Means and progress position change that allows the user to change the progress position of the score display
Means , corresponding to each of a plurality of progress positions of the score display,
A music score image is reproduced in the reproduction of the music sound signal by the music reproduction means.
Display indicates the playback point at which to switch, and
The progress position of the score display was changed by the line position changing means
A traveling position every time data storage means for storing <br/> between data when indicating the playback point the music reproducing means to be reproduced at the time, said in response to the musical sound signal reproduced by said music reproducing means The time data sequentially output from the music reproducing means is sequentially compared with the time data in the time-of-progress-position data storage means, whereby the musical score at the progress position corresponding to the time data sequentially output from the music reproducing means is obtained. first control means for the data read from the musical score data storing means to be displayed on the score display means, the musical score by reading said musical score data of the changed traveling position by the traveling position changing means from said musical score data storing means together on the display unit, wherein in the advanced position
At the time when the musical score image displayed by the musical score display means is switched, the time data of the music sound signal to be reproduced by the music reproducing means is read out from the time-of-progress-position data storage means .
2 corresponding to the time data read by the second control means.
And a reproduction position changing means for searching for a music sound signal to be reproduced .