JP2914365B2 - Score display device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a musical score display device for displaying musical scores and the like input by handwriting.

[0002]

2. Description of the Related Art Conventionally, for a display such as a CRT,
Alternatively, various devices having a function of displaying a musical score as a print result of a printer are used. These devices are an application of a personal computer that supports composition, or an electronic musical instrument. The input of a musical score can be performed by keying in data corresponding to symbols constituting the musical score such as notes and rests, or by CRT. This is performed by selectively inputting various symbols constituting the musical score using a pointing device such as a light pen or a mouse while watching the screen.

[0003]

However, in such a device having a conventional score display function, various symbols constituting the score are input as a data string or by selecting a symbol to be input and designating an input position. Therefore, it is not possible to create a score as if by handwriting input on a staff paper. As a device suitable for such an application, a handwriting input unit and a unit for displaying the contents of the handwritten input may be provided, but there is a problem that a beautiful score cannot be displayed as it is.

[0004] It is an object of the present invention to provide a musical score display device that enables a musical score to be input by handwriting and that allows a musical score to be displayed using a predetermined musical score constituent symbol.

[0005]

According to a first aspect of the present invention, there is provided an input means comprising a pen-like body and a board-like body for inputting symbols constituting a musical score by handwriting, and provided integrally with the board-like body. Display means for displaying a score-like image; means for storing data for recognizing symbols constituting the score; means for storing font data of symbols constituting the score;
The symbols constituting the musical score input from the input means are read as graphic data and displayed on the display means. When the pen-shaped body is separated from the board-shaped body, the graphic data is represented based on the recognition data. If the constituent symbols of the score are recognized alone, and if they cannot be recognized alone, the constituent symbols of the score represented by the combination of the graphic data and the other symbols previously inputted are recognized, and Display control means for erasing the display by the graphic data display means and displaying the musical score by the font data of the recognized music composition symbol when the constituent symbol of the musical score represented by the graphic data is recognized by the recognition. It is characterized by.

According to a second aspect of the present invention, when the constituent symbols of the musical score represented by the graphic data cannot be recognized by the display control means, the graphic data that cannot be recognized is erased and the display means is displayed. Data erasing means for erasing the display of the figure.

FIG. 1 shows the structure of the present invention. In FIG. 1, a score reading means 1 is a device for reading handwritten input such as a touch panel or a digitizer. The recognition data storage means 2 stores in advance data for recognizing to which of the musical score constituent symbols such as notes and rests the symbols of the musical score input by handwriting correspond. The display data storage means 3 stores display data used when displaying musical score constituent symbols. The recognizing means 4 recognizes the constituent symbols of the musical score input by handwriting based on the data read by the musical score reading means 1 and the data of the recognizing data storage means 2 and selects corresponding data from the display data storing means 3. I do. The score display means 5 displays the score based on the selected display data.

[0008] With the above-described configuration, the musical score input by handwriting is once recognized and clearly displayed as a musical score using the corresponding musical score constituent symbol.

[0009]

FIG. 2 is an external plan view of a musical score display apparatus according to an embodiment of the present invention. In FIG. 1, reference numeral 10 denotes an input / display unit for inputting a musical score by handwriting and displaying the musical score, and 11 denotes a stylus pen used at the time of handwriting input. An input / display unit 10 displays a staff display D1, and a lower right portion of the screen includes an area D2 to be selected (touched by a pen) when inputting again, and a selection when scrolling the display screen upward or downward. Areas D3 and D4 to be displayed and an area D5 to be selected when the instruction to print out the score after the input is completed are displayed. (Hereinafter, D2 to D5 are referred to as function display sections.) Further, by manually inputting symbols such as musical scores on the staff display D1 using the stylus pen 11, the recognized symbols D6 are displayed.

FIG. 3 is a block diagram of a control section of the musical score display apparatus. In FIG. 1, reference numeral 20 denotes a CPU which controls the control of the entire control unit, and the following units are connected via a bus line. The ROM 21 has an area for storing recognition data, an area for storing display data, and a CP.
A memory having an area for storing the processing program of U;
AM22 is an area for temporarily storing handwritten data,
This is a memory having a recognition work area used for recognizing the data and an area for storing display data to be displayed after the recognition. 10a is a dot matrix type liquid crystal display panel, and the LCD controller 24 is a display panel 10a
Is a control circuit for generating a scanning signal and a display signal. The display memory 23 is a memory having bits corresponding to the dots of the display panel 10a, and the CPU 20 writes a pattern to be displayed on the display memory 23 as a bit pattern to perform display. The digitizer panel 10b is a panel in which an X-axis coil and a Y-axis coil orthogonal to the X-axis coil are arranged, and is arranged below the display panel 10a. The stylus pen 11 includes a coil for detecting an alternating magnetic field generated from the digitizer panel 10b through the display panel 10a and a switch SW for detecting pen touch. The digitizer controller 25 sequentially supplies an alternating current to the X-axis coil and the Y-axis coil to the digitizer panel 10b, and detects the induced voltage of the coil of the stylus pen 11 and the presence / absence of pen touch to display panel 1b.
The pen touch position with respect to 0a is detected. Printer 27
Is a device for printing out a score as a fair copy on the basis of input data relating to the score, a printer controller 2
Reference numeral 6 denotes a circuit for controlling the printer 27 based on a print signal received from the CPU 20.

FIG. 4 and FIG.
3 shows a memory map in the AM 22. Here, M1 is an area for storing recognition data for recognizing handwritten contents, and includes various notes such as a full note, a quarter note, an eighth note, a full rest, a quarter rest, and an eighth quarter. It stores data for recognizing various music composition symbols such as rests such as rests, bar lines, and slur symbols. M2 is an area for storing display data (font data) for displaying the various musical composition symbols, and M3 is an area for storing a processing program of the CPU. M4 is an area for temporarily storing handwritten data, M5 is a work area for performing recognition processing based on the handwritten data and recognition data stored in M1, and M6 is a display panel after recognition. This is an area for storing the code (font code) of the musical score constituent symbol to be displayed and its display position.

The operation of the musical score display device constructed as described above is as follows.

FIGS. 6 and 7 are flowcharts showing the processing procedure of the CPU 20, and FIG. 8 shows an example of a change in display of symbols (notes) at each processing time.

First, a staff display D1 and function displays D2 to D5 shown in FIG. 2 are displayed as an initial screen (n1). Subsequently, the presence or absence of pen touch is detected (n
2). If there is a pen touch, the position is read and a process corresponding to the position is performed. That is, if the position touched by the pen is other than the function display section, it is regarded as an input of a symbol constituting a musical score, the pen touched position is written into the input data memory M4, and the corresponding bit of the display memory 23 is set (n3 to n8). → n9). When the pen tip is moved without raising the pen, the positions are sequentially read and the same processing is performed (n10 → n3). With the above processing, a display as shown in FIG. 8A is performed.

Thereafter, once the pen tip is separated from the display panel, recognition is performed by comparing the contents input to the input data memory with the contents of the recognition data (n10 → n1).
1). As a recognition method at that time, a structural analysis such as a stroke analysis method or a feature matching method such as a vector matching method can be performed. When the recognition is completed, the data already plotted (bit set) in the display memory is deleted based on the data in the input data memory, and the font code obtained by the recognition and the display position of the font are stored (n1).
2 → n13 → n14). Further, font data corresponding to the font code is read out from the display data M2 and written into the display memory 23 (n15). Thus, a display as shown in FIG. 8B is performed.

Thereafter, the presence or absence of pen touch is detected again, and
Similar processing is performed, but if the recognition is not possible in step n11, it is tried whether or not it can be recognized as one symbol composed of a combination with the already recognized symbol (n12).
→ n16). When the recognition is completed, the display data of the corresponding symbol already written in the display memory 23 is deleted based on the contents of the display data memory and the font data, and the corresponding font code and The data at the display position is deleted (n17 → n18 → n19). Thereafter, the font code newly obtained by the recognition and its display position are written into the display data memory M6, and the font data corresponding to the font code is read from the display data M2 and written into the display memory 23 (n20 → n2).
1). As a result, for example, by handwriting input as shown in FIG. 8C, it is stored and displayed as one new symbol as shown in FIG. 8D.

If recognition is not possible in any of the steps n11 and n16, the input data is stored in the input data memory without recognition. If recognition is not performed even when the operator finishes inputting one symbol, and the display does not change, the operator notices that handwriting input was inappropriate and reenters the symbol. In such a case, if the CE (clear entry) in the function display section is selected (touched with a pen), the contents (unrecognized part) of the input data memory are deleted, and the data already plotted from the display memory 23 is deleted. After erasing, the process returns to the normal process after the pen tip is released (n4 → n30 → n31 → n32).

When a musical score is created beyond the display capacity of the display panel, the up arrow or the down arrow of the function display section is selected to shift the display content.
In this case, the data indicating the area to be displayed is shifted (n5 → n33, n6 → n34).

When the operator finishes inputting the musical score and prints out the contents, "print" in the function display section is selected. If this is selected, the contents of the display data memory (M6) are sequentially read, and a print signal is created from the phone data corresponding to the font code and output to the printer controller 26 (n
40 → n41). This process is performed for all data (n42).

In the above-described embodiment, the musical score input by hand is so-called fairly printed and displayed on the screen and printed out. However, the recognition result is supplied to the automatic performance device to add a function of performing the automatic performance. It is also possible.

[0021]

According to the first aspect of the present invention, since it is determined that the input of the graphic data has been completed by moving the pen-shaped body away from the board-shaped body, the recognition of the graphic data is started.
The musical score constituent symbol represented by the graphic data can be recognized without separately instructing the start of recognition, and the efficiency of the recognition operation can be improved. Further, even if the handwritten input graphic data cannot be recognized alone, the recognition accuracy can be improved by performing recognition in combination with other previously input symbols, which is realized by a combination of a plurality of elements. Symbol recognition is also possible.

According to the second aspect of the present invention, when graphic data that cannot be recognized alone cannot be recognized even when combined with another symbol, the graphic data is deleted, so that It is possible to work efficiently even with the input of complex score constituent symbols, and even when inputting unrecognizable graphic data, it can be erased and overtaken, so that the accuracy of the score input operation can be improved.

[Brief description of the drawings]

FIG. 1 is a block diagram showing the configuration of the present invention.

FIG. 2 is an external plan view of a musical score display device according to an embodiment of the present invention.

FIG. 3 is a block diagram of a control unit of the musical score display device.

FIG. 4 is a memory map of a ROM provided in the control unit.

FIG. 5 is a memory map of a RAM provided in the control unit.

FIG. 6 is a flowchart showing a processing procedure of a CPU.

FIG. 7 is a flowchart showing a processing procedure of a CPU.

FIG. 8 is a diagram showing a change in display accompanying handwritten note input.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Score reading means, 2 ... Recognition data storage means, 3 ... Display data storage means, 4 ... Recognition means, 5 ... Score display means 10 ... Input / display part, 10a ... Dot matrix liquid crystal display panel, 10b ... Digitizer panel, 11: stylus pen, 23: display memory

Claims (2)

(57) [Claims] An input means comprising a pen-like body and a board-like body for handwriting input of symbols constituting a musical score, a display means provided integrally with the board-like body and displaying a musical score-like image, Means for storing data for recognizing the constituent symbols; means for storing font data of the symbols forming the score; and reading the symbols forming the score input from the input means as graphic data and displaying them on the display means When the pen-shaped object is separated from the board-shaped object, the constituent symbols of the musical score represented by the graphic data are independently recognized based on the recognition data. When a component symbol of a musical score represented by a combination with another symbol previously input is recognized, and a component symbol of the musical score represented by the graphic data is recognized by any of the recognitions, the diagram shown in FIG. Clears the display by the data display means, the musical score display device characterized by comprising a display control means for displaying a musical score by font data of the recognized score component symbol. 2. When the constituent symbols of the musical score represented by the graphic data cannot be recognized by the display control means, the graphic data that cannot be recognized is deleted and the display of the graphic on the display means is deleted. The musical score display device according to claim 1, further comprising a data erasing unit.