CN109493684B

CN109493684B - Multifunctional digital music teaching system

Info

Publication number: CN109493684B
Application number: CN201811505383.2A
Authority: CN
Inventors: 魏宏惠; 李现峰; 魏宏茹
Original assignee: Beijing Jinsanhui Technology Co ltd
Current assignee: Beijing Jinsanhui Technology Co ltd
Priority date: 2018-12-10
Filing date: 2018-12-10
Publication date: 2021-02-23
Anticipated expiration: 2038-12-10
Also published as: CN109493684A

Abstract

The invention belongs to the technical field of digital music teaching, and particularly relates to a multifunctional digital music teaching system; a multifunctional digital music teaching system comprises a music score playing operation module, a music score playing module, a white board operation module, a music theory teaching module, a playing teaching module, an appreciation module and an internet module. The invention provides a novel multifunctional digital music teaching system, which integrates functional modules such as music creation, an electronic teaching board, a music score player, video playing, picture viewing, webpage browsing and the like, and meets the requirement of the conventional music class teaching of primary and middle schools; the music score making operation module is no longer limited to only being capable of making a music score for uploaded songs or accompaniments, automatic synthesis of sound can be carried out on written music, and then a music score making file is generated, functions are more comprehensive, requirements of a user are met better, and the generated music score file is stored through a json file.

Description

Multifunctional digital music teaching system

The invention belongs to the technical field of digital music teaching, and particularly relates to a multifunctional digital music teaching system.

Background

The digital music education society is established in 2002 in China, the development of digital music education enters a new era, and although the digital music education field in China has been developed for more than ten years, the development of the digital music education field has not made great breakthrough progress, and the main reason is the lack of software with complete functions for music classroom teaching. For existing software for teaching music in class, such as AURALIA, EARPOVER, TONICA, OVERTRUE, etc. Although the teaching software is designed aiming at music teaching and greatly improved in usability, the teaching software is designed aiming at a single aspect of music teaching, for example, AURALIA mainly aims at hearing practice and answering of students, OVERTRUNE mainly aims at music score creation, and relatively comprehensive music classroom teaching software is lacked. Finally, the existing music classroom teaching auxiliary system has serious defects in the aspect of music score making, and although the music score teaching auxiliary system has a music score making function and can provide a good music score presentation mode, the music score teaching auxiliary system cannot synthesize the sound of the made music and realize the function of music score making.

Disclosure of Invention

Aiming at the problems, the invention provides a novel multifunctional digital music teaching system which has complete functions, wherein the music score printing module not only can print and synthesize the uploaded music score, but also can automatically synthesize the sound of the written music score and realize the music score printing function, and the generated music score file is stored through a json file, so that the machine readability and the human readability are well balanced.

The specific technical scheme of the invention is as follows:

the invention provides a multifunctional digital music teaching system, which comprises:

the system comprises a music score marking operation module, a music score file generation module and a music score storage module, wherein the music score marking operation module is used for marking a music score of an audio file to generate a music score file and storing the music score file into a json file;

the music score playing module is used for playing the music score file in multiple modes;

the whiteboard operation module is used for establishing a whiteboard library, constructing mapping between functional icons and corresponding functional attribute values in the whiteboard library, displaying the functional icons on a functional panel, and performing editing operation on a spectrum in an editing page, wherein the editing operation comprises but is not limited to an electronic pen, an eraser and an insertion file;

the music theory teaching module is used for constructing mapping from a staff table to a music keyboard and from the music keyboard to the staff table, calling a white board library to mark and explain a teaching page, and simultaneously establishing a music theory library, constructing mapping between music theory icons and corresponding attribute values in the music theory library, displaying the music theory icons on a music theory panel, and adjusting the tone or tone of a virtual keyboard and notes;

the performance teaching module is used for recording and projecting the demonstration performance of the teacher to the display screen through the camera, establishing a performance library, constructing mapping between performance setting icons and corresponding attributes in the performance library, displaying the performance setting icons on the performance panel, and adjusting the virtual keyboard, the performance tone and the tone;

the appreciation module is used for entering an appreciation page to appreciate the resources and calling a whiteboard operation mode to perform related operations;

the internet module is used for entering an internet interface to search and query related knowledge materials;

the operation module of making a music score includes:

a note library for constructing a data structure of notes including mapping between note data and note icons, mapping between note data and midi signals, and constructing each note data constituting the same tempo into bar data, the notes include regular notes, rests, and beats, which may be inter-transformed by modifying the duration fields in the attribute panel of the note, the note icon displayed on the note panel, when the user clicks on the note icon on the note panel, a general note, rest or tempo is initialized, assigning an initial value through a duration value field of a common note, a rest or a beat corresponding to the clicked note icon in an attribute panel of the note, directly storing the initial value into bar data, the note data is stored with lyric data, pitch data, note length data and the current playing time point of the audio file;

the note attribute library is used for constructing a data structure of a music score, and comprises a mapping between attribute values of the note and attribute icons, wherein the attribute icons are displayed on an attribute panel, after a user clicks the attribute icons on the attribute panel, the attribute values of the corresponding attribute icons can be obtained, and the attribute values are stored in corresponding key values in the data structure of the note;

and the music score generating unit is used for acquiring the time point of the currently played audio file based on the pause instruction when the audio file is played, recording the time point into the note data of the note library, taking the corresponding note data as the data of the innermost layer and storing the data into the bar data, forming the data of a complex spectrum table by using a spectrum table containing a continuous spectrum number, forming the data of the spectrum table of the outermost layer by using a plurality of lines of data of the complex spectrum table, and forming the music score file by using the data of the spectrum table and the structure of the data of the spectrum table and storing the data of the music score file into a json file.

The invention has the following beneficial effects:

the invention provides a new multifunctional digital music teaching system, which integrates functional modules of music creation, an electronic teaching board, a music score player, video playing, picture viewing, web browsing and the like, meets the requirement of the conventional music class teaching of primary and middle schools, is simple and easy to use, has a friendly interface, and provides rich and colorful tools; the music score making operation module is no longer limited to only making a music score for the uploaded song or the accompaniment, the written music score can be automatically synthesized, and then a music score making file is generated.

Drawings

Fig. 1 is a block diagram showing the structure of a multifunctional digital music teaching system according to embodiment 1;

FIGS. 2-6 are partially shown views of a spectroscopy operation module;

FIG. 7 is a block diagram showing the structure of a music score playing module according to embodiment 2;

FIG. 8 is a diagram showing a music score playing unit according to embodiment 2.

Detailed Description

The present invention will be described in further detail with reference to the following examples and drawings.

Example 1

An embodiment 1 of the present invention provides a multifunctional digital music teaching system, as shown in fig. 1, where the music teaching system includes:

the system comprises a scoring operation module 1, a music score generation module and a music score storage module, wherein the scoring operation module is used for scoring an audio file to generate a music score file and storing the music score file into a json file;

the music score playing module 2 is used for playing music score files in multiple modes;

the whiteboard operation module 3 is used for establishing a whiteboard library, constructing mapping between functional icons and corresponding functional attribute values in the whiteboard library, displaying the functional icons on a functional panel, and performing editing operation on a music score in an editing page, wherein the editing operation comprises but is not limited to an electronic pen, an eraser and an insertion file;

the music theory teaching module 4 is used for constructing the mapping from the staff table to the music keyboard and from the music keyboard to the staff table, calling a white board library to mark and explain a teaching page, and simultaneously establishing a music theory library, constructing the mapping between music theory icons and corresponding attribute values in the music theory library, displaying the music theory icons on a music theory panel, and adjusting the tone or tone of a virtual keyboard and musical notes;

the performance teaching module 5 is used for recording the demonstration performance of the teacher through the camera, projecting the demonstration performance to the display screen, establishing a performance library, constructing mapping between performance setting icons and corresponding attributes in the performance library, displaying the performance setting icons on the performance panel, and adjusting the virtual keyboard, the performance tone and the tone;

the appreciation module 6 is used for entering an appreciation page to appreciate the resources and calling a whiteboard operation mode to perform related operations;

the internet module 7 is used for entering an internet interface to search and query related knowledge materials;

the scoring operation module 1 includes:

the note library 11 is used for constructing a data structure of notes, including constructing a mapping between note data and note icons, a mapping between note data and midi signals, and constructing each note data composing the same beat into bar data, the notes include regular notes, rests, and beats, which may be inter-transformed by modifying the duration fields in the attribute panel of the note, the note icon displayed on the note panel, when the user clicks on the note icon on the note panel, a general note, rest or tempo is initialized, assigning an initial value through a duration value field of a common note, a rest or a beat corresponding to the clicked note icon in an attribute panel of the note, directly storing the initial value into bar data, the note data is stored with lyric data, pitch data, note length data and the current playing time point of the audio file;

a note attribute library 12 for constructing a data structure of a notation, including mapping between attribute values of the constructed notes and attribute icons displayed on an attribute panel on a user

After clicking the attribute icon on the attribute panel, obtaining the attribute value of the corresponding attribute icon, and storing the attribute value on the corresponding key value in the data structure of the note;

the music score generating unit 13 is configured to, when an audio file is played, obtain a time point of the currently played audio file based on a pause instruction, record the time point into note data of the note library 11, use corresponding note data as data of an innermost layer and store the data into bar data, form complex spectrum table data by using a spectrum table containing a consecutive number, form spectrum table data of an outermost layer by using a plurality of lines of complex spectrum table data, and store the music score file into a json file by using the spectrum table data and a structure thereof.

In the embodiment, the music score making operation module can realize the easy writing, editing and making of staff and numbered musical notation, and the intelligent association and movement of elements such as music scores, music symbols, lyrics and the like; the music score playing module can realize the random playing of the music score: the 128 sound color libraries can selectively adjust the tone, the sound speed and the sound color, can be played in any selection range and can be switched between the staff and the numbered musical notation at any time, can play the staff and the musical notation in the form of the staff or the numbered musical notation, and can switch the display of the staff or the staff and the playing of the musical notation by one key as required only by one-time playing of the staff; the white board operation module is realized: 1) arbitrary use of three types of teaching resource information: hand resources such as textbooks and exercise books are stored in the computer, PPT, DOC files, pictures and video resources are stored in the computer, and the Internet teaching website is accessed randomly. 2) Any whiteboard marks and explains, supports blackboard writing pens, blackboard erasers, curtains and the like, and inherits teaching habits and essences. 3) The teaching assistance of multiple modes, videos, pictures, texts and the like, and the classroom vitality is increased. The music theory teaching module integrates a music keyboard, a staff table, a tune, a key number, a musical note, a singing name, a chord, a musical interval ruler and the like into a whole, so that independent music theory elements are organically linked together, the mutual relation is convenient to know, and the visibility and the intuition of music theory teaching are improved; 128 timbres can be set; 15 different numbers can be set, and the real-time ring is displayed according to the number; 32 sets of chord demonstration teaching can be performed, including three chords and seven chords, such as: major triadimefon, minor triadimefon, major seventh chord, minor seventh chord, and seventh chord; a metronome can be arranged, so that the playing rhythm can be conveniently mastered; has an explanation mode; the function of showing and hiding the interval ruler is provided; the mapping function from the staff table to the music keyboard and from the music keyboard to the staff table is realized; the simulation multi-point music keyboard can be seamlessly connected with the MIDI interface in a hanging way; the multi-point touch simulation music keyboard is adopted, the playing fingering and skill of teachers are displayed in a backdrop manner, the teaching is visual, and the teaching quality and speed are greatly improved. The performance teaching module realizes seamless connection with a standard USB interface video real object exhibition stand, and is convenient for exhibiting the play of teachers; the simulated multi-point music keyboard is adopted and can be seamlessly connected with the MIDI interface in a hanging way; the multi-point touch simulation music keyboard is adopted, the playing fingering and skill of teachers are displayed in a backdrop manner, the teaching is visual, and the teaching quality and speed are greatly improved. The appreciation module can appreciate videos, pictures and the like, support demonstration operations such as handwriting labeling and handwriting erasing when playing video files or enjoying pictures, and support transfer of pages with handwriting labeling to a white board for storage. The internet module can directly access the webpage in the software, has the webpage control function, and comprises: forward, backward, refresh, etc.

In the embodiment, the music score file is saved and called by the JSON file, and the method has the following advantages:

1. in terms of coding difficulty, the score XML file has rich coding tools, such as Dom4j, JDom and the like, and the score JSON file also has a tool provided by JSON.

2. In the aspect of decoding difficulty, the parsing of the music score XML file considers the father node of the child node to make people dizzy, and the parsing difficulty of the music score JSON file is almost 0.

3. In terms of popularity, the music score XML file has been widely used in the industry, while the music score JSON file has just started, but in the specific field of Ajax, the future development must be that the music score XML file gives way to the music score JSON file. By that time Ajax should become Ajaj (Asynchronous Javascript and JSON).

4. The data volume of the music score JSON file is small compared with that of the music score XML file.

5. The interaction between the music score JSON file and the JavaScript is more convenient.

6. The speed of the music score JSON file is far faster than that of the music score XML file.

In this embodiment, the score-making operation module 1 further includes a score line-changing unit 14, where the score line-changing unit 14 is configured to implement a line-changing function, select a syllable line, click to change the line, delete attribute data of a line after the syllable line, insert attribute data of a new line in a next line of a currently edited line of a score or program attribute data of a line after the syllable line into a new line, or select a staff, click to change the line, insert attribute data of a new line in a next line of a currently edited line of a score, where the inserted attribute data is consistent with the attribute data of the currently edited line, and the attribute data includes, but is not limited to, a multi-line score, a multi-instrument, a clef, a beat number, and a key number. When a user clicks line feed, adding the line object in the current spectrum sub-data, and then refreshing the interface through the current data to see a new line.

As shown in fig. 2, clicking a black point at the end of a staff can select the whole staff, and at this time, clicking to change the line can add a new staff, or after selecting the whole staff, modifying the attributes of the staff, wherein the attributes include line spacing, coincidence staff, musical instrument timbre, polyphonic staff and high-low staff; as shown in fig. 3, when the icon on the left side of the staff is selected, the selection and modification of the staff number, the key signature and the time signature can be performed; as shown in fig. 4, the icon on the left side of the numbered musical notation is selected, and the selection and modification of the clef, the key and the time scale can be carried out.

In this embodiment, the score-scoring operation module 1 further includes a staff attribute library 15, where the staff attribute library 15 is used to construct a data structure of a staff, and includes a mapping between attribute values of the staff and staff attribute icons, after a user clicks a staff attribute icon, an attribute value of a corresponding icon may be obtained, and the attribute value of the staff is stored in a corresponding key value (key value) in the data structure of the staff; the staff attributes comprise line spacing, a composite staff, musical instrument timbres, polyphonic staff and high and low sound spectrums; the composite staff is used for recording a plurality of sound parts by putting a plurality of staff together by a hyphen number. The attributes of the staff (e.g., staff) can be modified to make the staff more in line with the needs of the user.

In this embodiment, the staff attribute library 15 further includes:

a high-range library 151 for constructing a mapping between high-range icons and corresponding state data;

a bass spectrum library 152 for constructing a mapping between bass spectrum numbers and corresponding state data;

the conversion sub-module 153 is configured to establish mapping between the high-pitch spectrum library and the low-pitch spectrum library, to implement conversion from a high-pitch spectrum to a low-pitch spectrum, and when a note is entered in a click icon, the high-pitch spectrum appears, and the conversion between the high-pitch spectrum and the low-pitch spectrum is completed by converting state data of the high-pitch spectrum into state data of the low-pitch spectrum.

When inputting notes, a high-pitch score is firstly output, and after receiving an instruction of converting the notes into a low-pitch score, the state data of the high-pitch score is changed into the state data of the low-pitch score.

In this embodiment, the spectrum-making operation module further includes: the lyric adding unit is used for editing input lyrics in a blank part under notes, and clicking a blank space to enable the lyrics to correspond to the notes when the lyrics are input; a polyphonic unit for modifying the selected note into a polyphonic pattern; the synchronous and asynchronous adding unit is used for adding a synchronous or asynchronous bar to the bar where the selected note is located, and the added bar can change the length through dragging; the beat adding unit is used for setting beats to the selected staff; a play speed setting unit for setting a play speed of the music score; and the model singing and accompaniment adding unit is used for adding a model singing file or an accompaniment file. When the music score is compiled in the music score mode, not only notes need to be edited and limited, but also lyrics need to be input, edited and limited, and meanwhile, a complete music score file needs to be edited or uploaded, so that a music score generation unit can generate a json file conveniently, and subsequent playing and use are facilitated.

In this embodiment, the score operation module 1 includes an asynchronous score table unit 16, where the asynchronous score table unit 16 is configured to add an asynchronous score to a score where a selected note is located, select the staff after the asynchronous score is added, obtain an attribute value of a corresponding attribute icon after a user clicks the attribute icon on an attribute panel, and store the attribute value on a corresponding key value (key value) in the score table data of the staff. As shown in fig. 5, a second segment of asynchronous music score is added.

The asynchronous (including asynchronous measures) and synchronous (including synchronous measures) in this embodiment both refer to the sub-melody, the asynchronous referring to the sub-melody below the main melody and the synchronous referring to the sub-melody above the main melody.

In this embodiment, the attributes in the note attribute library 12 include note name, note duration, time-lapse line, line of inflection, scale, point of inflection, chord, polyphonic note, asynchronous music score, lyric duration, lyric line, bracket, stem orientation, paragraph distinction, polyphonic character, and note identifier; wherein, the note singing name comprises a plurality of numbers, preferably 1, 2, 3, 4, 5, 6, 7 and 0, and the positions of the notes in the staff are transformed according to the numbers of the selected note singing name; the note durations include a number of categories, preferably 1/32 break notes, 1/16 break notes, 1/8 break notes, 1/4 break notes, 1/2 break notes, and whole notes; the time reduction line comprises a plurality of numbers, preferably none, 2, 3, 4, 5, 6, 7, 8, 9 and 10, the numbers represent the number of the notes, and after the time reduction line is set, the corresponding number of the notes can be changed into a note group with the time reduction line; the numbers below the connecting sound line are 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13 and 14, and indicate the number of the notes, and after the connecting sound line is arranged, the corresponding number of the notes can be changed into a note group with the connecting sound line; the musical scale comprises a plurality of musical scales, preferably the original musical scale, one octave lower, two octaves lower, three octaves lower, one octave higher, two octaves higher and three octaves higher, after selecting the musical note, the musical scale of the musical note is selected on the attribute panel, and the musical note can be correspondingly changed in position in the staff according to the selected musical scale; the rear attachment points comprise a plurality of attachment point forms, preferably no attachment points, single attachment points and double attachment points; the accents include various forms of accents, preferably original, front long, front short, rear long, rear short; the chord includes a number of digits, preferably none, 2, 3, 4, 5; polyphones include monophonic notes and polyphones; the asynchronous music score comprises a plurality of added paragraphs, preferably a first section, a second section, a third section, a fourth section and a fifth section; the lyric time value comprises a plurality of time values, preferably 32 minute time value, 16 minute time value, 8 minute time value, 4 minute time value, 2 minute time value and full time value; the lyrics comprise a plurality of numbers, preferably none, 2, 3, 4, 5, 6, 7, 8, 9 and 10, under the connection line, the numbers represent the number of the lyrics, and the lyrics are connected together after the corresponding number is selected; brackets include left and right brackets, with brackets added to the left and right of the note by clicking on the left and right behind the brackets; the stem orientation includes up and down; the paragraph sets the paragraph of the selected note in a distinguishing manner, the corresponding note is clicked, the input paragraph can enable the corresponding paragraph of the measure where the note is located to be played in the repeated process, as shown in fig. 6, the corresponding note is clicked, the input paragraph on the right side can enable the measure where the note is located to be played in the repeated process, the second paragraph is set in fig. 6, and the measure can be played when the measure is played for the second time; the polyphone is used for setting the pronunciation of the selected lyrics, and after the polyphone is set, when the music score is played, the music score is singed according to the set pinyin; the note identifier is used to provide q note identifiers (preferably 53 note identifiers), and the position of the identifier can be changed by dragging the identifier with a mouse after the identifier is added. The attributes in the note attribute library are more comprehensive, and the requirements of users are better met.

The audio file in the music score generating unit 13 in this embodiment includes an auto-synthesized lyric audio file, and the construction of the lyric audio file is as follows:

a Chinese pinyin library 131 for constructing mappings between the Chinese pinyins of the tones and the corresponding lyric audio files;

the libretto audio file generation submodule 132 is configured to record audio files of corresponding tones in advance according to pinyin of chinese, record wav audio files of m pitches (preferably 36 pitches) related to each pinyin, intercept and adjust recording duration of each pitch, compress and convert the wav audio files into MP3 files, perform base64 processing, and store the MP3 files in json files.

The audio files in the music score generating unit 13 in this embodiment include automatically synthesized sing-name audio files, which are constructed as follows:

the note name file library 133 is used for establishing mapping between note data and a note name file, wherein the note data is stored with lyric data, pitch data and note length data;

the record name audio file generation sub-module 134 is configured to record a record name file of n key numbers (preferably 15 key numbers) in advance, record wav audio files of m pitches (preferably 36 pitches) under each key number, intercept and adjust the recording duration of each pitch, compress and convert the wav audio files into MP3 files, perform base64 processing, and store the converted files in a json file, where the record name file includes a boy version and a girl version. The automatic singing name synthesizing system is used for automatically synthesizing a singing name file or a singing word file, so that the system has more comprehensive functions, is convenient for teachers to teach, and also meets the use requirements of students.

The automatic synthesis of the audio file in the present embodiment has the following effects: the simple songs are easily created, the creation threshold is crossed, and the interest of students is enhanced; the study is driven by creation, and the study effect is improved by freely editing music, modifying and seeing and hearing; through free tools, students can submit music assignments and create practices, and music lessons are no longer optional.

In the embodiment, a file is inserted into a playable music score, the file is judged according to the type of the currently inserted file when being inserted, if the file is audio (MP3, wav), a fixed picture is inserted into the drawing board, and the audio can be played by double-clicking the picture; if the picture is a video file, a picture after the first frame picture is intercepted is inserted into the drawing board, and the video can be played by double clicking the picture.

The audio files in the music score generation unit in the embodiment can be recorded and uploaded vocal range or accompaniment files in advance, and can also be music score files which are compiled and automatically synthesized by the user; simple songs can be easily created through the music score making operation module, the creation threshold is crossed, and the interest of students is enhanced; the study is driven by creation, and the study effect is improved by freely editing music, modifying and seeing and hearing; through free tools, students can submit music assignments and create practices, and music lessons are no longer optional.

Example 2

A multifunctional digital music teaching system, as shown in fig. 7 and 8, different from embodiment 1: the music score playing module 2 includes:

a music score playing unit 21, configured to parse the data of the music score when the music score is played, call the json file in the music score generating unit 13, circulate the outermost layer of data of the music score table, recirculate the data of the complex music score table and the bar data in each row, circulate the note data from the bar data, obtain the MIDI value of the current note through the pitch data of the note, the tone mark of the current music score, and the tone mark selected by the current user, play the note through a MIDI Api (preferably windows MIDI Api), highlight the interface through the currently played note data, and, at the same time, after obtaining the MIDI value of the note, find the key position of the virtual keyboard corresponding to the MIDI value from the virtual keyboard and highlight the key position;

a tone name playing unit 22 for parsing the clew data when playing the tone name file, confirming the current tone name file by the pitch of the current note, the key number of the current clew, the key number selected by the current user, and playing the sound of the corresponding tone name audio by calling a player, including but not limited to sound-player, and the tone name playing unit 22 including a boy's tone name mode and a girl's tone name mode;

the model singing and accompaniment playing unit 23 is used for analyzing the music sub-data during model singing or accompaniment, calling the json file in the music score generating unit 13, finding the musical notes in the json file through the playing time point and highlighting, obtaining the MIDI value of the current musical note through the musical note data, playing the musical notes through MIDI Api (preferably windows MIDI Api), highlighting on the interface through the currently played musical note data, and finding the key position of the virtual keyboard corresponding to the MIDI value from the virtual keyboard and highlighting after obtaining the MIDI value of the musical note;

the lyric playing unit 24 is configured to temporarily generate a tone library json through the pinyin and the tone used by each music score when playing a lyric file, store the tone library json in the lyric folder 241, perform pinyin conversion on lyrics in the notes by analyzing the music score data, find corresponding note data and lyric files through the pinyin, and play the pitch data and the pinyin sound corresponding to the current notes through a player, where the player includes but is not limited to a soundfont-player; a function-same-record playing unit 22 called at the time of playing;

the lyric playing unit 24 further includes a lyric folder 241, and the lyric folder 241 is used for storing pinyin and tones used for each music during playing;

the music score playing unit 21 comprises a tone switching sub-module 211, and the tone switching sub-module 211 is configured to modify the playing tone of the current music score by invoking a MIDI Api (preferably windows MIDI Api) to switch the tone of the current channel.

In this embodiment, the music score playing module 2 further includes a conversion unit 25, where the conversion unit 25 is configured to implement conversion between a staff and a numbered musical notation based on json data, and the staff data is json data, icons and rules during display are processed through data, and the staff is displayed through rendering performed through data.

The score play unit 21, the rename play unit 22, the model singing and accompaniment play unit 23, and the lyric play unit 24 in this embodiment recognize a minus time line, a line of a chord, a note point, an accent, and a chord in a score when parsing score data, and perform corresponding processing on sounds according to the minus time line, the line of a chord, the note point, the accent, and the chord when playing notes.

In the embodiment, the music score playing module also supports a lyric display and hiding function, and judges whether the lyrics are displayed or hidden currently when the lyrics are clicked to display and hide, and if the lyrics are displayed, directly hides all the tags of the lyrics. And otherwise, displaying all the labels of the lyrics.

In the embodiment, the music score playing module supports 8 modes of music score playing, can play uploaded music scores and music scores synthesized by a system, and meets the requirements of music teaching in middle and primary schools better, including music score playing, male/female student name playing, model singing playing, accompaniment playing, male/female voice rhythm playing and female student word singing (test singing); the module can open the music score and play the music score; the playing can be started from any position; simulating a music keyboard and simultaneously displaying the positions of the music symbols on the keyboard in the playing process; tone, playing speed, etc. can be set; the metronome is arranged, so that the playing rhythm can be conveniently mastered; the one-key switching of the numbered musical notation and staff display pages can be realized. Field description of json data of music score:

the above-mentioned embodiments are merely illustrative of the preferred embodiments of the present invention, and do not limit the scope of the present invention, and various modifications and improvements of the technical solution of the present invention by those skilled in the art should fall within the protection scope defined by the claims of the present invention without departing from the spirit of the present invention.

Claims

1. A multi-functional digital music teaching system, said music teaching system comprising:

the system comprises a scoring operation module (1) for scoring an audio file to generate a music score file and storing the music score file into a json file;

the music score playing module (2) is used for playing music score files in multiple modes;

the whiteboard operation module (3) is used for establishing a whiteboard library, constructing mapping between functional icons and corresponding functional attribute values in the whiteboard library, displaying the functional icons on a functional panel, and performing editing operation on a staff in an editing page, wherein the editing operation comprises an electronic pen, an eraser and an insertion file;

the music theory teaching module (4) is used for constructing the mapping from the staff table to the music keyboard and from the music keyboard to the staff table, calling a white board library to mark and explain a teaching page, and simultaneously establishing a music theory library, constructing the mapping between music theory icons and corresponding attribute values in the music theory library, displaying the music theory icons on a music theory panel, and adjusting the tone or tone color of the virtual keyboard and the musical notes;

the performance teaching module (5) is used for recording the demonstration performance of the teacher through the camera, projecting the demonstration performance to the display screen, establishing a performance library, constructing mapping between performance setting icons and corresponding attributes in the performance library, displaying the performance setting icons on the performance panel, and adjusting the virtual keyboard, the performance tone and the tone;

the appreciation module (6) is used for entering an appreciation page to appreciate the resources and calling a whiteboard operation mode to perform related operations;

the internet module (7) is used for entering an internet interface to search and query related knowledge materials;

the scoring operation module (1) comprises:

a note library (11) for constructing a data structure of notes including constructing a mapping between note data and note icons, a mapping between note data and midi signals, and constructing each note data constituting the same tempo into bar data, the notes include regular notes, rests, and beats, which may be inter-transformed by modifying the duration fields in the attribute panel of the note, the note icon displayed on the note panel, when the user clicks on the note icon on the note panel, a general note, rest or tempo is initialized, assigning an initial value through a duration value field of a common note, a rest or a beat corresponding to the clicked note icon in an attribute panel of the note, directly storing the initial value into bar data, the note data is stored with lyric data, pitch data, note length data and the current playing time point of the audio file;

the note attribute library (12) is used for constructing a data structure of a spectrum, and comprises a mapping between attribute values of notes and attribute icons, wherein the attribute icons are displayed on an attribute panel, after a user clicks the attribute icons on the attribute panel, the attribute values of the corresponding attribute icons can be obtained, and the attribute values are stored in corresponding key values in the data structure of the notes;

the music score generating unit (13) is used for acquiring the time point of the currently played audio file based on a pause instruction when the audio file is played, recording the time point into note data of a note database (11), taking the corresponding note data as the data of the innermost layer and storing the data into bar data, forming compound spectrum table data by a spectrum table containing continuous spectrum numbers, forming the data of the outermost layer by a plurality of lines of compound spectrum table data, and forming a music score file and storing the music score file into a json file by the spectrum table data and the structure of the music score table data;

the audio files in the music score generation unit (13) comprise automatically synthesized lyric audio files, and the structures of the lyric audio files are as follows:

a Chinese pinyin library (131) for constructing a mapping between the Chinese pinyin for each tone and the corresponding lyric audio files;

and the libretto audio file generation submodule (132) is used for recording audio files of corresponding tones in advance according to Chinese Pinyin, recording wav audio files of m related pitches according to each Pinyin, intercepting and adjusting the recording duration of each pitch, compressing and converting the wav audio files into MP3 files, and performing base64 processing and storing the files into json files.

2. The multifunctional digital music teaching system according to claim 1, wherein the score operation module (1) further comprises a score line changing unit (14), the score line changing unit (14) is configured to implement a line changing function, select a syllabic line, click a line change, delete attribute data of a line after the syllabic line, insert attribute data of a new line in a line next to a currently edited line of a score or program attribute data of the line after the syllabic line into the new line, or select a staff, click a line change, insert attribute data of a new line in a line next to the currently edited line of the score, and the attribute data of the inserted line is consistent with the attribute data of the currently edited line, wherein the attribute data includes a plurality of lines of scores, a plurality of instruments, a clefs, a beat number, and a key number.

3. The multifunctional digital music teaching system according to claim 1, wherein the score writing operation module (1) further comprises a staff attribute library (15), the staff attribute library (15) is used for constructing a data structure of a staff, including mapping between attribute values of the staff and staff attribute icons, after a user clicks a staff attribute icon, the attribute value of the corresponding icon can be obtained, and the attribute value of the staff is stored on the corresponding key value in the data structure of the staff; the staff attributes comprise line spacing, a composite staff, musical instrument timbres, polyphonic staff and high and low sound spectrums; the composite staff is used for recording a plurality of sound parts by putting a plurality of staff together by a hyphen number.

4. Multifunctional digital music tutoring system according to claim 3, characterized in that the library of staff attributes (15) further comprises:

a high-range library (151) for constructing a mapping between high-range icons and corresponding status data;

a bass spectrum library (152) for constructing a mapping between bass spectrum numbers and corresponding state data;

and the conversion sub-module (153) is used for establishing mapping between the high-pitch spectrum library and the low-pitch spectrum library, realizing conversion from a high-pitch spectrum to a low-pitch spectrum, and converting the state data of the high-pitch spectrum into the state data of the low-pitch spectrum to finish the conversion between the high-pitch spectrum and the low-pitch spectrum when notes are recorded in the clicking icons.

5. The multifunctional digital music teaching system according to claim 1, wherein the score operation module (1) comprises an asynchronous staff gauge unit (16), the asynchronous staff gauge unit (16) is configured to add an asynchronous measure to a measure where the selected note is located, select the staff after the asynchronous measure is added, obtain an attribute value of a corresponding attribute icon after a user clicks the attribute icon on the attribute panel, and store the attribute value on a corresponding key value in staff data.

6. The multifunctional digital music tutoring system of claim 1, wherein the attributes in the note attribute library (12) comprise note name, note duration, time lapse, line of notes, scale, point of postamble, accent, chord, polyphonic notes, asynchronous music score, lyric duration, lyric line, brackets, token orientation, paragraph distinction, polyphonic characters, and note identification.

7. The multifunctional digital music teaching system according to claim 1, wherein the audio files in the music score generation unit (13) include automatically synthesized sing-name audio files constructed as follows:

the song name file library (133) is used for establishing mapping between the note data and the song name file, and the note data is stored with lyric data, pitch data and note length data;

and the record name audio file generation submodule (134) is used for recording record name files of n tone numbers in advance, the wav audio file for recording m pitches under each tone number intercepts and adjusts the recording duration of each pitch, compresses and converts the wav audio file into an MP3 file, performs base64 processing and stores the MP3 file into a json file, and the record name audio file comprises a boy version and a girl version.

8. Multifunctional digital music teaching system according to claim 1, characterized in that the music score playing module (2) comprises:

the music score playing unit (21) is used for analyzing the data of the music score when the music score is played, calling the json file in the music score generating unit (13), circulating the data of the music score on the outermost layer, circulating the data of the complex music score and the bar data in each row, circulating the data of the musical notes from the bar data, obtaining the MIDI value of the current musical note through the pitch data of the musical note, the tone mark of the current music score and the tone mark selected by the current user, playing the musical note through MIDIApi, highlighting the interface through the data of the currently played musical note, and finding out the key position of the virtual keyboard corresponding to the MIDI value from the virtual keyboard to highlight the key position after obtaining the MIDI value of the musical note;

a note playing unit (22) for parsing the clef data when playing the note file, confirming the current note file by the pitch of the current note, the key number selected by the current user, and playing the sound of the corresponding note audio by calling a player, wherein the player comprises a sound-player, and the note playing unit (22) comprises a boy note mode and a girl note mode;

the model singing and accompaniment playing unit (23) is used for analyzing the music sub-data during model singing or accompaniment, calling a json file in the music score generating unit (13), finding out the musical notes in the json file through the playing time point and highlighting the musical notes, obtaining the MIDI value of the current musical notes through the musical note data, playing the musical notes through MIDI Api, highlighting the interface through the currently played musical note data, and finding out the key position of the virtual keyboard corresponding to the MIDI value from the virtual keyboard and highlighting the key position after obtaining the MIDI value of the musical notes;

the lyric playing unit (24) is used for temporarily generating a tone color library json through the pinyin and the tone used by each score and storing the json into a lyric folder (241), performing pinyin conversion on lyrics in notes by analyzing the score data, finding corresponding note data and lyric files through the pinyin, and playing the tone data and the voice of the pinyin corresponding to the current note through a player to realize the lyric playing, wherein the player comprises a sound-player;

the lyric playing unit (24) further comprises a lyric folder (241), wherein the lyric folder (241) is used for storing pinyin and tones used by each staff during playing;

the music score playing unit (21) comprises a tone switching submodule (211), and the tone switching submodule (211) is used for switching the tone of the current channel by calling MIDIApi and modifying the playing tone of the current music score.

9. The multifunctional digital music teaching system according to claim 1, wherein the music score playing module (2) further comprises a conversion unit (25), the conversion unit (25) is configured to implement conversion between a staff and a numbered musical notation based on json data, the staff data is json data, icons and rules during display are processed through data, and the staff is displayed through rendering of the data.