CN107610550A - The implementation method and device of Online class - Google Patents
The implementation method and device of Online class Download PDFInfo
- Publication number
- CN107610550A CN107610550A CN201710816361.7A CN201710816361A CN107610550A CN 107610550 A CN107610550 A CN 107610550A CN 201710816361 A CN201710816361 A CN 201710816361A CN 107610550 A CN107610550 A CN 107610550A
- Authority
- CN
- China
- Prior art keywords
- keyboard
- player
- music score
- chinese operas
- performance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 47
- 238000001514 detection method Methods 0.000 claims abstract description 57
- 238000011156 evaluation Methods 0.000 claims abstract description 31
- 238000012549 training Methods 0.000 claims abstract description 30
- 238000012854 evaluation process Methods 0.000 claims abstract description 20
- 238000012545 processing Methods 0.000 claims description 31
- 238000004891 communication Methods 0.000 claims description 18
- 239000004744 fabric Substances 0.000 claims description 3
- 230000009471 action Effects 0.000 description 28
- 230000008569 process Effects 0.000 description 15
- 230000003993 interaction Effects 0.000 description 8
- 229910044991 metal oxide Inorganic materials 0.000 description 6
- 150000004706 metal oxides Chemical class 0.000 description 6
- 230000003044 adaptive effect Effects 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 5
- 238000001228 spectrum Methods 0.000 description 5
- 230000001960 triggered effect Effects 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 239000004065 semiconductor Substances 0.000 description 4
- 230000000295 complement effect Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000005553 drilling Methods 0.000 description 3
- 238000003384 imaging method Methods 0.000 description 3
- 238000003825 pressing Methods 0.000 description 3
- 230000033764 rhythmic process Effects 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- 240000007711 Peperomia pellucida Species 0.000 description 2
- 235000012364 Peperomia pellucida Nutrition 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 238000013459 approach Methods 0.000 description 2
- 230000006399 behavior Effects 0.000 description 2
- 239000004020 conductor Substances 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000007689 inspection Methods 0.000 description 2
- 238000007781 pre-processing Methods 0.000 description 2
- 238000003672 processing method Methods 0.000 description 2
- 238000012797 qualification Methods 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 210000000707 wrist Anatomy 0.000 description 2
- 241000208340 Araliaceae Species 0.000 description 1
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 1
- 235000003140 Panax quinquefolius Nutrition 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 230000008451 emotion Effects 0.000 description 1
- 238000005538 encapsulation Methods 0.000 description 1
- 210000000245 forearm Anatomy 0.000 description 1
- 235000008434 ginseng Nutrition 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Landscapes
- Electrophonic Musical Instruments (AREA)
Abstract
The present invention provides a kind of implementation method and device of Online class.The embodiment of the present invention is under intelligent training mate pattern, by obtaining player according to the performance task arranged, play the detection actuation of keys for specifying keyboard, and then acted according to the button model of the detection actuation of keys and the specified keyboard built in advance, obtain the performance situation of the player, make it possible to the performance situation according to the player, carry out evaluation process, to obtain the evaluation result of the player, musical instrument class exercise scene can be truly reduced, it is achieved thereby that the Online class of musical instrument class teaching.
Description
【Technical field】
The present invention relates to the implementation method and device of online education, more particularly to a kind of Online class.
【Background technology】
The music score of Chinese operas is the music score of Chinese operas, is the regular combination for the various written symbols for recording music, pitch or rhythm, for example,
Our usually common numbered musical notation, staff, guitar spectrum, seven-stringed plucked instrument in some ways similar to the zither spectrums etc. various modern or ancient times the music score of Chinese operas can be called
The music score of Chinese operas.
Musical instrument class teaching method using the music score of Chinese operas as main contents, due to the complexity of its content of courses, and teaching scene
Variation for example, play demonstration, action explanation etc. so that this musical instrument class teaching method is difficult to use online teaching pattern,
I.e. director is carried out performance demonstration, music score of Chinese operas explanation to multiple players online, is acted and said based on the music score of Chinese operas showed to player
The online teaching task such as solution, classroom interactions, the teaching of the musical instrument such as piano class is caused slowly to fail to enter online teaching category.
Therefore, need badly and a kind of implementation method of Online class is provided, to realize the Online class of musical instrument class teaching.
【The content of the invention】
The many aspects of the present invention provide a kind of implementation method and device of Online class, with realize the teaching of musical instrument class
Line classroom.
An aspect of of the present present invention, there is provided a kind of implementation method of Online class, including:
Obtain the Online class pattern of musical instrument class teaching;
If the Online class pattern is intelligent training mate pattern, player is obtained according to the performance task arranged, is played
Specify the detection actuation of keys of keyboard;
Acted according to the button model of the detection actuation of keys and the specified keyboard built in advance, drilled described in acquisition
The performance situation for the person of playing;
According to the performance situation of the player, evaluation process is carried out, to obtain the evaluation result of the player.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, the acquisition are drilled
For the person of playing according to the performance task arranged, the detection actuation of keys of keyboard is specified in performance, including:
Obtain the player that the first image collecting device is gathered and keyboard is specified according to the performance task arranged, performance
Keyboard image;According to the player that described first image harvester is gathered according to the performance task arranged, play and specify
The reference picture of the keyboard image of keyboard and the specified keyboard built in advance, the detection button for obtaining the specified keyboard move
Make;Or
The player that at least two second image collecting devices are gathered is obtained according to the performance task arranged, performance to be referred to
Determine the keyboard image of keyboard;Drilled according to the player that at least two second image collecting device is gathered according to what is arranged
Task is played, plays the keyboard image for specifying keyboard, obtains and plays anaglyph;Build according to the performance anaglyph and in advance
The specified keyboard reference anaglyph, obtain the detection actuation of keys of the specified keyboard.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, it is described according to institute
The performance situation of player is stated, carries out evaluation process, after obtaining the evaluation result of the player, in addition to:
Export the evaluation result of the player.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, it is described to obtain pleasure
After the Online class pattern of device class teaching, in addition to:
If the Online class pattern is class's class pattern, obtains and specify music score of Chinese operas file;
According to the specified music score of Chinese operas file, at least one music score of Chinese operas element is obtained;
According to each music score of Chinese operas element at least one music score of Chinese operas element, the music score of Chinese operas pair of acquisition each music score of Chinese operas element
As;The music score of Chinese operas object of each music score of Chinese operas element includes each music score of Chinese operas attribute of an element information and each music score of Chinese operas element
Layout information;
Export the music score of Chinese operas object of each music score of Chinese operas element.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, it is described to obtain pleasure
After the Online class pattern of device class teaching, in addition to:
If the Online class pattern is one-to-one training mate pattern, the communication link established between director and the player
Connect;
Based on the communication connection, information exchange service is provided to the director and the player.
Another aspect of the present invention, there is provided a kind of realization device of Online class, including:
Pattern acquiring unit, for obtaining the Online class pattern of musical instrument class teaching;
Mode processing units, if being intelligent training mate pattern for the Online class pattern, player is obtained according to institute's cloth
The performance task put, play the detection actuation of keys for specifying keyboard;
Situation acquiring unit, for the button mould according to the detection actuation of keys and the specified keyboard built in advance
Type acts, and obtains the performance situation of the player;
Evaluation process unit, for the performance situation according to the player, evaluation process is carried out, to obtain the performance
The evaluation result of person.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, at the pattern
Unit is managed, is specifically used for
Obtain the player that the first image collecting device is gathered and keyboard is specified according to the performance task arranged, performance
Keyboard image;According to the player that described first image harvester is gathered according to the performance task arranged, play and specify
The reference picture of the keyboard image of keyboard and the specified keyboard built in advance, the detection button for obtaining the specified keyboard move
Make;Or
The player that at least two second image collecting devices are gathered is obtained according to the performance task arranged, performance to be referred to
Determine the keyboard image of keyboard;Drilled according to the player that at least two second image collecting device is gathered according to what is arranged
Task is played, plays the keyboard image for specifying keyboard, obtains and plays anaglyph;Build according to the performance anaglyph and in advance
The specified keyboard reference anaglyph, obtain the detection actuation of keys of the specified keyboard.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, at the evaluation and test
Unit is managed, is additionally operable to
Export the evaluation result of the player.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, at the pattern
Unit is managed, is additionally operable to
If the Online class pattern is class's class pattern, obtains and specify music score of Chinese operas file;
According to the specified music score of Chinese operas file, at least one music score of Chinese operas element is obtained;
According to each music score of Chinese operas element at least one music score of Chinese operas element, the music score of Chinese operas pair of acquisition each music score of Chinese operas element
As;The music score of Chinese operas object of each music score of Chinese operas element includes each music score of Chinese operas attribute of an element information and each music score of Chinese operas element
Layout information;And
Export the music score of Chinese operas object of each music score of Chinese operas element.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, at the pattern
Unit is managed, is additionally operable to
If the Online class pattern is one-to-one training mate pattern, the communication link established between director and the player
Connect;And
Based on the communication connection, information exchange service is provided to the director and the player.
As shown from the above technical solution, the embodiment of the present invention is under intelligent training mate pattern, by obtaining player according to institute
The performance task of arrangement, the detection actuation of keys for specifying keyboard is played, and then according to the detection actuation of keys and advance structure
The specified keyboard the action of button model, obtain the performance situation of the player, enabling according to the player
Performance situation, carry out evaluation process, to obtain the evaluation result of the player, can truly reduce musical instrument class training field
Scape, it is achieved thereby that the Online class of musical instrument class teaching.
In addition, using technical scheme provided by the present invention, performance situation that can simultaneously to multiple players is commented
Survey is handled, and to obtain the evaluation result of multiple players, musical instrument class exercise scene can be truly reduced, it is achieved thereby that musical instrument class
More people's Online class of teaching.
In addition, using technical scheme provided by the present invention, the keyboard image of keyboard is specified by being played according to player,
Reproduce player and play the keyboard state for specifying keyboard, it is achieved thereby that the mesh of the keyboard action of button kind musical instrument such as detection piano
's.
In addition, using technical scheme provided by the present invention, by the key that specified keyboard is played according to the player of plane
Disk image, the performance anaglyph of reconstructed stereoscopic, enabling clearly reduce player and play the keypad space for specifying keyboard
State, it is achieved thereby that the purpose of the keyboard action of button kind musical instrument such as detection piano.
In addition, using technical scheme provided by the present invention, under class's class pattern, due to by included in music score of Chinese operas file
Music score of Chinese operas element carries out objectification to obtain music score of Chinese operas object separate one by one, enabling according to any display device can
Viewing area, it is adaptive to carry out the related output of online teaching task and operated, it is achieved thereby that director is based on to performance
The music score of Chinese operas that person is showed, it is online to carry out performance demonstration, music score of Chinese operas explanation, action explanation, classroom interactions etc. to multiple players online
Teaching task.
In addition, using technical scheme provided by the present invention, under one-to-one training mate pattern, director can be realized with drilling
Targetedly individually communication between the person of playing, so as to effectively increase the playing effect of player.
In addition, using technical scheme provided by the present invention, Consumer's Experience can be effectively lifted.
【Brief description of the drawings】
Technical scheme in order to illustrate the embodiments of the present invention more clearly, below will be to embodiment or description of the prior art
In the required accompanying drawing used be briefly described, it should be apparent that, drawings in the following description be the present invention some realities
Example is applied, for those of ordinary skill in the art, without having to pay creative labor, can also be attached according to these
Figure obtains other accompanying drawings.
Fig. 1 is the schematic flow sheet of the implementation method for the Online class that one embodiment of the invention provides;
Fig. 2 is the structural representation of the realization device for the Online class that another embodiment of the present invention provides.
【Embodiment】
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention
In accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is
Part of the embodiment of the present invention, rather than whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art
The whole other embodiments obtained under the premise of creative work is not made, belong to the scope of protection of the invention.
It should be noted that terminal involved in the embodiment of the present invention can include but is not limited to mobile phone, individual digital
Assistant (Personal Digital Assistant, PDA), radio hand-held equipment, tablet personal computer (Tablet Computer),
PC (Personal Computer, PC), MP3 player, MP4 players, wearable device (for example, intelligent glasses,
Intelligent watch, Intelligent bracelet etc.) etc..
In addition, the terms "and/or", only a kind of incidence relation for describing affiliated partner, represents there may be
Three kinds of relations, for example, A and/or B, can be represented:Individualism A, while A and B be present, these three situations of individualism B.Separately
Outside, character "/" herein, it is a kind of relation of "or" to typically represent forward-backward correlation object.
Fig. 1 is the schematic flow sheet of the implementation method for the Online class that one embodiment of the invention provides, as shown in Figure 1.
101st, the Online class pattern of musical instrument class teaching is obtained.
The Online class pattern of musical instrument class teaching provided by the present invention can include but is not limited to intelligent training mate pattern, class
At least one of in class pattern and one-to-one training mate pattern, the present embodiment is to this without being particularly limited to.
Class's class pattern, refer to that director can see the real-time exercise picture of all players, all performances simultaneously
It can be seen that director's instructs picture, director's person can unite on Online class to given content such as some music score of Chinese operas
One explains and demonstrates, and then arranges that exercise is performance task, for example, playing song, playing mode (departure), playing speed, drill
Play pass etc..
In class's class pattern, different performance tasks can be arranged, for example, pin according to the actual conditions of different players
For the player relatively low to qualification, it can arrange that the performance task of identification of spectrogram pattern requires that player's emphasis is played correctly
Each note, specifically can easily occur the position of interim card, and player with recording performance person in the ripe of each position of song
Practice the detection actuation of keys of the specified keyboards such as degree;Or for another example for for the higher player of qualification, can be with
The performance task of the corresponding beat of arrangement requires player and specified song is played according to fixed beat, and culture player is slapping
Timing is grasped while holding pitch accuracy, can specifically be referred to the exercise number of recording performance person, wrong sound mistake rhythm situation etc.
Determine the detection actuation of keys of keyboard.
The intelligent training mate pattern, refer to after director arranges performance task to all players, all performances
Person just switches into intelligent training mate pattern, first, can be automatically loaded the performance task that director is arranged, then, start to gather
The exercise data of player are to play the detection actuation of keys for specifying keyboard, the button with the specified keyboard constructed before
Model action carries out real time contrast, analyzes the actuation of keys each time of player, obtains the performance situation of the player, example
Such as, the key-case such as the exercise progress of player, exercise duration, wrong sound situation, wrong rhythm situation, and then according to the player
Performance situation, carry out evaluation process, to obtain the evaluation result of the player.At the same time it can also described in further basis
The evaluation result of player provides auxiliary exercise method, to help player to carry out more specification and efficient exercise.
In intelligent training mate pattern, if player completes the performance task that director arranged or player complete
During the performance task arranged into director, the problems such as running into emphasis, difficult point, one-to-one accompany can be entered with trigger request
Practice pattern, individually linked up with director.
In intelligent training mate pattern, evaluation result can be synchronized to director in real time and be showed, and then automatic triggering
Into patrolling class pattern.In class pattern is patrolled, director can enter one-to-one accompany according to the evaluation result of player, trigger request
Practice pattern, individually linked up with player.
The pair of training mate pattern, refer to the video that director can be with real time inspection player under intelligent training mate pattern
Playback and evaluation result, in order to have more specific aim when individually instructing player.Director can demonstrate explanation player encounter
Some emphasis, difficult point the problems such as, to help player to have more deep understanding and results of learning.
If the 102, the Online class pattern is intelligent training mate pattern, player is obtained according to the performance task arranged,
Play the detection actuation of keys for specifying keyboard.
It is understood that a player can only be obtained according to the performance task arranged, play and specify keyboard
Actuation of keys is detected, or multiple player persons can also be obtained simultaneously according to the performance task arranged, plays and specifies keyboard
Detection actuation of keys, the present embodiment is to this without being particularly limited to.
103rd, acted according to the button model of the detection actuation of keys and the specified keyboard built in advance, obtain institute
State the performance situation of player.
Wherein, the performance situation of the player, player can be included but is not limited to and play pressing for the specified keyboard
Key situation, the present embodiment is to this without being particularly limited to.
104th, according to the performance situation of the player, evaluation process is carried out, to obtain the evaluation result of the player.
In above-mentioned Online class pattern, using technical scheme provided by the present invention, a pair of effectively support is not only able to
More musical instrument class teaching scenes, while the performance situation to multiple players, carry out evaluation process, to obtain multiple players'
Evaluation result, additionally it is possible to more targetedly improve man-to-man musical instrument class teaching scene.
It should be noted that 101~104 executive agent can be partly or entirely the application for being located locally terminal,
Or can also be the plug-in unit being arranged in the application of local terminal or SDK (Software
Development Kit, SDK) etc. functional unit, can also be either processing engine in network side server or
Can also be the distributed system positioned at network side, the present embodiment is to this without being particularly limited to.
It is understood that the application can be mounted in the local program (nativeApp) in terminal, or may be used also
To be a web page program (webApp) of browser in terminal, the present embodiment is to this without limiting.
So, under intelligent training mate pattern, by obtaining player according to the performance task arranged, play and specify keyboard
Detection actuation of keys, and then moved according to the detection actuation of keys and the button model of the specified keyboard built in advance
Make, obtain the performance situation of the player, enabling according to the performance situation of the player, evaluation process is carried out, with
Obtain the evaluation result of the player, can truly reduce musical instrument class exercise scene, it is achieved thereby that musical instrument class teaching
Line classroom.
Alternatively, in a possible implementation of the present embodiment, in 102, the first image can specifically be obtained
The player that harvester is gathered plays the keyboard image for specifying keyboard according to the performance task arranged, and then, then can be with
According to the player that described first image harvester is gathered according to the performance task arranged, the keyboard for specifying keyboard is played
The reference picture of image and the specified keyboard built in advance, obtain the detection actuation of keys of the specified keyboard.So, may be used
Played with the player gathered by contrasting obtained described first image harvester the keyboard image of specifying keyboard and
The reference picture of the specified keyboard built in advance, as long as the player that described first image harvester is gathered plays assignment key
Part is had differences between the keyboard image and reference picture of disk, it is possible to by the button corresponding to the difference section, is defined as
The button is pressed.
In the implementation, the keyboard image of keyboard is specified by being played according to player, player's performance is reproduced and specifies
The keyboard state of keyboard, it is achieved thereby that the purpose of the keyboard action of button kind musical instrument such as detection piano.
So-called first image collecting device, can specifically imaging sensor be used to realize.Wherein, described image sensor
It can be charge coupled cell (Charge Coupled Device, CCD) sensor, or can also be metal oxide half
Conductor element (Complementary Metal-Oxide Semiconductor, CMOS) sensor, the present embodiment do not enter to this
Row is particularly limited to.If detecting current light than dark, further keyboard can also be specified to carry out on object to be collected
Light filling processing, for example, opening light emitting diode (Light Emitting Diode, LED) light compensating lamp.
In the implementation, where used first image collecting device can be arranged on specified keyboard in equipment,
It is fixed using supporting structure set in equipment.For example, support unit set in the string storehouse lid plane of piano, etc.
Deng.
Wherein, the specified keyboard can include but is not limited to the first key area and the second key area, the present embodiment
To this without being particularly limited to.
Specifically, first key area can be the intermediate region of the specified keyboard, correspondingly, described second
Key area can be then in the beside of the intermediate region both sides in the specified keyboard.
Wherein, first key area can include but is not limited at least one first button and described at least one
Mark in one button set by the specified location of each first button.Specifically, the specific bit of each first button
The paster of particular geometric figure can be included but is not limited to by putting set mark.For example, in the keyboard intermediate region of piano
One dot is set on button, black round dot is set on white key, white round dot is set on black key.
Second key area can include but is not limited at least one second button.
Specifically, described first image harvester, the surface of first key area can be specifically arranged at.
So, correspondingly, specifically can be according to the keyboard of first key area during a concrete implementation
The ginseng of mark and first key area built in advance described in image set by the specified location of each first button
The mark set by the specified location of each first button described in image is examined, obtains the displacement feelings of each first button
Condition, and then, then can be according to the misalignment of each first button, the detection button for obtaining first key area moves
Make.In the implementation process, specifically button detection can be carried out, to obtain each first button according to the position of mark
Misalignment.
So, alternatively, specifically can be according to second key area during another concrete implementation
Each second button at least one second button described in keyboard image, obtain each second button and second pressed by other
The circumstance of occlusion of key, and then, then it can be built according to each second button by the circumstance of occlusion of other buttons and in advance
Each second button described in the reference picture of second key area is by the circumstance of occlusion of other the second buttons, described in acquisition
The detection actuation of keys of second key area.In the implementation process, it can specifically be carried out according to the key features of diverse location
Button detects, to obtain the misalignment of each second button.
Further, in the implementation, the inter-frame information method of difference, color character analytic approach can also further be used
Etc. processing method, the hand of player is split, so, then can be according to the hand being partitioned into, estimating may quilt
The button pressed, so, then image scanning, the i.e. key to the specified button can be carried out to the key area that may be pressed
The key area that may be pressed in disk image corresponds to key area with the reference picture of the specified button built in advance
Images match is carried out, can effectively avoid the technology that sweep time is grown caused by specifying the full keyboard image scanning of keyboard
Problem, so as to improve the efficiency of the realization of Online class.
In this implementation, the reference picture of used specified keyboard, it is necessary to be built in advance.Specifically, have
Body can be analyzed using standard picture, obtain the standard flat image that normal data specifies keyboard.So, obtaining
, can be to analyze the keyboard image to be detected of arbitrary specified keyboard, as long as to be checked after the standard flat image for specifying keyboard
Surveying between keyboard image and standard flat image has difference, then can analyze actuation of keys.
Specifically, position and angle of the first image collecting device etc. by man-machine interaction, can be specifically adjusted,
Ensure that gatherer process meets the requirement of vision algorithm analysis.First image collecting device, branch set in equipment can be used
Frame structure is fixed.For example, support unit set in the string storehouse lid plane of piano, etc..Supporting structure allows to
One image collecting device carries out the adjustment such as upper and lower, front and rear and angle.In the laying of the first initial image collecting device, to it
Approximate location have certain requirement.For example, the first image collecting device needs to be arranged on the upper of the centre position of specified keyboard
Side;By adjusting position and/or the angle of the first image collecting device, ensure to specify all images of keyboard to be collected.
, it is necessary to Real-time Feedback problem in building process, and prompt to carry out the adjustment of the first image collecting device.For example,
The height fine adjusting function of first image collecting device, front and rear fine setting, gradient fine setting and site light environment adjustment, etc..
, can after the standard picture for the specified keyboard that the first image collecting device after being adjusted is gathered
The pretreatment operation such as dry is gone further to carry out image cutting-out, image gray processing and image to the standard picture.Then, may be used
Further to utilize maximum between-cluster variance (OTSU) algorithm or improved OTSU algorithms etc., in the standard after pre-processing
Keyboard detection is carried out in image, and is partitioned into keyboard envelope.Then, algorithm of region growing or improved region can be utilized to give birth to
Long algorithm etc., it is partitioned into each button.
Alternatively, in a possible implementation of the present embodiment, in 102, at least two can specifically be obtained
The player that second image collecting device is gathered plays the keyboard image for specifying keyboard, entered according to the performance task arranged
And then can according to the player that at least two second image collecting device is gathered according to the performance task arranged,
The keyboard image for specifying keyboard is played, obtains and plays anaglyph, according further to the performance anaglyph and advance structure
The reference anaglyph for the specified keyboard built, obtain the detection actuation of keys of the specified keyboard.So, can be by right
Than the performance anaglyph of specified keyboard and the reference anaglyph of the specified keyboard built in advance obtained, regarded as long as playing
Part is had differences between difference image and reference anaglyph, it is possible to by the button corresponding to the difference section, is defined as this
Button is pressed.
In the implementation, the keyboard image of keyboard is specified by being played according to the player of plane, reconstructed stereoscopic is drilled
Play anaglyph, enabling clearly reduce player and play the keypad space state for specifying keyboard, it is achieved thereby that detection
The purpose of the keyboard action of the button kind musical instrument such as piano.
So-called second image collecting device, can specifically imaging sensor be used to realize.Wherein, described image sensor
It can be charge coupled cell (Charge Coupled Device, CCD) sensor, or can also be metal oxide half
Conductor element (Complementary Metal-Oxide Semiconductor, CMOS) sensor, the present embodiment do not enter to this
Row is particularly limited to.If detecting current light than dark, further keyboard can also be specified to carry out on object to be collected
Light filling processing, for example, opening light emitting diode (Light Emitting Diode, LED) light compensating lamp.
In the implementation, the quantity of used second image collecting device can be with the centre bit of target object
Be set to center, symmetrically arranged two, or can also be centered on the center of target object, it is symmetrically arranged more
Individual, the parallax that the position that each second image collecting device is placed needs to meet to pre-set sets distance, the present embodiment pair
This is without being particularly limited to.So-called parallax, refer to that same target object is produced from two points for having certain distance
Raw direction difference.
Specifically, the second image collecting device, where specified keyboard can be arranged in equipment, using set in equipment
The supporting structure put is fixed.For example, support unit set in the string storehouse lid plane of piano, etc..
Due to being multiple second image collecting devices while gathering the image i.e. keyboard image of same target object, because
This to these second image collecting devices, it is necessary to carry out debugging processing, to ensure collected keyboard image as standardization figure
Picture.So-called standardized images, refer to that the keyboard image that each second image collecting device is gathered has synchronizing characteristics, example
Such as, identical image quality, synchronous triggering collection, identical image parameter such as, size, port number, bit depth, orientation etc..
Specifically, two of the left side of equipment where being separately positioned on the specified keyboard and the right the can specifically be obtained
The player that two image collecting devices are gathered plays the keyboard image for specifying keyboard.
In this implementation, the reference anaglyph of used specified keyboard, it is necessary to be built in advance.It is specific next
Say, can specifically be analyzed using standard picture, obtain the standard stereo image that normal data specifies keyboard.So, exist
, can be to analyze the keyboard image to be detected of arbitrary specified keyboard, only after the standard stereo image for obtaining specified keyboard
Want have difference between keyboard image and standard stereo image to be detected, then can analyze actuation of keys.
Specifically, position and angle of the second image collecting device etc. by man-machine interaction, can be specifically adjusted,
Ensure that gatherer process meets the requirement of vision algorithm analysis.Second image collecting device, branch set in equipment can be used
Frame structure is fixed.For example, support unit set in the string storehouse lid plane of piano, etc..Supporting structure allows to
Two image collecting devices carry out the adjustment such as upper and lower, front and rear and angle.In the laying of the second initial image collecting device, to it
Approximate location have certain requirement.For example, the second image collecting device needs to be arranged on the upper of the centre position of specified keyboard
Side;By adjusting position and/or the angle of the second image collecting device, ensure to specify all images of keyboard to be collected.
, it is necessary to Real-time Feedback problem in building process, and prompt to carry out the adjustment of the second image collecting device.For example,
The height fine adjusting function of second image collecting device, front and rear fine setting, gradient fine setting and site light environment adjustment, etc..
, can after the standard picture for the specified keyboard that the second image collecting device after being adjusted is gathered
The pretreatment operation such as dry is gone further to carry out image cutting-out, image gray processing and image to the standard picture.Then, may be used
Further to utilize maximum between-cluster variance (OTSU) algorithm or improved OTSU algorithms etc., in the standard after pre-processing
Keyboard detection is carried out in image, and is partitioned into keyboard envelope.Then, algorithm of region growing or improved region can be utilized to give birth to
Long algorithm etc., it is partitioned into each button.
In the present invention, because the second image collecting device distance objective object is the distance and target object of specified keyboard
Ratio between overall width is smaller so that the angle of view of the second image collecting device needs to meet that a certain size can
Collect all images of target object.Assuming that the second image collecting device placing height is at 50 centimetres, (distance specifies keyboard institute
Plane) left and right, and need gather image width be 150 cms.Drawn by repetition test, the second IMAQ
The angle of view of device needs just collect all images of specified keyboard when being more than 150 °.Due to the second IMAQ
The angle of view of device has larger angle so that can cause larger optical distortion, in the keyboard image gathered
Obvious fisheye effect occurs in edge.Therefore, it is necessary to be carried out to acquired keyboard image after keyboard image is got
Distortion correction processing.Specifically, the player that can be specifically gathered at least two second image collecting device drills
The keyboard image of specified keyboard is played, distortion correction processing is carried out, to obtain at least two changing images.And then then can basis
At least two changing image, obtain and play anaglyph.
, specifically can be according to the performance anaglyph and the specified keyboard that builds in advance in the implementation
With reference to anaglyph, the difference section of acquisition each button, and then, then can be according to the difference portion of each button
Point, the detection actuation of keys of the acquisition specified keyboard.
Further, in the implementation, the inter-frame information method of difference, color character analytic approach can also further be used
Etc. processing method, the hand of player is split, so, then can be according to the hand being partitioned into, estimating may quilt
The button pressed, so, then image scanning can be carried out to the key area that may be pressed, i.e., the specified button be drilled
It is corresponding with the reference anaglyph of the specified button built in advance to play the key area that may be pressed in anaglyph
Key area carries out images match, can effectively avoid the sweep time caused by specifying the full keyboard image scanning of keyboard
Long technical problem, so as to improve the efficiency of the realization of Online class.
Alternatively, in a possible implementation of the present embodiment, in 103, the detection can specifically be pressed
The button model action for the specified keyboard that key is acted and built in advance is compared processing.If the inspection of the specified keyboard
The button model for surveying actuation of keys and current reference is kept strokes, then can illustrate that player plays the button of the specified keyboard
Situation is standard key situation;If the detection actuation of keys of the specified keyboard and the button model action of current reference differ
Cause, then the key-case that the player plays the specified keyboard can be obtained, for example, differing according to inconsistent situation
The place of cause is fewer, then illustrates that the key-case of player's performance specified keyboard is better, inconsistent place is more, then says
The key-case that bright player plays the specified keyboard is poorer.
During a concrete implementation, obtain the player play the specified keyboard key-case it
Afterwards, the key-case that the player plays the specified keyboard can also further be exported.So, by according to being obtained
The detection actuation of keys of keyboard and the button model action of current reference are specified, player is obtained and plays pressing for the specified keyboard
Key situation, and then the key-case is exported, it can effectively strengthen the visualization of the realization of Online class.
Specifically, it can specifically obtain the player that video acquisition device is gathered and play the specified keyboard
Original video information, and then, then pressing for the specified keyboard can be played according to the original video information and the player
Key situation, the sharing video frequency information is obtained, and export the sharing video frequency information.
Wherein, video acquisition device, where specified keyboard can be arranged in equipment, using support set in equipment
Structure is fixed.For example, support unit set in the string storehouse lid plane of piano, etc..
Alternatively, in a possible implementation of the present embodiment, after 104, institute can also further be exported
The evaluation result of player is stated, so that director is according to the evaluation result, associative operation is carried out, for example, trigger request enters one
To a training mate pattern, individually linked up with player.
Alternatively, in a possible implementation of the present embodiment, after 101, if the Online class pattern
For class's class pattern, then specified music score of Chinese operas file can be further obtained, and then, then it can be obtained according to the specified music score of Chinese operas file
At least one music score of Chinese operas element, and according to each music score of Chinese operas element at least one music score of Chinese operas element, obtain each music score of Chinese operas
The music score of Chinese operas object of element;Wherein, the music score of Chinese operas object of each music score of Chinese operas element includes each music score of Chinese operas attribute of an element information
With the layout information of each music score of Chinese operas element.Then, then the music score of Chinese operas object of each music score of Chinese operas element can be exported, for example,
Can be in the music score of Chinese operas object of locally output each music score of Chinese operas element, to realize local viewing music score of Chinese operas file, or can also be
Remotely to the music score of Chinese operas object of multiple beholders output each music score of Chinese operas element, to realize that long-range online of director shares the music score of Chinese operas
File, the present embodiment is to this without being particularly limited to.
Due to the music score of Chinese operas element included in music score of Chinese operas file is carried out into objectification to obtain the music score of Chinese operas separate one by one
Object, enabling according to any display device can viewing area, it is adaptive carry out the related output of online teaching task and
Operated, it is achieved thereby that director is based on the music score of Chinese operas showed to player, online to multiple players carry out performance demonstration,
The online teaching tasks such as music score of Chinese operas explanation, action explanation, classroom interactions.
In the implementation, " specified " two word in involved specified music score of Chinese operas file, not particular meaning, be exactly for
Current file destination is specified, it is therefore intended that music score of Chinese operas file is exactly common music score of Chinese operas file, can be printed copy
Papery music score of Chinese operas file, or can also be the electronic score file of the electronic score file such as MusicXML forms of electronic version
Deng the present embodiment is to this without being particularly limited to.
The so-called music score of Chinese operas, refer to a kind of method that music is recorded with symbol.Different culture and regional development difference
Recording method, recording method can be divided into record pitch method and record fingering method this two classes method.Staff and numbered musical notation
Belong to the music score of Chinese operas of record pitch, six line spectrums of guitar and the music score of Chinese operas for subtracting word spectrum and belonging to record fingering of seven-stringed plucked instrument in some ways similar to the zither.
So-called music score of Chinese operas element, it is exactly the record symbol of used record music, time signature can be included but is not limited to, adjusted
Number, all kinds of notes and play symbol in it is at least one, the present embodiment is to this without being particularly limited to.Wherein, it is described each
The music score of Chinese operas object of music score of Chinese operas element can include but is not limited to each music score of Chinese operas attribute of an element information and each music score of Chinese operas member
The layout information of element, the present embodiment is to this without being particularly limited to.
Wherein, each music score of Chinese operas attribute of an element information can include but is not limited to the element of each music score of Chinese operas element
The element type of title and each music score of Chinese operas element, the present embodiment is to this without being particularly limited to.
Wherein, the layout information of each music score of Chinese operas element can include but is not limited to the element of each music score of Chinese operas element
The element position of size and each music score of Chinese operas element, the present embodiment is to this without being particularly limited to.
, can be in each music score of Chinese operas element in order to avoid overlapping between music score of Chinese operas element during a concrete implementation
Outside or inner periphery set a sightless encirclement frame element, as a rule, can use rectangle, square, triangle
The regular planar graph such as shape is as encirclement frame element.Therefore, the element size of each music score of Chinese operas element, it can be understood as music score of Chinese operas member
The size of encirclement frame element belonging to element.
After the music score of Chinese operas object of each music score of Chinese operas element is obtained, each music score of Chinese operas member that can also further to being obtained
The music score of Chinese operas object of element, carries out storage processing.Wherein, storage form can use but be not limited to the storage shape of tree form data structure
Formula, the present embodiment is to this without being particularly limited to.
Specifically, can by the music score of Chinese operas object of each music score of Chinese operas element obtained, in the storage device of local terminal,
Carry out that processing is locally stored, or can also be by the storage of the music score of Chinese operas object, beyond the clouds terminal of each music score of Chinese operas element obtained
In equipment, long-range storage processing is carried out, to feed to the music score of Chinese operas object that other-end provides each music score of Chinese operas element stored, this reality
Example is applied to this without being particularly limited to.
During a concrete implementation, the storage device of the terminal can be slow storage device, specifically can be with
For the hard disk of computer system, or can also be that the inoperative internal memory of mobile phone be physical memory, for example, read-only storage
(Read-Only Memory, ROM) and RAM card etc., the present embodiment is to this without being particularly limited to.
During another concrete implementation, the storage device of the terminal can also be speedy storage equipment, specifically
It can be the internal memory of computer system, or can also be Installed System Memory for the running memory of mobile phone, for example, random access memory
(Random Access Memory, RAM) etc., the present embodiment is to this without being particularly limited to.
In the implementation, can specifically obtain display device can viewing area display size data, and then, then
The music score of Chinese operas object placement parameter pre-set can be obtained, enabling according to the display size data and the music score of Chinese operas object
Layout parameter, in the music score of Chinese operas object that each music score of Chinese operas element in viewing area, can be exported.Before this, can also enter
One step pre-sets music score of Chinese operas object placement parameter, for example, the parameter such as music score of Chinese operas object minimum spacing.Correspondingly, specifically can be two
On dimensional plane, according to music score of Chinese operas tradition typesetting rule, optimal branch is calculated using dynamic programming algorithm, then, to music score of Chinese operas object
Carry out Dynamic iterations, calculate display device face to face can in viewing area each music score of Chinese operas object placement position, solve not
The problem of with music score of Chinese operas file is shared on the display device of size.
Specifically, due to different display devices can the size of viewing area be not completely the same, but with one
Fixed gap, therefore, can according to different display devices can viewing area size, the music score of Chinese operas file institute shown to needs is right
The music score of Chinese operas object answered carries out auto arrangement, enabling according to any display device can viewing area, it is adaptive carry out it is online
The related output of teaching task and operated.
After the music score of Chinese operas object of each music score of Chinese operas element is exported, it can also further obtain user i.e. director or drill
The person of playing to the Action Events of the specified music score of Chinese operas object exported, and then, then can according to the Action Events, obtain operation pair
As, wherein, the operation object includes operation content and the specified music score of Chinese operas object.It is then possible to according to the operation object,
Corresponding operating is performed on the specified music score of Chinese operas object exported.
So-called Action Events, selection music score of Chinese operas object can be included but is not limited to, the paragraph of music score of Chinese operas object is selected, select to press
Beat walks spectrum, adjustment music score of Chinese operas object color, adjustment music score of Chinese operas object's position and amplification/diminution music score of Chinese operas object, and the present embodiment is to this
Without being particularly limited to.
In the implementation, by according to acquired user to the Action Events of the specified music score of Chinese operas object exported,
Operation object is obtained, the operation object includes operation content and the specified music score of Chinese operas object, enabling according to the operation
Object, corresponding operating is performed on the specified music score of Chinese operas object exported, due to the music score of Chinese operas included in music score of Chinese operas file is first
Element carries out objectification to obtain music score of Chinese operas object separate one by one, then can be according to the Action Events of objectification i.e. operation pair
As the corresponding operating of execution operation object on the specified music score of Chinese operas object exported, enabling to any music score of Chinese operas object
The related operation of online teaching task is carried out, it is achieved thereby that director is based on the music score of Chinese operas showed to player, online to more
Individual player carries out the online teaching tasks such as performance demonstration, music score of Chinese operas explanation, action explanation, classroom interactions.
Wherein, it the operation object obtained, can be an operation object, or can also be that multiple operation objects are grasped
Make object sequence, the present embodiment is to this without being particularly limited to.
In a possible implementation process, the same of corresponding operating is performed on the specified music score of Chinese operas object exported
When, the multi-medium data that the user is triggered can also be further obtained, the multi-medium data includes video data and sound
At least one of frequency in, and then, then processing can be associated to the operation object and the multi-medium data, to obtain
Obtain associated data.It is then possible to export the associated data.
Specifically, specifically the associated data can be locally being exported, to realize local viewing music score of Chinese operas file, or may be used also
Remotely to export the music score of Chinese operas object of each music score of Chinese operas element, long-range online share music score of Chinese operas file, the present embodiment to realize
To this without being particularly limited to.
In the implementation process, the corresponding operating of execution operation object is same on the specified music score of Chinese operas object exported
When, the multi-medium data that is also further triggered by obtaining the user, the multi-medium data includes video data and sound
At least one of frequency in, and then can then processing be associated to the operation object and the multi-medium data, to obtain
Associated data, enabling by the content of courses during online teaching be user to the behaviour of the specified music score of Chinese operas object exported
Make the image related with the content of courses that event triggered to user and/or sound associates, during by online teaching
The corelation behaviour of user is mapped directly on the music score of Chinese operas object of correlation, and online teaching is intuitively visualized so as to form.
In the implementation process, it can specifically obtain the user that at least two multimedia collection devices are gathered and touch
The multi-medium data of hair.
Specifically, media multimedia harvester, can be made up of image collecting device and voice collection device.
So-called image collecting device, can specifically imaging sensor be used to realize.Wherein, described image sensor can be with
For charge coupled cell (Charge Coupled Device, CCD) sensor, or it can also be metal-oxide semiconductor (MOS)
Element (Complementary Metal-Oxide Semiconductor, CMOS) sensor, the present embodiment is to this without spy
Do not limit.If detecting current light than dark, further keyboard can also be specified to carry out light filling on object to be collected
Processing, for example, opening light emitting diode (Light Emitting Diode, LED) light compensating lamp.
Purpose using multiple multimedia collection devices is to shoot complete musical instrument class teaching scene such as Piano Teaching field
Scape etc..By taking Piano Teaching scene as an example, the function point for setting the camera of different angle to stress is different.
For example, shooting camera in front can be set, for the emotion communication during Piano Teaching, the upper half of player
Figure gesture includes shoulder, large arm etc.;
Or for another example shooting camera directly over can setting, can use wide-angle lens, from key upper vertical
Complete 88 keys of piano are shot, for shooting the pitch played, fingering and wrist movement etc.;
Or for another example side can be set to shoot camera, for shooting the large arm of player, forearm, wrist, hand
Ramus volaris profundus support, folding refer to, lift refer to, tone hopping, various playing methods and the skill such as touching.
So-called voice collection device, can specifically microphone be used to realize.
In the implementation process, specifically the user institute can be obtained by wireless transmission method or wire transmission mode
The multi-medium data of triggering.
In wire transmission mode, wired connection transferring equipment can be used, connection display device gathers with multiple images
Device, by wire transmission mode, the multi-medium data that acquired user is triggered, carry out the religion during online teaching
Learn the figure related with the content of courses that the Action Events that content is specified music score of Chinese operas object of the user to being exported are triggered to user
The association process of picture and/or sound, association content can be made to reach Millisecond synchronization.
After the associated data after obtaining by association process, then associated data can be carried out at data frame encapsulation
Reason, for follow-up transmission process.
In the implementation process, after associated data is obtained, it can also be stored further to the associated data
Processing.Specifically, the associated data that will can be obtained, in the storage device of local terminal, carry out that processing is locally stored,
Or the associated data that will can also be obtained, beyond the clouds in the storage device of terminal, carry out long-range storage processing, the present embodiment
To this without being particularly limited to.
During a concrete implementation, the storage device of the terminal can be slow storage device, specifically can be with
For the hard disk of computer system, or can also be that the inoperative internal memory of mobile phone be physical memory, for example, read-only storage
(Read-Only Memory, ROM) and RAM card etc., the present embodiment is to this without being particularly limited to.
During another concrete implementation, the storage device of the terminal can also be speedy storage equipment, specifically
It can be the internal memory of computer system, or can also be Installed System Memory for the running memory of mobile phone, for example, random access memory
(Random Access Memory, RAM) etc., the present embodiment is to this without being particularly limited to.
Alternatively, in a possible implementation of the present embodiment, after 101, if the Online class pattern
For one-to-one training mate pattern, then the communication connection that can be established between director and the player, and then, then it can be based on institute
Communication connection is stated, information exchange service is provided to the director and the player.
In the implementation, between director and player, man-to-man proprietary communication can be based on and connected, carried out single
Only information exchange, in such manner, it is possible to targetedly help player's fast lifting performance level.
In the present embodiment, under intelligent training mate pattern, referred to by obtaining player according to the performance task arranged, performance
Determine the detection actuation of keys of keyboard, and then according to the detection actuation of keys and the button mould of the specified keyboard built in advance
Type acts, and obtains the performance situation of the player, enabling according to the performance situation of the player, carry out at evaluation and test
Reason, to obtain the evaluation result of the player, musical instrument class exercise scene can be truly reduced, it is achieved thereby that musical instrument class is imparted knowledge to students
Online class.
In addition, using technical scheme provided by the present invention, performance situation that can simultaneously to multiple players is commented
Survey is handled, and to obtain the evaluation result of multiple players, musical instrument class exercise scene can be truly reduced, it is achieved thereby that musical instrument class
More people's Online class of teaching.
In addition, using technical scheme provided by the present invention, the keyboard image of keyboard is specified by being played according to player,
Reproduce player and play the keyboard state for specifying keyboard, it is achieved thereby that the mesh of the keyboard action of button kind musical instrument such as detection piano
's.
In addition, using technical scheme provided by the present invention, by the key that specified keyboard is played according to the player of plane
Disk image, the performance anaglyph of reconstructed stereoscopic, enabling clearly reduce player and play the keypad space for specifying keyboard
State, it is achieved thereby that the purpose of the keyboard action of button kind musical instrument such as detection piano.
In addition, using technical scheme provided by the present invention, under class's class pattern, due to by included in music score of Chinese operas file
Music score of Chinese operas element carries out objectification to obtain music score of Chinese operas object separate one by one, enabling according to any display device can
Viewing area, it is adaptive to carry out the related output of online teaching task and operated, it is achieved thereby that director is based on to performance
The music score of Chinese operas that person is showed, it is online to carry out performance demonstration, music score of Chinese operas explanation, action explanation, classroom interactions etc. to multiple players online
Teaching task.
In addition, using technical scheme provided by the present invention, under one-to-one training mate pattern, director can be realized with drilling
Targetedly individually communication between the person of playing, so as to effectively increase the playing effect of player.
In addition, using technical scheme provided by the present invention, Consumer's Experience can be effectively lifted.
It should be noted that for foregoing each method embodiment, in order to be briefly described, therefore it is all expressed as a series of
Combination of actions, but those skilled in the art should know, the present invention is not limited by described sequence of movement because
According to the present invention, some steps can use other orders or carry out simultaneously.Secondly, those skilled in the art should also know
Know, embodiment described in this description belongs to preferred embodiment, and involved action and module are not necessarily of the invention
It is necessary.
In the above-described embodiments, the description to each embodiment all emphasizes particularly on different fields, and does not have the portion being described in detail in some embodiment
Point, it may refer to the associated description of other embodiment.
Fig. 2 is the structural representation of the realization device for the Online class that another embodiment of the present invention provides, as shown in Figure 2.
The realization device of the Online class of the present embodiment can include pattern acquiring unit 21, mode processing units 22, situation and obtain list
Member 23 and evaluation process unit 24.Wherein, pattern acquiring unit 21, for obtaining the Online class pattern of musical instrument class teaching;Mould
Formula processing unit 22, if being intelligent training mate pattern for the Online class pattern, player is obtained according to the performance arranged
Task, play the detection actuation of keys for specifying keyboard;Situation acquiring unit 23, for according to the detection actuation of keys and in advance
The button model action of the specified keyboard of structure, obtain the performance situation of the player;Evaluation process unit 24, is used for
According to the performance situation of the player, evaluation process is carried out, to obtain the evaluation result of the player.
It should be noted that the realization device for the Online class that the present embodiment is provided partly or entirely can be positioned at
The application of local terminal, or can also be the plug-in unit or SDK being arranged in the application of local terminal
Functional units such as (Software Development Kit, SDK), or can also be the processing in network side server
Engine, or can also be the distributed system positioned at network side, the present embodiment is to this without being particularly limited to.
It is understood that the application can be mounted in the local program (nativeApp) in terminal, or may be used also
To be a web page program (webApp) of browser in terminal, the present embodiment is to this without limiting.
Alternatively, in a possible implementation of the present embodiment, the mode processing units 22, can specifically use
In
Obtain the player that the first image collecting device is gathered and keyboard is specified according to the performance task arranged, performance
Keyboard image;According to the player that described first image harvester is gathered according to the performance task arranged, play and specify
The reference picture of the keyboard image of keyboard and the specified keyboard built in advance, the detection button for obtaining the specified keyboard move
Make;Or
The player that at least two second image collecting devices are gathered is obtained according to the performance task arranged, performance to be referred to
Determine the keyboard image of keyboard;Drilled according to the player that at least two second image collecting device is gathered according to what is arranged
Task is played, plays the keyboard image for specifying keyboard, obtains and plays anaglyph;Build according to the performance anaglyph and in advance
The specified keyboard reference anaglyph, obtain the detection actuation of keys of the specified keyboard.
Alternatively, in a possible implementation of the present embodiment, the evaluation process unit 24, one can also be entered
Walk the evaluation result for exporting the player.
Alternatively, in a possible implementation of the present embodiment, the mode processing units 22, one can also be entered
If it is class's class pattern to walk for the Online class pattern, obtains and specify music score of Chinese operas file;According to the specified music score of Chinese operas file, obtain
At least one music score of Chinese operas element;According to each music score of Chinese operas element at least one music score of Chinese operas element, each music score of Chinese operas element is obtained
Music score of Chinese operas object;The music score of Chinese operas object of each music score of Chinese operas element includes each music score of Chinese operas attribute of an element information and described each
The layout information of music score of Chinese operas element;And the music score of Chinese operas object of output each music score of Chinese operas element.
Alternatively, in a possible implementation of the present embodiment, the mode processing units 22, one can also be entered
If it is one-to-one training mate pattern to walk for the Online class pattern, the communication link established between director and the player
Connect;And based on the communication connection, information exchange service is provided to the director and the player.
It should be noted that method in embodiment corresponding to Fig. 1, the realization for the Online class that can be provided by the present embodiment
Device is realized.The related content that may refer in embodiment corresponding to Fig. 1 is described in detail, here is omitted.
It is intelligent training mate mould in the Online class pattern of the musical instrument class teaching acquired in pattern acquiring unit in the present embodiment
Under formula, mode processing units are played by obtaining player according to the performance task arranged and specify the detection button of keyboard to move
Make, and then moved by situation acquiring unit according to the button model of the detection actuation of keys and the specified keyboard built in advance
Make, obtain the performance situation of the player so that evaluation process unit can be carried out according to the performance situation of the player
Evaluation process, to obtain the evaluation result of the player, musical instrument class exercise scene can be truly reduced, it is achieved thereby that musical instrument
The Online class of class teaching.
In addition, using technical scheme provided by the present invention, performance situation that can simultaneously to multiple players is commented
Survey is handled, and to obtain the evaluation result of multiple players, musical instrument class exercise scene can be truly reduced, it is achieved thereby that musical instrument class
More people's Online class of teaching.
In addition, using technical scheme provided by the present invention, the keyboard image of keyboard is specified by being played according to player,
Reproduce player and play the keyboard state for specifying keyboard, it is achieved thereby that the mesh of the keyboard action of button kind musical instrument such as detection piano
's.
In addition, using technical scheme provided by the present invention, by the key that specified keyboard is played according to the player of plane
Disk image, the performance anaglyph of reconstructed stereoscopic, enabling clearly reduce player and play the keypad space for specifying keyboard
State, it is achieved thereby that the purpose of the keyboard action of button kind musical instrument such as detection piano.
In addition, using technical scheme provided by the present invention, under class's class pattern, due to by included in music score of Chinese operas file
Music score of Chinese operas element carries out objectification to obtain music score of Chinese operas object separate one by one, enabling according to any display device can
Viewing area, it is adaptive to carry out the related output of online teaching task and operated, it is achieved thereby that director is based on to performance
The music score of Chinese operas that person is showed, it is online to carry out performance demonstration, music score of Chinese operas explanation, action explanation, classroom interactions etc. to multiple players online
Teaching task.
In addition, using technical scheme provided by the present invention, under one-to-one training mate pattern, director can be realized with drilling
Targetedly individually communication between the person of playing, so as to effectively increase the playing effect of player.
In addition, using technical scheme provided by the present invention, Consumer's Experience can be effectively lifted.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and unit, the corresponding process in preceding method embodiment is may be referred to, will not be repeated here.
In several embodiments provided by the present invention, it should be understood that disclosed system, apparatus and method can be with
Realize by another way.For example, device embodiment described above is only schematical, for example, the unit
Division, only a kind of division of logic function, can there is other dividing mode, such as multiple units or component when actually realizing
Another system can be combined or be desirably integrated into, or some features can be ignored, or do not perform.It is another, it is shown or
The mutual coupling discussed or direct-coupling or communication connection can be the indirect couplings by some interfaces, device or unit
Close or communicate to connect, can be electrical, mechanical or other forms.
The unit illustrated as separating component can be or may not be physically separate, show as unit
The part shown can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
On NE.Some or all of unit therein can be selected to realize the mesh of this embodiment scheme according to the actual needs
's.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, can also
That unit is individually physically present, can also two or more units it is integrated in a unit.Above-mentioned integrated list
Member can both be realized in the form of hardware, can also be realized in the form of hardware adds SFU software functional unit.
The above-mentioned integrated unit realized in the form of SFU software functional unit, can be stored in one and computer-readable deposit
In storage media.Above-mentioned SFU software functional unit is stored in a storage medium, including some instructions are causing a computer
It is each that equipment (can be personal computer, server, or network equipment etc.) or processor (processor) perform the present invention
The part steps of embodiment methods described.And foregoing storage medium includes:USB flash disk, mobile hard disk, read-only storage (Read-
Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disc or CD etc. it is various
Can be with the medium of store program codes.
Finally it should be noted that:The above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations;Although
The present invention is described in detail with reference to the foregoing embodiments, it will be understood by those within the art that:It still may be used
To be modified to the technical scheme described in foregoing embodiments, or equivalent substitution is carried out to which part technical characteristic;
And these modification or replace, do not make appropriate technical solution essence depart from various embodiments of the present invention technical scheme spirit and
Scope.
Claims (10)
- A kind of 1. implementation method of Online class, it is characterised in that including:Obtain the Online class pattern of musical instrument class teaching;If the Online class pattern is intelligent training mate pattern, player is obtained according to the performance task arranged, plays and specifies The detection actuation of keys of keyboard;Acted according to the button model of the detection actuation of keys and the specified keyboard built in advance, obtain the player Performance situation;According to the performance situation of the player, evaluation process is carried out, to obtain the evaluation result of the player.
- 2. according to the method for claim 1, it is characterised in that the acquisition player according to the performance task arranged, The detection actuation of keys for specifying keyboard is played, including:Obtain the player that the first image collecting device is gathered and the keyboard of keyboard is specified according to the performance task arranged, performance Image;According to the player that described first image harvester is gathered according to the performance task arranged, play and specify keyboard Keyboard image and the specified keyboard built in advance reference picture, obtain the detection actuation of keys of the specified keyboard; OrPlayer that at least two second image collecting devices are gathered is obtained according to the performance task arranged, plays assignment key The keyboard image of disk;Appointed according to the player that at least two second image collecting device is gathered according to the performance arranged Business, the keyboard image for specifying keyboard is played, obtain and play anaglyph;According to the performance anaglyph and the institute built in advance The reference anaglyph of specified keyboard is stated, obtains the detection actuation of keys of the specified keyboard.
- 3. according to the method for claim 1, it is characterised in that the performance situation according to the player, commented Survey is handled, after obtaining the evaluation result of the player, in addition to:Export the evaluation result of the player.
- 4. according to the method described in claims 1 to 3 any claim, it is characterised in that described to obtain what musical instrument class was imparted knowledge to students After Online class pattern, in addition to:If the Online class pattern is class's class pattern, obtains and specify music score of Chinese operas file;According to the specified music score of Chinese operas file, at least one music score of Chinese operas element is obtained;According to each music score of Chinese operas element at least one music score of Chinese operas element, the music score of Chinese operas object of acquisition each music score of Chinese operas element;Institute Stating the music score of Chinese operas object of each music score of Chinese operas element includes the cloth of each music score of Chinese operas attribute of an element information and each music score of Chinese operas element Office's information;Export the music score of Chinese operas object of each music score of Chinese operas element.
- 5. according to the method described in claims 1 to 3 any claim, it is characterised in that described to obtain what musical instrument class was imparted knowledge to students After Online class pattern, in addition to:If the Online class pattern is one-to-one training mate pattern, the communication connection established between director and the player;Based on the communication connection, information exchange service is provided to the director and the player.
- A kind of 6. realization device of Online class, it is characterised in that including:Pattern acquiring unit, for obtaining the Online class pattern of musical instrument class teaching;Mode processing units, if be intelligent training mate pattern for the Online class pattern, player is obtained according to being arranged Performance task, play the detection actuation of keys for specifying keyboard;Situation acquiring unit, for being moved according to the button model of the detection actuation of keys and the specified keyboard built in advance Make, obtain the performance situation of the player;Evaluation process unit, for the performance situation according to the player, evaluation process is carried out, to obtain the player's Evaluation result.
- 7. device according to claim 6, it is characterised in that the mode processing units, be specifically used forObtain the player that the first image collecting device is gathered and the keyboard of keyboard is specified according to the performance task arranged, performance Image;According to the player that described first image harvester is gathered according to the performance task arranged, play and specify keyboard Keyboard image and the specified keyboard built in advance reference picture, obtain the detection actuation of keys of the specified keyboard; OrPlayer that at least two second image collecting devices are gathered is obtained according to the performance task arranged, plays assignment key The keyboard image of disk;Appointed according to the player that at least two second image collecting device is gathered according to the performance arranged Business, the keyboard image for specifying keyboard is played, obtain and play anaglyph;According to the performance anaglyph and the institute built in advance The reference anaglyph of specified keyboard is stated, obtains the detection actuation of keys of the specified keyboard.
- 8. device according to claim 6, it is characterised in that the evaluation process unit, be additionally operable toExport the evaluation result of the player.
- 9. according to the device described in claim 6~8 any claim, it is characterised in that the mode processing units, also use InIf the Online class pattern is class's class pattern, obtains and specify music score of Chinese operas file;According to the specified music score of Chinese operas file, at least one music score of Chinese operas element is obtained;According to each music score of Chinese operas element at least one music score of Chinese operas element, the music score of Chinese operas object of acquisition each music score of Chinese operas element;Institute Stating the music score of Chinese operas object of each music score of Chinese operas element includes the cloth of each music score of Chinese operas attribute of an element information and each music score of Chinese operas element Office's information;AndExport the music score of Chinese operas object of each music score of Chinese operas element.
- 10. according to the device described in claim 6~8 any claim, it is characterised in that the mode processing units, also ForIf the Online class pattern is one-to-one training mate pattern, the communication connection established between director and the player; AndBased on the communication connection, information exchange service is provided to the director and the player.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710816361.7A CN107610550A (en) | 2017-09-12 | 2017-09-12 | The implementation method and device of Online class |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710816361.7A CN107610550A (en) | 2017-09-12 | 2017-09-12 | The implementation method and device of Online class |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107610550A true CN107610550A (en) | 2018-01-19 |
Family
ID=61062972
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710816361.7A Pending CN107610550A (en) | 2017-09-12 | 2017-09-12 | The implementation method and device of Online class |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107610550A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108711337A (en) * | 2018-05-25 | 2018-10-26 | 京东方科技集团股份有限公司 | Keyboard instrument auxiliary exercise method, apparatus |
| CN109035963A (en) * | 2018-07-20 | 2018-12-18 | 广州市雅迪数码科技有限公司 | The method and device of piano long-distance education |
| CN109599085A (en) * | 2018-12-20 | 2019-04-09 | 余姚市荣大塑业有限公司 | Extended pattern electronic violin |
| CN110517555A (en) * | 2019-07-19 | 2019-11-29 | 森兰信息科技(上海)有限公司 | Method, system, storage medium and the device of synchronization class state based on piano |
| CN111224863A (en) * | 2019-12-10 | 2020-06-02 | 平安国际智慧城市科技股份有限公司 | Session task generation method and device, computer equipment and storage medium |
| CN111816013A (en) * | 2020-08-17 | 2020-10-23 | 玖月音乐科技(北京)有限公司 | Control method for teaching of double-row key group lessons |
| CN113272891A (en) * | 2019-01-22 | 2021-08-17 | 雅马哈株式会社 | Musical performance system, musical performance mode setting method, and musical performance mode setting device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0991266A (en) * | 1995-09-21 | 1997-04-04 | Matsushita Electric Ind Co Ltd | Learning type recognition judgment device |
| CN105430453A (en) * | 2015-11-27 | 2016-03-23 | 刘军 | Media data collection method, media terminal and online music teaching system |
| CN106228961A (en) * | 2016-07-21 | 2016-12-14 | 赵洪云 | Play evaluation methodology and device |
| CN106709427A (en) * | 2016-12-01 | 2017-05-24 | 北京银河润泰科技有限公司 | Keyboard action detection method and device |
| CN106782464A (en) * | 2016-12-01 | 2017-05-31 | 北京银河润泰科技有限公司 | Keyboard action detection method and device |
| CN106951457A (en) * | 2017-02-24 | 2017-07-14 | 北京银河润泰科技有限公司 | The processing method and processing device of the music score of Chinese operas |
| CN107067151A (en) * | 2017-02-10 | 2017-08-18 | 美国元源股份有限公司 | Practise music score collocation method and device |
-
2017
- 2017-09-12 CN CN201710816361.7A patent/CN107610550A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0991266A (en) * | 1995-09-21 | 1997-04-04 | Matsushita Electric Ind Co Ltd | Learning type recognition judgment device |
| CN105430453A (en) * | 2015-11-27 | 2016-03-23 | 刘军 | Media data collection method, media terminal and online music teaching system |
| CN106228961A (en) * | 2016-07-21 | 2016-12-14 | 赵洪云 | Play evaluation methodology and device |
| CN106709427A (en) * | 2016-12-01 | 2017-05-24 | 北京银河润泰科技有限公司 | Keyboard action detection method and device |
| CN106782464A (en) * | 2016-12-01 | 2017-05-31 | 北京银河润泰科技有限公司 | Keyboard action detection method and device |
| CN107067151A (en) * | 2017-02-10 | 2017-08-18 | 美国元源股份有限公司 | Practise music score collocation method and device |
| CN106951457A (en) * | 2017-02-24 | 2017-07-14 | 北京银河润泰科技有限公司 | The processing method and processing device of the music score of Chinese operas |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108711337A (en) * | 2018-05-25 | 2018-10-26 | 京东方科技集团股份有限公司 | Keyboard instrument auxiliary exercise method, apparatus |
| CN109035963A (en) * | 2018-07-20 | 2018-12-18 | 广州市雅迪数码科技有限公司 | The method and device of piano long-distance education |
| CN109599085A (en) * | 2018-12-20 | 2019-04-09 | 余姚市荣大塑业有限公司 | Extended pattern electronic violin |
| CN113272891A (en) * | 2019-01-22 | 2021-08-17 | 雅马哈株式会社 | Musical performance system, musical performance mode setting method, and musical performance mode setting device |
| CN113272891B (en) * | 2019-01-22 | 2024-02-27 | 雅马哈株式会社 | Performance system, performance mode setting method, and performance mode setting device |
| CN110517555A (en) * | 2019-07-19 | 2019-11-29 | 森兰信息科技(上海)有限公司 | Method, system, storage medium and the device of synchronization class state based on piano |
| CN111224863A (en) * | 2019-12-10 | 2020-06-02 | 平安国际智慧城市科技股份有限公司 | Session task generation method and device, computer equipment and storage medium |
| CN111224863B (en) * | 2019-12-10 | 2021-06-22 | 平安国际智慧城市科技股份有限公司 | Session task generation method and device, computer equipment and storage medium |
| CN111816013A (en) * | 2020-08-17 | 2020-10-23 | 玖月音乐科技(北京)有限公司 | Control method for teaching of double-row key group lessons |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107610550A (en) | The implementation method and device of Online class | |
| CN110531860B (en) | Animation image driving method and device based on artificial intelligence | |
| CN106056996B (en) | A kind of multimedia interactive tutoring system and method | |
| US20210104169A1 (en) | System and method for ai based skill learning | |
| JP6690489B2 (en) | Information processing apparatus, information processing method, and program | |
| US12014645B2 (en) | Virtual tutorials for musical instruments with finger tracking in augmented reality | |
| CN111598160B (en) | Training method and device of image classification model, computer equipment and storage medium | |
| US11557269B2 (en) | Information processing method | |
| US10991349B2 (en) | Method and system for musical synthesis using hand-drawn patterns/text on digital and non-digital surfaces | |
| CN108491804B (en) | Chess game display method, related device and system | |
| CN105335136B (en) | The control method and device of smart machine | |
| CN114418972B (en) | Picture quality detection method, device, equipment and storage medium | |
| CN115023732B (en) | Information processing device, information processing method, and information processing program | |
| JP2018147428A (en) | Information processing apparatus, information processing method, and program | |
| CN111641861B (en) | Video playing method and electronic equipment | |
| US20200365123A1 (en) | Information processing method | |
| CN112183430A (en) | A method and device for sign language recognition based on dual neural network | |
| CN108932060A (en) | Gesture three-dimensional interaction shadow casting technique | |
| CN106951457A (en) | The processing method and processing device of the music score of Chinese operas | |
| WO2014061931A1 (en) | Device and method for playing sound | |
| CN107248407A (en) | A kind of gesture musical performance device | |
| CN109816023A (en) | Method and apparatus for generating picture tag model | |
| CN115480923A (en) | Multimode intelligent classroom edge calculation control system | |
| CN113554045B (en) | Data set manufacturing method, device, equipment and storage medium | |
| CN114333031A (en) | Vulnerability detection method and device of living body detection model and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180119 |
|
| RJ01 | Rejection of invention patent application after publication |