[go: up one dir, main page]

CN107610550A - The implementation method and device of Online class - Google Patents

The implementation method and device of Online class Download PDF

Info

Publication number
CN107610550A
CN107610550A CN201710816361.7A CN201710816361A CN107610550A CN 107610550 A CN107610550 A CN 107610550A CN 201710816361 A CN201710816361 A CN 201710816361A CN 107610550 A CN107610550 A CN 107610550A
Authority
CN
China
Prior art keywords
keyboard
player
music score
chinese operas
performance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710816361.7A
Other languages
Chinese (zh)
Inventor
郭毅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BEIJING YINHE RUNTAI TECHNOLOGY Co Ltd
Original Assignee
BEIJING YINHE RUNTAI TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BEIJING YINHE RUNTAI TECHNOLOGY Co Ltd filed Critical BEIJING YINHE RUNTAI TECHNOLOGY Co Ltd
Priority to CN201710816361.7A priority Critical patent/CN107610550A/en
Publication of CN107610550A publication Critical patent/CN107610550A/en
Pending legal-status Critical Current

Links

Landscapes

  • Electrophonic Musical Instruments (AREA)

Abstract

The present invention provides a kind of implementation method and device of Online class.The embodiment of the present invention is under intelligent training mate pattern, by obtaining player according to the performance task arranged, play the detection actuation of keys for specifying keyboard, and then acted according to the button model of the detection actuation of keys and the specified keyboard built in advance, obtain the performance situation of the player, make it possible to the performance situation according to the player, carry out evaluation process, to obtain the evaluation result of the player, musical instrument class exercise scene can be truly reduced, it is achieved thereby that the Online class of musical instrument class teaching.

Description

The implementation method and device of Online class
【Technical field】
The present invention relates to the implementation method and device of online education, more particularly to a kind of Online class.
【Background technology】
The music score of Chinese operas is the music score of Chinese operas, is the regular combination for the various written symbols for recording music, pitch or rhythm, for example, Our usually common numbered musical notation, staff, guitar spectrum, seven-stringed plucked instrument in some ways similar to the zither spectrums etc. various modern or ancient times the music score of Chinese operas can be called The music score of Chinese operas.
Musical instrument class teaching method using the music score of Chinese operas as main contents, due to the complexity of its content of courses, and teaching scene Variation for example, play demonstration, action explanation etc. so that this musical instrument class teaching method is difficult to use online teaching pattern, I.e. director is carried out performance demonstration, music score of Chinese operas explanation to multiple players online, is acted and said based on the music score of Chinese operas showed to player The online teaching task such as solution, classroom interactions, the teaching of the musical instrument such as piano class is caused slowly to fail to enter online teaching category.
Therefore, need badly and a kind of implementation method of Online class is provided, to realize the Online class of musical instrument class teaching.
【The content of the invention】
The many aspects of the present invention provide a kind of implementation method and device of Online class, with realize the teaching of musical instrument class Line classroom.
An aspect of of the present present invention, there is provided a kind of implementation method of Online class, including:
Obtain the Online class pattern of musical instrument class teaching;
If the Online class pattern is intelligent training mate pattern, player is obtained according to the performance task arranged, is played Specify the detection actuation of keys of keyboard;
Acted according to the button model of the detection actuation of keys and the specified keyboard built in advance, drilled described in acquisition The performance situation for the person of playing;
According to the performance situation of the player, evaluation process is carried out, to obtain the evaluation result of the player.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, the acquisition are drilled For the person of playing according to the performance task arranged, the detection actuation of keys of keyboard is specified in performance, including:
Obtain the player that the first image collecting device is gathered and keyboard is specified according to the performance task arranged, performance Keyboard image;According to the player that described first image harvester is gathered according to the performance task arranged, play and specify The reference picture of the keyboard image of keyboard and the specified keyboard built in advance, the detection button for obtaining the specified keyboard move Make;Or
The player that at least two second image collecting devices are gathered is obtained according to the performance task arranged, performance to be referred to Determine the keyboard image of keyboard;Drilled according to the player that at least two second image collecting device is gathered according to what is arranged Task is played, plays the keyboard image for specifying keyboard, obtains and plays anaglyph;Build according to the performance anaglyph and in advance The specified keyboard reference anaglyph, obtain the detection actuation of keys of the specified keyboard.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, it is described according to institute The performance situation of player is stated, carries out evaluation process, after obtaining the evaluation result of the player, in addition to:
Export the evaluation result of the player.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, it is described to obtain pleasure After the Online class pattern of device class teaching, in addition to:
If the Online class pattern is class's class pattern, obtains and specify music score of Chinese operas file;
According to the specified music score of Chinese operas file, at least one music score of Chinese operas element is obtained;
According to each music score of Chinese operas element at least one music score of Chinese operas element, the music score of Chinese operas pair of acquisition each music score of Chinese operas element As;The music score of Chinese operas object of each music score of Chinese operas element includes each music score of Chinese operas attribute of an element information and each music score of Chinese operas element Layout information;
Export the music score of Chinese operas object of each music score of Chinese operas element.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, it is described to obtain pleasure After the Online class pattern of device class teaching, in addition to:
If the Online class pattern is one-to-one training mate pattern, the communication link established between director and the player Connect;
Based on the communication connection, information exchange service is provided to the director and the player.
Another aspect of the present invention, there is provided a kind of realization device of Online class, including:
Pattern acquiring unit, for obtaining the Online class pattern of musical instrument class teaching;
Mode processing units, if being intelligent training mate pattern for the Online class pattern, player is obtained according to institute's cloth The performance task put, play the detection actuation of keys for specifying keyboard;
Situation acquiring unit, for the button mould according to the detection actuation of keys and the specified keyboard built in advance Type acts, and obtains the performance situation of the player;
Evaluation process unit, for the performance situation according to the player, evaluation process is carried out, to obtain the performance The evaluation result of person.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, at the pattern Unit is managed, is specifically used for
Obtain the player that the first image collecting device is gathered and keyboard is specified according to the performance task arranged, performance Keyboard image;According to the player that described first image harvester is gathered according to the performance task arranged, play and specify The reference picture of the keyboard image of keyboard and the specified keyboard built in advance, the detection button for obtaining the specified keyboard move Make;Or
The player that at least two second image collecting devices are gathered is obtained according to the performance task arranged, performance to be referred to Determine the keyboard image of keyboard;Drilled according to the player that at least two second image collecting device is gathered according to what is arranged Task is played, plays the keyboard image for specifying keyboard, obtains and plays anaglyph;Build according to the performance anaglyph and in advance The specified keyboard reference anaglyph, obtain the detection actuation of keys of the specified keyboard.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, at the evaluation and test Unit is managed, is additionally operable to
Export the evaluation result of the player.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, at the pattern Unit is managed, is additionally operable to
If the Online class pattern is class's class pattern, obtains and specify music score of Chinese operas file;
According to the specified music score of Chinese operas file, at least one music score of Chinese operas element is obtained;
According to each music score of Chinese operas element at least one music score of Chinese operas element, the music score of Chinese operas pair of acquisition each music score of Chinese operas element As;The music score of Chinese operas object of each music score of Chinese operas element includes each music score of Chinese operas attribute of an element information and each music score of Chinese operas element Layout information;And
Export the music score of Chinese operas object of each music score of Chinese operas element.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, at the pattern Unit is managed, is additionally operable to
If the Online class pattern is one-to-one training mate pattern, the communication link established between director and the player Connect;And
Based on the communication connection, information exchange service is provided to the director and the player.
As shown from the above technical solution, the embodiment of the present invention is under intelligent training mate pattern, by obtaining player according to institute The performance task of arrangement, the detection actuation of keys for specifying keyboard is played, and then according to the detection actuation of keys and advance structure The specified keyboard the action of button model, obtain the performance situation of the player, enabling according to the player Performance situation, carry out evaluation process, to obtain the evaluation result of the player, can truly reduce musical instrument class training field Scape, it is achieved thereby that the Online class of musical instrument class teaching.
In addition, using technical scheme provided by the present invention, performance situation that can simultaneously to multiple players is commented Survey is handled, and to obtain the evaluation result of multiple players, musical instrument class exercise scene can be truly reduced, it is achieved thereby that musical instrument class More people's Online class of teaching.
In addition, using technical scheme provided by the present invention, the keyboard image of keyboard is specified by being played according to player, Reproduce player and play the keyboard state for specifying keyboard, it is achieved thereby that the mesh of the keyboard action of button kind musical instrument such as detection piano 's.
In addition, using technical scheme provided by the present invention, by the key that specified keyboard is played according to the player of plane Disk image, the performance anaglyph of reconstructed stereoscopic, enabling clearly reduce player and play the keypad space for specifying keyboard State, it is achieved thereby that the purpose of the keyboard action of button kind musical instrument such as detection piano.
In addition, using technical scheme provided by the present invention, under class's class pattern, due to by included in music score of Chinese operas file Music score of Chinese operas element carries out objectification to obtain music score of Chinese operas object separate one by one, enabling according to any display device can Viewing area, it is adaptive to carry out the related output of online teaching task and operated, it is achieved thereby that director is based on to performance The music score of Chinese operas that person is showed, it is online to carry out performance demonstration, music score of Chinese operas explanation, action explanation, classroom interactions etc. to multiple players online Teaching task.
In addition, using technical scheme provided by the present invention, under one-to-one training mate pattern, director can be realized with drilling Targetedly individually communication between the person of playing, so as to effectively increase the playing effect of player.
In addition, using technical scheme provided by the present invention, Consumer's Experience can be effectively lifted.
【Brief description of the drawings】
Technical scheme in order to illustrate the embodiments of the present invention more clearly, below will be to embodiment or description of the prior art In the required accompanying drawing used be briefly described, it should be apparent that, drawings in the following description be the present invention some realities Example is applied, for those of ordinary skill in the art, without having to pay creative labor, can also be attached according to these Figure obtains other accompanying drawings.
Fig. 1 is the schematic flow sheet of the implementation method for the Online class that one embodiment of the invention provides;
Fig. 2 is the structural representation of the realization device for the Online class that another embodiment of the present invention provides.
【Embodiment】
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention In accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is Part of the embodiment of the present invention, rather than whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art The whole other embodiments obtained under the premise of creative work is not made, belong to the scope of protection of the invention.
It should be noted that terminal involved in the embodiment of the present invention can include but is not limited to mobile phone, individual digital Assistant (Personal Digital Assistant, PDA), radio hand-held equipment, tablet personal computer (Tablet Computer), PC (Personal Computer, PC), MP3 player, MP4 players, wearable device (for example, intelligent glasses, Intelligent watch, Intelligent bracelet etc.) etc..
In addition, the terms "and/or", only a kind of incidence relation for describing affiliated partner, represents there may be Three kinds of relations, for example, A and/or B, can be represented:Individualism A, while A and B be present, these three situations of individualism B.Separately Outside, character "/" herein, it is a kind of relation of "or" to typically represent forward-backward correlation object.
Fig. 1 is the schematic flow sheet of the implementation method for the Online class that one embodiment of the invention provides, as shown in Figure 1.
101st, the Online class pattern of musical instrument class teaching is obtained.
The Online class pattern of musical instrument class teaching provided by the present invention can include but is not limited to intelligent training mate pattern, class At least one of in class pattern and one-to-one training mate pattern, the present embodiment is to this without being particularly limited to.
Class's class pattern, refer to that director can see the real-time exercise picture of all players, all performances simultaneously It can be seen that director's instructs picture, director's person can unite on Online class to given content such as some music score of Chinese operas One explains and demonstrates, and then arranges that exercise is performance task, for example, playing song, playing mode (departure), playing speed, drill Play pass etc..
In class's class pattern, different performance tasks can be arranged, for example, pin according to the actual conditions of different players For the player relatively low to qualification, it can arrange that the performance task of identification of spectrogram pattern requires that player's emphasis is played correctly Each note, specifically can easily occur the position of interim card, and player with recording performance person in the ripe of each position of song Practice the detection actuation of keys of the specified keyboards such as degree;Or for another example for for the higher player of qualification, can be with The performance task of the corresponding beat of arrangement requires player and specified song is played according to fixed beat, and culture player is slapping Timing is grasped while holding pitch accuracy, can specifically be referred to the exercise number of recording performance person, wrong sound mistake rhythm situation etc. Determine the detection actuation of keys of keyboard.
The intelligent training mate pattern, refer to after director arranges performance task to all players, all performances Person just switches into intelligent training mate pattern, first, can be automatically loaded the performance task that director is arranged, then, start to gather The exercise data of player are to play the detection actuation of keys for specifying keyboard, the button with the specified keyboard constructed before Model action carries out real time contrast, analyzes the actuation of keys each time of player, obtains the performance situation of the player, example Such as, the key-case such as the exercise progress of player, exercise duration, wrong sound situation, wrong rhythm situation, and then according to the player Performance situation, carry out evaluation process, to obtain the evaluation result of the player.At the same time it can also described in further basis The evaluation result of player provides auxiliary exercise method, to help player to carry out more specification and efficient exercise.
In intelligent training mate pattern, if player completes the performance task that director arranged or player complete During the performance task arranged into director, the problems such as running into emphasis, difficult point, one-to-one accompany can be entered with trigger request Practice pattern, individually linked up with director.
In intelligent training mate pattern, evaluation result can be synchronized to director in real time and be showed, and then automatic triggering Into patrolling class pattern.In class pattern is patrolled, director can enter one-to-one accompany according to the evaluation result of player, trigger request Practice pattern, individually linked up with player.
The pair of training mate pattern, refer to the video that director can be with real time inspection player under intelligent training mate pattern Playback and evaluation result, in order to have more specific aim when individually instructing player.Director can demonstrate explanation player encounter Some emphasis, difficult point the problems such as, to help player to have more deep understanding and results of learning.
If the 102, the Online class pattern is intelligent training mate pattern, player is obtained according to the performance task arranged, Play the detection actuation of keys for specifying keyboard.
It is understood that a player can only be obtained according to the performance task arranged, play and specify keyboard Actuation of keys is detected, or multiple player persons can also be obtained simultaneously according to the performance task arranged, plays and specifies keyboard Detection actuation of keys, the present embodiment is to this without being particularly limited to.
103rd, acted according to the button model of the detection actuation of keys and the specified keyboard built in advance, obtain institute State the performance situation of player.
Wherein, the performance situation of the player, player can be included but is not limited to and play pressing for the specified keyboard Key situation, the present embodiment is to this without being particularly limited to.
104th, according to the performance situation of the player, evaluation process is carried out, to obtain the evaluation result of the player.
In above-mentioned Online class pattern, using technical scheme provided by the present invention, a pair of effectively support is not only able to More musical instrument class teaching scenes, while the performance situation to multiple players, carry out evaluation process, to obtain multiple players' Evaluation result, additionally it is possible to more targetedly improve man-to-man musical instrument class teaching scene.
It should be noted that 101~104 executive agent can be partly or entirely the application for being located locally terminal, Or can also be the plug-in unit being arranged in the application of local terminal or SDK (Software Development Kit, SDK) etc. functional unit, can also be either processing engine in network side server or Can also be the distributed system positioned at network side, the present embodiment is to this without being particularly limited to.
It is understood that the application can be mounted in the local program (nativeApp) in terminal, or may be used also To be a web page program (webApp) of browser in terminal, the present embodiment is to this without limiting.
So, under intelligent training mate pattern, by obtaining player according to the performance task arranged, play and specify keyboard Detection actuation of keys, and then moved according to the detection actuation of keys and the button model of the specified keyboard built in advance Make, obtain the performance situation of the player, enabling according to the performance situation of the player, evaluation process is carried out, with Obtain the evaluation result of the player, can truly reduce musical instrument class exercise scene, it is achieved thereby that musical instrument class teaching Line classroom.
Alternatively, in a possible implementation of the present embodiment, in 102, the first image can specifically be obtained The player that harvester is gathered plays the keyboard image for specifying keyboard according to the performance task arranged, and then, then can be with According to the player that described first image harvester is gathered according to the performance task arranged, the keyboard for specifying keyboard is played The reference picture of image and the specified keyboard built in advance, obtain the detection actuation of keys of the specified keyboard.So, may be used Played with the player gathered by contrasting obtained described first image harvester the keyboard image of specifying keyboard and The reference picture of the specified keyboard built in advance, as long as the player that described first image harvester is gathered plays assignment key Part is had differences between the keyboard image and reference picture of disk, it is possible to by the button corresponding to the difference section, is defined as The button is pressed.
In the implementation, the keyboard image of keyboard is specified by being played according to player, player's performance is reproduced and specifies The keyboard state of keyboard, it is achieved thereby that the purpose of the keyboard action of button kind musical instrument such as detection piano.
So-called first image collecting device, can specifically imaging sensor be used to realize.Wherein, described image sensor It can be charge coupled cell (Charge Coupled Device, CCD) sensor, or can also be metal oxide half Conductor element (Complementary Metal-Oxide Semiconductor, CMOS) sensor, the present embodiment do not enter to this Row is particularly limited to.If detecting current light than dark, further keyboard can also be specified to carry out on object to be collected Light filling processing, for example, opening light emitting diode (Light Emitting Diode, LED) light compensating lamp.
In the implementation, where used first image collecting device can be arranged on specified keyboard in equipment, It is fixed using supporting structure set in equipment.For example, support unit set in the string storehouse lid plane of piano, etc. Deng.
Wherein, the specified keyboard can include but is not limited to the first key area and the second key area, the present embodiment To this without being particularly limited to.
Specifically, first key area can be the intermediate region of the specified keyboard, correspondingly, described second Key area can be then in the beside of the intermediate region both sides in the specified keyboard.
Wherein, first key area can include but is not limited at least one first button and described at least one Mark in one button set by the specified location of each first button.Specifically, the specific bit of each first button The paster of particular geometric figure can be included but is not limited to by putting set mark.For example, in the keyboard intermediate region of piano One dot is set on button, black round dot is set on white key, white round dot is set on black key.
Second key area can include but is not limited at least one second button.
Specifically, described first image harvester, the surface of first key area can be specifically arranged at.
So, correspondingly, specifically can be according to the keyboard of first key area during a concrete implementation The ginseng of mark and first key area built in advance described in image set by the specified location of each first button The mark set by the specified location of each first button described in image is examined, obtains the displacement feelings of each first button Condition, and then, then can be according to the misalignment of each first button, the detection button for obtaining first key area moves Make.In the implementation process, specifically button detection can be carried out, to obtain each first button according to the position of mark Misalignment.
So, alternatively, specifically can be according to second key area during another concrete implementation Each second button at least one second button described in keyboard image, obtain each second button and second pressed by other The circumstance of occlusion of key, and then, then it can be built according to each second button by the circumstance of occlusion of other buttons and in advance Each second button described in the reference picture of second key area is by the circumstance of occlusion of other the second buttons, described in acquisition The detection actuation of keys of second key area.In the implementation process, it can specifically be carried out according to the key features of diverse location Button detects, to obtain the misalignment of each second button.
Further, in the implementation, the inter-frame information method of difference, color character analytic approach can also further be used Etc. processing method, the hand of player is split, so, then can be according to the hand being partitioned into, estimating may quilt The button pressed, so, then image scanning, the i.e. key to the specified button can be carried out to the key area that may be pressed The key area that may be pressed in disk image corresponds to key area with the reference picture of the specified button built in advance Images match is carried out, can effectively avoid the technology that sweep time is grown caused by specifying the full keyboard image scanning of keyboard Problem, so as to improve the efficiency of the realization of Online class.
In this implementation, the reference picture of used specified keyboard, it is necessary to be built in advance.Specifically, have Body can be analyzed using standard picture, obtain the standard flat image that normal data specifies keyboard.So, obtaining , can be to analyze the keyboard image to be detected of arbitrary specified keyboard, as long as to be checked after the standard flat image for specifying keyboard Surveying between keyboard image and standard flat image has difference, then can analyze actuation of keys.
Specifically, position and angle of the first image collecting device etc. by man-machine interaction, can be specifically adjusted, Ensure that gatherer process meets the requirement of vision algorithm analysis.First image collecting device, branch set in equipment can be used Frame structure is fixed.For example, support unit set in the string storehouse lid plane of piano, etc..Supporting structure allows to One image collecting device carries out the adjustment such as upper and lower, front and rear and angle.In the laying of the first initial image collecting device, to it Approximate location have certain requirement.For example, the first image collecting device needs to be arranged on the upper of the centre position of specified keyboard Side;By adjusting position and/or the angle of the first image collecting device, ensure to specify all images of keyboard to be collected.
, it is necessary to Real-time Feedback problem in building process, and prompt to carry out the adjustment of the first image collecting device.For example, The height fine adjusting function of first image collecting device, front and rear fine setting, gradient fine setting and site light environment adjustment, etc..
, can after the standard picture for the specified keyboard that the first image collecting device after being adjusted is gathered The pretreatment operation such as dry is gone further to carry out image cutting-out, image gray processing and image to the standard picture.Then, may be used Further to utilize maximum between-cluster variance (OTSU) algorithm or improved OTSU algorithms etc., in the standard after pre-processing Keyboard detection is carried out in image, and is partitioned into keyboard envelope.Then, algorithm of region growing or improved region can be utilized to give birth to Long algorithm etc., it is partitioned into each button.
Alternatively, in a possible implementation of the present embodiment, in 102, at least two can specifically be obtained The player that second image collecting device is gathered plays the keyboard image for specifying keyboard, entered according to the performance task arranged And then can according to the player that at least two second image collecting device is gathered according to the performance task arranged, The keyboard image for specifying keyboard is played, obtains and plays anaglyph, according further to the performance anaglyph and advance structure The reference anaglyph for the specified keyboard built, obtain the detection actuation of keys of the specified keyboard.So, can be by right Than the performance anaglyph of specified keyboard and the reference anaglyph of the specified keyboard built in advance obtained, regarded as long as playing Part is had differences between difference image and reference anaglyph, it is possible to by the button corresponding to the difference section, is defined as this Button is pressed.
In the implementation, the keyboard image of keyboard is specified by being played according to the player of plane, reconstructed stereoscopic is drilled Play anaglyph, enabling clearly reduce player and play the keypad space state for specifying keyboard, it is achieved thereby that detection The purpose of the keyboard action of the button kind musical instrument such as piano.
So-called second image collecting device, can specifically imaging sensor be used to realize.Wherein, described image sensor It can be charge coupled cell (Charge Coupled Device, CCD) sensor, or can also be metal oxide half Conductor element (Complementary Metal-Oxide Semiconductor, CMOS) sensor, the present embodiment do not enter to this Row is particularly limited to.If detecting current light than dark, further keyboard can also be specified to carry out on object to be collected Light filling processing, for example, opening light emitting diode (Light Emitting Diode, LED) light compensating lamp.
In the implementation, the quantity of used second image collecting device can be with the centre bit of target object Be set to center, symmetrically arranged two, or can also be centered on the center of target object, it is symmetrically arranged more Individual, the parallax that the position that each second image collecting device is placed needs to meet to pre-set sets distance, the present embodiment pair This is without being particularly limited to.So-called parallax, refer to that same target object is produced from two points for having certain distance Raw direction difference.
Specifically, the second image collecting device, where specified keyboard can be arranged in equipment, using set in equipment The supporting structure put is fixed.For example, support unit set in the string storehouse lid plane of piano, etc..
Due to being multiple second image collecting devices while gathering the image i.e. keyboard image of same target object, because This to these second image collecting devices, it is necessary to carry out debugging processing, to ensure collected keyboard image as standardization figure Picture.So-called standardized images, refer to that the keyboard image that each second image collecting device is gathered has synchronizing characteristics, example Such as, identical image quality, synchronous triggering collection, identical image parameter such as, size, port number, bit depth, orientation etc..
Specifically, two of the left side of equipment where being separately positioned on the specified keyboard and the right the can specifically be obtained The player that two image collecting devices are gathered plays the keyboard image for specifying keyboard.
In this implementation, the reference anaglyph of used specified keyboard, it is necessary to be built in advance.It is specific next Say, can specifically be analyzed using standard picture, obtain the standard stereo image that normal data specifies keyboard.So, exist , can be to analyze the keyboard image to be detected of arbitrary specified keyboard, only after the standard stereo image for obtaining specified keyboard Want have difference between keyboard image and standard stereo image to be detected, then can analyze actuation of keys.
Specifically, position and angle of the second image collecting device etc. by man-machine interaction, can be specifically adjusted, Ensure that gatherer process meets the requirement of vision algorithm analysis.Second image collecting device, branch set in equipment can be used Frame structure is fixed.For example, support unit set in the string storehouse lid plane of piano, etc..Supporting structure allows to Two image collecting devices carry out the adjustment such as upper and lower, front and rear and angle.In the laying of the second initial image collecting device, to it Approximate location have certain requirement.For example, the second image collecting device needs to be arranged on the upper of the centre position of specified keyboard Side;By adjusting position and/or the angle of the second image collecting device, ensure to specify all images of keyboard to be collected.
, it is necessary to Real-time Feedback problem in building process, and prompt to carry out the adjustment of the second image collecting device.For example, The height fine adjusting function of second image collecting device, front and rear fine setting, gradient fine setting and site light environment adjustment, etc..
, can after the standard picture for the specified keyboard that the second image collecting device after being adjusted is gathered The pretreatment operation such as dry is gone further to carry out image cutting-out, image gray processing and image to the standard picture.Then, may be used Further to utilize maximum between-cluster variance (OTSU) algorithm or improved OTSU algorithms etc., in the standard after pre-processing Keyboard detection is carried out in image, and is partitioned into keyboard envelope.Then, algorithm of region growing or improved region can be utilized to give birth to Long algorithm etc., it is partitioned into each button.
In the present invention, because the second image collecting device distance objective object is the distance and target object of specified keyboard Ratio between overall width is smaller so that the angle of view of the second image collecting device needs to meet that a certain size can Collect all images of target object.Assuming that the second image collecting device placing height is at 50 centimetres, (distance specifies keyboard institute Plane) left and right, and need gather image width be 150 cms.Drawn by repetition test, the second IMAQ The angle of view of device needs just collect all images of specified keyboard when being more than 150 °.Due to the second IMAQ The angle of view of device has larger angle so that can cause larger optical distortion, in the keyboard image gathered Obvious fisheye effect occurs in edge.Therefore, it is necessary to be carried out to acquired keyboard image after keyboard image is got Distortion correction processing.Specifically, the player that can be specifically gathered at least two second image collecting device drills The keyboard image of specified keyboard is played, distortion correction processing is carried out, to obtain at least two changing images.And then then can basis At least two changing image, obtain and play anaglyph.
, specifically can be according to the performance anaglyph and the specified keyboard that builds in advance in the implementation With reference to anaglyph, the difference section of acquisition each button, and then, then can be according to the difference portion of each button Point, the detection actuation of keys of the acquisition specified keyboard.
Further, in the implementation, the inter-frame information method of difference, color character analytic approach can also further be used Etc. processing method, the hand of player is split, so, then can be according to the hand being partitioned into, estimating may quilt The button pressed, so, then image scanning can be carried out to the key area that may be pressed, i.e., the specified button be drilled It is corresponding with the reference anaglyph of the specified button built in advance to play the key area that may be pressed in anaglyph Key area carries out images match, can effectively avoid the sweep time caused by specifying the full keyboard image scanning of keyboard Long technical problem, so as to improve the efficiency of the realization of Online class.
Alternatively, in a possible implementation of the present embodiment, in 103, the detection can specifically be pressed The button model action for the specified keyboard that key is acted and built in advance is compared processing.If the inspection of the specified keyboard The button model for surveying actuation of keys and current reference is kept strokes, then can illustrate that player plays the button of the specified keyboard Situation is standard key situation;If the detection actuation of keys of the specified keyboard and the button model action of current reference differ Cause, then the key-case that the player plays the specified keyboard can be obtained, for example, differing according to inconsistent situation The place of cause is fewer, then illustrates that the key-case of player's performance specified keyboard is better, inconsistent place is more, then says The key-case that bright player plays the specified keyboard is poorer.
During a concrete implementation, obtain the player play the specified keyboard key-case it Afterwards, the key-case that the player plays the specified keyboard can also further be exported.So, by according to being obtained The detection actuation of keys of keyboard and the button model action of current reference are specified, player is obtained and plays pressing for the specified keyboard Key situation, and then the key-case is exported, it can effectively strengthen the visualization of the realization of Online class.
Specifically, it can specifically obtain the player that video acquisition device is gathered and play the specified keyboard Original video information, and then, then pressing for the specified keyboard can be played according to the original video information and the player Key situation, the sharing video frequency information is obtained, and export the sharing video frequency information.
Wherein, video acquisition device, where specified keyboard can be arranged in equipment, using support set in equipment Structure is fixed.For example, support unit set in the string storehouse lid plane of piano, etc..
Alternatively, in a possible implementation of the present embodiment, after 104, institute can also further be exported The evaluation result of player is stated, so that director is according to the evaluation result, associative operation is carried out, for example, trigger request enters one To a training mate pattern, individually linked up with player.
Alternatively, in a possible implementation of the present embodiment, after 101, if the Online class pattern For class's class pattern, then specified music score of Chinese operas file can be further obtained, and then, then it can be obtained according to the specified music score of Chinese operas file At least one music score of Chinese operas element, and according to each music score of Chinese operas element at least one music score of Chinese operas element, obtain each music score of Chinese operas The music score of Chinese operas object of element;Wherein, the music score of Chinese operas object of each music score of Chinese operas element includes each music score of Chinese operas attribute of an element information With the layout information of each music score of Chinese operas element.Then, then the music score of Chinese operas object of each music score of Chinese operas element can be exported, for example, Can be in the music score of Chinese operas object of locally output each music score of Chinese operas element, to realize local viewing music score of Chinese operas file, or can also be Remotely to the music score of Chinese operas object of multiple beholders output each music score of Chinese operas element, to realize that long-range online of director shares the music score of Chinese operas File, the present embodiment is to this without being particularly limited to.
Due to the music score of Chinese operas element included in music score of Chinese operas file is carried out into objectification to obtain the music score of Chinese operas separate one by one Object, enabling according to any display device can viewing area, it is adaptive carry out the related output of online teaching task and Operated, it is achieved thereby that director is based on the music score of Chinese operas showed to player, online to multiple players carry out performance demonstration, The online teaching tasks such as music score of Chinese operas explanation, action explanation, classroom interactions.
In the implementation, " specified " two word in involved specified music score of Chinese operas file, not particular meaning, be exactly for Current file destination is specified, it is therefore intended that music score of Chinese operas file is exactly common music score of Chinese operas file, can be printed copy Papery music score of Chinese operas file, or can also be the electronic score file of the electronic score file such as MusicXML forms of electronic version Deng the present embodiment is to this without being particularly limited to.
The so-called music score of Chinese operas, refer to a kind of method that music is recorded with symbol.Different culture and regional development difference Recording method, recording method can be divided into record pitch method and record fingering method this two classes method.Staff and numbered musical notation Belong to the music score of Chinese operas of record pitch, six line spectrums of guitar and the music score of Chinese operas for subtracting word spectrum and belonging to record fingering of seven-stringed plucked instrument in some ways similar to the zither.
So-called music score of Chinese operas element, it is exactly the record symbol of used record music, time signature can be included but is not limited to, adjusted Number, all kinds of notes and play symbol in it is at least one, the present embodiment is to this without being particularly limited to.Wherein, it is described each The music score of Chinese operas object of music score of Chinese operas element can include but is not limited to each music score of Chinese operas attribute of an element information and each music score of Chinese operas member The layout information of element, the present embodiment is to this without being particularly limited to.
Wherein, each music score of Chinese operas attribute of an element information can include but is not limited to the element of each music score of Chinese operas element The element type of title and each music score of Chinese operas element, the present embodiment is to this without being particularly limited to.
Wherein, the layout information of each music score of Chinese operas element can include but is not limited to the element of each music score of Chinese operas element The element position of size and each music score of Chinese operas element, the present embodiment is to this without being particularly limited to.
, can be in each music score of Chinese operas element in order to avoid overlapping between music score of Chinese operas element during a concrete implementation Outside or inner periphery set a sightless encirclement frame element, as a rule, can use rectangle, square, triangle The regular planar graph such as shape is as encirclement frame element.Therefore, the element size of each music score of Chinese operas element, it can be understood as music score of Chinese operas member The size of encirclement frame element belonging to element.
After the music score of Chinese operas object of each music score of Chinese operas element is obtained, each music score of Chinese operas member that can also further to being obtained The music score of Chinese operas object of element, carries out storage processing.Wherein, storage form can use but be not limited to the storage shape of tree form data structure Formula, the present embodiment is to this without being particularly limited to.
Specifically, can by the music score of Chinese operas object of each music score of Chinese operas element obtained, in the storage device of local terminal, Carry out that processing is locally stored, or can also be by the storage of the music score of Chinese operas object, beyond the clouds terminal of each music score of Chinese operas element obtained In equipment, long-range storage processing is carried out, to feed to the music score of Chinese operas object that other-end provides each music score of Chinese operas element stored, this reality Example is applied to this without being particularly limited to.
During a concrete implementation, the storage device of the terminal can be slow storage device, specifically can be with For the hard disk of computer system, or can also be that the inoperative internal memory of mobile phone be physical memory, for example, read-only storage (Read-Only Memory, ROM) and RAM card etc., the present embodiment is to this without being particularly limited to.
During another concrete implementation, the storage device of the terminal can also be speedy storage equipment, specifically It can be the internal memory of computer system, or can also be Installed System Memory for the running memory of mobile phone, for example, random access memory (Random Access Memory, RAM) etc., the present embodiment is to this without being particularly limited to.
In the implementation, can specifically obtain display device can viewing area display size data, and then, then The music score of Chinese operas object placement parameter pre-set can be obtained, enabling according to the display size data and the music score of Chinese operas object Layout parameter, in the music score of Chinese operas object that each music score of Chinese operas element in viewing area, can be exported.Before this, can also enter One step pre-sets music score of Chinese operas object placement parameter, for example, the parameter such as music score of Chinese operas object minimum spacing.Correspondingly, specifically can be two On dimensional plane, according to music score of Chinese operas tradition typesetting rule, optimal branch is calculated using dynamic programming algorithm, then, to music score of Chinese operas object Carry out Dynamic iterations, calculate display device face to face can in viewing area each music score of Chinese operas object placement position, solve not The problem of with music score of Chinese operas file is shared on the display device of size.
Specifically, due to different display devices can the size of viewing area be not completely the same, but with one Fixed gap, therefore, can according to different display devices can viewing area size, the music score of Chinese operas file institute shown to needs is right The music score of Chinese operas object answered carries out auto arrangement, enabling according to any display device can viewing area, it is adaptive carry out it is online The related output of teaching task and operated.
After the music score of Chinese operas object of each music score of Chinese operas element is exported, it can also further obtain user i.e. director or drill The person of playing to the Action Events of the specified music score of Chinese operas object exported, and then, then can according to the Action Events, obtain operation pair As, wherein, the operation object includes operation content and the specified music score of Chinese operas object.It is then possible to according to the operation object, Corresponding operating is performed on the specified music score of Chinese operas object exported.
So-called Action Events, selection music score of Chinese operas object can be included but is not limited to, the paragraph of music score of Chinese operas object is selected, select to press Beat walks spectrum, adjustment music score of Chinese operas object color, adjustment music score of Chinese operas object's position and amplification/diminution music score of Chinese operas object, and the present embodiment is to this Without being particularly limited to.
In the implementation, by according to acquired user to the Action Events of the specified music score of Chinese operas object exported, Operation object is obtained, the operation object includes operation content and the specified music score of Chinese operas object, enabling according to the operation Object, corresponding operating is performed on the specified music score of Chinese operas object exported, due to the music score of Chinese operas included in music score of Chinese operas file is first Element carries out objectification to obtain music score of Chinese operas object separate one by one, then can be according to the Action Events of objectification i.e. operation pair As the corresponding operating of execution operation object on the specified music score of Chinese operas object exported, enabling to any music score of Chinese operas object The related operation of online teaching task is carried out, it is achieved thereby that director is based on the music score of Chinese operas showed to player, online to more Individual player carries out the online teaching tasks such as performance demonstration, music score of Chinese operas explanation, action explanation, classroom interactions.
Wherein, it the operation object obtained, can be an operation object, or can also be that multiple operation objects are grasped Make object sequence, the present embodiment is to this without being particularly limited to.
In a possible implementation process, the same of corresponding operating is performed on the specified music score of Chinese operas object exported When, the multi-medium data that the user is triggered can also be further obtained, the multi-medium data includes video data and sound At least one of frequency in, and then, then processing can be associated to the operation object and the multi-medium data, to obtain Obtain associated data.It is then possible to export the associated data.
Specifically, specifically the associated data can be locally being exported, to realize local viewing music score of Chinese operas file, or may be used also Remotely to export the music score of Chinese operas object of each music score of Chinese operas element, long-range online share music score of Chinese operas file, the present embodiment to realize To this without being particularly limited to.
In the implementation process, the corresponding operating of execution operation object is same on the specified music score of Chinese operas object exported When, the multi-medium data that is also further triggered by obtaining the user, the multi-medium data includes video data and sound At least one of frequency in, and then can then processing be associated to the operation object and the multi-medium data, to obtain Associated data, enabling by the content of courses during online teaching be user to the behaviour of the specified music score of Chinese operas object exported Make the image related with the content of courses that event triggered to user and/or sound associates, during by online teaching The corelation behaviour of user is mapped directly on the music score of Chinese operas object of correlation, and online teaching is intuitively visualized so as to form.
In the implementation process, it can specifically obtain the user that at least two multimedia collection devices are gathered and touch The multi-medium data of hair.
Specifically, media multimedia harvester, can be made up of image collecting device and voice collection device.
So-called image collecting device, can specifically imaging sensor be used to realize.Wherein, described image sensor can be with For charge coupled cell (Charge Coupled Device, CCD) sensor, or it can also be metal-oxide semiconductor (MOS) Element (Complementary Metal-Oxide Semiconductor, CMOS) sensor, the present embodiment is to this without spy Do not limit.If detecting current light than dark, further keyboard can also be specified to carry out light filling on object to be collected Processing, for example, opening light emitting diode (Light Emitting Diode, LED) light compensating lamp.
Purpose using multiple multimedia collection devices is to shoot complete musical instrument class teaching scene such as Piano Teaching field Scape etc..By taking Piano Teaching scene as an example, the function point for setting the camera of different angle to stress is different.
For example, shooting camera in front can be set, for the emotion communication during Piano Teaching, the upper half of player Figure gesture includes shoulder, large arm etc.;
Or for another example shooting camera directly over can setting, can use wide-angle lens, from key upper vertical Complete 88 keys of piano are shot, for shooting the pitch played, fingering and wrist movement etc.;
Or for another example side can be set to shoot camera, for shooting the large arm of player, forearm, wrist, hand Ramus volaris profundus support, folding refer to, lift refer to, tone hopping, various playing methods and the skill such as touching.
So-called voice collection device, can specifically microphone be used to realize.
In the implementation process, specifically the user institute can be obtained by wireless transmission method or wire transmission mode The multi-medium data of triggering.
In wire transmission mode, wired connection transferring equipment can be used, connection display device gathers with multiple images Device, by wire transmission mode, the multi-medium data that acquired user is triggered, carry out the religion during online teaching Learn the figure related with the content of courses that the Action Events that content is specified music score of Chinese operas object of the user to being exported are triggered to user The association process of picture and/or sound, association content can be made to reach Millisecond synchronization.
After the associated data after obtaining by association process, then associated data can be carried out at data frame encapsulation Reason, for follow-up transmission process.
In the implementation process, after associated data is obtained, it can also be stored further to the associated data Processing.Specifically, the associated data that will can be obtained, in the storage device of local terminal, carry out that processing is locally stored, Or the associated data that will can also be obtained, beyond the clouds in the storage device of terminal, carry out long-range storage processing, the present embodiment To this without being particularly limited to.
During a concrete implementation, the storage device of the terminal can be slow storage device, specifically can be with For the hard disk of computer system, or can also be that the inoperative internal memory of mobile phone be physical memory, for example, read-only storage (Read-Only Memory, ROM) and RAM card etc., the present embodiment is to this without being particularly limited to.
During another concrete implementation, the storage device of the terminal can also be speedy storage equipment, specifically It can be the internal memory of computer system, or can also be Installed System Memory for the running memory of mobile phone, for example, random access memory (Random Access Memory, RAM) etc., the present embodiment is to this without being particularly limited to.
Alternatively, in a possible implementation of the present embodiment, after 101, if the Online class pattern For one-to-one training mate pattern, then the communication connection that can be established between director and the player, and then, then it can be based on institute Communication connection is stated, information exchange service is provided to the director and the player.
In the implementation, between director and player, man-to-man proprietary communication can be based on and connected, carried out single Only information exchange, in such manner, it is possible to targetedly help player's fast lifting performance level.
In the present embodiment, under intelligent training mate pattern, referred to by obtaining player according to the performance task arranged, performance Determine the detection actuation of keys of keyboard, and then according to the detection actuation of keys and the button mould of the specified keyboard built in advance Type acts, and obtains the performance situation of the player, enabling according to the performance situation of the player, carry out at evaluation and test Reason, to obtain the evaluation result of the player, musical instrument class exercise scene can be truly reduced, it is achieved thereby that musical instrument class is imparted knowledge to students Online class.
In addition, using technical scheme provided by the present invention, performance situation that can simultaneously to multiple players is commented Survey is handled, and to obtain the evaluation result of multiple players, musical instrument class exercise scene can be truly reduced, it is achieved thereby that musical instrument class More people's Online class of teaching.
In addition, using technical scheme provided by the present invention, the keyboard image of keyboard is specified by being played according to player, Reproduce player and play the keyboard state for specifying keyboard, it is achieved thereby that the mesh of the keyboard action of button kind musical instrument such as detection piano 's.
In addition, using technical scheme provided by the present invention, by the key that specified keyboard is played according to the player of plane Disk image, the performance anaglyph of reconstructed stereoscopic, enabling clearly reduce player and play the keypad space for specifying keyboard State, it is achieved thereby that the purpose of the keyboard action of button kind musical instrument such as detection piano.
In addition, using technical scheme provided by the present invention, under class's class pattern, due to by included in music score of Chinese operas file Music score of Chinese operas element carries out objectification to obtain music score of Chinese operas object separate one by one, enabling according to any display device can Viewing area, it is adaptive to carry out the related output of online teaching task and operated, it is achieved thereby that director is based on to performance The music score of Chinese operas that person is showed, it is online to carry out performance demonstration, music score of Chinese operas explanation, action explanation, classroom interactions etc. to multiple players online Teaching task.
In addition, using technical scheme provided by the present invention, under one-to-one training mate pattern, director can be realized with drilling Targetedly individually communication between the person of playing, so as to effectively increase the playing effect of player.
In addition, using technical scheme provided by the present invention, Consumer's Experience can be effectively lifted.
It should be noted that for foregoing each method embodiment, in order to be briefly described, therefore it is all expressed as a series of Combination of actions, but those skilled in the art should know, the present invention is not limited by described sequence of movement because According to the present invention, some steps can use other orders or carry out simultaneously.Secondly, those skilled in the art should also know Know, embodiment described in this description belongs to preferred embodiment, and involved action and module are not necessarily of the invention It is necessary.
In the above-described embodiments, the description to each embodiment all emphasizes particularly on different fields, and does not have the portion being described in detail in some embodiment Point, it may refer to the associated description of other embodiment.
Fig. 2 is the structural representation of the realization device for the Online class that another embodiment of the present invention provides, as shown in Figure 2. The realization device of the Online class of the present embodiment can include pattern acquiring unit 21, mode processing units 22, situation and obtain list Member 23 and evaluation process unit 24.Wherein, pattern acquiring unit 21, for obtaining the Online class pattern of musical instrument class teaching;Mould Formula processing unit 22, if being intelligent training mate pattern for the Online class pattern, player is obtained according to the performance arranged Task, play the detection actuation of keys for specifying keyboard;Situation acquiring unit 23, for according to the detection actuation of keys and in advance The button model action of the specified keyboard of structure, obtain the performance situation of the player;Evaluation process unit 24, is used for According to the performance situation of the player, evaluation process is carried out, to obtain the evaluation result of the player.
It should be noted that the realization device for the Online class that the present embodiment is provided partly or entirely can be positioned at The application of local terminal, or can also be the plug-in unit or SDK being arranged in the application of local terminal Functional units such as (Software Development Kit, SDK), or can also be the processing in network side server Engine, or can also be the distributed system positioned at network side, the present embodiment is to this without being particularly limited to.
It is understood that the application can be mounted in the local program (nativeApp) in terminal, or may be used also To be a web page program (webApp) of browser in terminal, the present embodiment is to this without limiting.
Alternatively, in a possible implementation of the present embodiment, the mode processing units 22, can specifically use In
Obtain the player that the first image collecting device is gathered and keyboard is specified according to the performance task arranged, performance Keyboard image;According to the player that described first image harvester is gathered according to the performance task arranged, play and specify The reference picture of the keyboard image of keyboard and the specified keyboard built in advance, the detection button for obtaining the specified keyboard move Make;Or
The player that at least two second image collecting devices are gathered is obtained according to the performance task arranged, performance to be referred to Determine the keyboard image of keyboard;Drilled according to the player that at least two second image collecting device is gathered according to what is arranged Task is played, plays the keyboard image for specifying keyboard, obtains and plays anaglyph;Build according to the performance anaglyph and in advance The specified keyboard reference anaglyph, obtain the detection actuation of keys of the specified keyboard.
Alternatively, in a possible implementation of the present embodiment, the evaluation process unit 24, one can also be entered Walk the evaluation result for exporting the player.
Alternatively, in a possible implementation of the present embodiment, the mode processing units 22, one can also be entered If it is class's class pattern to walk for the Online class pattern, obtains and specify music score of Chinese operas file;According to the specified music score of Chinese operas file, obtain At least one music score of Chinese operas element;According to each music score of Chinese operas element at least one music score of Chinese operas element, each music score of Chinese operas element is obtained Music score of Chinese operas object;The music score of Chinese operas object of each music score of Chinese operas element includes each music score of Chinese operas attribute of an element information and described each The layout information of music score of Chinese operas element;And the music score of Chinese operas object of output each music score of Chinese operas element.
Alternatively, in a possible implementation of the present embodiment, the mode processing units 22, one can also be entered If it is one-to-one training mate pattern to walk for the Online class pattern, the communication link established between director and the player Connect;And based on the communication connection, information exchange service is provided to the director and the player.
It should be noted that method in embodiment corresponding to Fig. 1, the realization for the Online class that can be provided by the present embodiment Device is realized.The related content that may refer in embodiment corresponding to Fig. 1 is described in detail, here is omitted.
It is intelligent training mate mould in the Online class pattern of the musical instrument class teaching acquired in pattern acquiring unit in the present embodiment Under formula, mode processing units are played by obtaining player according to the performance task arranged and specify the detection button of keyboard to move Make, and then moved by situation acquiring unit according to the button model of the detection actuation of keys and the specified keyboard built in advance Make, obtain the performance situation of the player so that evaluation process unit can be carried out according to the performance situation of the player Evaluation process, to obtain the evaluation result of the player, musical instrument class exercise scene can be truly reduced, it is achieved thereby that musical instrument The Online class of class teaching.
In addition, using technical scheme provided by the present invention, performance situation that can simultaneously to multiple players is commented Survey is handled, and to obtain the evaluation result of multiple players, musical instrument class exercise scene can be truly reduced, it is achieved thereby that musical instrument class More people's Online class of teaching.
In addition, using technical scheme provided by the present invention, the keyboard image of keyboard is specified by being played according to player, Reproduce player and play the keyboard state for specifying keyboard, it is achieved thereby that the mesh of the keyboard action of button kind musical instrument such as detection piano 's.
In addition, using technical scheme provided by the present invention, by the key that specified keyboard is played according to the player of plane Disk image, the performance anaglyph of reconstructed stereoscopic, enabling clearly reduce player and play the keypad space for specifying keyboard State, it is achieved thereby that the purpose of the keyboard action of button kind musical instrument such as detection piano.
In addition, using technical scheme provided by the present invention, under class's class pattern, due to by included in music score of Chinese operas file Music score of Chinese operas element carries out objectification to obtain music score of Chinese operas object separate one by one, enabling according to any display device can Viewing area, it is adaptive to carry out the related output of online teaching task and operated, it is achieved thereby that director is based on to performance The music score of Chinese operas that person is showed, it is online to carry out performance demonstration, music score of Chinese operas explanation, action explanation, classroom interactions etc. to multiple players online Teaching task.
In addition, using technical scheme provided by the present invention, under one-to-one training mate pattern, director can be realized with drilling Targetedly individually communication between the person of playing, so as to effectively increase the playing effect of player.
In addition, using technical scheme provided by the present invention, Consumer's Experience can be effectively lifted.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description, The specific work process of device and unit, the corresponding process in preceding method embodiment is may be referred to, will not be repeated here.
In several embodiments provided by the present invention, it should be understood that disclosed system, apparatus and method can be with Realize by another way.For example, device embodiment described above is only schematical, for example, the unit Division, only a kind of division of logic function, can there is other dividing mode, such as multiple units or component when actually realizing Another system can be combined or be desirably integrated into, or some features can be ignored, or do not perform.It is another, it is shown or The mutual coupling discussed or direct-coupling or communication connection can be the indirect couplings by some interfaces, device or unit Close or communicate to connect, can be electrical, mechanical or other forms.
The unit illustrated as separating component can be or may not be physically separate, show as unit The part shown can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple On NE.Some or all of unit therein can be selected to realize the mesh of this embodiment scheme according to the actual needs 's.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, can also That unit is individually physically present, can also two or more units it is integrated in a unit.Above-mentioned integrated list Member can both be realized in the form of hardware, can also be realized in the form of hardware adds SFU software functional unit.
The above-mentioned integrated unit realized in the form of SFU software functional unit, can be stored in one and computer-readable deposit In storage media.Above-mentioned SFU software functional unit is stored in a storage medium, including some instructions are causing a computer It is each that equipment (can be personal computer, server, or network equipment etc.) or processor (processor) perform the present invention The part steps of embodiment methods described.And foregoing storage medium includes:USB flash disk, mobile hard disk, read-only storage (Read- Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disc or CD etc. it is various Can be with the medium of store program codes.
Finally it should be noted that:The above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations;Although The present invention is described in detail with reference to the foregoing embodiments, it will be understood by those within the art that:It still may be used To be modified to the technical scheme described in foregoing embodiments, or equivalent substitution is carried out to which part technical characteristic; And these modification or replace, do not make appropriate technical solution essence depart from various embodiments of the present invention technical scheme spirit and Scope.

Claims (10)

  1. A kind of 1. implementation method of Online class, it is characterised in that including:
    Obtain the Online class pattern of musical instrument class teaching;
    If the Online class pattern is intelligent training mate pattern, player is obtained according to the performance task arranged, plays and specifies The detection actuation of keys of keyboard;
    Acted according to the button model of the detection actuation of keys and the specified keyboard built in advance, obtain the player Performance situation;
    According to the performance situation of the player, evaluation process is carried out, to obtain the evaluation result of the player.
  2. 2. according to the method for claim 1, it is characterised in that the acquisition player according to the performance task arranged, The detection actuation of keys for specifying keyboard is played, including:
    Obtain the player that the first image collecting device is gathered and the keyboard of keyboard is specified according to the performance task arranged, performance Image;According to the player that described first image harvester is gathered according to the performance task arranged, play and specify keyboard Keyboard image and the specified keyboard built in advance reference picture, obtain the detection actuation of keys of the specified keyboard; Or
    Player that at least two second image collecting devices are gathered is obtained according to the performance task arranged, plays assignment key The keyboard image of disk;Appointed according to the player that at least two second image collecting device is gathered according to the performance arranged Business, the keyboard image for specifying keyboard is played, obtain and play anaglyph;According to the performance anaglyph and the institute built in advance The reference anaglyph of specified keyboard is stated, obtains the detection actuation of keys of the specified keyboard.
  3. 3. according to the method for claim 1, it is characterised in that the performance situation according to the player, commented Survey is handled, after obtaining the evaluation result of the player, in addition to:
    Export the evaluation result of the player.
  4. 4. according to the method described in claims 1 to 3 any claim, it is characterised in that described to obtain what musical instrument class was imparted knowledge to students After Online class pattern, in addition to:
    If the Online class pattern is class's class pattern, obtains and specify music score of Chinese operas file;
    According to the specified music score of Chinese operas file, at least one music score of Chinese operas element is obtained;
    According to each music score of Chinese operas element at least one music score of Chinese operas element, the music score of Chinese operas object of acquisition each music score of Chinese operas element;Institute Stating the music score of Chinese operas object of each music score of Chinese operas element includes the cloth of each music score of Chinese operas attribute of an element information and each music score of Chinese operas element Office's information;
    Export the music score of Chinese operas object of each music score of Chinese operas element.
  5. 5. according to the method described in claims 1 to 3 any claim, it is characterised in that described to obtain what musical instrument class was imparted knowledge to students After Online class pattern, in addition to:
    If the Online class pattern is one-to-one training mate pattern, the communication connection established between director and the player;
    Based on the communication connection, information exchange service is provided to the director and the player.
  6. A kind of 6. realization device of Online class, it is characterised in that including:
    Pattern acquiring unit, for obtaining the Online class pattern of musical instrument class teaching;
    Mode processing units, if be intelligent training mate pattern for the Online class pattern, player is obtained according to being arranged Performance task, play the detection actuation of keys for specifying keyboard;
    Situation acquiring unit, for being moved according to the button model of the detection actuation of keys and the specified keyboard built in advance Make, obtain the performance situation of the player;
    Evaluation process unit, for the performance situation according to the player, evaluation process is carried out, to obtain the player's Evaluation result.
  7. 7. device according to claim 6, it is characterised in that the mode processing units, be specifically used for
    Obtain the player that the first image collecting device is gathered and the keyboard of keyboard is specified according to the performance task arranged, performance Image;According to the player that described first image harvester is gathered according to the performance task arranged, play and specify keyboard Keyboard image and the specified keyboard built in advance reference picture, obtain the detection actuation of keys of the specified keyboard; Or
    Player that at least two second image collecting devices are gathered is obtained according to the performance task arranged, plays assignment key The keyboard image of disk;Appointed according to the player that at least two second image collecting device is gathered according to the performance arranged Business, the keyboard image for specifying keyboard is played, obtain and play anaglyph;According to the performance anaglyph and the institute built in advance The reference anaglyph of specified keyboard is stated, obtains the detection actuation of keys of the specified keyboard.
  8. 8. device according to claim 6, it is characterised in that the evaluation process unit, be additionally operable to
    Export the evaluation result of the player.
  9. 9. according to the device described in claim 6~8 any claim, it is characterised in that the mode processing units, also use In
    If the Online class pattern is class's class pattern, obtains and specify music score of Chinese operas file;
    According to the specified music score of Chinese operas file, at least one music score of Chinese operas element is obtained;
    According to each music score of Chinese operas element at least one music score of Chinese operas element, the music score of Chinese operas object of acquisition each music score of Chinese operas element;Institute Stating the music score of Chinese operas object of each music score of Chinese operas element includes the cloth of each music score of Chinese operas attribute of an element information and each music score of Chinese operas element Office's information;And
    Export the music score of Chinese operas object of each music score of Chinese operas element.
  10. 10. according to the device described in claim 6~8 any claim, it is characterised in that the mode processing units, also For
    If the Online class pattern is one-to-one training mate pattern, the communication connection established between director and the player; And
    Based on the communication connection, information exchange service is provided to the director and the player.
CN201710816361.7A 2017-09-12 2017-09-12 The implementation method and device of Online class Pending CN107610550A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710816361.7A CN107610550A (en) 2017-09-12 2017-09-12 The implementation method and device of Online class

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710816361.7A CN107610550A (en) 2017-09-12 2017-09-12 The implementation method and device of Online class

Publications (1)

Publication Number Publication Date
CN107610550A true CN107610550A (en) 2018-01-19

Family

ID=61062972

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710816361.7A Pending CN107610550A (en) 2017-09-12 2017-09-12 The implementation method and device of Online class

Country Status (1)

Country Link
CN (1) CN107610550A (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108711337A (en) * 2018-05-25 2018-10-26 京东方科技集团股份有限公司 Keyboard instrument auxiliary exercise method, apparatus
CN109035963A (en) * 2018-07-20 2018-12-18 广州市雅迪数码科技有限公司 The method and device of piano long-distance education
CN109599085A (en) * 2018-12-20 2019-04-09 余姚市荣大塑业有限公司 Extended pattern electronic violin
CN110517555A (en) * 2019-07-19 2019-11-29 森兰信息科技(上海)有限公司 Method, system, storage medium and the device of synchronization class state based on piano
CN111224863A (en) * 2019-12-10 2020-06-02 平安国际智慧城市科技股份有限公司 Session task generation method and device, computer equipment and storage medium
CN111816013A (en) * 2020-08-17 2020-10-23 玖月音乐科技(北京)有限公司 Control method for teaching of double-row key group lessons
CN113272891A (en) * 2019-01-22 2021-08-17 雅马哈株式会社 Musical performance system, musical performance mode setting method, and musical performance mode setting device

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0991266A (en) * 1995-09-21 1997-04-04 Matsushita Electric Ind Co Ltd Learning type recognition judgment device
CN105430453A (en) * 2015-11-27 2016-03-23 刘军 Media data collection method, media terminal and online music teaching system
CN106228961A (en) * 2016-07-21 2016-12-14 赵洪云 Play evaluation methodology and device
CN106709427A (en) * 2016-12-01 2017-05-24 北京银河润泰科技有限公司 Keyboard action detection method and device
CN106782464A (en) * 2016-12-01 2017-05-31 北京银河润泰科技有限公司 Keyboard action detection method and device
CN106951457A (en) * 2017-02-24 2017-07-14 北京银河润泰科技有限公司 The processing method and processing device of the music score of Chinese operas
CN107067151A (en) * 2017-02-10 2017-08-18 美国元源股份有限公司 Practise music score collocation method and device

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0991266A (en) * 1995-09-21 1997-04-04 Matsushita Electric Ind Co Ltd Learning type recognition judgment device
CN105430453A (en) * 2015-11-27 2016-03-23 刘军 Media data collection method, media terminal and online music teaching system
CN106228961A (en) * 2016-07-21 2016-12-14 赵洪云 Play evaluation methodology and device
CN106709427A (en) * 2016-12-01 2017-05-24 北京银河润泰科技有限公司 Keyboard action detection method and device
CN106782464A (en) * 2016-12-01 2017-05-31 北京银河润泰科技有限公司 Keyboard action detection method and device
CN107067151A (en) * 2017-02-10 2017-08-18 美国元源股份有限公司 Practise music score collocation method and device
CN106951457A (en) * 2017-02-24 2017-07-14 北京银河润泰科技有限公司 The processing method and processing device of the music score of Chinese operas

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108711337A (en) * 2018-05-25 2018-10-26 京东方科技集团股份有限公司 Keyboard instrument auxiliary exercise method, apparatus
CN109035963A (en) * 2018-07-20 2018-12-18 广州市雅迪数码科技有限公司 The method and device of piano long-distance education
CN109599085A (en) * 2018-12-20 2019-04-09 余姚市荣大塑业有限公司 Extended pattern electronic violin
CN113272891A (en) * 2019-01-22 2021-08-17 雅马哈株式会社 Musical performance system, musical performance mode setting method, and musical performance mode setting device
CN113272891B (en) * 2019-01-22 2024-02-27 雅马哈株式会社 Performance system, performance mode setting method, and performance mode setting device
CN110517555A (en) * 2019-07-19 2019-11-29 森兰信息科技(上海)有限公司 Method, system, storage medium and the device of synchronization class state based on piano
CN111224863A (en) * 2019-12-10 2020-06-02 平安国际智慧城市科技股份有限公司 Session task generation method and device, computer equipment and storage medium
CN111224863B (en) * 2019-12-10 2021-06-22 平安国际智慧城市科技股份有限公司 Session task generation method and device, computer equipment and storage medium
CN111816013A (en) * 2020-08-17 2020-10-23 玖月音乐科技(北京)有限公司 Control method for teaching of double-row key group lessons

Similar Documents

Publication Publication Date Title
CN107610550A (en) The implementation method and device of Online class
CN110531860B (en) Animation image driving method and device based on artificial intelligence
CN106056996B (en) A kind of multimedia interactive tutoring system and method
US20210104169A1 (en) System and method for ai based skill learning
JP6690489B2 (en) Information processing apparatus, information processing method, and program
US12014645B2 (en) Virtual tutorials for musical instruments with finger tracking in augmented reality
CN111598160B (en) Training method and device of image classification model, computer equipment and storage medium
US11557269B2 (en) Information processing method
US10991349B2 (en) Method and system for musical synthesis using hand-drawn patterns/text on digital and non-digital surfaces
CN108491804B (en) Chess game display method, related device and system
CN105335136B (en) The control method and device of smart machine
CN114418972B (en) Picture quality detection method, device, equipment and storage medium
CN115023732B (en) Information processing device, information processing method, and information processing program
JP2018147428A (en) Information processing apparatus, information processing method, and program
CN111641861B (en) Video playing method and electronic equipment
US20200365123A1 (en) Information processing method
CN112183430A (en) A method and device for sign language recognition based on dual neural network
CN108932060A (en) Gesture three-dimensional interaction shadow casting technique
CN106951457A (en) The processing method and processing device of the music score of Chinese operas
WO2014061931A1 (en) Device and method for playing sound
CN107248407A (en) A kind of gesture musical performance device
CN109816023A (en) Method and apparatus for generating picture tag model
CN115480923A (en) Multimode intelligent classroom edge calculation control system
CN113554045B (en) Data set manufacturing method, device, equipment and storage medium
CN114333031A (en) Vulnerability detection method and device of living body detection model and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180119

RJ01 Rejection of invention patent application after publication