CN108269563A - A kind of virtual jazz drum and implementation method - Google Patents

Abstract

The invention discloses a virtual jazz drum and its realization method. The virtual jazz drum includes foot pedals, drumsticks, cameras, host computer, jazz drum software program, memory, jazz drum sound database and sound box, wherein the drumsticks and foot pedals Used as a jazz drum performance tool, the camera is connected to the host computer to capture the player's hand and foot movements in real time, the jazz drum software program runs on the host computer, the jazz drum sound database is stored in the memory of the host computer, and the speakers are connected through lines to the upper computer; the upper computer can match the video signal collected by the camera to the sound signal in the sound data of the jazz drum after being analyzed by the jazz drum software program, and the sound signal is then processed to form an audio file, and the audio file is finally passed through the speaker to play. The invention is easy to carry, low cost, strong practicability and can meet the individual needs of individual users for jazz drum performance to the greatest extent, and is suitable for use by different groups of people on different occasions.

Description

A virtual jazz drum and its implementation method

technical field

The invention relates to the technical field of comprehensive education and entertainment, in particular to a virtual jazz drum and its implementation method.

Background technique

Jazz drum (Drum kit, Drum set) is a set of hand percussion instruments and foot percussion instruments of various types and different timbres assembled into one large musical instrument played by a single person using pedals, drum sticks or drum brushes. It is mainly used in rock music and jazz. The ups and downs of the three-dimensional drum beats are matched with the drummer's expression on the performance, which is very rendering. The basic combination of jazz drums includes bass drum, snare drum, two toms (tom-tom), a floor tom (floortom), hi-hat cymbal and cymbal (cymbal) . Among them, cymbals are divided into crash cymbals, ride cymbals, Chinese cymbals, splash cymbals and crashride (crash/ride cymbals) that produce sound effects. Because it looks like a row of drums hanging on a row of racks, it is also known as a drum kit. Jazz drum performance, a combination of entertainment and sports. However, traditional jazz drums are expensive and take up a lot of space, which largely limits their popularity. As we all know, western modern music is based on the performance of electroacoustic instruments, but the electroacoustic research and development of jazz drums as a basic instrument seems to be unknown. Drum tube) causes vibration, and the vibration triggers the vibration sensor under the drum skin. The vibration sensor converts the vibration signal into an electrical signal, which is transmitted to the sound source of the electronic drum. change. Electronic jazz drums have solved the shortcomings of traditional jazz drums to a certain extent, but their prices are still high.

Contents of the invention

The object of the present invention is to provide a virtual jazz drum and its implementation method in order to solve the above-mentioned defects in the prior art.

According to the disclosed embodiment, the first aspect of the present invention discloses a kind of virtual jazz drum, and described virtual jazz drum comprises pedal 10, drumstick 13, camera 2, upper computer 3, jazz drum software program 4, memory 5 , jazz drum sound database 6 and sound box 7, wherein, described drumstick 13 and described pedal 10 are used as jazz drum performance tool, and described camera 2 is connected with described upper computer 3, and real-time photographing player 1’s hand and foot movements, the jazz drum software program 4 runs on the host computer 3, the jazz drum sound database 6 is stored in the memory 5 of the host computer 3, the The speaker 7 is connected to the host computer 3 through a line;

The video signal collected by the camera 2 in the host computer 3 can be matched to the sound signal in the drum sound data 6 after the analysis of the drum software program 4, and the sound signal can then be After audio processing, an audio file is formed, and the audio file is finally played through the speaker.

Further, the pedal 10 includes a hi-hat pedal 11 corresponding to the position of the player's left foot and a bass drum pedal 12 corresponding to the position of the player's right foot, and the drumsticks 13 are one for each of the left and right hands.

Further, the jazz drum software program calculates and analyzes relevant information in the video data collected by the camera 2 in real time, and uses the above-mentioned relevant information to match the corresponding audio signal in the jazz drum database and configure related parameters of the speaker , The interactive interface is displayed, and finally the corresponding audio is played out through the speaker, and the interactive interface of the jazz drum software program will be displayed to the player at the same time, which is convenient for the player to perform;

Wherein, the relevant information is the position information and motion information of the drumstick head of the hand and the pedal hammer head of the foot, and the jazz drum software program judges which one the player hits according to the position information and motion information. Drums or cymbals and the specific location of the hitting point, according to the motion information to judge the strength and direction of the player hitting the drum or cymbal surface, according to the location of the hitting point, combined with the relative position information of each drum and cymbal displayed at a fixed position on the video screen, The jazz drum software program will match the corresponding sound signal of the jazz drum database, and form an audio file in combination with the relevant settings made by the user on the program interface.

Further, the interface 40 of the jazz drum software program includes a basic operation column 401, an instrument model selection area 402 and an instrument model placement area 403, and the basic operation column 401 includes sound size, music style, storage or not, foot Pedal with sticks to set and initialize buttons.

According to the disclosed embodiment, the second aspect of the present invention discloses a kind of realization method of virtual jazz drum, and described realization method comprises the following steps:

S1. The camera 2 is placed directly in front of the player 1 to capture the operation of the player 1 on the pedal 10 and the drumstick 13, wherein the pedal includes the hi-hat pedal corresponding to the position of the player's left foot and the corresponding performance The big drum pedal at the position of the right foot, and the drum sticks are one for each of the left and right hands;

S2, the camera 2 uploads the captured video data to the host computer 3, and the video data is stored in the memory 5 at the same time, and is analyzed in real time by the jazz drum software program 4 of the host computer 3 to obtain the hitting information, which is stored as a performance at the same time Record, match the sound signal in the jazz drum sound database 6 by hitting information, the sound signal that matches forms audio file through audio processing again, and this audio file is stored on memory 5 as performance record;

S3. Play the audio file or performance record file through the speaker.

Further, it is characterized in that the process of step S2 is as follows:

Through calculation and analysis, the relevant information in the video data collected by the camera 2 in real time will be used to match the corresponding audio signal in the jazz drum database, configure the relevant parameters of the speaker, display the interactive interface, and finally play the corresponding audio through the speaker At the same time, the interactive interface of the jazz drum software program will be displayed to the player, which is convenient for the player to perform;

Wherein, the relevant information is the position information and motion information of the drumstick head of the hand and the pedal hammer head of the foot, and the jazz drum software program judges which one the player hits according to the position information and motion information. Drums or cymbals and the specific location of the hitting point, according to the motion information to judge the strength and direction of the player hitting the drum or cymbal surface, according to the location of the hitting point, combined with the relative position information of each drum and cymbal displayed at a fixed position on the video screen, The jazz drum software program will match the corresponding sound signal of the jazz drum database, and form an audio file in combination with the relevant settings made by the user on the program interface.

Further, the determination of the position of the hitting point is to determine the magnitude and direction of its motion speed by analyzing the spatial position changes of the hammer head and the hammer head in continuous video frames. When the speed is smaller than a certain threshold and the speed direction is a specific direction When , it is considered that this moment is the striking moment, and then the continuous video frame images before and after this moment are taken out and comprehensively analyzed to obtain the spatial position of the hammer head and the hammer head, and this spatial position is the position of the striking point;

The determination of the strength and direction of hitting the drum surface or cymbal surface is to obtain the magnitude and direction of the hitting acceleration by analyzing the speed and direction of the hammer head and the speed change of the hammer head near the above hitting moment, so that the hitting acceleration can be inferred. strength and direction of impact.

Further, the jazz drum software program will fix and display the position of each model on the program interface after the user drags and drops the percussion instrument model, and combined with the obtained hammer head and hammer head hitting position, it can be judged that the player Which drum or cymbal is being hit, and the relative position of the hitting point on the drum head and the cymbal face, the hitting point will have a water ripple effect, and the color of the water ripple is different for different percussion instruments. Color shades.

Further, in the described step S2, match the sound signal in the jazz drum sound database 6 by striking the information, specifically as follows:

The hit position of each musical instrument model is numbered, and each number corresponds to a sound signal, and the described jazz drum software program will match the sound signal of the corresponding jazz drum sound database accordingly, wherein the sound signal includes the tone and timbre, and then the sound signal is processed into an audio file through loudness adjustment and audio mixing, wherein the loudness adjustment is determined according to the hitting force and direction, and the audio mixing process is the mixing of multiple sound signals and the user's mixing settings.

Further, the process of the real-time analysis of the video data by the jazz drum software program in the step S2 is as follows:

S201, extract the video signal frame by frame and perform pattern recognition on it, find the hi-hat pedal 11, bass drum pedal 12 and drumstick 13 in the frame and determine their positions, and the position information of three consecutive frames is used to calculate the hi-hat pedal 11, The speed of motion and the acceleration of the drum pedal 12 and the drumstick 13, wherein the speed of motion is used as the basis for judging whether it is the hitting point, and the acceleration is used as the basis for judging the strength and direction of the hit;

S202. After the hit point is confirmed, the position information of the hit point will be calculated relative to the position information of the musical instrument to obtain the relative position of the hit point on the musical instrument model, and water ripples will be displayed at the position of the hit point, with different colors for different musical instrument models. Different stroke intensity different color depth.

Compared with the prior art, the present invention has the following advantages and effects:

The invention designs a virtual jazz drum and its implementation method, which is easy to carry, low cost, strong practicability and can meet the individual needs of individual users in jazz drum performance to the greatest extent, that is, it is suitable for game entertainment, professional performance, jazz drum teaching, etc. It is used by different groups of people on different occasions.

Description of drawings

Fig. 1 is the full flow schematic diagram that virtual kit drum implements among the present invention;

Fig. 2 is a schematic diagram of the implementation example one of camera shooting player in the present invention;

Fig. 3 is the second schematic diagram of the implementation example of the camera shooting the player in the present invention;

Fig. 4 is a schematic diagram of the player's actions taken by the camera in the present invention;

Fig. 5 is a schematic diagram of a jazz drum software program interface in the present invention;

Fig. 6 is the video information analysis flowchart of jazz drum software program in the present invention;

Fig. 7 is a jazz drum software program flowchart in the present invention;

Description of reference signs: 1—player, 10—foot pedal, 11—bass drum pedal, 12—hi-hat pedal, 13—drumstick, 2—camera, 21—camera A, 22—camera B, 23—camera C, 24—camera D, 3—host computer, 4—jazz drum software program, 40—jazz drum program interface, 401—basic operation bar, 402—musical instrument model selection area, 403—musical instrument model placement area, 5—memory, 6—jazz drum sound database, 7—sound box.

Detailed ways

In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

Embodiment one

Referring to Fig. 1-Fig. 4, as Fig. 1 shows a kind of virtual jazz drum and implementation method, comprise pedal 10, drumstick 13, camera 2, host computer 3, jazz drum software program 4, memory 5, jazz drum sound database 6 and speaker 7. The camera 2 faces the performer 1, the camera 2 is connected to the host computer 3 via a data line or wirelessly, the jazz drum software program 4 runs on the host computer 3, the memory 5 is connected to the host computer 3 through a bus, and the jazz drum sound database 6 is located on the host computer. On the memory 5 of machine, sound box 7 is connected with upper computer 3 lines.

The camera 2 is placed directly in front of the player 1, and mainly photographs the operation actions of the player 1 on the pedal 10 and the drumstick 13. The pedal 10 and the drumstick 13 are jazz drum beating tools, and there are two pedals 10, corresponding to The one on the player's left foot is a hi-hat pedal 11, the one corresponding to the player's right foot is a big drum pedal 12, and the drumstick 13 is each one for the left and right hands. The camera 2 is mainly used to photograph the stepping and hitting actions of the pedal 10 and the drumstick 11 (Fig. 4). The distribution of the camera 2 can be directly facing the player 1 as shown in Fig. 2, and multiple cameras can also be used for shooting. As shown in Fig. 3, the camera A20, the camera B21, the camera C22, and the camera D23 are respectively placed around the player 1. The camera 2 uploads the collected video data to the host computer 3, and the video data can be stored in the memory 5, and the same video signal is analyzed in real time by the jazz drum software program 4 of the host computer 3 to obtain the hitting information, which can be stored For performance recording, it is convenient for player 1 to use later. The hitting information is used to match the 6 sound signals of the jazz drum sound database, the matched sound signal, and the sound signal is processed to form an audio file. The audio processing here mainly involves the mixing of multiple sound signals and the pair of music styles of the player. Audio processing, the audio file of the player 1 can be stored on the memory 5 as a performance record, so that it can be recalled later. Both live audio files and recorded performance files can be played through the speakers.

Embodiment two

A virtual jazz drum and its realization method, comprising pedal 10, drumstick 13, camera 2, host computer 3, jazz drum software program 4, memory 5, jazz drum sound database 6 and sound box 7. Drumsticks 13 and pedals 10 are jazz drum performance tools. Camera 2 is connected with host computer 3 to capture player 1 hand and foot movements in real time. Jazz drum software program 4 runs on host computer 3, and jazz drum sound database 6 Stored in the memory 5 of the host computer 3, the speaker 7 is connected to the host computer 3 through a line. The host computer 3 can match the video signal collected by the camera 2 to the sound signal in the jazz drum sound data 6 after the analysis of the jazz drum software program 4, and the sound signal is processed to form an audio file, and the audio file is finally passed through the speaker to play.

Among them, the drumsticks and pedals can be traditional jazz drum sticks and pedals, or can be replaced by any other objects that can be easily moved or stepped on. Their main function is to mark the hands and feet, which is convenient for the host computer program to The real-time camera data analyzes the movement information and position information of the drumsticks of the hands and the pedals of the feet.

Among them, the camera is used to take pictures of drumsticks and pedal movements. The frame rate, pixel and viewing angle of the camera have certain parameter requirements, and the relevant parameters of the camera need to be input into the jazz drum software program. The number of cameras here can be multiple, and the types can be 2D or 3D cameras, and the video data captured by the cameras are uploaded to the host computer through data transmission lines or wirelessly.

Among them, the upper computer is a microcomputer with computing, storage and display functions.

Among them, the memory is mainly used to store the upper computer operating system, the jazz drum software program, the jazz drum sound database and the relevant performance records of the players.

Among them, the role of the jazz drum software program is to calculate and analyze relevant information in real-time video data, and use this information to match the jazz drum database, configure speakers, and display interactive interfaces. The jazz drum software program is a program running on the host computer. This program can analyze and calculate the video images uploaded by the camera and obtain relevant information, and then match the corresponding audio signals in the jazz drum audio database, configure speaker related parameters, and finally pass The speaker will play the corresponding audio, and at the same time, the interactive interface of the jazz drum software program will be displayed to the player, which is convenient for the player to perform.

Among them, in the jazz drum software program interface, players can choose to drag and drop models of various jazz drum percussion instruments. Each instrument has different specifications for selection. Percussion instrument models mainly include: bass drum, snare drum, middle drum, floor drum Drums, hi-hats, crash cymbals, ride cymbals, Chinese cymbals, splash cymbals, cowbells, wooden fish, shakers, triangles, bells, etc.

Wherein, the relevant information obtained through the analysis and calculation of the jazz drum software program specifically refers to the position information and motion information of the drumstick head of the hand and the hammer head of the foot pedal. Then, according to the position information and motion information, it can be judged which drum or cymbal the player is hitting and the specific hitting point position, and according to other motion information, the strength and direction of the player hitting the drum head or cymbal face can be judged. According to the position of the hit point, combined with the relative position information of each drum and cymbal displayed at a fixed position on the video screen, the program will match the corresponding sound signal of the jazz drum database, and form an audio file in combination with the relevant settings made by the user on the program interface, and finally by The speakers play out.

Among them, the location of the hitting point is determined by analyzing the spatial position changes of the hammer head and the hammer head in continuous video frames, and the size and direction of its motion speed can be judged. When the speed is smaller than a certain threshold and the speed direction is a specific direction, it is considered This moment is the hitting moment, and then the continuous video frame images before and after this moment are taken out, and comprehensively analyzed to obtain the spatial position of the hammer head and the hammer head, and this spatial position is the hitting point position.

Among them, the determination of the hitting force and the hitting direction is to obtain the size and direction of the hitting acceleration by analyzing the speed and direction of the hammer head and the speed change of the hammer head near the above hitting time, so that the hitting force and hitting direction can be deduced. direction.

Wherein, the jazz drum software program will fix and display the position of each model on the program interface after the user drags and drops the percussion instrument models. Combined with the obtained hammer head and hammer head hitting position, it can be judged which drum or cymbal the player is hitting, and the relative position of the hitting point on the drum surface and the cymbal surface. The hitting point will have a water ripple effect. The water ripples of percussion instruments have different colors, and different hitting strengths and angles will affect the color of the water waves.

Among them, how the program will match the corresponding sound signal to the jazz drum sound database. The struck positions of each musical instrument model are numbered, and each number corresponds to a sound signal. According to this, the program will match the corresponding sound signal of the jazz drum sound database.

Wherein, the sound signal mainly includes pitch and timbre.

Wherein, the sound signal is processed into an audio file, and the processing includes: loudness adjustment and audio mixing. The loudness adjustment is mainly determined according to the hitting strength and direction, and the audio mixing process mainly refers to the mixing of multiple sound signals and the user's mixing settings.

Wherein, the audio signal is sent to the speaker for playing. The volume of its playback can be adjusted in the jazz drum software program and the speaker end.

Embodiment Three

Referring to Fig. 5-Fig. 7, when using the virtual jazz drum, click to open the jazz drum software program 4 on the host computer 3, the jazz drum program interface 40 will be displayed on the host computer 3 as shown in Fig. drag and drop the musical instrument model to the musical instrument model placement area 403, this area can simultaneously display the camera 2 video. The basic operation column 401 includes: volume of sound, music style, storage or not, pedal and drumstick setting and other configuration and initialization buttons. Any objects in the frame are pedals and drumsticks. After clicking initialization, the program will form a configuration file, initialize the ports such as the camera 2, and lock the hi-hat pedal 11, bass drum pedal 12 and drum stick 13. After the initialization is successful, the player will be prompted to start playing. At the same time, the program will enter the video analysis process as shown in Figure 6. In the first step, the video signal will be extracted frame by frame and its pattern recognition will be performed to find the hi-hat pedal 11 and bass drum pedal 12 in the frame. And the drumstick 13 and determine its position, the position information of three consecutive frames is used to calculate the motion speed and acceleration of the hi-hat pedal 11, the bass drum pedal 12 and the drumstick 13, wherein the motion speed is an important basis for judging whether it is the hitting point, Acceleration is the main reference for hitting strength and direction. After the hit point is confirmed, the position information of the hit point will be calculated relative to the position information of the instrument to obtain the relative position of the hit point on the instrument model. The location of the hitting point will display water ripples, different colors for different instrument models, and different color depths for different hitting strengths. In the second step, since each position of the instrument model has a unique code corresponding to the jazz drum sound database, similarly, the hitting strength and direction information will determine the loudness of the sound, and finally combined with player 1's choice of music style , to perform final audio processing to form an audio file. In the last step, the audio signal will be played by the speakers and recorded and stored according to the player 1 settings.

This embodiment is suitable for the fields of jazz drum entertainment, practice, teaching and the like.

The above-mentioned embodiment discloses a kind of virtual jazz drum and its implementation method, which is extremely convenient and can fully realize its core functions on a personal computer, and is suitable for users of different ages and different jazz drum operation levels, and this virtual jazz drum device can Bring a good sense of presence, suitable for performance, entertainment and learning.

The above-mentioned embodiment is a preferred embodiment of the present invention, but the embodiment of the present invention is not limited by the above-mentioned embodiment, and any other changes, modifications, substitutions, combinations, Simplifications should be equivalent replacement methods, and all are included in the protection scope of the present invention.

Claims (10)

1. a kind of virtual jazz drum, it is characterized in that, described virtual jazz drum comprises pedal, drumstick, camera, host computer, jazz drum software program, memory, jazz drum sound database and sound box, wherein, described drum The mallet and the pedal are used as jazz drum performance tools, the camera is connected with the host computer, and the player's hand and foot movements are photographed in real time, and the jazz drum software program runs on the On the host computer, the jazz drum sound database is stored in the memory of the host computer, and the sound box is connected to the host computer through a line; The video signal collected by the camera in the host computer can be matched to the sound signal in the sound data of the jazz drum after being analyzed by the jazz drum software program, and the sound signal is formed by audio processing. audio files, and the audio files are finally played through the speakers. 2. A kind of virtual jazz drum according to claim 1, characterized in that, said pedals include a hi-hat pedal corresponding to the position of the player's left foot and a bass drum pedal corresponding to the position of the player's right foot, said There is one drumstick for each of the left and right hands. 3. a kind of virtual jazz drum according to claim 1, is characterized in that, described jazz drum software program analyzes the relevant information in the real-time collection video data of described camera by operation, and will utilize above-mentioned relevant information with To match the corresponding audio signal in the jazz drum database, configure the relevant parameters of the speaker, and display the interactive interface, and finally play the corresponding audio through the speaker, and at the same time, the interactive interface of the jazz drum software program will be displayed to the player, which is convenient for the player to perform; Wherein, the relevant information is the position information and motion information of the drumstick head of the hand and the pedal hammer head of the foot, and the jazz drum software program judges which one the player hits according to the position information and motion information. Drums or cymbals and the specific location of the hitting point, according to the motion information to judge the strength and direction of the player hitting the drum or cymbal surface, according to the location of the hitting point, combined with the relative position information of each drum and cymbal displayed at a fixed position on the video screen, The jazz drum software program will match the corresponding sound signal of the jazz drum database, and form an audio file in combination with the relevant settings made by the user on the program interface. 4. a kind of virtual jazz drum according to claim 1, is characterized in that, the interface of described jazz drum software program comprises basic operation column, instrument model selection area and instrument model placement area, and described basic operation column comprises Sound level, music style, storage or not, pedal and drumstick setting and initialization buttons. 5. a kind of realization method of virtual jazz drum, it is characterized in that, described realization method comprises the following steps: S1. The camera is placed directly in front of the player to photograph the player's operation on the pedals and drumsticks, wherein the pedals include a hi-hat pedal corresponding to the position of the player's left foot and a hi-hat pedal corresponding to the position of the player's right foot. Drum pedals, the drum sticks are one for each of the left and right hands; S2. The camera uploads the video data captured by the camera to the host computer, and the video data is stored in the memory at the same time. The jazz drum software program of the host computer performs real-time analysis to obtain the hitting information, which is stored as a performance record at the same time. information to match the sound signal in the jazz drum sound database, and the matched sound signal forms an audio file through audio processing, and the audio file is stored on the memory as a performance record; S3. Play the audio file or performance record file through the speaker. 6. the realization method of a kind of virtual jazz drum according to claim 5, is characterized in that, the process of described step S2 is as follows: Through calculation and analysis, the relevant information in the video data collected by the camera in real time will be used to match the corresponding audio signal in the jazz drum database, configure the relevant parameters of the speaker, display the interactive interface, and finally play the corresponding audio through the speaker , and at the same time, the interactive interface of the jazz drum software program will be displayed to the player, which is convenient for the player to perform; Wherein, the relevant information is the position information and motion information of the drumstick head of the hand and the pedal hammer head of the foot, and the jazz drum software program judges which one the player hits according to the position information and motion information. Drums or cymbals and the specific location of the hitting point, according to the motion information to judge the strength and direction of the player hitting the drum or cymbal surface, according to the location of the hitting point, combined with the relative position information of each drum and cymbal displayed at a fixed position on the video screen, The jazz drum software program will match the corresponding sound signal of the jazz drum database, and form an audio file in combination with the relevant settings made by the user on the program interface. 7. the realization method of a kind of virtual jazz drum according to claim 6, is characterized in that, the determination of described impact point position, is by analyzing the spatial position variation of mallet, hammerhead in the continuous video frame, judge its The magnitude and direction of the movement speed. When the magnitude of the velocity is less than a certain threshold and the direction of the velocity is in a specific direction, it is considered that this moment is the hitting moment, and then the continuous video frame images before and after this moment are taken out and comprehensively analyzed to obtain the space of the hammer head and the hammer head. position, this spatial position is the hitting point position; The determination of the strength and direction of hitting the drum surface or cymbal surface is to obtain the magnitude and direction of the hitting acceleration by analyzing the speed and direction of the hammer head and the speed change of the hammer head near the above hitting moment, so that the hitting acceleration can be inferred. strength and direction of impact. 8. The realization method of a kind of virtual jazz drum according to claim 6, characterized in that, the described jazz drum software program will fix and display the position of each model on the program interface after the user drags and drops the percussion instrument model In combination with the obtained hammer head and hammer head hitting position, it can be judged which drum or cymbal the player is hitting, and the relative position of the hitting point on the drum surface and the cymbal surface. The hitting point will have a water ripple effect. Different percussion instruments have different colors of water ripples, and different hitting strength and angles will affect the color of the water waves. 9. the realization method of a kind of virtual jazz drum according to claim 8, is characterized in that, in described step S2, matches sound signal in the jazz drum sound database by striking information and is specifically as follows: The hit position of each musical instrument model is numbered, and each number corresponds to a sound signal, and the described jazz drum software program will match the sound signal of the corresponding jazz drum sound database accordingly, wherein the sound signal includes the tone and timbre, and then the sound signal is processed into an audio file through loudness adjustment and audio mixing, wherein the loudness adjustment is determined according to the hitting force and direction, and the audio mixing process is the mixing of multiple sound signals and the user's mixing settings. 10. the realization method of a kind of virtual jazz drum according to claim 5, is characterized in that, in the described step S2, the process of the jazz drum software program real-time analysis video data is as follows: S201. Extract the video signal frame by frame and perform pattern recognition on it, find the hi-hat pedal, bass drum pedal and drumstick in the frame and determine their positions, and the position information of three consecutive frames is used to calculate the hi-hat pedal, bass drum pedal and drumstick The movement speed and acceleration of the mallet, wherein the movement speed is used as the basis for judging whether it is the hitting point, and the acceleration is used as the basis for judging the strength and direction of the hitting; S202. After the hit point is confirmed, the position information of the hit point will be calculated relative to the position information of the musical instrument to obtain the relative position of the hit point on the musical instrument model, and water ripples will be displayed at the position of the hit point, with different colors for different musical instrument models. Different stroke intensity different color depth.