CN113426101B - Teaching method, device, equipment and computer readable storage medium - Google Patents

Abstract

The invention discloses a teaching method, device, equipment and computer-readable storage medium. The teaching method includes: obtaining the learner information of the learning terminal according to the teaching request sent by the learning terminal; determining the information related to the learning from the teaching video library The teaching video matches the user information; determines the starting position of the teaching video according to the learning video of the learning terminal; superimposes the teaching video on the learning video and plays it from the starting position of the teaching video . The present invention superimposes the teaching video when sending the video stream to the learning terminal, so that the learner can watch the learning video and the teaching video simultaneously on the learning terminal, and the learner can learn from the instructor's operating mode identified in the teaching video, thereby effectively Improve learners’ game operation abilities.

Description

Teaching methods, devices, equipment and computer-readable storage media

Technical field

The present invention relates to the field of data processing technology, and in particular, to a teaching method, device, equipment and computer-readable storage medium.

Background technique

Currently, games have become an important part of people's daily lives. People can relieve and release stress by playing games. During the game, users can learn about the actual operation of the game by obtaining the instructional videos provided by the game, so as to facilitate users to obtain a better gaming experience.

The existing game teaching method mainly uses voice teaching, describing the actual operation method through voice, and showing the game operation results corresponding to the actual operation method through video. Learners can only start the game after watching the teaching video, and cannot practice in similar scenarios immediately after understanding the teaching operation method. For learners, this teaching method makes it impossible for learners to effectively master various complex operations and operation time points in the game, thus making it impossible for learners to effectively improve their game level, resulting in a poor game experience.

Contents of the invention

The main purpose of the present invention is to provide a teaching method, device, equipment and computer-readable storage medium, aiming to solve the technical problem that the existing game teaching method cannot effectively guide learners.

In order to achieve the above objectives, the present invention provides a teaching method, which includes the following steps:

Obtain the learner information of the learning terminal according to the teaching request sent by the learning terminal;

Determine the teaching video that matches the learner information from the teaching video library;

Determine the starting position of the teaching video according to the learning video of the learning terminal;

The teaching video is superimposed on the learning video and played from the starting position of the teaching video.

Optionally, the step of determining the starting position of the teaching video based on the learning video of the learning terminal includes:

Convert the continuous frame images of the learning video into a first feature string group, and obtain the second feature string group corresponding to the continuous frame image of each teaching video from the teaching video library;

Match the first characteristic string group with all second characteristic string groups, and determine a matching characteristic string group from the second characteristic string group that meets the matching requirements;

The corresponding teaching video is determined according to the matching feature string group, and the playing position of the consecutive frame images corresponding to the matching feature string group is used as the playing starting position of the teaching video.

Optionally, convert the continuous frame images of the learning video of the learning terminal into a first feature string group, and obtain the second feature character corresponding to the continuous frame image of each teaching video from the teaching video library. The steps of stringing include:

Divide multiple background areas from the learning video of the learning terminal, and convert the continuous frame images of each background area into a corresponding first background area feature string group;

Divide the corresponding background area from each teaching video in the teaching video library, and convert the continuous frame images of the background area of each teaching video into the corresponding second background area feature string group;

The step of matching the first characteristic string group with all second characteristic string groups and determining the matching characteristic string group from the second characteristic string group that meets the matching requirements includes:

Select a background area as the background area to be matched, match the first background area feature string group corresponding to the background area to be matched with the second background area feature string group in sequence, and determine whether there is a second background that meets the matching requirements. Regional feature string group; wherein the matching requirement is that the matching degree between the first background area feature string group and the second background area feature string group reaches a preset matching threshold;

When there is a second background area feature string group that meets the matching requirements, determine the matching feature string group from the second background area feature string group that meets the matching requirements;

When there is no second background area feature string group that meets the matching requirements, update the background area to be matched according to the preset background area selection sequence, and return to the execution step of: converting the first background area corresponding to the background area to be matched The characteristic string group is matched with the second background area characteristic string group in sequence.

Optionally, the step of superimposing the teaching video on the learning video and playing the teaching video from the starting position of the teaching video includes:

Determine the delay length according to the preset margin rules;

The teaching video is superimposed on the learning video, and the playback start position of the teaching video is delayed according to the delay duration, starting from the delayed playback start position of the teaching video. Play.

Optionally, the step of determining the delay duration according to a preset margin rule includes:

When determining the playback starting position of the teaching video, obtain the corresponding operation duration;

The delay duration is generated according to the operation duration and the preset starting delay value.

Optionally, after the step of superimposing the teaching video on the learning video and playing the teaching video from the starting position of the teaching video, the method further includes:

Obtain the operating parameters of the learning terminal every preset period;

Determine the video adjustment amount according to the operating parameters and the preset advance adjustment algorithm;

The playback progress of the teaching video is adjusted according to the video adjustment amount.

Optionally, the step of determining the teaching video that matches the learner information from the teaching video library includes:

Obtain the teacher information corresponding to each teaching video from the teaching video library;

Calculate the matching parameters of each teacher information and the learner information respectively according to the preset matching algorithm;

The teaching video corresponding to the matching parameter with the highest matching degree is determined as the teaching video matching the learner information.

In addition, to achieve the above objectives, the present invention also provides a teaching device, including:

An acquisition unit, configured to acquire learner information of the learning terminal according to the teaching request sent by the learning terminal;

A matching unit, used to determine the teaching video that matches the learner information from the teaching video library;

a positioning unit, configured to determine the starting position of the teaching video according to the learning video of the learning terminal;

A playback unit is configured to superimpose the teaching video on the learning video and play the teaching video from the starting position of the teaching video.

In addition, to achieve the above object, the present invention also provides a teaching device. The teaching device includes a memory, a processor, and a teaching program stored in the memory and executable on the processor. When the teaching program is executed by the processor, the above-mentioned teaching program is implemented. Steps in teaching methods.

In addition, to achieve the above object, the present invention also provides a computer-readable storage medium. A teaching program is stored on the computer-readable storage medium. When the teaching program is executed by the processor, the steps of the above teaching method are implemented.

By receiving the teaching request sent by the learning terminal and obtaining the learner information of the learning terminal, the present invention can determine multiple matching teaching videos from the teaching video library based on the learner information, and select the most matching teaching videos from the multiple teaching videos. Instructional videos. After determining the corresponding learning progress based on the learner's current learning video, the playback progress of the teaching video can be determined accordingly as the starting position of the playback for the learner. When sending the video stream to the learning terminal, the teaching video can be superimposed in the video stream, so that the learner can watch the learning video and the teaching video simultaneously on the learning terminal. The learner can follow the instructor's operation method identified in the teaching video. learning, thereby effectively improving learners’ game operation abilities.

Description of the drawings

Figure 1 is a schematic diagram of the terminal\device structure of the hardware operating environment involved in the embodiment of the present invention;

Figure 2 is a schematic flow chart of the first embodiment of the teaching method of the present invention;

Figure 3 is a schematic flow chart of the second embodiment of the teaching method of the present invention;

Figure 4 is a schematic flow chart of the sixth embodiment of the teaching method of the present invention;

Figure 5 is a schematic flow chart of the seventh embodiment of the teaching method of the present invention.

Figure 6 is a schematic diagram of the device unit of the teaching device of the present invention.

The realization of the purpose, functional features and advantages of the present invention will be further described with reference to the embodiments and the accompanying drawings.

Detailed ways

It should be understood that the specific embodiments described here are only used to explain the present invention and are not intended to limit the present invention.

As shown in Figure 1, Figure 1 is a schematic diagram of the terminal structure of the hardware operating environment involved in the embodiment of the present invention.

The terminal in the embodiment of the present invention is a teaching device.

As shown in Figure 1, the terminal may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002. Among them, the communication bus 1002 is used to realize connection communication between these components. The user interface 1003 may include a display screen (Display) and an input unit such as a keyboard (Keyboard). The optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a WI-FI interface). The memory 1005 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may optionally be a storage device independent of the aforementioned processor 1001.

Optionally, the terminal may also include a camera, RF (Radio Frequency, radio frequency) circuit, sensor, audio circuit, WiFi module, etc. Among them, sensors such as light sensors, motion sensors and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, where the ambient light sensor can adjust the brightness of the display screen according to the brightness of the ambient light, and the proximity sensor can turn off the display screen and/or when the terminal device moves to the ear. Backlight. Of course, the terminal device can also be equipped with other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor, etc., which will not be described again here.

Those skilled in the art can understand that the terminal structure shown in FIG. 1 does not limit the terminal, and may include more or fewer components than shown, or combine certain components, or arrange different components.

As shown in Figure 1, memory 1005, which is a computer storage medium, may include an operating system, a network communication module, a user interface module and a teaching program.

In the terminal shown in Figure 1, the network interface 1004 is mainly used to connect to the background teaching device and communicate with the background teaching device; the user interface 1003 is mainly used to connect to the client (user) and communicate with the client; and The processor 1001 can be used to call the teaching program stored in the memory 1005 and perform the following operations:

Obtain the learner information of the learning terminal according to the teaching request sent by the learning terminal;

Determine the teaching video that matches the learner information from the teaching video library;

Determine the starting position of the teaching video according to the learning video of the learning terminal;

The teaching video is superimposed on the learning video and played from the starting position of the teaching video.

Referring to Figure 2, the present invention provides a teaching method. In the first embodiment of the teaching method, the teaching method includes the following steps:

Step S10: Obtain the learner information of the learning terminal according to the teaching request sent by the learning terminal;

This embodiment can be applied to a cloud game platform, and the cloud game platform can be a remote game server. The game can be run on the cloud server, and the server can realize the calculation and rendering of the game, encode the game screen in real time, and generate a video stream that is pushed to the game terminal. The game terminal can be a learning terminal used by learners. After receiving the audio and video stream, the game terminal decodes and plays it to the user. At the same time, it collects the operation instructions triggered by the user and sends them to the cloud server, thereby realizing the game experience.

When a user plays a game on a learning terminal as a learner, a corresponding teaching request can be triggered, and the learning terminal can send the teaching request to the server, so that the server can obtain the learner information corresponding to the learning terminal according to the teaching request. It can be understood that the learner information may include the name of the game currently played by the learner, the game character, the game level, the current progress, the effectiveness of the operation, and other information parameters that can reflect the learner's gaming ability.

Step S20, determine the teaching video that matches the learner information from the teaching video library;

After obtaining the learner information, the server can determine a teaching video that matches the learner's game ability from the learner information. According to the learner information of the learner, the teaching videos of teachers in the same game level who have a smaller gap with the current learner's game operation level can be determined from the teaching videos in the teaching video library. Learners can effectively improve their game operation abilities by watching instructional videos with similar operating levels. There may be one or more teaching videos matched by the server.

It is understandable that since the calculation and rendering of the game are all completed by the server, the server not only saves the game videos of all players during the game, but also stores the player operation steps and operation instructions corresponding to each game video. After the player's operating steps and operating instructions are identified in the corresponding game video, the player's game video can be converted into a teaching video and stored in the teaching video library. By watching the teaching video, learners can not only watch the teacher's original game video, but also observe the teacher's actual operating steps and operating instructions, so that learners can intuitively understand the correspondence between game operations and operation results. Improve learners' understanding of how to operate.

It should be noted that different games can be experienced on the learning terminal, and the server can also set up different teaching video libraries for different games. When the server obtains the learner information, it can determine the game name of the game currently entered by the learner from the learner information, and determine the teaching video library corresponding to the game name. The teaching videos in the teaching video library are Instructional video for the game. By obtaining the game name, the matching scope of the teaching video can be narrowed and the matching efficiency can be improved. Further, the learner information may also include the game character used by the learner in the game. According to the game character, the server can further filter out the teaching video corresponding to the game character from the teaching video library corresponding to the game name to continue Narrow down the instructional videos for matching. That is, through learner information, teaching videos that meet the conditions can be selected from the teaching video library to reduce the matching range of teaching videos and improve the matching speed.

Step S30, determine the playback starting position of the teaching video according to the learning video of the learning terminal;

After the server determines the teaching video that matches the learner's information, if the learner does not currently start the game, the corresponding teaching video can be played directly. If the learner has started the game, the server also needs to determine the starting position of the teaching video based on the learner's current game progress. For example, when the learner has started the game and the game progress of the current level is 50%, if the teaching video is played from the beginning, the progress of the teaching video will not match the learner's current game progress. The server needs to determine the corresponding playback progress in the teaching video based on the video image of the learner's current learning video, so that the teaching video can start playing from the learner's current game progress.

Step S40: Superimpose the teaching video on the learning video and play it from the starting position of the teaching video.

After determining the starting position of the teaching video, the server can superimpose the video stream of the teaching video in the game video stream pushed to the learning terminal. The learning terminal decodes the superimposed video stream and plays it, so that the learning video can be displayed on the screen. At the same time, the teaching video is displayed simultaneously. Learners can implement linked teaching based on the displayed teaching video. For example, after the learner watches the teaching video, the corresponding first input can be triggered. After the learning terminal receives the first input, it can respond to the first input and generate the corresponding Learning video, so that learners can determine the operation result corresponding to their first input by watching the learning video. The first input may be a key operation, click operation, track sliding operation or gesture operation triggered by the learner on the learning terminal. Learn the instructor's operating methods through teaching videos, and practice the corresponding operations to obtain the corresponding results in the learning videos to improve game operation capabilities.

It is understandable that the teaching video can be superimposed in part of the display area of the learning video. When the user is watching a learning video, the teaching video is displayed in this part of the display area, and the learning video is displayed in the area other than the teaching video. After the learner understands the instructor's operation method based on the teaching video, he or she can immediately adjust his or her operating steps and instructions. , practice in similar scenarios, and determine the operation results corresponding to the adjusted operation method based on the corresponding display content of the learning video.

In this embodiment, the server can receive the teaching request sent by the learning terminal and obtain the learner information of the learning terminal. According to the learner information, it can determine multiple matching teaching videos from the teaching video library, and select the matching teaching videos from the multiple teaching videos. Choose the most suitable teaching video. After the server determines the corresponding learning progress based on the learner's current learning video, the server can accordingly determine the playback progress of the teaching video as the starting position of the playback for the learner. When the server sends a video stream to the learning terminal, the teaching video can be superimposed in the video stream, so that the learner can watch the learning video and the teaching video simultaneously on the learning terminal. The learner can identify the instructor's operation method from the teaching video. Carry out learning to effectively improve learners’ game operation abilities.

Further, based on the above-mentioned first embodiment of the present invention, a second embodiment of the teaching method of the present invention is proposed. Refer to Figure 3. Figure 3 is a schematic flow chart of the second embodiment of the teaching method of the present invention. In this embodiment, In step S30, the step of determining the playback starting position of the teaching video according to the learning video of the learning terminal includes:

Step S31, convert the continuous frame images of the learning video into a first feature string group, and obtain the second feature string group corresponding to the continuous frame image of each teaching video from the teaching video library;

Step S32: Match the first characteristic string group with all second characteristic string groups, and determine a matching characteristic string group from the second characteristic string group that meets the matching requirements;

Step S33: Determine the corresponding teaching video according to the matching feature string group, and use the playing position of the consecutive frame images corresponding to the matching feature string group as the playing starting position of the teaching video.

In this embodiment, the server determines the starting position of the teaching video playback according to the video progress of the learning video by performing string conversion on each frame image of the consecutive frame images in the current learning video to convert each frame image into is the corresponding feature string, and sorts the corresponding feature string according to the order of consecutive frame images to obtain the first feature string group.

When a matching teaching video is obtained from the teaching video library, each frame image in the teaching video is converted into a corresponding feature string using the same conversion algorithm, and the features are compared according to the display order of each frame image in the teaching video. The strings are sorted accordingly to obtain the second characteristic string group. If there are multiple matching teaching videos, each teaching video is converted into a corresponding second feature string group to obtain multiple second feature string groups.

The first feature string group contains feature strings corresponding to a preset number of consecutive frame images. For example, the preset number of frames can be 60, then the first feature string group contains feature strings corresponding to 60 consecutive frame images. A string group composed of 60 characteristic strings in order. The second feature string group is a string group composed of feature strings corresponding to all consecutive frame images in the teaching video in order. It can be understood that the number of characteristic strings in the second characteristic string group is much larger than that of the first characteristic string group.

When it is determined that there is and is only one matching teaching video in the teaching video library, the method of matching the first feature string group with the second feature string group is to match the preset number of consecutive frames in the first feature string. Match the characteristic string with the second characteristic string group, and determine whether there is a continuous characteristic string of the same preset length in the second characteristic string group that is consistent with the first characteristic string group. The preset length can be the same as the preset frame Corresponding to the number, it can also be adjusted according to the preset frame number. For example, when the preset number of frames is 60, the first feature string group is 60 continuous feature strings, and it is detected in the second feature string group whether there are 60 continuous feature strings consistent with the first feature String groups are consistent. If there are such 60 continuous feature strings in the second feature string group, then the continuous feature strings are the matching feature string groups in the second feature string group. The consecutive frame images corresponding to the matching feature string group in the teaching video are the playback progress of the teaching video synchronized with the learning video, thereby determining the starting position of the teaching video.

If there is no continuous characteristic string in the second characteristic string group that is completely consistent with the first characteristic string group, it means that the second characteristic string group cannot achieve 100% matching with the first characteristic string group. In an optional embodiment, the number of frames of consecutive character strings to be matched can be adjusted, for example, 60 consecutive feature strings are reduced to the most recent 30 consecutive frame images, that is, the first feature string group at this time That is, they are 30 consecutive feature string groups, and are matched with the second feature string group to determine whether there are the same 30 continuous feature string groups in the second feature string group. If there are the same 30 consecutive feature string groups in the second feature string group, then it is also possible to determine the continuous frame images and learning values corresponding to the 30 consecutive feature string groups in the second feature string group. Correspond to the current progress of the video and determine the starting position of the teaching video.

Further, if after adjusting the preset number of frames, there is still no continuous feature string that is completely consistent with the first feature string group in the second feature string group, then the matching degree requirement can be lowered. For example, reduce the matching degree to 95%, and when the preset number of frames is 60, 60*95%=57, take the first 57 continuous feature strings among the 60 continuous feature strings in the first feature string group. , and determine whether there are corresponding 57 continuous feature strings in the second feature string group that are consistent with the first 57 continuous feature strings; or take the last 57 continuous feature strings among the 60 continuous feature strings, and determine Whether there are corresponding 57 continuous feature strings in the second feature string group that are consistent with the last 57 continuous feature strings.

When there is a corresponding continuous feature string in the second feature string group, it is determined that the match is successful. If there is still no corresponding continuous feature string in the second feature string group, the matching degree can be further reduced to 90%, 85% % and 80%, and determine whether there are 54, 51 and 48 consecutive feature strings in the second feature string group and the 54, 51 and 48 consecutive feature strings in the first feature string group. The characteristic string is consistent.

It can be understood that the above loop matching method of reducing the matching degree can also include a matching method of adjusting the preset number of frames. For example, when the matching degree is reduced to 95% and the preset number of frames is 60, the second feature string If there are still no corresponding 57 continuous feature strings in the group, the preset number of frames can be further reduced, for example, to 30, and it is determined whether there are corresponding 28 continuous feature strings in the second feature string group. When the preset frame number is reduced and the matching still fails, the preset frame number is restored to the initial value, and the matching degree is reduced to 90% before matching again. By continuously adjusting the matching degree and adjusting the preset number of frames, the first feature string group and the second feature string group are matched cyclically until a continuous feature string is determined from the second feature string group, thereby determining the corresponding The continuous frame image is the starting position of the teaching video.

It should be noted that when the number of continuous feature strings of the preset number of frames is reduced for matching, if the continuous feature string is the first 30 of the 60 continuous feature strings, then the second feature string The 30 continuous feature strings matching it in the group correspond to the first 30 continuous feature strings in the first feature string group. At this time, the frame image corresponding to the video progress of the learning video is actually the 60th feature string. That is, it is the last feature string among 30 consecutive feature strings and 30 frames later. Therefore, 30 frames after the successfully matched 30th feature string in the second feature string group is the playback starting position of the teaching video corresponding to the video progress of the learning video.

It can be understood that when the number of matching teaching videos is determined to be greater than one in the teaching video library, each teaching video can be matched with the learning video respectively. When it is determined that the same continuous feature string exists in the second feature string group of a certain teaching video, the teaching video is the most matching teaching video among multiple teaching videos.

Further, based on the above-mentioned second embodiment of the present invention, a third embodiment of the teaching method of the present invention is proposed. In this embodiment, step S31 converts the continuous frame images of the learning video into first characteristic characters. The steps of string grouping and obtaining the second characteristic string group corresponding to the consecutive frame images of each teaching video from the teaching video library include:

Step S311, divide multiple background areas from the learning video of the learning terminal, and convert the continuous frame images of each background area into the corresponding first background area feature string group;

Step S312, divide the corresponding background area from each teaching video in the teaching video library, and convert the continuous frame images of the background area of each teaching video into the corresponding second background area feature string group;

The step S32 of matching the first characteristic string group with all second characteristic string groups, and determining a matching characteristic string group from the second characteristic string group that meets the matching requirements includes:

Step S321: Select a background area as the background area to be matched, match the first background area feature string group corresponding to the background area to be matched with the second background area feature string group in sequence, and determine whether there is a background area that meets the matching requirements. a second background area characteristic string group; wherein the matching requirement is that the matching degree between the first background area characteristic string group and the second background area characteristic string group reaches a preset matching threshold;

Step S322, when there is a second background area feature string group that meets the matching requirements, determine the matching feature string group from the second background area feature string group that meets the matching requirements;

Step S323: When there is no second background area feature string group that meets the matching requirements, update the background area to be matched according to the preset background area selection sequence, and return to the execution step of: adding the third background area corresponding to the background area to be matched. A background area feature string group is matched with a second background area feature string group in sequence.

In this embodiment, since the way the learner operates the game characters during the game is not exactly the same as that of the instructor, even under the same game progress, the frame images of the teaching video are not exactly the same as the frame images of the learning video. Correspondence, that is, the feature string corresponding to the teaching video frame image and the feature string corresponding to the learning video frame image are not the same. However, it is understandable that during the game, except for the fact that the image area affected by the game character is different from the image in the teaching video due to the different way the learner operates the game character, the learning video does not cause any problems due to the way the game character operates. The changed background area should completely correspond to the background area of the instructional video. That is, at the same game progress, the background area of the learning video and the background area of the teaching video are displayed consistent, and the corresponding feature strings of the two background areas should also be consistent. That is, when matching the frame image of the current game progress of the learning video with the teaching video to obtain the starting position of the teaching video, only the background area in the learning video frame image can be converted into a background area feature string, and combined with the teaching video The background area feature string corresponding to the video frame image is matched and compared.

What needs to be explained is how to determine the background area in the display area of the teaching video. The server can obtain multiple teaching videos with the same game name, the same game character, and the same game level, and encode each teaching video separately. If the frame image is a P frame, then perform discrete cosine transform DCT on the code stream of the P frame. deal with. The areas that are completely consistent in the frame images of multiple teaching videos are the background areas of the game level, while the areas that are inconsistent in the frame images are the non-background areas formed by different instructors due to different operating methods. area.

In an optional embodiment, multiple background areas may be pre-divided in the learning video of the learning terminal, and accordingly, the same background areas may be divided in the same manner in the teaching video. After determining a background area as the background area to be matched, feature string matching can be performed on the frame image of the background area to be matched in the learning video and the frame image of the background area to be matched in the teaching video. For example, after dividing the background area of the learning video into a left background area, an upper background area, and a right background area. The continuous frame images of the left background area of the learning video can be converted into continuous feature strings to form a corresponding first background area feature string group. Similarly, the continuous frame images of the left background area of the teaching video are converted into the second background area feature string group. Match the continuous feature strings in the first background area feature string group with the second background area feature string group, and determine whether the same continuous feature string exists in the second background area feature string group.

If it exists, the continuous feature strings in the second background area feature string group that meet the matching requirements and match the first background area feature string group can be used as the matching feature string group, and the continuous feature strings in the matching feature string group The continuous frame images corresponding to the feature string are the starting position of the teaching video. If it does not exist, the background area to be matched can be updated according to the preset background area selection sequence, for example, the continuous frame images of the upper background area of the learning video are converted into continuous features in the order of the left background area, the upper background area, and the right background area. string, and convert the continuous frame images of the upper background area of the teaching video into continuous feature strings, and then match them again. During the process of matching the left, upper and right background areas in sequence, if the same continuous feature string exists in the teaching video, it can be determined that the matching is successful and the matching process is exited.

Further, based on the above-mentioned first embodiment of the present invention, a fourth embodiment of the teaching method of the present invention is proposed. In this embodiment, the step S40 superimposes the teaching video on the learning video, from the The steps to play the starting position of the teaching video include:

Step S41, determine the delay length according to the preset margin rule;

Step S42, superimpose the teaching video in the learning video, and perform delay processing on the starting position of the teaching video according to the delay duration, starting from the delayed playback of the teaching video. playback from the starting position.

In this embodiment, it takes a certain amount of computing and processing time for the server to obtain the current game progress of the learning video from the learning terminal, determine the starting position of the teaching video to play, and push the superimposed video stream. At this time, the learner is still playing the game, and the game progress of the learning video is still advancing. Therefore, after determining the starting position of the teaching video, the game progress in the learning video is no longer at the original game progress position. At this time, the starting position of the teaching video also needs to be delayed so that the playing progress of the teaching video can keep up. Game progress on learning videos.

Moreover, even if the playback progress of the teaching video is completely consistent with the game progress of the learning video, since there is a certain reaction time for the learner to operate after seeing the teaching video, even if the learner performs the corresponding operation immediately after seeing the teaching video, it will not be possible. There will be a corresponding delay. Therefore, the playback progress of the teaching video should be slightly ahead of the game progress of the learning video, so that learners have a certain reaction time after seeing the teaching video. The server can store margin rules in advance. After determining the starting position of the teaching video, a delay length can be determined based on the margin rule, and the starting position of the teaching video can be delayed accordingly based on the delay length. After time processing, the video is played from the delay processing start position, so that the server's computing processing time does not affect the progress matching of the learning video and the teaching video, and can also leave corresponding reaction time for learners.

Further, based on the fourth embodiment of the present invention, a fifth embodiment of the teaching method of the present invention is proposed. In this embodiment, step S41, the step of determining the delay duration according to the preset margin rule includes:

Step S411, when determining the playback starting position of the teaching video, obtain the corresponding operation duration;

Step S412: Generate a delay duration based on the operation duration and a preset starting delay value.

In this embodiment, the server can obtain the corresponding operation time when determining the starting position of the teaching video according to the pre-stored margin rule, and superimpose a preset start delay value on the basis of the operation time. , to generate the delay duration. The computing time is the computing time from when the server receives the teaching request sent by the learning terminal to when the server determines the starting position of the teaching video. The preset start delay value can be 1 second. When superimposing the teaching video on the learning video, delaying the corresponding computing time can eliminate the impact of the server computing process on the game progress, and delaying the corresponding starting delay value can provide learners with reaction time, so that learners can After understanding the operation method of the teaching video, you can immediately practice it through the operation in the learning video.

Further, based on the above-mentioned first embodiment of the present invention, a sixth embodiment of the teaching method of the present invention is proposed. Refer to Figure 4. Figure 4 is a schematic flow chart of the sixth embodiment of the teaching method of the present invention. In this embodiment, Step S40, after the step of superimposing the teaching video on the learning video and playing the teaching video from the starting position of the teaching video, also includes:

Step S50: Obtain the operating parameters of the learning terminal every preset period;

Step S51, determine the video adjustment amount according to the operating parameters and the preset advance adjustment algorithm;

Step S52: Adjust the playback progress of the teaching video according to the video adjustment amount.

In this embodiment, since different learners have different reaction speeds, their adaptability to teaching videos is also different. After delaying the playback of the teaching video according to the preset start delay value, the playback progress of the teaching video can also be adjusted according to the learner's learning ability and operating level to make the playback progress of the teaching video more suitable for learning. By.

When the learner watches the teaching video, the operating parameters of the learning terminal can be obtained at preset intervals. Among them, the operation parameter can be the learner's operation effectiveness ratio L_P, and the operation effectiveness ratio is the number of effective operations/the total number of operations. After determining the learner's operation effectiveness ratio, the operation effectiveness ratio can be compared with the operation effectiveness ratio sampled in the previous cycle to determine the progress adjustment method of the teaching video. For example, when it is determined that the operation effective ratio obtained by this sampling is increased compared to the operation effective ratio of the previous sampling, the playback progress of the teaching video can be increased and adjusted, that is, the teaching video can be increased in advance relative to the learning video. . Correspondingly, if the effective ratio of this operation is lower than the effective ratio of the last sampled operation, the advance amount of the teaching video relative to the learning video can be reduced.

In an optional embodiment, after obtaining the learner's operational effectiveness ratio for each sampling, the advance parameter TC can be calculated, TC=(later sampling point L_P – previous sampling point L_P)*T, T is the interval preset period.

Video adjustment amount (C) = F (0.2, TC, 0.5);

Among them, F means that the TC value is taken when TC is between 0.2 to 0.5 or -0.5 to -0.2; when TC>0.5, C takes 0.5; when TC<-0.5, C takes -0.5; when -0.2<TC <0, C takes -0.2; when 0<TC<0.2, C takes 0.2.

After calculating the video adjustment amount C, if C>0, increase the advance amount of the video by C; if C<0, decrease the advance amount of the video by C.

It is understandable that when making video adjustments, corresponding special rules can also be set to make special adjustments according to the special rules when the corresponding rules are met. For example, the adjustment threshold of the operation effective ratio can be set in advance. When the sampled operation effective ratio is greater than the adjustment threshold, the playback progress of the teaching video does not need to be adjusted. It can also be set to not adjust when -0.2<TC<0.2. You can also set that if TC is between 0.2 and 0.5 for three consecutive times, no adjustment will be made from the third time. At the same time, since the normal reaction time of the human body should be at least higher than 0.2 seconds, no matter how the adjustment is made, the video advance of the teaching video relative to the learning video must be no less than 0.2 seconds.

Further, based on the above-mentioned first embodiment of the present invention, a seventh embodiment of the teaching method of the present invention is proposed. Refer to Figure 5. Figure 5 is a schematic flow chart of the seventh embodiment of the teaching method of the present invention. In this embodiment, Referring to step S20, the step of determining the teaching video matching the learner information from the teaching video library includes:

Step S21, obtain the teacher information corresponding to each teaching video from the teaching video library;

Step S22: Calculate the matching parameters of each teacher information and the learner information according to the preset matching algorithm;

Step S23: Determine the teaching video corresponding to the matching parameter with the highest matching degree as the teaching video matching the learner information.

In this embodiment, after obtaining the learner information of the learning terminal, the server can obtain the teacher information corresponding to each teaching video from the teaching video library, and calculate the relationship between each teacher information and the learning process according to the preset matching algorithm. The matching parameters of the user information. After calculating the matching parameters of all teaching videos and the learning videos, the teaching video corresponding to the matching parameter with the highest matching degree can be determined as the matching teaching video.

For example, the learner information may include game name L_ID, learner level L_G, role L_R, current level speed L_V = current level elapsed time (seconds)/((current level game progress/total level progress)*current level rated standard time ( seconds)) Operation effective ratio L_P = number of valid operations/total number of operations; accordingly, the teacher information may include game name T_ID, teacher level T_G, role T_R, level passing speed T_V = current level video duration (seconds)/current level rating Standard duration (seconds), operation validity ratio T_P = number of valid operations/total number of operations.

It is understandable that the instructional videos that learners learn should be instructional videos generated by the instructor operating the same character in the same game. Teaching videos that meet the requirements can be selected from the teaching video library based on the game name and game characters, thus reducing the number of matching teaching videos. After the server obtains the learner information, it can determine the name of the game and the game character currently played by the learner based on L_ID and L_R, and extract the teaching videos whose T_ID is the same as L_ID and T_R is the same as L_R from the teaching video library. The corresponding matching algorithm is pre-stored in the server. For each teaching video, the server can calculate a number of difference parameters between the learner and the teacher, such as the game level difference, the current level progress difference and the operation effective ratio difference, respectively. |L_G-T_G|, |L_V-T_V| and |L_P–T_P|. Different weight coefficients are also set for each difference parameter. By multiplying each difference parameter and the corresponding weight coefficient and then accumulating them, the matching parameters of the teaching video and the learning video can be obtained.

For example, for the difference in game level, current level progress difference and operation effectiveness ratio, the weight coefficient can be 1, square and cubic. Then the matching parameters of teaching videos and learning videos are:

M＝|L_G-T_G|+|L_V-T_V|*|L_V-T_V|+|L_P–T_P|*|L_P–T_P|*|L_P–T_P|;

Among all the teaching videos with the same game name and the same game character as the learning video, the matching parameter M of each teaching video is calculated. When the matching parameter M is the smallest, the teaching video has the highest matching degree with the learning video. The teaching video is Instructional videos identified as matching learner information.

Furthermore, the teaching video can be set to always follow the learner's progress. When the learner's game scene rolls back, causing the video progress of the learning video to roll back, the teaching video will also roll back accordingly to match the video progress of the learning video. Playback progress. For example, the server can also generate corresponding feature strings based on the background areas of the teaching video and the learning video at preset intervals, and determine whether the background areas of the teaching video and the learning video match. When it is detected that the background area of the learning video matches the teaching video There is a big gap in the background area (that is, when the learner scene fast forwards, pauses, and rewinds), the new starting position of the teaching video can be re-determined based on the new continuous frame images of the learning video, and then the new starting position of the teaching video can be re-determined according to the advance The amount adjustment algorithm determines the video adjustment amount to adjust the playback advance of the teaching video to achieve scene linkage with the learner.

Learners can also click on the display area of the teaching video to break away from the game state of the current learning video, enlarge the display of the teaching video and play it normally. When the learner controls the teaching video to be reduced from the enlarged display state to the partial area display state, the teaching video can be played again following the game progress of the learning video.

In addition, referring to Figure 6, an embodiment of the present invention also provides a teaching device, including:

The acquisition unit 10 is configured to acquire the learner information of the learning terminal according to the teaching request sent by the learning terminal;

The matching unit 20 is used to determine the teaching video that matches the learner information from the teaching video library;

Positioning unit 30, configured to determine the starting position of the teaching video according to the learning video of the learning terminal;

The playback unit 40 is configured to superimpose the teaching video on the learning video and play the teaching video from the starting position of the teaching video.

Optionally, positioning unit 30 is used for:

Convert the continuous frame images of the learning video into a first feature string group, and obtain the second feature string group corresponding to the continuous frame image of each teaching video from the teaching video library;

Match the first characteristic string group with all second characteristic string groups, and determine a matching characteristic string group from the second characteristic string group that meets the matching requirements;

The corresponding teaching video is determined according to the matching feature string group, and the playing position of the consecutive frame images corresponding to the matching feature string group is used as the playing starting position of the teaching video.

Optionally, positioning unit 30 is used for:

Divide multiple background areas from the learning video of the learning terminal, and convert the continuous frame images of each background area into a corresponding first background area feature string group;

Divide the corresponding background area from each teaching video in the teaching video library, and convert the continuous frame images of the background area of each teaching video into the corresponding second background area feature string group;

Select a background area as the background area to be matched, match the first background area feature string group corresponding to the background area to be matched with the second background area feature string group in sequence, and determine whether there is a second background that meets the matching requirements. Regional feature string group; wherein the matching requirement is that the matching degree between the first background area feature string group and the second background area feature string group reaches a preset matching threshold;

When there is a second background area feature string group that meets the matching requirements, determine the matching feature string group from the second background area feature string group that meets the matching requirements;

When there is no second background area feature string group that meets the matching requirements, update the background area to be matched according to the preset background area selection sequence, and return to the execution step of: converting the first background area corresponding to the background area to be matched The characteristic string group is matched with the second background area characteristic string group in sequence.

Optionally, the playback unit 40 is used for:

Determine the delay length according to the preset margin rules;

The teaching video is superimposed on the learning video, and the playback start position of the teaching video is delayed according to the delay duration, starting from the delayed playback start position of the teaching video. Play.

Optionally, the playback unit 40 is used for:

When determining the playback starting position of the teaching video, obtain the corresponding operation duration;

The delay duration is generated according to the operation duration and the preset starting delay value.

Optionally, the teaching device also includes an adjustment unit, which is used for:

Obtain the operating parameters of the learning terminal every preset period;

Determine the video adjustment amount according to the operating parameters and the preset advance adjustment algorithm;

The playback progress of the teaching video is adjusted according to the video adjustment amount.

Optionally, the matching unit 20 is used for:

Obtain the teacher information corresponding to each teaching video from the teaching video library;

Calculate the matching parameters of each teacher information and the learner information respectively according to the preset matching algorithm;

The teaching video corresponding to the matching parameter with the highest matching degree is determined as the teaching video matching the learner information.

The steps implemented by each functional unit of the teaching device may be referred to the various embodiments of the teaching method of the present invention, and will not be described again here.

In addition, the present invention also provides a teaching device. The terminal includes: a memory, a processor, a communication bus, and a teaching program stored on the memory:

The communication bus is used to realize connection communication between the processor and the memory;

The processor is used to execute the teaching program to implement the steps of each embodiment of the above teaching method.

The present invention also provides a computer-readable storage medium that stores one or more programs, and the one or more programs can also be executed by one or more processors to implement The steps of each embodiment of the above teaching method.

The specific implementation of the computer-readable storage medium of the present invention is basically the same as the above-mentioned embodiments of the teaching method, and will not be described again here.

It should be noted that, as used herein, the terms "include", "comprising" or any other variation thereof are intended to cover a non-exclusive inclusion, such that a process, method, article or system that includes a list of elements not only includes those elements, but It also includes other elements not expressly listed or that are inherent to the process, method, article or system. Without further limitation, an element defined by the statement "comprises a..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element.

The above serial numbers of the embodiments of the present invention are only for description and do not represent the advantages and disadvantages of the embodiments.

Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus the necessary general hardware platform. Of course, it can also be implemented by hardware, but in many cases the former is better. implementation. Based on this understanding, the technical solution of the present invention can be embodied in the form of a software product that is essentially or contributes to the existing technology. The computer software product is stored in a storage medium (such as ROM/RAM) as mentioned above. , magnetic disk, optical disk), including several instructions to cause a terminal device (which can be a mobile phone, a computer, a teaching device, an air conditioner, or a network device, etc.) to execute the methods described in various embodiments of the present invention.

The above are only preferred embodiments of the present invention, and do not limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the description and drawings of the present invention may be directly or indirectly used in other related technical fields. , are all similarly included in the scope of patent protection of the present invention.

Claims (8)

1. A teaching method, comprising the steps of:

acquiring learner information of a learning terminal according to a teaching request sent by the learning terminal;

determining a teaching video matched with the learner information from a teaching video library, wherein the teaching video is a teaching video of a learner in the same game level close to the operation level of the learner;

determining a play starting position of the teaching video according to the learning video of the learning terminal;

the teaching video is overlapped in the learning video, and is played from the play starting position of the teaching video, wherein the teaching video always follows the progress of a learner;

the step of determining the play starting position of the teaching video according to the learning video of the learning terminal comprises the following steps:

converting the continuous frame images of the learning videos into a first characteristic character string group, and acquiring a second characteristic character string group corresponding to the continuous frame images of each teaching video from the teaching video library;

Matching the first characteristic character string group with all the second characteristic character string groups, and determining a matching characteristic character string group from the second characteristic character string groups meeting the matching requirement;

determining a corresponding teaching video according to the matched characteristic character string group, and taking the playing position of the continuous frame image corresponding to the matched characteristic character string group as the playing starting position of the teaching video;

the step of converting the continuous frame images of the learning video of the learning terminal into a first characteristic character string group and obtaining a second characteristic character string group corresponding to the continuous frame images of each teaching video from the teaching video library comprises the following steps:

dividing a plurality of background areas from a learning video of the learning terminal, and converting continuous frame images of each background area into a corresponding first background area characteristic character string group;

dividing a corresponding background area from each teaching video in the teaching video library, and converting continuous frame images of the background area of each teaching video into a corresponding second background area characteristic character string group;

the step of matching the first characteristic string group with all the second characteristic string groups and determining the matched characteristic string group from the second characteristic string groups meeting the matching requirement comprises the following steps:

Selecting a background area as a background area to be matched, sequentially matching a first background area characteristic string group corresponding to the background area to be matched with a second background area characteristic string group, and judging whether the second background area characteristic string group meeting the matching requirement exists or not; the matching requirement is that the first background area characteristic character string group and the second background area characteristic character string group are continuous characteristic character strings which are completely consistent and have the character string length reaching a preset length;

when a second background area characteristic character string group meeting the matching requirement exists, determining the matching characteristic character string group from the second background area characteristic character string group meeting the matching requirement;

when the second background area characteristic character string group meeting the matching requirement does not exist, updating the background area to be matched according to the preset background area selection sequence, and returning to the execution step: and sequentially matching the first background area characteristic character string group corresponding to the background area to be matched with the second background area characteristic character string group.

2. The teaching method according to claim 1, wherein the step of superimposing the teaching video in the learning video and playing from a play start position of the teaching video comprises:

Determining delay time according to a preset margin rule;

and superposing the teaching video in the learning video, carrying out delay processing on the playing starting position of the teaching video according to the delay time length, and playing from the playing starting position after the delay processing of the teaching video.

3. The teaching method according to claim 2, wherein the step of determining the delay time length according to a preset margin rule includes:

when the play starting position of the teaching video is determined, acquiring corresponding operation duration;

and generating a delay time according to the operation time and a preset initial delay value.

4. The teaching method according to claim 1, wherein the step of superimposing the teaching video in the learning video and playing from a play start position of the teaching video further comprises:

acquiring operation parameters of the learning terminal every interval preset period;

determining a video adjustment amount according to the operation parameter and a preset advance adjustment algorithm;

and adjusting the playing progress of the teaching video according to the video adjustment amount.

5. The teaching method according to claim 1, wherein the step of determining a teaching video matching the learner information from a teaching video library includes:

Acquiring the information of the teaching person corresponding to each teaching video from the teaching video library;

respectively calculating matching parameters of each piece of teaching person information and the learner information according to a preset matching algorithm;

and determining the teaching video corresponding to the matching parameter with the highest matching degree as the teaching video matched with the learner information.

6. A teaching device, characterized in that it comprises:

the learning terminal comprises an acquisition unit, a learning unit and a processing unit, wherein the acquisition unit is used for acquiring learner information of the learning terminal according to a teaching request sent by the learning terminal;

the matching unit is used for determining teaching videos matched with the learner information from a teaching video library, wherein the teaching videos are teaching videos of the learner in the same game level close to the operation level of the learner;

the positioning unit is used for determining the play starting position of the teaching video according to the learning video of the learning terminal;

the playing unit is used for superposing the teaching video in the learning video and playing the teaching video from the playing starting position of the teaching video, wherein the teaching video always follows the progress of a learner;

the positioning unit is further used for converting the continuous frame images of the learning video into a first characteristic character string group and acquiring a second characteristic character string group corresponding to the continuous frame images of each teaching video from the teaching video library; matching the first characteristic character string group with all the second characteristic character string groups, and determining a matching characteristic character string group from the second characteristic character string groups meeting the matching requirement; determining a corresponding teaching video according to the matched characteristic character string group, and taking the playing position of the continuous frame image corresponding to the matched characteristic character string group as the playing starting position of the teaching video;

The positioning unit is further used for dividing a plurality of background areas from the learning video of the learning terminal and converting continuous frame images of each background area into corresponding first background area characteristic character string groups; dividing a corresponding background area from each teaching video in the teaching video library, and converting continuous frame images of the background area of each teaching video into a corresponding second background area characteristic character string group; selecting a background area as a background area to be matched, sequentially matching a first background area characteristic string group corresponding to the background area to be matched with a second background area characteristic string group, and judging whether the second background area characteristic string group meeting the matching requirement exists or not; the matching requirement is that the matching degree of the first background area characteristic character string group and the second background area characteristic character string group reaches a preset matching threshold; when a second background area characteristic character string group meeting the matching requirement exists, determining the matching characteristic character string group from the second background area characteristic character string group meeting the matching requirement; when the second background area characteristic character string group meeting the matching requirement does not exist, updating the background area to be matched according to the preset background area selection sequence, and returning to the execution step: and sequentially matching the first background area characteristic character string group corresponding to the background area to be matched with the second background area characteristic character string group.

7. A teaching device, characterized in that the teaching device comprises: memory, a processor and a teaching program stored on the memory and executable on the processor, which when executed by the processor implements the steps of the teaching method according to any of claims 1 to 5.

8. A computer readable storage medium, wherein a teaching program is stored on the computer readable storage medium, which when executed by a processor, implements the steps of the teaching method according to any of claims 1 to 5.