CN110191365A - A method, storage medium and system for action imitation - Google Patents

Abstract

The invention discloses a method, a storage medium and a system for action imitation, wherein the method comprises the steps of: turning on a display device and a magic mirror interface; The motion data of the imitator in front of the display device is displayed; the motion of the imitator is displayed in the magic mirror interface according to the motion data. The invention solves the problem of difficulty in checking individual imitation and learning comparison in the prior art when imitating and learning actions such as makeup, sports fitness, entertainment, education, and games played in reference display devices.

Description

A method, storage medium and system for action imitation

technical field

The present invention relates to the technical field of mixed reality, and in particular, to a method, storage medium and system for action simulation.

Background technique

At present, with the increasing popularity of the Internet, more and more users begin to obtain learning materials through the Internet. When the user is doing things like learning makeup, doing physical exercise with a fitness video, or imitating the voice or action of an actor in an entertainment program, in order to check the imitation and learning effect of the imitator, it needs to be compared with the standard action, usually by looking in a mirror. method, that is, the user imitates the action of the glass mirror, and observes whether the imitated and learned actions are in place by observing the mirror image in the glass mirror. Usually, in order to better compare the action, it is often necessary to splicing multiple glass mirrors into a mirror room. On the one hand, splicing multiple mirrors into a mirror room increases the difficulty of splicing, which leads to a higher cost. At the same time, the glass mirror is also easily broken, which is safe. On the other hand, since the actions imitated by the imitator cannot be synchronized with the actions played in the video, it is inconvenient to compare actions.

Therefore, the prior art still needs to be improved and further developed.

SUMMARY OF THE INVENTION

The technical problem to be solved by the present invention is to provide a method, storage medium and system for action imitation in view of the above-mentioned defects of the prior art, aiming to solve the problem of checking individual imitations when performing action imitation and learning in the prior art. Difficult questions when comparing the effects of learning.

The technical scheme adopted by the present invention for solving the above-mentioned technical problems is as follows:

A method for action imitation, comprising the steps of:

Turn on the display device and the magic mirror interface;

Obtain the motion data of the imitator in front of the display device in real time through the camera associated with the magic mirror interface;

The action of the imitator is displayed in the magic mirror interface according to the action data.

The method for action imitation, wherein the step obtains the action data of the imitator located in front of the display device through a camera associated with the magic mirror interface, and specifically includes:

The camera associated with the magic mirror interface is detected, and when the camera is detected, motion data of the imitator located in front of the display device is acquired, and the motion data is sent back to the display device.

The method for action imitation, wherein the magic mirror interface is suspended on the interface of the display device.

In the method for motion imitation, when the camera does not acquire the motion data of the imitator within a predetermined time, the magic mirror interface is in standby or closed.

In the method for action imitation, a camera associated with the magic mirror interface is detected, and an error prompt is issued when the camera is not detected.

In the method for action imitation, the area of the magic mirror interface is smaller than the interface area of the display device.

In the method for action imitation, the imitator's imitating object is the object displayed in the display device.

The method for action imitation, wherein the display device is any one of a TV, a computer and a PAD

A storage medium having stored thereon a plurality of instructions, wherein the instructions are adapted for one or more processors to load and execute the method as described above.

A system for motion imitation, wherein it includes:

display screen;

a camera associated with the magic mirror interface, used to obtain motion data of the imitator in front of the display device;

The action of the imitator is displayed in the magic mirror interface according to the action data.

Beneficial effect: by using the camera to capture the action of the imitator in real time, the obtained action data is sent back to the display device, and finally the action of the imitator is displayed in the magic mirror interface in the way of looking in a mirror. By adopting the method provided by the present invention, the user can perform action imitation and learning while facing the object to be imitated played in the interface of the display device, and at the same time, the effect of the imitation and learning can be detected and compared through the interface of the magic mirror, thereby realizing the imitator and the display. Synchronization of behavioral action imitation and learning in imitating objects in devices. It solves the problem of difficulty in checking individual imitation and learning comparison in the prior art when imitating and learning actions such as makeup, sports and fitness, entertainment, education, games, etc. shown in the reference display device.

Description of drawings

FIG. 1 is a flowchart of a preferred embodiment of the method for motion imitation in the present invention.

FIG. 2 is a view of a specific application scenario of the method for action imitation in the present invention.

FIG. 3 is a block diagram of a preferred embodiment of the motion imitation system of the present invention.

Detailed ways

In order to make the objectives, technical solutions and advantages of the present invention clearer and clearer, the present invention will be further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention.

Please also refer to FIGS. 1-2 , the present invention provides some embodiments of a method for motion imitation.

As shown in Figure 1, the method for action imitation of the present invention comprises the following steps:

S100. Turn on the display device and the magic mirror interface.

Specifically, the display device may be an electronic device such as a television, a desktop computer, a notebook computer, or a PAD. As an example, the present invention is explained by using a television as a display device, and is not intended to limit the present invention.

The magic mirror interface refers to the window used to display the picture captured by the camera, and the window is displayed independently on the interface of the display device (ie, suspended). The magic mirror is a small application, and its installation In the display device, the application can be loaded and called through the display device.

The display device can be turned on by means of physical keys, such as a remote control or a physical key on the display device, or through a voice mode or a mobile terminal bound to the display device in advance. The opening method of the magic mirror interface may be by voice or by pressing a physical button set on the remote control. In the present invention, it is preferable to open the magic mirror application through a voice command and enter the magic mirror interface, which can facilitate the use of the user.

S200. Acquire, in real time, motion data of an imitator located in front of the display device through a camera associated with the magic mirror interface.

Specifically, the magic mirror interface is associated with a camera, and the camera may be original on a display device, such as a TV with a camera. Of course, it can also be an external mobile camera. The camera is a camera with infrared function, which can provide the action of photographing the imitator in various time periods.

In one or more specific implementation manners, the step S200 specifically includes: detecting a camera associated with the magic mirror interface, and when the camera is detected, acquiring the information of the imitator located in front of the display device. Action data. That is, after the magic mirror is turned on through the voice command, the display device needs to detect the camera associated with the magic mirror interface. Only when the camera can be found, will it enter the magic mirror interface, and obtain the front (magic mirror) interface of the display device in real time through the camera. Motion data of the imitator in front of the mirror interface). That is to use the camera function of the camera to track and record the movement of the imitator, and completely record the actions of the imitator.

Further, after the magic mirror interface is normally started, the magic mirror interface is suspended on the interface of the TV by using the layer superposition technology. The magic mirror interface can be displayed on the four corners of the TV interface, or in the middle of the TV interface or near the four sides of the TV. The specific location can be adjusted according to the specific situation. The area of the magic mirror interface is much smaller than the screen area of the TV, because the magic mirror interface is suspended on the TV interface, the magic mirror interface is opaque, and the magic mirror interface will block the TV interface where it is located. . Therefore, by setting the area of the magic mirror interface to be smaller than that of the TV screen, it is more convenient for the user to imitate and learn according to the video played on the TV interface. Of course, the objects imitated by the imitators can also be in other forms, such as those stored in the mind, displayed by the users next to them, and so on.

Further, what the TV plays may be local media, TV applications, or client mirroring, which is not limited here.

S300. Display the action of the imitator in the magic mirror interface according to the action data.

Specifically, after obtaining the action data of the imitator, the camera associated with the magic mirror interface uses the streaming media protocol to return the data, and the TV system down-grades the received return data. Noise processing is performed to eliminate noise interference to obtain more stable and clear movements, and then the movements of the imitator are displayed on the magic mirror interface according to the processed return data. In order to ensure the security of the returned data, an encryption algorithm can also be used to encrypt and calculate the data. The involved streaming media protocol technology and encryption algorithm are both common existing technologies, and this is only a reference to the existing technology If applied, the specific technical details of the streaming media protocol technology and the encryption algorithm will not be repeated here.

In some implementation manners, the magic mirror interface can be set to be multiple, and each corresponding magic mirror interface has an associated camera. For example, when there are two magic mirror interfaces, they are respectively recorded as the first magic mirror interface, the second magic mirror interface, the first magic mirror interface and the second magic mirror interface, which are located on the display device respectively. For example, the first magic mirror interface may be at the lower right corner of the TV display screen, and the second magic mirror interface may be at the upper left corner, upper right corner or lower left corner of the TV. The actions of the imitator displayed at the same time on the first magic mirror interface and the second magic mirror interface are from different perspectives. The second magic mirror interface displays the actions of the imitator from the side view angle. By simultaneously displaying the actions of the imitator from the front view angle and the side view angle, it is possible to more comprehensively show whether the actions imitated by the imitator are in place.

In one or more embodiments, when the magic mirror interface is set to two (each corresponding magic mirror interface is respectively associated with a camera), they are respectively recorded as the first magic mirror interface, the second magic mirror interface, The first magic mirror interface and the second magic mirror interface are located at different positions of the display device, for example, the first magic mirror interface can be located in the lower right corner of the TV display screen, and the second magic mirror interface can be located on the TV upper left corner of the machine. The actions of the imitators displayed on the first magic mirror interface and the second magic mirror interface are actions performed by different imitators, that is, the first magic mirror interface and the second magic mirror interface work independently, It can satisfy two imitators at the same time to do imitating actions. That is, you can invite family members and friends to participate in it, and at the same time satisfy the two people for action imitation. Of course, the magic mirror interface can also be set to more than two, as long as each camera independently obtains the imitation data of the target (the imitator), and displays the imitation data on the magic mirror interface associated with the camera That's it.

In one or more embodiments, the magic mirror interface may further include an action scoring function. Specifically, the display device obtains the action data of the imitator in the display interface as standard data, and at the same time obtains the action data returned by the camera, that is, the action data of the imitator in the magic mirror interface, as the comparison data. Differences in standard data, give corresponding scores, such as grades are divided into pass, good, excellent and so on. By setting the scoring function, the imitation and comparison of the imitator is more scientific and reasonable, and the imitator can make the action imitation more targeted according to the scoring level given by the magic mirror interface.

In one or more specific implementation manners, if after the TV is turned on, the magic mirror is turned on through a voice command, and the system cannot detect a camera at this time, or in other words detects a camera, but the camera is not associated with the magic mirror interface, then An abnormal prompt dialog window pops up on the TV screen, for example, prompting the user to detect whether there is a camera such as a loose socket, the TV itself does not have a camera, and the magic mirror interface is not associated with a camera, etc. That is, the camera is faulty, and the task ends. Of course, in addition to prompting an abnormality in the form of text, it can also be broadcast by voice.

In one or more specific implementation manners, when the camera does not acquire motion data of the imitator within a predetermined time or acquires less motion data, the magic mirror interface is on standby or closed. Standby or close the magic mirror interface can save system resources and save the power consumption of the TV. Monitor the data obtained by the camera. If no imitator is moving in the data returned by the camera within the specified time (such as 3 minutes), the magic mirror interface will be put into a standby state or directly closed. Magic mirror interface. The monitoring of the data acquired by the camera is in the prior art, and details are not described here.

The method for action imitation provided by the present invention will be explained below through a specific application scenario.

For example, as shown in Figure 2, that is, a fitness video is played on the TV screen, and a magic mirror interface is suspended in the lower right corner of the TV screen. Simultaneously display with the video action played on the TV screen, that is, integrate the real imitation situation at this moment with the content in the video playback, which facilitates the comparison and detection of imitators. Because the screen of the TV is relatively large, the user can more clearly observe whether the imitated action is in place and whether the action is deformed. This facilitates the practice of imitators.

Through the above steps, it is convenient to check the comparison of individual imitation and learning.

It can be seen that in the method for action imitation according to the present invention, it is necessary to check whether a camera is installed on the camera display device. If a camera is found, the magic mirror interface is opened, and the magic mirror interface is suspended on the TV. In the lower right corner, the action data of the imitator is obtained through the camera, and the action data is sent back, and the action of the imitator is displayed in the magic mirror interface according to the action data. It realizes the synchronization of behavioral imitation and learning in the imitator and the imitated object in the display device.

Based on the above method, the present invention also provides a storage medium, where a plurality of instructions are stored on the storage medium, wherein the instructions are suitable for one or more processors to load and execute the above-mentioned method for action simulation. method.

In some embodiments, the processor may be a central processing unit, microprocessor or other data processing chip.

Based on the above method, the present invention also provides a system for action imitation, as shown in FIG. 3 , including: a display device 100;

The camera 300 associated with the magic mirror interface 200 is used to obtain the motion data of the imitator in front of the magic mirror interface;

The action of the imitator is displayed in the magic mirror interface according to the action data.

The technical details and benefits of the above system have been described in detail in the above method, and will not be repeated here.

To sum up, the method, storage medium and system for action imitation provided by the present invention load the magic mirror interface on the display device, the magic mirror interface is suspended on the display device interface, and the magic mirror interface is suspended on the display device interface, The camera associated with the magic mirror interface acquires the motion data of the imitator in front of the (display device) magic mirror interface in real time; rather than returning the obtained motion data to the display device, the display device will Action data, displaying the action of the imitator in the magic mirror interface. Therefore, while the user can imitate and learn the action of the object to be imitated displayed in the display device interface, on the other hand, the user can detect and compare the imitation effect through the magic mirror interface, so as to realize the behavior and action of the imitator and the imitated object in the display device. Simultaneous imitation and learning. It solves the problem of difficulty in checking individual imitation and learning comparison in the prior art when imitating and learning actions such as makeup, sports and fitness, entertainment, education, games, etc. shown in the reference display device.

It should be understood that the application of the present invention is not limited to the above examples. For those of ordinary skill in the art, improvements or transformations can be made according to the above descriptions, and all these improvements and transformations should belong to the protection scope of the appended claims of the present invention.

Claims (10)

1. a method for action imitation, is characterized in that, comprises the steps: Turn on the display device and the magic mirror interface; Obtain the motion data of the imitator in front of the display device in real time through the camera associated with the magic mirror interface; The action of the imitator is displayed in the magic mirror interface according to the action data. 2. The method for motion imitation according to claim 1, wherein the step obtains the motion data of the imitator in front of the display device through a camera associated with the magic mirror interface, specifically comprising: The camera associated with the magic mirror interface is detected, and when the camera is detected, motion data of the imitator located in front of the display device is acquired, and the motion data is sent back to the display device. 3 . The method for motion imitation according to claim 1 , wherein the magic mirror interface is suspended on the interface of the display device. 4 . 4. The method for motion imitation according to any one of claims 1-3, wherein when the camera does not acquire the motion data of the imitator within a predetermined time, the magic mirror interface is in standby or closure. 5 . The method for motion imitation according to claim 2 , wherein a camera associated with the magic mirror interface is detected, and an error prompt is issued when the camera is not detected. 6 . 6 . The method for motion imitation according to claim 3 , wherein the area of the magic mirror interface is smaller than the interface area of the display device. 7 . 7 . The method for action imitation according to claim 1 , wherein the imitated object of the imitator is the object displayed in the display device. 8 . 8. The method for action imitation according to claim 1, wherein the display device is any one of a television, a computer or a PAD. 9. A storage medium on which a plurality of instructions are stored, wherein the instructions are suitable for one or more processors to load and execute the method according to any one of claims 1-8. 10. A system for action imitation, characterized in that it comprises: display screen; a camera associated with the magic mirror interface, used to obtain motion data of the imitator in front of the display device; The action of the imitator is displayed in the magic mirror interface according to the action data.