CN105278667A - Data interaction method, data interaction system and mobile terminal - Google Patents

Abstract

The present invention relates to the technical field of mobile communication, and provides a data interaction method, comprising: a mobile terminal acquires application type information currently executed by a display device; and acquires an air operation identification library or a motion trajectory identification library corresponding to the application type information ; Obtain the user's air operation information or the user's motion track information, and query the operation instructions corresponding to the air operation information or the user's motion track information in the air operation identification library or the motion track identification library; and sending the operation instruction to the display device, so that the display device performs a corresponding operation. The present invention also provides a mobile terminal using the above method. In addition, the present invention also provides an interactive system, enabling the above-mentioned mobile terminal to interact with the display device. The invention can improve the convenience of somatosensory interaction between the user and the household large-screen device.

Description

Data interaction method and system, mobile terminal

technical field

The present invention relates to the technical field of mobile communication, in particular to a data interaction method and system, and a mobile terminal.

Background technique

With the development of society and the advancement of science and technology, the control methods for household large-screen devices are becoming more and more intelligent. At present, a control method that is more popular among users is that users can directly interact with the TV through body movements. A camera or infrared probe is installed on the machine to identify the user's air movements. This implementation method requires the user to stand directly in front of the TV to perform air-isolation operations. If the user is too far away from the TV or the position of the station is too biased, it will affect the accurate recognition of the air-isolation action by the TV, thereby affecting the user experience. caused a certain impact.

Contents of the invention

In order to overcome the problem of low user experience caused by excessive restrictions on user positions in the prior art, the first aspect of the embodiments of the present invention provides a data interaction method, including:

The mobile terminal acquires the application type information currently executed by the display device; the mobile terminal acquires an air manipulation identification library corresponding to the application type information;

The mobile terminal obtains air operation information of the user;

The mobile terminal queries the air operation identification database for operation instructions corresponding to the air operation information;

The mobile terminal sends the operation instruction to the display device, so that the display device performs a corresponding operation.

In the second aspect, the embodiment of the present invention also provides another data interaction method, including:

The mobile terminal obtains the application type information currently executed by the display device;

The mobile terminal acquires a motion trajectory identification library corresponding to the application type information;

The mobile terminal acquires its own motion trajectory information;

The mobile terminal searches the movement trajectory identification database for operation instructions corresponding to the movement trajectory information;

The mobile terminal sends the operation instruction to the display device, so that the display device performs a corresponding operation.

In a third aspect, the embodiment of the present invention also provides a mobile terminal, including:

An application type information acquisition module, configured to acquire the application type information currently executed by the display device;

An air-operation identification library acquisition module, configured to acquire an air-operation identification library corresponding to the application type information;

The air operation information acquisition module is used to obtain the user's air operation information;

A query module, configured to query the operation instruction corresponding to the air operation information in the air operation identification library;

A sending module, configured to send the operation instruction to the display device, so that the display device performs a corresponding operation.

In a fourth aspect, the embodiment of the present invention also provides another mobile terminal, including:

An application type information acquisition module, configured to acquire the application type information currently executed by the display device;

A motion track identification library acquisition module, configured to acquire a motion track identification library corresponding to the application type information;

a motion sensing sensor, used to acquire motion track information of the mobile terminal;

A query module, configured to query the motion track identification library for operation instructions corresponding to the motion track information;

A sending module, configured to send the operation instruction to the display device, so that the display device performs a corresponding operation.

In the fifth aspect, the embodiment of the present invention further provides a data interaction system, including the above-mentioned mobile terminal and a display device.

In the embodiment of the present invention, the mobile terminal acquires the user's air operation information on the display device, and the mobile terminal determines the operation instruction corresponding to the air operation information, and sends the operation instruction to the display device, so that the display device performs the corresponding operation. In this way, the portability of the mobile terminal allows the user to adjust the station at will, which greatly facilitates the user.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention. For those skilled in the art, other drawings can also be obtained based on these drawings without creative effort.

Fig. 1 is a schematic flow chart of the first embodiment of the data interaction method of the present invention;

Fig. 2 is a schematic flow chart of the second embodiment of the data interaction method of the present invention;

FIG. 3 is a schematic flowchart of a third embodiment of the data interaction method of the present invention;

FIG. 4 is a schematic flowchart of a fourth embodiment of the data interaction method of the present invention;

FIG. 5 is a schematic structural diagram of the first embodiment of the mobile terminal of the present invention;

FIG. 6 is a schematic structural diagram of a second embodiment of the mobile terminal of the present invention;

FIG. 7 is a schematic structural diagram of a third embodiment of the mobile terminal of the present invention;

FIG. 8 is a schematic structural diagram of a fourth embodiment of the mobile terminal of the present invention;

Fig. 9 is a schematic structural diagram of the first embodiment of the data interaction system of the present invention.

detailed description

In order to make the technical problems, technical solutions and beneficial effects solved by the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

Please refer to FIG. 1 , which is a schematic flowchart of the first embodiment of the data interaction method of the present invention. The data interaction methods include:

In step S11 , the mobile terminal receives the application type information currently executed by the display device.

In this embodiment, the mobile terminal may establish a communication connection with the display device to obtain application type information of the application currently executed by the display device. Or scan the image currently displayed by the display device through its camera, and determine the application type information currently executed by the display device according to the displayed image.

The above-mentioned communication link can be a wired connection or a wireless connection, such as: it can be based on the DLNA (Digital Living Network Alliance, Digital Living Network Alliance) protocol or the IGRS protocol or the Miracast protocol (this protocol aims to provide simplified discovery and settings, so that users can quickly connect to the device. transfer data between them), or establish a communication link between the mobile terminal and the display device through WiFi (WIreless-FIdelity, also known as Wi-Fi).

The above application type information is used to distinguish and determine the application types currently executed by the display device, and the application types include system desktop, setting menu, multimedia player software, games, and so on.

The above-mentioned display devices include large-screen display devices such as monitors, televisions, home desktop computers, and all-in-one computers. The number of display devices connected to the mobile terminal at the same time can be one or more; the number of mobile terminals connected to the display device at the same time can also be one or more, so that multiple people can simultaneously operate on the display device through their respective mobile terminals same game.

In step S12, the mobile terminal acquires an air manipulation identification library corresponding to the application type information.

In this embodiment, different application types correspond to different air manipulation recognition libraries. Each air-operation identification library includes several air-operation information and operation instructions corresponding to each air-operation information.

Step S13, the mobile terminal obtains the air operation information of the user.

In this embodiment, the air operation information is generated by the user's air operation on the mobile terminal. Different air operations generate different air operation information.

Step S14, the mobile terminal searches the air manipulation identification database for the operation instruction corresponding to the air manipulation information.

The mobile terminal obtains the air operation information of the user, and queries the operation instruction corresponding to the air operation information in the air operation identification library corresponding to the application type information.

In this embodiment, the operation instruction is any one of a movement instruction, a zoom instruction, a selection instruction, and a confirmation execution instruction.

When the current application type is a game type, the movement commands include acceleration, deceleration, left turn, right turn, jumping over obstacles, going upstairs, etc. Different movement commands correspond to different user air operations, and these air operations can be Defined by the user.

In step S15, the mobile terminal sends an operation instruction to the display device, so that the display device performs a corresponding operation.

After querying the operation instruction corresponding to the air-space operation information, the mobile terminal sends the operation instruction to the display device with which the communication is established, so that the display device executes the corresponding operation.

Exemplarily, corresponding to the moving instruction, the display device executes the operation of moving the executed object in the current application; corresponding to the scaling instruction, the display device executes the operation of zooming the executed object in the current application; An operation of the object to be executed in the application; corresponding to the confirmation instruction, the display device performs an operation of determining the object to be executed in the current application.

In the embodiment of the present invention, the mobile terminal acquires the user's air operation information on the display device, and the mobile terminal determines the operation instruction corresponding to the air operation information, and sends the operation instruction to the display device, so that the display device performs the corresponding operation. In this way, the portability of the mobile terminal allows the user to adjust the station at will, which greatly facilitates the user.

Please refer to FIG. 2 , which is a schematic flowchart of a second embodiment of the data interaction method of the present invention. The data interaction methods include:

In step S21, the mobile terminal receives the application type information currently executed by the display device.

This step is the same as the corresponding step in the first embodiment, and will not be repeated here.

In step S22, the mobile terminal acquires an air manipulation identification library corresponding to the application type information.

This step is the same as the corresponding step in the first embodiment, and will not be repeated here.

In step S23, the mobile terminal determines the air operation information of the user according to the acquired ultrasonic reflection signal and ultrasonic receiving time difference information.

In this embodiment, the mobile terminal is provided with an ultrasonic sensor, and the ultrasonic sensor includes an ultrasonic sending end and a plurality of ultrasonic receiving ends.

In this embodiment, the ultrasonic reflection signal is a signal received by each ultrasonic receiving end after the ultrasonic wave emitted by the ultrasonic sending end is reflected by an executing body (such as a user's finger or other pointers) performing air-space operations. The ultrasonic receiving time difference information is time difference information of successively received ultrasonic reflection signals by each ultrasonic receiving end.

In this embodiment, in order to avoid false triggers caused by other irrelevant actions of the user, a threshold distance can be defined, and the sensor can measure the distance between the user's finger or other pointers and the mobile terminal in real time. When the measured distance is greater than When the threshold distance is exceeded, the mobile terminal does not respond to the air operation; when the measured distance is less than the threshold distance, the mobile terminal responds to the air operation. Wherein, the threshold distance may be a distance preset by the system, or a distance defined by the user.

In step S24, the mobile terminal searches the air manipulation identification library for the operation instruction corresponding to the air manipulation information.

This step is the same as the corresponding step in the first embodiment, and will not be repeated here.

In step S25, the mobile terminal sends an operation instruction to the display device, so that the display device performs a corresponding operation.

This step is the same as the corresponding step in the first embodiment, and will not be repeated here.

In this embodiment, through the ultrasonic sending end and multiple ultrasonic receiving ends set on the mobile terminal, the mobile terminal can judge the orientation and location of the executive body currently operating in the air in real time according to the signals received by each ultrasonic receiving end and the time difference information. Gesture information, high judgment accuracy, rich postures of executable objects that can be recognized, improves the reliability of the mobile terminal to control the display device, and enhances the user experience.

Please refer to FIG. 3 , which is a schematic flowchart of a third embodiment of the data interaction method of the present invention. The data interaction methods include:

In step S31, the mobile terminal receives the application type information currently executed by the display device.

This step is the same as the corresponding step in the first embodiment, and will not be repeated here.

In step S32, the mobile terminal acquires a motion trajectory identification library corresponding to the application type information.

In this embodiment, different application types correspond to different motion trajectory recognition libraries. Each movement trajectory identification library includes a number of movement trajectory information and operation instructions corresponding to each movement trajectory information.

In step S33, the mobile terminal acquires its own motion track information.

In this embodiment, the motion trajectory information is generated by the user holding the mobile terminal and waving the mobile terminal in the air according to a specific trajectory. Different waving trajectories generate different motion trajectory information.

In step S34, the mobile terminal searches the motion track identification database for operation instructions corresponding to the motion track information.

The mobile terminal acquires the user's motion track information, and queries the operation instructions corresponding to the motion track information in the motion track identification library corresponding to the application type information.

In this embodiment, the operation instruction is any one of a movement instruction, a zoom instruction, a selection instruction, and a confirmation execution instruction.

In step S35, the mobile terminal sends an operation instruction to the display device, so that the display device performs a corresponding operation.

This step is the same as the corresponding step in the first embodiment, and will not be repeated here.

In the embodiment of the present invention, the mobile terminal receives the application type information currently executed by the display device, obtains the motion trajectory identification library corresponding to the application information, and obtains the motion trajectory of the mobile terminal itself to find the corresponding operation instructions to control the display device to execute the corresponding operation. operate. On the one hand, it realizes the interaction with display devices such as household large-screen devices without increasing additional purchase costs. On the other hand, it overcomes the defect that human-computer interaction is greatly affected by environmental factors in the prior art. The user's operation instructions to the mobile terminal can be reliably transmitted from the mobile terminal to the display device through the communication connection established between the mobile terminal and the display device, thereby improving user experience.

Please refer to FIG. 4 , which is a schematic flowchart of a fourth embodiment of the data interaction method of the present invention. The data interaction methods include:

In step S41, the mobile terminal receives application type information currently executed by the display device.

This step is the same as the corresponding step in the third embodiment, and will not be repeated here.

In step S42, the mobile terminal acquires a motion trajectory identification library corresponding to the application type information.

This step is the same as the corresponding step in the third embodiment, and will not be repeated here.

In step S43, the mobile terminal acquires its own motion trajectory information through the motion sensing sensor.

A motion sensing sensor is provided on the mobile terminal, and the motion sensing sensor includes any one of a nine-axis sensor, an acceleration sensor, a gravity sensor, and an angle sensor.

In this embodiment, the mobile terminal can obtain its own movement track information through cooperation of one or more of a nine-axis sensor, an acceleration sensor, a gravity sensor, and an angle sensor.

In step S44, the mobile terminal searches the motion track recognition database for operation instructions corresponding to the motion track information.

This step is the same as the corresponding step in the third embodiment, and will not be repeated here.

In step S45, the mobile terminal sends an operation instruction to the display device, so that the display device performs a corresponding operation.

In this embodiment, the motion track information of the mobile terminal is obtained through the motion sensing sensor that the mobile terminal carries. Motion trajectory information, in order to achieve the purpose of improving the accuracy of obtaining the motion trajectory of the mobile terminal. The reliability of the display device controlled by the mobile terminal is improved, and the user experience is enhanced.

An embodiment of a data interaction method of the present invention has been introduced in detail above. The mobile terminal corresponding to the above method will be further described below, wherein the mobile terminal includes a mobile phone, a tablet computer, MP3, MP4, or a notebook computer.

Please refer to FIG. 5 , which is a schematic structural diagram of the first embodiment of the mobile terminal of the present invention. The mobile terminal 100 includes: an application type information acquisition module 110 , an air manipulation identification library acquisition module 120 , an air manipulation information acquisition module 130 , a query module 140 and a sending module 150 .

Wherein, the application type information acquisition module 110 is connected with the air manipulation recognition library acquisition module 120 for receiving the application type information currently executed by the display device.

After the communication link is established between the mobile terminal and the display device, the receiving module of the mobile terminal receives the application type information of the application currently executed by the display device.

The above-mentioned communication link can be a wired connection or a wireless connection, such as: it can be based on the DLNA (Digital Living Network Alliance, Digital Living Network Alliance) protocol or the IGRS protocol or the Miracast protocol (this protocol aims to provide simplified discovery and settings, so that users can quickly connect to the device. transfer data between them), or establish a communication link between the mobile terminal and the display device through WiFi (WIreless-FIdelity, also known as Wi-Fi).

The above application type information is used to distinguish and determine the application types currently executed by the display device, and the application types include system desktop, setting menu, multimedia player software, games, and so on.

The above-mentioned display devices include large-screen display devices such as monitors, televisions, home desktop computers, and all-in-one computers. The number of display devices simultaneously connected to the mobile terminal may be one or more.

The air-operation identification library acquisition module 120 is connected to the query module 140, and is used to acquire the air-operation identification library corresponding to the application type information.

Different application types correspond to different air manipulation recognition libraries. Each air-operation identification library includes several air-operation information and operation instructions corresponding to each air-operation information.

The air operation information acquisition module 130 is connected to the query module 140 for acquiring the user's air operation information.

The above-mentioned air operation information is generated by the user's air operation on the mobile terminal. Different air operations generate different air operation information.

The query module 140 is connected with the sending module 150, and is used for querying the operation instruction corresponding to the air operation information in the air operation recognition database.

The operation instruction is any one of a movement instruction, a scaling instruction, a selection instruction, and a confirmation execution instruction.

The sending module 150 is configured to send an operation instruction to the display device, so that the display device performs a corresponding operation.

After querying the operation instruction corresponding to the air-space operation information, the sending module sends the operation instruction to the display device with which the communication is established, so that the display device executes the corresponding operation.

Exemplarily, corresponding to the moving instruction, the display device executes the operation of moving the executed object in the current application; corresponding to the scaling instruction, the display device executes the operation of zooming the executed object in the current application; An operation of the object to be executed in the application; corresponding to the confirmation instruction, the display device performs an operation of determining the object to be executed in the current application.

In the embodiment of the present invention, the mobile terminal receives the application type information currently executed by the display device, identifies and obtains the air operation identification library corresponding to the application information, and obtains the user's air operation to find the corresponding operation command to control the display device to execute the corresponding operation. operation. On the one hand, it realizes the interaction with display devices such as household large-screen devices without increasing additional purchase costs. On the other hand, it overcomes the defect that human-computer interaction is greatly affected by environmental factors in the prior art. The user's operation instructions to the mobile terminal can be reliably transmitted from the mobile terminal to the display device through the communication connection established between the mobile terminal and the display device, thereby improving user experience.

Please refer to FIG. 6 , which is a schematic structural diagram of a second embodiment of the mobile terminal of the present invention. The mobile terminal 200 includes: an application type information acquisition module 210 , an air manipulation identification database acquisition module 220 , an air manipulation information acquisition module 230 , a query module 240 and a sending module 250 .

Wherein, the application type information acquisition module 210 is connected with the air manipulation recognition library acquisition module 220 for receiving the application type information currently executed by the display device.

The principle of this module is the same as that of the corresponding module in the first embodiment of the mobile terminal, and will not be repeated here.

The air-operation identification library acquisition module 220 is connected to the query module 240, and is used to acquire the air-operation identification library corresponding to the application type information.

The principle of this module is the same as that of the corresponding module in the first embodiment of the mobile terminal, and will not be repeated here.

The air operation information acquisition module 230 is connected to the query module 240, and is used to determine the user's air operation information according to the acquired ultrasonic reflection signal and ultrasonic receiving time difference information.

The user information determining module 230 is provided with an ultrasonic sensor, and the ultrasonic sensor includes an ultrasonic sending end and a plurality of ultrasonic receiving ends.

In this embodiment, the ultrasonic reflection signal is a signal received by each ultrasonic receiving end after the ultrasonic wave emitted by the ultrasonic sending end is reflected by an executing body (such as a user's finger or other pointers) performing air-space operations. The ultrasonic receiving time difference information is time difference information of successively received ultrasonic reflection signals by each ultrasonic receiving end.

In this embodiment, in order to avoid false triggers caused by other irrelevant actions of the user, a threshold distance can be defined, and the sensor can measure the distance between the user's finger or other pointers and the mobile terminal in real time. When the measured distance is greater than When the threshold distance is exceeded, the mobile terminal does not respond to the air operation; when the measured distance is less than the threshold distance, the mobile terminal responds to the air operation. Wherein, the threshold distance may be a distance preset by the system, or a distance defined by the user.

The query module 240 is connected to the sending module 250, and is used for querying the operation instruction corresponding to the air operation information in the air operation identification database.

The principle of this module is the same as that of the corresponding module in the first embodiment of the mobile terminal, and will not be repeated here.

The sending module 250 is configured to send an operation instruction to the display device, so that the display device performs a corresponding operation.

The principle of this module is the same as that of the corresponding module in the first embodiment of the mobile terminal, and will not be repeated here.

In this embodiment, through the ultrasonic sending end and multiple ultrasonic receiving ends set on the mobile terminal, the mobile terminal can judge the orientation and location of the executive body currently operating in the air in real time according to the signals received by each ultrasonic receiving end and the time difference information. Gesture information, high judgment accuracy, rich postures of executable objects that can be recognized, improves the reliability of the mobile terminal to control the display device, and enhances the user experience.

Please refer to FIG. 7 , which is a schematic structural diagram of a third embodiment of the mobile terminal of the present invention. The mobile terminal 300 includes: an application type information acquisition module 310 , a motion track identification library acquisition module 320 , a motion induction sensor 330 , a query module 340 and a sending module 350 .

Wherein, the application type information acquisition module 310 is connected with the motion track recognition library acquisition module 320 for receiving the application type information currently executed by the display device.

The principle of this module is the same as that of the corresponding module in the first embodiment of the mobile terminal, and will not be repeated here.

The movement trajectory identification library acquisition module 320 is connected with the query module 340 and used to acquire the movement trajectory identification library corresponding to the application type information.

Different application types correspond to different motion trajectory recognition libraries. Each movement trajectory identification library includes a number of movement trajectory information and operation instructions corresponding to each movement trajectory information.

The motion sensing sensor 330 is connected with the query module 340 and is used to obtain the motion track information of the mobile terminal itself.

The motion trajectory information is generated by the user holding the mobile terminal and waving the mobile terminal in the air according to a specific trajectory. Different waving trajectories generate different motion trajectory information.

The query module 340 is connected with the sending module 350, and is used for querying the operation instruction corresponding to the motion track information in the motion track recognition database. By acquiring the user's motion track information, and querying the operation instructions corresponding to the motion track information in the motion track identification library corresponding to the application type information.

In this embodiment, the operation instruction is any one of a movement instruction, a zoom instruction, a selection instruction, and a confirmation execution instruction.

The sending module 350 is configured to send an operation instruction to the display device, so that the display device performs a corresponding operation.

The principle of this module is the same as that of the corresponding module in the first embodiment of the mobile terminal, and will not be repeated here.

In the embodiment of the present invention, the mobile terminal receives the application type information currently executed by the display device, obtains the motion trajectory identification library corresponding to the application information, and obtains the motion trajectory of the mobile terminal itself to find the corresponding operation instructions to control the display device to execute the corresponding operation. operate. On the one hand, it realizes the interaction with display devices such as household large-screen devices without increasing additional purchase costs. On the other hand, it overcomes the defect that human-computer interaction is greatly affected by environmental factors in the prior art. The user's operation instructions to the mobile terminal can be reliably transmitted from the mobile terminal to the display device through the communication connection established between the mobile terminal and the display device, thereby improving user experience.

Please refer to FIG. 8 , which is a schematic structural diagram of a fourth embodiment of the mobile terminal of the present invention. The mobile terminal 400 includes: an application type information acquisition module 410 , a motion trajectory identification library acquisition module 420 , a motion induction sensor 430 , a query module 440 and a sending module 450 .

Wherein, the application type information acquisition module 410 is connected with the movement track recognition library acquisition module 420 for receiving the application type information currently executed by the display device.

The principle of this module is the same as that of the corresponding module in the third embodiment of the mobile terminal, and will not be repeated here.

The movement trajectory identification library acquisition module 420 is connected with the query module 440, and is used to acquire the movement trajectory identification library corresponding to the application type information.

The principle of this module is the same as that of the corresponding module in the third embodiment of the mobile terminal, and will not be repeated here.

The motion sensing sensor 430 is connected to the query module 440, and is used to obtain its own motion track information through the motion sensing sensor.

The motion sensing sensor 430 is provided with a motion sensing sensor, and the motion sensing sensor includes any one of a nine-axis sensor, an acceleration sensor, a gravity sensor, and an angle sensor.

In this embodiment, the mobile terminal can obtain its own movement track information through cooperation of one or more of a nine-axis sensor, an acceleration sensor, a gravity sensor, and an angle sensor.

The query module 440 is connected with the sending module 450, and is used for querying the operation instruction corresponding to the motion track information in the motion track recognition database.

The principle of this module is the same as that of the corresponding module in the third embodiment of the mobile terminal, and will not be repeated here.

The sending module 450 is configured to send an operation instruction to the display device, so that the display device performs a corresponding operation.

The principle of this module is the same as that of the corresponding module in the third embodiment of the mobile terminal, and will not be repeated here.

In this embodiment, the motion track information of the mobile terminal is obtained through the motion sensing sensor that the mobile terminal carries. Motion trajectory information, in order to achieve the purpose of improving the accuracy of obtaining the motion trajectory of the mobile terminal. The reliability of the display device controlled by the mobile terminal is improved, and the user experience is enhanced.

The embodiments of the mobile terminal of the present invention have been introduced in detail above. The interactive system corresponding to the mobile terminal will be further elaborated below.

Please refer to FIG. 9 , which is a schematic structural diagram of the first embodiment of the interactive system of the present invention. The interactive system 50 includes: a mobile terminal 500 and a display device 501 connected to each other.

Wherein, the mobile terminal 500 may be any one of the above mobile terminal embodiments 1 to 4.

Exemplarily, the mobile terminal 500 includes:

An application type information acquisition module 510 , an air manipulation identification library acquisition module 520 , an air manipulation information acquisition module 530 , a query module 540 and a sending module 550 .

Wherein, the application type information acquisition module 510 is connected with the air manipulation recognition library acquisition module 520 for receiving the application type information currently executed by the display device.

The air-operation identification library acquisition module 520 is connected to the query module 540, and is used to acquire the air-operation identification library corresponding to the application type information.

Different application types correspond to different air manipulation recognition libraries. Each air-operation identification library includes several air-operation information and operation instructions corresponding to each air-operation information.

The air operation information acquisition module 530 is connected to the query module 540 for acquiring the user's air operation information.

The above-mentioned air operation information is generated by the user's air operation on the mobile terminal. Different air operations generate different air operation information.

The query module 540 is connected with the sending module 550, and is used for querying the operation instruction corresponding to the air operation information in the air operation recognition library. In the air operation identification library corresponding to the application type information, query the operation instruction corresponding to the air operation information.

The operation instruction is any one of a movement instruction, a scaling instruction, a selection instruction, and a confirmation execution instruction.

The sending module 550 is configured to send an operation instruction to the display device, so that the display device performs a corresponding operation.

The display device 501 includes large-screen display devices such as monitors, televisions, home desktop computers, and all-in-one computers. In this embodiment, the number of display devices simultaneously connected to the mobile terminal can be one or more, or multiple mobile terminals can also be connected to the same display device at the same time. Operate the same game on the display device.

In the interactive system of the embodiment of the present invention, the mobile terminal receives the application type information currently executed by the display device, identifies and obtains the air operation identification library corresponding to the application information, and obtains the user's air operation to find the corresponding operation command to control the display. The device performs the corresponding operation. On the one hand, it realizes the interaction with display devices such as household large-screen devices without increasing additional purchase costs. On the other hand, it overcomes the defect that human-computer interaction is greatly affected by environmental factors in the prior art. The user's operation instructions to the mobile terminal can be reliably transmitted from the mobile terminal to the display device through the communication connection established between the mobile terminal and the display device, thereby improving user experience.

The essence of the technical solution of the present invention or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions. So that a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor (processor) executes all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-OnlyMemory), random access memory (RAM, RandomAccessMemory), magnetic disk or optical disk and other media that can store program codes.

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present invention should be included in the protection of the present invention. within range.

Claims (10)

1. A data interaction method, characterized in that, comprising: The mobile terminal acquires the application type information currently executed by the display device; the mobile terminal acquires an air manipulation identification library corresponding to the application type information; The mobile terminal obtains air operation information of the user; The mobile terminal queries the air operation identification database for operation instructions corresponding to the air operation information; The mobile terminal sends the operation instruction to the display device, so that the display device performs a corresponding operation. 2. The data interaction method according to claim 1, wherein the mobile terminal is provided with an ultrasonic sensor, the ultrasonic sensor includes an ultrasonic sending end and a plurality of ultrasonic receiving ends, and the mobile terminal obtains the user's space Steps to manipulate information, including: The mobile terminal determines the air operation information of the user according to the acquired ultrasonic reflection signal and ultrasonic receiving time difference information; The ultrasonic reflection signal is a signal received by each of the ultrasonic receiving ends after the ultrasonic waves emitted by the ultrasonic sending end are reflected by the execution body implementing the air separation operation; The ultrasonic receiving time difference information is time difference information of successively receiving the ultrasonic reflected signals by each ultrasonic receiving end. 3. The data interaction method according to claim 1, wherein the operation instruction is any one of a move instruction, a zoom instruction, a selection instruction, and a confirmation execution instruction. 4. A data interaction method, comprising: The mobile terminal obtains the application type information currently executed by the display device; The mobile terminal acquires a motion trajectory identification library corresponding to the application type information; The mobile terminal acquires its own motion track information; The mobile terminal searches the movement trajectory identification database for operation instructions corresponding to the movement trajectory information; The mobile terminal sends the operation instruction to the display device, so that the display device performs a corresponding operation. 5. The data interaction method according to claim 4, wherein the mobile terminal is provided with a motion sensing sensor, and the motion sensing sensor includes any one of a nine-axis sensor, an acceleration sensor, a gravity sensor, and an angle sensor item; The step of the mobile terminal obtaining the motion track information of the motion sensing sensor itself includes: The mobile terminal obtains its own motion track information through the motion sensing sensor. 6. A mobile terminal, characterized in that, comprising: An application type information acquisition module, configured to receive information about the application type currently executed by the display device; An air-operation identification library acquisition module, configured to acquire an air-operation identification library corresponding to the application type information; The air operation information acquisition module is used to obtain the user's air operation information; A query module, configured to query the operation instruction corresponding to the air operation information in the air operation identification library; A sending module, configured to send the operation instruction to the display device, so that the display device performs a corresponding operation. 7. The mobile terminal according to claim 6, wherein the mobile terminal is provided with an ultrasonic sensor, and the ultrasonic sensor includes an ultrasonic transmitting terminal and a plurality of ultrasonic receiving terminals; The air-isolation operation information acquisition module is further used to determine the air-isolation operation information of the user according to the acquired ultrasonic reflection signal and ultrasonic receiving time difference information. The signals received by each of the ultrasonic receiving ends after being reflected by the execution body of the air-space operation, the ultrasonic receiving time difference information is the time difference information of each of the ultrasonic receiving ends successively receiving the ultrasonic reflected signals. 8. A mobile terminal, characterized in that it comprises: An application type information acquisition module, configured to acquire the application type information currently executed by the display device; A motion track identification library acquisition module, configured to acquire a motion track identification library corresponding to the application type information; a motion sensing sensor, used to acquire motion track information of the mobile terminal; A query module, configured to query the motion track identification library for operation instructions corresponding to the motion track information; A sending module, configured to send the operation instruction to the display device, so that the display device performs a corresponding operation. 9. The mobile terminal according to claim 8, wherein the motion sensing sensor comprises any one of a nine-axis sensor, an acceleration sensor, a gravity sensor, and an angle sensor. 10. A data interaction system, comprising a mobile terminal and a display device according to any one of claims 6-10.