CN103631734A - System and method for controlling mobile device through computer - Google Patents

Abstract

The invention proposes a computer-controlled mobile device system, including: a computer, a mobile device, and a connection path for realizing the connection between the computer and the mobile device; the computer simulates the operation data of the mobile device according to the display content of the mobile device, and controls the operation data through the connection path. The data is sent to the mobile device; the mobile device generates display content according to the operation data, and sends it to the computer through the connection path. The invention also provides a method for a computer to control a mobile device. The computer-controlled mobile device system and method provided by the present invention improve the mobile device by adopting a software method, directly obtains the display content of the mobile device, facilitates deployment and saves costs. The present invention simulates the user's operation instructions on the mobile device through a software method, which is more stable than the solution of controlling the relevant touch screen hardware, realizes precise touch control, efficiently and accurately controls the mobile device, and is capable of testing, diagnosing, and remotely controlling the mobile device. Control and many other occasions.

Description

System and method for computer-controlled mobile device

technical field

The present invention relates to data processing technology, and more specifically, to a computer-controlled mobile device system and method.

Background technique

With the popularization of mobile device technology based on intelligent operating systems such as IOS and Android, the remote testing technology for mobile devices is also developing rapidly. In the prior art, there are generally two solutions for the remote testing technology of mobile devices.

Option 1, the computer controls the camera connected to it to capture images displayed on the screen of the mobile device, and controls the touch instrument connected to the computer to simulate human hands operating the keys, touch screen and other input devices of the mobile device to generate input events such as key events and touch events. The computer controls the mobile device according to the interaction between the captured screen image and the input event. The disadvantage of this solution is that the camera is difficult to fix, and the computer user may not be able to observe the screen image of the mobile device smoothly due to the movement of the camera.

Solution 2: By customizing the hardware of the mobile device, the mobile device redirects the image signal that should be output to the screen for display to the computer, and the computer controls the touch instrument to simulate the manual operation of the input device of the mobile device to generate input events. According to the interaction between the screen image sent by the mobile device and the input event, the computer controls the mobile terminal. The disadvantage of this solution is that redirecting the image signal to the computer requires modification of the software and hardware of the mobile device, which requires the participation of the mobile device manufacturer, which is expensive and takes a long time.

Contents of the invention

The technical problem to be solved by the present invention is to provide a system and method for computer-controlled mobile equipment.

The technical scheme adopted by the present invention to solve the technical problem is to provide a computer-controlled mobile device system, including: a computer, a mobile device, and a connection path for realizing the connection between the computer and the mobile device; The operation data of the device is sent to the mobile device through the connection path; the mobile device generates display content according to the operation data and sends it to the computer through the connection path.

Preferably, the above-mentioned computer includes a computer processor and a computer interface; the above-mentioned mobile device includes a mobile device processor and a mobile device interface; one end of the above-mentioned connection path is connected to the computer interface, and the other end is connected to the mobile device interface; Display content, simulate the operation data of the mobile device, control the computer interface to send the operation data to the mobile device through the connection path; the mobile device processor generates display content according to the operation data, and control the mobile device interface to send the display content to the computer through the connection path .

Preferably, the above-mentioned computer also includes a computer display device and a computer input device; the above-mentioned computer processor controls the computer display device to display the display content from the mobile device; the computer input device receives the user's operation instruction on the mobile device, and the computer processor simulates Operating data to the mobile device; the computer processor controls the computer interface to send the operating data to the mobile device interface through the connection path.

Preferably, the mobile device further includes a mobile device display device; the mobile device processor generates display content according to the operation data; the mobile device processor controls the mobile device interface to send the display content to the computer through the connection path; and/or the mobile device processes The controller controls the display device of the mobile device to display the display content.

Preferably, the processor of the mobile device performs a screenshot operation on the displayed content to obtain an image file, and sends the image file to the computer.

Preferably, the above-mentioned simulated operation data on the mobile device refers to: the user sends an operation command to the computer to control the mobile device by operating the computer input device, and the computer processor simulates the operation command to control the mobile device as an input event of the mobile device. The input event is the operation data on the mobile device.

The present invention also proposes a computer-controlled mobile device method, based on the computer, the mobile device and the connection path for realizing the connection between the computer and the mobile device to realize the computer-controlled mobile device, including: the computer simulates the operation of the mobile device according to the display content of the mobile device Data, the step of sending the operation data to the mobile device through the connection path; the step of the mobile device generating display content according to the operation data, and sending it to the computer through the connection path.

Preferably, the above-mentioned computer simulates the operation data on the mobile device according to the display content of the mobile device, and the step of sending the operation data to the mobile device through the connection path includes: the step of the computer displaying the display content from the mobile device; The operation instruction of the device, the step of simulating the operation data of the mobile device according to the operation instruction; the step of the computer sending the operation data to the mobile device through the connection path.

Preferably, the upper mobile device generates display content according to the operation data, and sends it through the connection path

The step of sending to the computer includes: the step of the mobile device generating the display content according to the operation data; the step of the mobile device sending the display content to the computer through the connection path; and/or the step of the mobile device displaying the display content.

Preferably, the computer simulates the operation data on the mobile device according to the display content of the mobile device, and the step of sending the operation data to the mobile device through the connection path further includes: the computer judges whether the operation data is to terminate the operation on the mobile device; For non-terminating operations, the mobile device generates display content according to the operation data and sends it to the computer through the connection path; then the computer simulates the operation data of the mobile device according to the display content of the mobile device, and passes Steps in the connection path to send operational data to the mobile device.

The computer-controlled mobile device system and method provided by the present invention improve the mobile device by using a software method to directly obtain the display content of the mobile device, which is more convenient to deploy than the scheme of the camera in the prior art to capture and display content; Hardware, so that the scheme of display content redirection is cost-effective. The software method, simulating the touch screen message of the mobile device, saves cost compared with the method of controlling related touch screen hardware. On the other hand, the present invention simulates the user's operation instructions on the mobile device through the software method, which is more stable than the solution of controlling the relevant touch screen hardware, realizes precise touch control, efficiently and accurately controls the mobile device, and is capable of testing the mobile device , diagnosis, remote control and other occasions.

Description of drawings

The present invention will be further described below in conjunction with accompanying drawing and embodiment, in the accompanying drawing:

FIG. 1 is a schematic structural diagram of a computer-controlled mobile device system according to an embodiment of the present invention;

2 is a schematic diagram of the internal structure of a computer-controlled mobile device system according to an embodiment of the present invention;

3 is a schematic diagram of the internal structure of a computer-controlled mobile device system according to an embodiment of the present invention;

Fig. 4 is a schematic diagram of the overall flow of a method for controlling a mobile device by a computer according to an embodiment of the present invention;

Fig. 5 is a schematic flow diagram of a part of a method for controlling a mobile device by a computer according to an embodiment of the present invention;

FIG. 6 is a schematic flow diagram of a part of a method for controlling a mobile device by a computer according to an embodiment of the present invention;

FIG. 7 is a schematic flowchart of a method for controlling a mobile device by a computer according to an embodiment of the present invention.

Detailed ways

In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

Referring to the schematic structural diagram of a computer-controlled mobile device system shown in FIG. 1 , the present invention proposes an embodiment of a computer-controlled mobile device system comprising:

A computer 1, a mobile device 2 and a connection path 3 for realizing the connection between the computer 1 and the mobile device 2;

The computer 1 simulates the operation data on the mobile device 2 according to the display content of the mobile device 2, and sends the operation data to the mobile device 2 through the connection path 3;

The mobile device 2 generates display content according to the operation data, and sends it to the computer 1 through the connection path 3 .

Referring to the schematic diagram of the internal structure of a computer-controlled mobile device system shown in FIG. 2 , the present invention proposes an embodiment.

The computer 1 includes a computer processor 11 and a computer interface 12; the mobile device 2 includes a mobile device processor 21 and a mobile device interface 22;

The computer processor 11 simulates the operation data to the mobile device 2 according to the display content of the mobile device 2, and controls the computer interface 12 to send the operation data to the mobile device 2 through the connection path 3; the mobile device processor 21 generates display content according to the operation data, Control the mobile device interface 22 to send the displayed content to the computer 1 through the connection path 3 .

Referring to the schematic diagram of the internal structure of the computer-controlled mobile device system shown in FIG. 3 , an embodiment of the present invention proposes that the computer 1 further includes a computer display device 13 and a computer input device 14 .

The computer processor 11 controls the computer display device 13 to display the display content from the mobile device 2; The computer input device 14 receives the user's operation instruction to the mobile device 2, and the computer processor 11 simulates the operation data to the mobile device 2 according to the operation instruction; Computer processing The device 11 controls the computer interface 12 to send the generated operation data to the mobile device interface 22 through the connection path 3 .

Referring to the schematic diagram of the internal structure of the computer-controlled mobile device system shown in FIG. 3 , an embodiment of the present invention proposes that the mobile device 2 further includes a mobile device display device 23 . The mobile device processor 21 generates display content according to the operation data; the mobile device processor 21 controls the mobile device interface 22 to send the display content to the computer through the connection path 3; and/or the mobile device processor 21 controls the mobile device display device 23 to display the display content.

The mobile device 1 in the above embodiment is an intelligent device with network connection function and data processing function, and can adopt but not limited to mobile phone, PDA, tablet computer, multimedia player, navigator, Internet TV and other technologies.

The mobile device processor 21 can control the display device 23 of the mobile device to display the displayed content, take a screenshot of the displayed content to obtain an image file, and send the image file to the computer 1 . The mobile device display device 2 may also not display the display content, and the mobile device processor 21 directly controls the mobile device interface 22 to send the display content to the computer 1 .

In this embodiment, the display content of the display device of the mobile device is obtained directly through a software method. Compared with the method of redirecting the display content to the computer by transforming the mobile device, it is not controlled by the manufacturer of the mobile device, and the cost is lower. more flexible. This embodiment simulates the input event of the mobile device through the software method, which is more cost-effective and more accurate than the solution of controlling the relevant touch screen hardware device to press the touch screen of the mobile device, and can be adapted to various input devices of various mobile devices.

The present invention proposes that the computer 1 can connect and control more than one mobile device 2 respectively. Different mobile devices 2 may include, but are not limited to, various input devices such as touch screens, buttons, scroll wheels, stylus pens, cameras, and/or voice input, while computers 1 generally only include standard input devices such as keyboards and mice. In order to realize computer control of the mobile device 2 , it is necessary to simulate input events to the mobile device 2 on the computer 1 . The present invention proposes that the user sends an operation command to the computer 1 to control the mobile device 2 by operating standard input devices such as a keyboard and a mouse of the computer 1 . The computer 1 simulates the operation instructions through software means to adapt to various input events such as keyboard events (Key Event), mouse events (Mouse Event), touch events (Touch Event), and sensor events (Sensor Events) of the mobile device 2. The input event is the operation data on the mobile device 2 in the present invention.

In conjunction with FIG. 1 , referring to the schematic diagram of the overall flow of the computer-controlled mobile device method shown in FIG. 4 , the present invention proposes a computer-controlled mobile device method based on the computer 1, the mobile device 2 and the connection between the computer 1 and the mobile device 2. Path 3 realizes that computer 1 controls mobile device 2, including:

Step S1, the computer 1 simulates the operation data on the mobile device 2 according to the display content of the mobile device 2, and sends the operation data to the mobile device 2 through the connection path 3;

Step S2 , the mobile device 2 generates display content according to the operation data, and sends it to the computer 1 through the connection 3 .

Referring to the schematic flow chart of a part of the method for controlling a mobile device by a computer shown in FIG. 5, step S1 includes:

Step S11, the computer 1 displays the display content from the mobile device 2;

Step S12, the computer 2 receives the user's operation instruction on the mobile device 2, and simulates the operation data on the mobile device 2 according to the operation instruction;

Step S13 , the computer 1 sends the operation data to the mobile device through the connection path 3 .

Referring to the schematic flow chart of a part of the method for controlling a mobile device by a computer shown in FIG. 6, step S2 includes:

Step S21, the mobile device 2 generates display content according to the operation data;

Step S22, the mobile device 2 sends the displayed content to the computer 1 through the connection path 3; and/or

Step S23, the mobile device 2 displays the displayed content.

Referring to the detailed flow diagram of the method for controlling a mobile device by a computer shown in FIG. 7 , an embodiment of the present invention further includes step S01 , connecting the computer 1 and the mobile device 2 through the connection path 3 .

Wherein step S1 also includes:

Step S14, the computer 1 judges whether the operation data is to terminate the operation on the mobile device 2: if the operation is terminated, the process ends; if the operation is not terminated, go to step S13.

After step S13, proceed to step S21, execute the process in a loop until step S14, if the operation data is to terminate the operation on the mobile device 2, then the process of computer 1 controlling the mobile device 2 ends.

The computer 1 of the above embodiment of the present invention may include a computer processor 11, a computer interface 12, a computer display device 13 and a computer input device 14, and the mobile device 2 may include a mobile device processor 21, a mobile device interface 22 and a mobile device display device 23 , and its specific connection relationship and working relationship in this method embodiment refer to the foregoing embodiments, so details are not repeated.

The above are only preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention. Inside. the

Claims (10)

1. A computer-controlled mobile device system, comprising: Computers, mobile devices, and connection paths enabling computer-to-mobile connections; The computer simulates the operation data on the mobile device according to the display content of the mobile device, and sends the operation data to the mobile device through the connection path; The mobile device generates display content according to the operation data, and sends it to the computer through the connection path. 2. A computer-controlled mobile device system according to claim 1, characterized in that: The computer includes a computer processor and a computer interface; The mobile device includes a mobile device processor and a mobile device interface; one end of the connection path is connected to the computer interface, and the other end is connected to the mobile device interface; The computer processor simulates the operation data on the mobile device according to the display content of the mobile device, and controls the computer interface to send the operation data to the mobile device through the connection path; The mobile device processor generates display content according to the operation data, and controls the mobile device interface to send the display content to the computer through the connection path. 3. A computer-controlled mobile device system according to claim 2, characterized in that: The computer also includes a computer display device and a computer input device; The computer processor controls the computer display device to display display content from the mobile device; The computer input device receives the user's operation instruction on the mobile device, and the computer processor simulates the operation data on the mobile device according to the operation instruction; The computer processor controls the computer interface to send the operation data to the mobile device interface through the connection path. 4. A computer-controlled mobile device system according to claim 2, characterized in that: The mobile device also includes a mobile device display device; The mobile device processor generates display content according to the operation data; The mobile device processor controls the mobile device interface to send the displayed content to the computer through the connection path; and/or The mobile device processor controls the display device of the mobile device to display the display content. 5. A computer-controlled mobile device system according to claim 4, characterized in that: The processor of the mobile device performs a screenshot operation on the displayed content to obtain an image file, and sends the image file to the computer. 6. A kind of system of computer control mobile equipment according to claim 3, is characterized in that, described simulation refers to the operation data of mobile equipment: The user sends an operation instruction to the computer to control the mobile device by operating the computer input device, and the computer processor simulates the operation instruction to control the mobile device as an input event of the mobile device, and the input event is the operation data of the mobile device. 7. A computer-controlled mobile device method, based on a computer, a mobile device and a connection path that realizes the connection between the computer and the mobile device, to realize the computer-controlled mobile device, characterized in that, comprising: The computer simulates the operation data of the mobile device according to the display content of the mobile device, and sends the operation data to the mobile device through the connection path; A step in which the mobile device generates display content according to the operation data and sends it to the computer through the connection path. 8. A method for controlling a mobile device by a computer according to claim 7, wherein the computer simulates the operation data of the mobile device according to the display content of the mobile device, and sends the operation data to the mobile device through the connection path The steps include: the step of the computer displaying the display from the mobile device; The computer receives the user's operation instruction to the mobile device, and simulates the steps of operating data on the mobile device according to the operation instruction; The computer sends the operation data to the mobile device through the connection path. 9. A computer-controlled mobile device method according to claim 7, wherein the mobile device generates display content according to the operation data, and the step of sending it to the computer through the connection path comprises: A step of the mobile device generating display content according to the operation data; The mobile device sends the display content to the computer through the connection path; and/or The step of displaying the displayed content by the mobile device. 10. A computer-controlled mobile device method according to any one of claims 7 to 9, characterized in that: The computer simulates the operation data of the mobile device according to the display content of the mobile device, and the step of sending the operation data to the mobile device through the connection path also includes: The computer judges whether the operation data is to terminate the operation on the mobile device; For the termination operation, end the process; For non-terminating operations, the mobile device generates display content according to the operation data and sends it to the computer through the connection path; Further, the computer simulates the operation data on the mobile device according to the display content of the mobile device, and sends the operation data to the mobile device through the connection path.

Images