CN119248425A

CN119248425A - A method and related device for simulating mobile device interaction

Info

Publication number: CN119248425A
Application number: CN202411359697.1A
Authority: CN
Inventors: 王群; 于子元
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2024-09-26
Filing date: 2024-09-26
Publication date: 2025-01-03

Abstract

The embodiment of the application discloses a method and a related device for simulating interaction of mobile equipment, and provides a simulator which not only can simulate the running environment of the mobile equipment, but also can execute complex interaction functions, after the application program running through the simulator is displayed, responding to the target operation aiming at the application program, generating a simulation signal according to the target operation, and controlling the application program running through the simulator to execute the interaction function corresponding to the simulation signal. Therefore, the simulator provided by the application simulates and generates the signals acquired by the sensor based on the target operation belonging to the preset operation through the corresponding relation between the preset operation and the simulation signals, and converts the complex interaction operation into the logic of the application level, thereby breaking through the hardware limit between the mobile equipment and the non-mobile equipment, realizing the complex interaction function, breaking through the limitation of the interaction of the simulator, reducing the hardware dependence, improving the user experience sense and improving the development and test efficiency of the simulator.

Description

Method and related device for simulating interaction of mobile equipment

Technical Field

The present application relates to the field of computer technologies, and in particular, to a method and a related apparatus for simulating mobile device interaction.

Background

With the development of technology and the change of user demands, the same application program can be developed for multiple devices, for example, the same application program can be used on mobile devices such as smart phones and non-mobile devices such as desktop computers.

However, in the related art, some applications are only used in mobile devices and cannot be used in non-mobile devices due to limitations of technology, cost, and the like. Moreover, even if such applications can be used in a non-mobile device by means of a simulator developed by a third party, the user experience is poor due to the hardware difference between the mobile device and the non-mobile device.

Disclosure of Invention

In order to solve the technical problems, the application provides a method and a related device for simulating interaction of mobile equipment, which are used for solving the problem of poor user experience caused by hardware difference of mobile equipment and non-mobile equipment.

The embodiment of the application discloses the following technical scheme:

in one aspect, an embodiment of the present application provides a method for simulating mobile device interaction, the method including:

Displaying an application program operated by a simulator, wherein the simulator is used for simulating the operation environment of the mobile equipment;

responding to the acquisition of target operation aiming at the application program, and generating an analog signal according to the target operation, wherein the analog signal is used for simulating a signal acquired by a sensor in the mobile equipment, and the target operation is matched with a preset operation;

And controlling the application program to execute the interactive function corresponding to the analog signal.

On the other hand, the embodiment of the application provides a device for simulating interaction of mobile equipment, which comprises a display unit, a generation unit and a control unit;

the display unit is used for displaying an application program operated by a simulator, and the simulator is used for simulating the operation environment of the mobile equipment;

the generating unit is used for responding to the acquisition of target operation aiming at the application program, generating an analog signal according to the target operation, wherein the analog signal is used for simulating a signal acquired by a sensor in the mobile equipment, and the target operation is matched with a preset operation;

And the control unit is used for controlling the application program to execute the interactive function corresponding to the analog signal.

In another aspect, an embodiment of the present application provides a computer device including a processor and a memory:

The memory is used for storing a computer program and transmitting the computer program to the processor;

The processor is configured to perform the method of the above aspect according to instructions in the computer program.

In another aspect, embodiments of the present application provide a computer-readable storage medium storing a computer program for executing the method described in the above aspect.

In another aspect, embodiments of the present application provide a computer program product comprising a computer program which, when run on a computer device, causes the computer device to perform the method of the above aspect.

As can be seen from the above technical solution, the present application provides a new simulator, which is capable of simulating an operating environment of a mobile device, so that an application program used in the mobile device can be used in a non-mobile device, and is also capable of executing a complex interactive function, that is, by establishing a correspondence between a preset operation (i.e., a preset operation) and a simulation signal, generating a signal for simulating a sensor acquisition in the mobile device, that is, the simulation signal, based on the preset operation, so that in response to acquiring a target operation for the application program, the target operation is an operation matched with the preset operation, and thus, according to the correspondence between the preset operation and the simulation signal, determining the simulation signal corresponding to the target operation, and controlling the application program operated by the simulator to execute the interactive function corresponding to the simulation signal. That is, the simulator provided by the application can simulate and generate the signals acquired by the sensor based on the target operation through the corresponding relation between the preset operation and the simulation signals, and convert the complex interaction operation into the logic of the application level, thereby breaking through the hardware limit between the mobile equipment and the non-mobile equipment, realizing the complex interaction function, breaking through the limitation of simulator interaction, reducing the hardware dependence, improving the user experience sense and improving the development and test efficiency of the simulator.

Drawings

In order to more clearly illustrate the embodiments of the application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is an application scenario schematic diagram of a method for simulating mobile device interaction according to an embodiment of the present application;

fig. 2 is a schematic diagram of an application program in a mobile device according to an embodiment of the present application;

FIG. 3 is a flow chart of a method for simulating mobile device interaction according to an embodiment of the present application;

FIG. 4 is a schematic diagram of a simulator operation according to an embodiment of the present application;

FIG. 5 is a schematic diagram of performing multiple displacement operations in a page corresponding to an application according to an embodiment of the present application;

FIG. 6 is a schematic diagram of performing multiple displacement operations during selection of an application program according to an embodiment of the present application;

FIG. 7 is a schematic diagram of a control application program executing multiple displacement operations according to an embodiment of the present application;

FIG. 8 is a schematic diagram of drawing a preset rule symbol in a page corresponding to a simulator according to an embodiment of the present application;

FIG. 9 is a schematic diagram of drawing a preset rule symbol in a page corresponding to an application program according to an embodiment of the present application;

FIG. 10 is a schematic diagram of a simulator running an application according to an embodiment of the present application;

FIG. 11 is a schematic diagram of a simulator running multiple applications together according to an embodiment of the present application;

FIG. 12 is a schematic diagram of a simulator running multiple applications concurrently according to an embodiment of the present application;

FIG. 13 is a schematic diagram of a plurality of applications executing the same interactive function according to an embodiment of the present application;

FIG. 14 is a schematic diagram of a plurality of applications executing different interactive functions according to an embodiment of the present application;

FIG. 15 is a schematic diagram of a method for simulating mobile device interaction according to an embodiment of the present application;

fig. 16 is a schematic structural diagram of an apparatus for simulating interaction of mobile devices according to an embodiment of the present application;

fig. 17 is a schematic structural diagram of a server according to an embodiment of the present application;

Fig. 18 is a schematic structural diagram of a terminal device according to an embodiment of the present application.

Detailed Description

Embodiments of the present application are described below with reference to the accompanying drawings.

In the related art, some application programs can only be used in mobile devices, but cannot be used in non-mobile devices, and have cross-platform interaction barriers, which have the following technical problems.

(1) As technology advances and user demands change, sensors are added to mobile devices. For example, an acceleration sensor and a gyroscope are built in the mobile device and are used for sensing the motion state and direction change of the mobile device so as to realize functions of automatic rotation of a screen, game control and the like. Wherein the user is an object using the content application, such as a human, a robot, a virtual person, etc., to which the present application is not particularly limited.

That is, in applications suitable for mobile devices, many complex interactive functions (e.g., a "pan-tilt" interactive function, a tap screen capture function, etc.) rely on sensor implementations in mobile devices, whereas most non-mobile devices typically do not have sensors. Therefore, even though the application program is used in the non-mobile device through a simulator developed by a third party and the like, the non-mobile device cannot capture signals generated by the complex interaction functions due to hardware limitation, and further the complex interaction functions cannot be realized in the non-mobile device, namely, a user cannot enjoy all interaction experiences on the mobile device on the non-mobile device, and the experience is poor.

(2) For the test of the simulator, complex interactive functions such as a "shake-shake" interactive function cannot be realized in the simulator or are difficult to realize, and in the test process, each example (namely case by case) needs to be tested, so that the development and test efficiency of the simulator are lower due to the fact that software integration is complex and the like.

Based on this, the embodiment of the application provides a method and a related device for simulating interaction of mobile equipment, and the simulator provided by the application not only can simulate the running environment of the mobile equipment, but also can execute complex interaction functions, can simulate and generate signals acquired through a sensor through the corresponding relation between target operation and analog signals, and converts the complex interaction operation into logic of an application level, thereby breaking through the hardware limit between the mobile equipment and non-mobile equipment, realizing the complex interaction functions, breaking through the limitation of simulator interaction, reducing hardware dependence, improving user experience sense, and improving the development and test efficiency of the simulator.

The method for simulating mobile equipment interaction provided by the application can be applied to computer equipment with the capability of simulating mobile equipment interaction, such as terminal equipment and a server.

The terminal device may be a desktop computer, a notebook computer, a smart phone, a tablet computer, an internet of things device and a portable wearable device, the internet of things device may be an intelligent sound box, an intelligent television, an intelligent air conditioner, an intelligent vehicle-mounted device, the intelligent vehicle-mounted device may be a vehicle-mounted navigation terminal, a vehicle-mounted computer, and the portable wearable device may be an intelligent watch, an intelligent bracelet, a head-mounted device, but is not limited thereto.

The server may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server or a server cluster for providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, a content distribution network (Content Delivery Network, CDN), basic cloud computing services such as big data and an artificial intelligent platform. The terminal device and the server may be directly or indirectly connected through wired or wireless communication, and the present application is not limited herein.

It will be appreciated that mobile devices and non-mobile devices are another division, e.g., smartphones may be mobile devices, desktop computers and servers may be non-mobile devices, etc.

In order to facilitate understanding of the method for simulating mobile device interaction provided by the embodiment of the present application, an application scenario of the method for simulating mobile device interaction is described in an exemplary manner by taking an execution body of the method for simulating mobile device interaction as a terminal device.

Referring to fig. 1, the application scenario is schematically shown in a method for simulating interaction of mobile devices according to an embodiment of the present application. As shown in fig. 1, the application scenario includes a terminal device 110, where the terminal device 110 is a non-mobile device, and is configured to execute the method for simulating mobile device interaction provided by the present application.

The terminal device 110 is provided with a simulator provided in an embodiment of the present application, and two main functions of the simulator are described below.

In one aspect, a simulator is capable of simulating an operating environment of a mobile device such that applications used in the mobile device may be used in non-mobile devices.

Referring to fig. 2, a schematic diagram of an application program in a mobile device according to an embodiment of the present application is shown. Some of the applications in fig. 2 may not be suitable for non-mobile devices, such as X applications.

In practical applications, the user may open a simulator in the terminal device 110, where the simulator can simulate the running environment of the mobile device, so that an application suitable for the mobile device may be used in a non-mobile device, that is, in response to an opening operation for the simulator, a plurality of pending application programs that can be run by the simulator are displayed, as shown in fig. 1 (a), a page of the non-mobile device after the simulator is opened, where a page corresponding to the simulator includes a plurality of pending application programs that can be run, such as an AA application, an a game, and the like, and includes an X application that cannot be run by the non-mobile device.

In response to a selection operation for an application from among a plurality of pending applications, the application run by the simulator is displayed. As shown in fig. 1 (B), after the user clicks the X application through the mouse, that is, after selecting the X application from the plurality of pending applications, a page on which the X application operates is displayed, and the X application is operated through the simulator.

And the simulator can execute complex interaction functions.

In the simulator, a correspondence relationship between a preset operation (hereinafter, simply referred to as a preset operation for convenience of explanation) and an analog signal is established. The preset operation may be a preset operation, such as shaking a mouse, drawing a preset rule symbol, or the like. The analog signal is a signal acquired by a sensor in an analog mobile device, such as a pan signal.

In response to acquiring a target operation for the application program, the target operation is an operation matched with a preset operation, so that according to a corresponding relation between the preset operation and the analog signal, an analog signal corresponding to the target operation can be generated, thereby controlling the application program running through the simulator to execute an interactive function corresponding to the analog signal. As shown in fig. 1 (C), the title bar may be clicked by the mouse without being released, and then the mouse may be moved according to a form such as an arrow direction, which is similar to a pan operation of the mobile device, thereby generating a pan signal corresponding thereto, and controlling the X application to perform an interactive function corresponding to the pan signal according to the pan signal, i.e., to jump to the setup page, as shown in fig. 1 (D).

That is, the simulator provided by the application can simulate and generate the signals acquired by the sensor through the corresponding relation between the preset operation and the simulation signals, and convert the complex interaction operation into the logic of the application level, thereby breaking through the hardware limit between the mobile equipment and the non-mobile equipment, realizing the complex interaction function, breaking through the limitation of simulator interaction, reducing the hardware dependence, improving the user experience sense and improving the development and test efficiency of the simulator.

The method for simulating mobile equipment interaction provided by the embodiment of the application can be executed by the terminal equipment. However, in other embodiments of the present application, the server may also have a similar function to the terminal device, so as to perform the method for simulating mobile device interaction provided in the embodiments of the present application, or the terminal device and the server together perform the method for simulating mobile device interaction provided in the embodiments of the present application, which is not limited in this embodiment.

The method for simulating mobile device interaction provided by the application can be applied to various scenes, including but not limited to cloud games, live broadcast, social interaction, entertainment and the like. For example, by opening the application corresponding to live broadcast through a simulator in the non-mobile device, live broadcast recording and sharing can be performed, and convenience and rapidness are realized. In another example, in the process of playing a game with a friend, mobile devices of two persons are not the same operating system and cannot play together, and at this time, an application corresponding to the game can be started through a simulator in the non-mobile device, so that cross-platform game is realized through the non-mobile device.

The simulator in the scene not only can provide convenience for various non-mobile devices to simulate mobile devices, but also can execute the complex interaction function, further improves the user experience sense, and ensures that the user retention rate of the simulator is higher. For example, in a mobile application development and testing scenario, the functionality of a mobile application may be tested through a simulator in a non-mobile device, through a target operation. As another example, in a mobile application cross-platform usage scenario, a user may use an application that is applicable to a mobile device in a non-mobile device through similar operations. For another example, in a mobile application desktop scenario, a user may set a favorite preset operation for a commonly used mobile application (i.e., an application program applicable to a mobile device), optimize a desktop layout of a non-mobile device, and improve operation efficiency.

It should be noted that the above application scenario is only an example, and the method for simulating mobile device interaction provided in this embodiment may also be applied to other scenarios, which is not limited herein.

The following describes a method for simulating interaction of mobile equipment in detail through a method embodiment.

Referring to fig. 3, a flowchart of a method for simulating mobile device interaction according to an embodiment of the present application is shown. For convenience of description, the following embodiments will be described by taking an execution body of the method for simulating mobile device interaction as an example of a terminal device. As shown in fig. 3, the method of simulating mobile device interaction includes S301-S303.

S301 shows an application running through the simulator.

The embodiment of the application provides a new simulator which has at least two functions, namely a first function capable of simulating the running environment of mobile equipment and a second function capable of executing complex interaction functions. The function one will be explained first.

The simulator is used for simulating the running environment of the mobile equipment.

An operating system is typically installed in a mobile device that provides an operating environment for applications in the mobile device (e.g., mobile clients as shown in fig. 2), which the simulator can simulate, thereby simulating the operating environment of the mobile device, so that applications suitable for the mobile device can also run on non-mobile devices, similar to desktop clients running in non-mobile devices. For example, an application on a tour may only be used on a smartphone, and the application on the tour may be experienced on a desktop computer when using a simulator.

Taking an android simulator as an example, the main function of the android simulator is to simulate an android system on a mobile device such as a smart phone on a non-mobile device such as a desktop computer. Through the android simulator, a user can run an application program applicable to the android system on the non-mobile device, and experience various functions of the application program. In addition, the android simulator also supports installation, use, and uninstallation of android applications, enabling users to do a variety of operations without a mobile device.

That is, by the function one of the simulator, an application running in the running environment of the mobile device can be run in the non-mobile device, thereby realizing cross-platform compatibility.

Referring to fig. 4, a schematic diagram of simulator operation is provided in an embodiment of the present application. Fig. 4 shows a page of the non-mobile device after the simulator is opened, where the page corresponding to the simulator includes a plurality of pending application programs that can be run, and includes an X application that can only be run on the mobile device, or the X application cannot be run on the non-mobile device without passing through the simulator.

S302, in response to acquiring the target operation for the application program, generating an analog signal according to the target operation.

In response to a condition or state that is used to represent the dependency of an operation performed, one or more operations performed may be real-time or may have a set delay when the dependency is satisfied, such that there is no restriction in the order of execution of the operations performed without specifically describing the order.

After the first function is introduced, the second function of the simulator will be described.

And secondly, complex interaction functions can be executed.

The complex interaction function refers to a function which is realized based on signal control after a signal is acquired by a sensor in the mobile equipment, such as a shaking interaction function, a knocking screen capturing function and the like. The shake-shake interaction function is based on a shake-shake signal (namely, triaxial acceleration data acquired through an acceleration sensor in the mobile device), and the knocking screen capturing function is based on a knocking signal (namely, data such as vibration frequency and acceleration acquired through a gravity sensor in the mobile device).

As can be seen from the foregoing, the non-mobile device generally does not have related sensor hardware, and cannot implement complex interaction functions. Based on this, in the embodiment of the present application, the correspondence between the preset operation and the analog signal is established in advance in the simulator.

The corresponding relation between the preset operation and the analog signal is used for describing which preset operation corresponds to which analog signal, so that after the target operation is acquired, the target operation is identified as which preset operation, and then the analog signal corresponding to the target operation is generated in a simulation mode according to the corresponding relation between the preset operation and the analog signal.

The embodiment of the application is not particularly limited to the corresponding relation between the preset operation and the analog signal, and a person skilled in the art can set the corresponding relation according to actual needs, and a user can also set the corresponding relation in a personalized way through a simulator. Three cases will be described below as examples.

In the first case, different preset operations can correspond to the same analog signal, so that the plurality of preset operations can realize the same interactive function, and a user can realize one interactive function based on various target operations.

In the second case, the same preset operation may correspond to different analog signals, for example, the same preset operation corresponds to the same analog signal in the same application program, and the same preset operation corresponds to different analog signals in different application programs, for example, after the application program a and the application program B recognize the target operation belonging to the preset operation a, the same analog signal is generated, and after the application program C recognizes the target operation belonging to the preset operation a, another analog signal is generated, which is different from the analog signal generated in the application program a and the application program B.

And in the third case, different preset operations correspond to different analog signals, so that a user can realize different interaction functions based on the different preset operations, confusion is avoided, the accuracy of realizing the interaction functions after the user executes the target operation is improved, and the user experience is improved.

The target operation is a preset operation which can be identified by the non-mobile device, and in the embodiment of the application, one or more preset operations can be preset, such as shaking a mouse, drawing preset rule symbols, and the like. The analog signals are used to simulate signals acquired based on sensors in the mobile device, such as a shake signal, a knock signal, etc.

The embodiment of the application is not particularly limited to the identification mode of the target operation. For example, in response to acquiring a target operation for an application program, if there is only one preset operation, whether the target operation is the preset operation is identified based on a movement track and a movement speed corresponding to the target operation, and then it is determined which preset operation the target operation belongs to based on the movement track and the movement speed, which is not described herein.

If there are multiple preset operations, it is also necessary to identify which one of the multiple preset operations the target operation belongs to, so that based on the corresponding relationship between the preset operation and the analog signal, the analog signal corresponding to the preset operation to which the target operation belongs is generated in a simulation manner.

For example, if the user shakes the mouse, the multiple displacement operations are target operations in response to acquiring multiple displacement operations for the application program, and correspond to a shake operation set in advance. For another example, if the user draws a preset rule symbol, in response to obtaining the preset rule symbol drawn for the application program, drawing the preset rule symbol as a target operation, and corresponding to a preset gesture operation (that is, drawing the preset rule symbol by sliding on a screen or the like).

That is, the signal which cannot be acquired by the non-mobile device is converted into the target operation which can be acquired by the non-mobile device, and then after the target operation is identified as the preset operation, the analog signal corresponding to the target operation is generated through simulation based on the corresponding relation between the preset operation and the analog signal, so that after the analog signal is obtained by the application program of the mobile device, the corresponding interaction function is implemented by the analog signal simulation based on the signal acquired by the sensor in the mobile device. For example, if the analog signal simulates a tapping signal, a corresponding interactive function, i.e., a screen capturing operation, may be performed based on the analog signal.

Therefore, through establishing the corresponding relation between the preset operation and the analog signal, the signal which can not be identified by the non-mobile equipment is converted into the identifiable target operation, and the analog signal which can be identified by the application program is generated based on the target operation simulation according to the corresponding relation, so that the corresponding interaction function is realized based on the analog signal, and the corresponding control of the application program in the simulator is realized.

In addition, the application program is generally developed by a third party, the corresponding relation between the signal and the interactive function is set in the application program, and the corresponding relation between the signal and the interactive function required by the internal writing of the intrusion application program is difficult to realize.

Based on the above, according to the embodiment of the application, through two corresponding relations, namely, the corresponding relation between the preset operation and the analog signal, and the corresponding relation between the analog signal and the interactive function, the corresponding interactive function can be realized based on the preset operation through the two corresponding relations. Specifically, after the target operation is acquired, the interactive function corresponding to the analog signal can be realized based on which preset operation the target operation is. The signals actually generated by the mobile equipment are simulated based on the analog signals, namely the analog signals are used as the medium, so that the intrusion into the application program is not needed, the transformation difficulty is reduced, and the method is convenient and quick.

It should be noted that, by setting the corresponding relation between the multiple preset operations and the analog signals and the corresponding relation between the multiple analog signals and the interactive functions, different interactive functions are realized based on different target operations, that is, different target operations are respectively the preset operations, so that convenience of user operation is improved.

And S303, controlling the application program to execute the interactive function corresponding to the analog signal.

The interactive functions are used to describe functions that interact with an application, such as switching pages, triggering specific functions (e.g., triggering random events in a gaming application, achieving relationship matching in a social application), etc.

Thus, after the non-mobile device recognizes the target operation, an analog signal is generated based on the target operation, and the application program is controlled to execute the interactive function corresponding to the analog signal based on the analog signal. For the application program, the analog signal is obtained, which is equivalent to the signal acquired by the sensor, and then the corresponding interactive function is executed according to the signal, so that the corresponding interactive function is executed in the non-mobile device based on the preset operation control of the application program applicable to the mobile device while the interior of the application program is not invasive.

The embodiment of the application does not specifically limit the execution range of the target operation, and those skilled in the art can set the execution range according to actual needs.

For example, the target operation is executed in the page corresponding to the simulator, the range of the page corresponding to the simulator is larger, so that the execution range of the target operation is larger, and the user operation is facilitated. For another example, the target operation is executed in the page corresponding to the application program, if the simulator runs a plurality of application programs and the like at the same time, the target operation is executed in the page corresponding to the application program, and although the execution range of the target operation is smaller, the target operation has pertinence, the execution target of the user can be more clearly defined, the identification accuracy is improved, and the user experience is improved.

If only one application program is executed in the simulator corresponding page, the target operation may be executed in the simulator corresponding page or the application program corresponding page, and no confusion will occur no matter in which range the target operation is executed for the executed application program.

If multiple application programs are simultaneously operated in the corresponding page of the simulator, one or more application programs need to be selected first, then target operation can be executed in the corresponding page of the simulator to determine which application program or application programs the target operation is executed for, or if the application programs are not selected, then target operation needs to be executed in the corresponding page of the application programs to determine which application program the target operation is executed for. The embodiment of the application is not particularly limited to selecting corresponding operations, such as long pressing or long clicking a title bar of an application program, circling the application program required by the application program, clicking the application program in the process of pressing a ctrl key, and the like.

For another example, if a plurality of application programs are simultaneously run in the page corresponding to the simulator, and in order to expand the execution range of the target operation, the target operation may be allowed to be executed in the page corresponding to the simulator, and then the preset number of application programs may be determined as the application programs targeted by the target operation according to the preset policy. The preset policy may be one or more (determined according to a preset number) application programs before the application program performs the operation in the time closest to the current time, so as to expand the execution range of the target operation, and meanwhile, define the pertinence of the target operation, and improve the user experience.

The embodiment of the present application is not particularly limited to the target operation, and the specific implementation manner of S302, that is, the specific implementation manner of generating the analog signal according to the target operation in response to acquiring the target operation for the application program, will be described below by taking four manners as examples.

In one mode, the target operation is to execute a plurality of displacement operations for the application program.

In response to acquiring multiple displacement operations for an application, an analog signal is generated from the multiple displacement operations. The multiple displacement operations for the application program are target operations for the application program, the multiple displacement operations are operations for executing displacement operations, the number of times of which is larger than a number of times threshold, and the displacement operations are operations for generating displacement.

For example, the mouse is rocked to generate regular rocking, such as moving the mouse leftwards, then moving the mouse rightwards, and then moving the mouse backwards. For another example, the sliding finger generates a continuous and regular sliding track, such as sliding the finger to the right, sliding the finger to the left, and sliding the finger to the right.

The embodiment of the application is not particularly limited to the targeting mode of the application program, for example, the displacement operation is executed for a plurality of times in the page corresponding to the application program. As another example, after an application is selected, a plurality of displacement operations are performed during the time that the application is selected.

Referring to fig. 5, a schematic diagram of performing multiple displacement operations in a page corresponding to an application according to an embodiment of the present application is shown. In fig. 5, the cursor can be controlled to move leftwards, rightwards and leftwards in the page 400 corresponding to the application program, which is equivalent to that the cursor is regularly rocked through three continuous displacement operations. In addition, the cursor is always located in the page 400 corresponding to the application program in the multiple displacement operation process, so that the multiple displacement operation executed at this time is specific to the application program corresponding to the page, and the cursor has more pertinence.

Referring to fig. 6, a schematic diagram of performing a plurality of displacement operations during a selected application program according to an embodiment of the present application is shown. The selected application, in fig. 6, the selected effect is represented by thickening the border of the page to which the application corresponds. After the application program is selected, multiple displacement operations can be realized at any position of the display interface during the selection of the application program, as shown in fig. 6, the displacement operations are moved from the outside of the page corresponding to the application program to the inside of the page corresponding to the application program, and after the reverse operation is executed, the reverse operation is executed again for the reverse operation, so that the multiple displacement operations executed this time are clear for the application program corresponding to the page through the selection operation, and the method has more pertinence. By selecting the operation, the number of the targeted application programs can be increased, and the execution efficiency of the user can be improved.

Thus, by performing a plurality of displacement operations for an application program, a panning operation of the mobile device can be simulated so as to generate a signal for simulating a panning signal for the panning operation. Therefore, similar interaction modes are provided for the same application program on the mobile device and the non-mobile device, interaction barriers existing across platforms are reduced, a user can conveniently and rapidly use the application program through the simulator, the use feeling of the user is improved, and meanwhile the user retention rate of the simulator is improved.

And secondly, the target operation is to control the application program to execute the displacement operation for a plurality of times.

In response to the control application performing a plurality of displacement operations, an analog signal is generated in accordance with the plurality of displacement operations. Wherein the control application program performs a plurality of displacement operations as target operations for the application program. The control application program performs the displacement operation a plurality of times, and the number of times the control application program performs the displacement operation is greater than the number threshold.

For example, a plurality of displacement operations are performed by dragging a page corresponding to the application program. Wherein the drag application may not be released by clicking the title bar of the application with a mouse. As another example, a drag application may hold the application's title bar long by a finger, and so on. The manner of dragging the application program is not particularly limited in the present application.

Referring to fig. 7, a schematic diagram of a control application program performing multiple displacement operations according to an embodiment of the present application is shown. In fig. 7, the application program can be dragged to execute multiple displacement operations by pressing the title bar 600 of the application program with the cursor for a long time, for example, multiple continuous displacement operations such as dragging left first, then dragging right, and dragging left last are implemented, so that the application program is dragged to shake, that is, multiple displacement operations are implemented for the application program in a targeted manner.

It should be noted that, if the simulator runs multiple application programs simultaneously, the multiple application programs can be controlled to execute multiple displacement operations simultaneously, so as to increase the number of the application programs and improve the execution efficiency of the user.

It should be noted that, different analog signals can be generated based on different forms of displacement operation, for example, different forms of multiple displacement operation can be obtained based on continuous times of displacement operation, direction of displacement operation and other factors, so as to generate different analog signals, further realize different interaction functions, improve richness of interaction and improve user experience.

Therefore, by controlling the application program to execute multiple displacements, the interactive function can be realized through an interactive mode (namely shaking operation) similar to the mobile equipment, the application program generating interaction can be more targeted, conflicts with the existing shortcut operation and the like are avoided, the accuracy of interactive control is improved, a user can conveniently and quickly use the application program through the simulator, and the user retention rate of the simulator is improved while the user using sense is improved.

And thirdly, the target operation is to draw a preset rule symbol for the application program.

And generating an analog signal according to the preset rule symbol in response to acquiring the preset rule symbol drawn in the page corresponding to the simulator or the page corresponding to the application program. The preset rule sign is a target operation for the application program.

The drawing mode may be that a mouse or a finger touches the screen to make the cursor draw a preset rule symbol, which is not particularly limited in the application.

The preset rule symbol is a preset pattern having a shape, such as a zigzag shape, a triangle shape, a circle shape, etc., which is not particularly limited in the present application. Different preset rule symbols can be used for controlling corresponding application programs to execute different interactive operations, for example, the corresponding relation between a plurality of preset rule symbols and analog signals and the corresponding relation between a plurality of analog signals and interactive functions are set, so that different interactive functions are realized through different preset rule symbols, the realization mode of the interactive functions is further expanded, and the user experience is improved.

Referring to fig. 8, the diagram is a schematic diagram of drawing a preset rule symbol in a page corresponding to a simulator according to an embodiment of the present application. In fig. 8, a zigzag 820 is drawn in the simulator-corresponding page 810, where the zigzag 820 is a predetermined rule symbol.

Referring to fig. 9, the diagram is a schematic diagram of drawing a preset rule symbol in a page corresponding to an application program according to an embodiment of the present application. In fig. 9, a circle 920 is drawn in the application corresponding page 910, where the circle 920 is a preset rule symbol.

Therefore, the interactive function of the application program is realized by drawing the preset rule symbol aiming at the application program, the realization mode of realizing the interactive function by the user is expanded, and the experience of the user is improved. Moreover, compared with the multiple displacement operation of a single type, the types of the preset rule symbols are richer, so that the number of the interactive functions realized based on the preset rule symbols is more, and further, a user can realize more interactive functions based on the more preset rule symbols, thereby being convenient and quick and improving the experience of the user.

It should be noted that, the method of realizing the interactive function by using the multiple displacement operations of the application program and the preset rule symbols together as a way of quickly realizing the interactive function can be further improved, and the user experience is improved.

And fourthly, the target operation is a shortcut instruction aiming at the application program.

In response to obtaining a shortcut instruction from the peripheral device for the application, generating an analog signal in accordance with the shortcut instruction. Wherein the shortcut instruction is a target operation for the application program.

Peripheral devices refer to devices for extending the functionality of non-mobile devices, such as displays, keyboards, keypads, mice, speakers, printers, scanners, cameras, microphones, digital drawing tablets, and the like. The shortcut command is based on a command input by the peripheral device, such as a shortcut command input through a keyboard, a voice command input through a microphone, etc., which is not particularly limited in the present application.

Therefore, aiming at the mobile equipment, the interactive function is generally executed through the mobile equipment, the peripheral equipment is not needed to be installed in the mobile equipment, for example, the keyboard is generally installed in the desktop computer, the shortcut instruction aiming at the application program is input through the peripheral equipment, the method is more suitable for the non-mobile equipment, compared with the mobile equipment, the realization mode of the same interactive function is more various, the user can select the target operation which is more suitable for the user to realize the interactive function, and the experience of the user is improved.

The embodiment of the present application is not particularly limited to the number of applications that execute the simulator simultaneously, and will be described below by taking two cases as examples.

In case one, the simulator runs an application.

In response to acquiring an open operation for the simulator, a plurality of pending applications capable of being run by the simulator are displayed. In response to acquiring a selection operation for an application from a plurality of pending applications, the application running through the simulator is displayed.

The application program is one of a plurality of pending application programs, namely one pending application program can be selected from the plurality of pending application programs to serve as the application program, and then interaction is executed for the application program. The pending application is an application that can be run by a simulator.

Referring to fig. 10, a schematic diagram of a simulator running an application according to an embodiment of the present application is shown. In fig. 10, an open operation such as clicking, double clicking, etc. is performed for a simulator in a display screen 1010 of a non-mobile device, and in response to acquiring the open operation for the simulator, a plurality of pending applications capable of being run by the simulator are displayed, such as AA applications, BB applications, etc. are displayed in a simulator correspondence page 1020. After the user selects the X application from the plurality of pending applications, in response to acquiring a selection operation for the X application from the plurality of pending applications, the X application running through the simulator is displayed, and a page corresponding to the X application is shown as 1030.

It should be noted that, the application program running through the simulator runs through the application container, or one application container corresponds to one pending application program, and when the user selects the pending application program, the application container corresponding to the pending application program is activated, so that the application program corresponding to the application container is activated, thereby implementing running of the application program through the simulator. Compared with running the application program in the mobile device, the application container can be modified in size in the page corresponding to the simulator through the application container running the application program, so that the application container is convenient for a user to use as required, the number of the application containers can be displayed according to the user requirement in the limited display range of the page corresponding to the simulator, and the user experience is improved.

Therefore, by installing the simulator in the non-mobile device, the running environment of the mobile device is simulated through the simulator, so that an application program used in the mobile device is operated in the non-mobile device, and the simulator can provide richer use experience, such as realizing various interactive functions through target operation, adjusting the display range of the application program and the like, so that the experience of a user is improved.

In the second case, the simulator runs a plurality of applications.

K pending applications capable of being run by the simulator are displayed in response to acquiring an open operation for the simulator, and M applications run by the simulator are displayed in response to acquiring a select operation for M applications from among the K pending applications.

The application program is one of a plurality of undetermined application programs, K is an integer greater than 1, and M is an integer less than or equal to K. That is, some or all of the plurality of pending applications may be selected as applications to subsequently perform interactions with respect to the plurality of applications Chen Xu.

It should be noted that, M applications may be selected from K pending applications together, or after one application is opened, one application may be opened again until M applications are opened, that is, the embodiment of the present application is not limited to the selection manner of M applications specifically. The M application programs can be the same or different in type, for example, by opening a plurality of application programs of the same type and logging in different accounts, the multi-opening function is realized, and the use efficiency of the user is improved.

Referring to fig. 11, a schematic diagram of a simulator running multiple applications together is provided in an embodiment of the present application. In fig. 11, an open operation such as clicking, double clicking, etc. is performed for a simulator in a display screen 1110 of a non-mobile device, and in response to acquiring the open operation for the simulator, a plurality of pending applications capable of being run by the simulator are displayed, such as a plurality of pending applications such as AA applications, BB applications, etc. are displayed in a simulator correspondence page 1120. After the user selects two applications from the plurality of pending applications (e.g., clicks on the two applications during pressing the ctrl key, respectively), in response to acquiring a selection operation for the two applications from the plurality of pending applications, two applications running through the simulator are displayed, and pages corresponding to the two applications are shown as 1130 and 1140.

Referring to fig. 12, a schematic diagram of a simulator running multiple applications together is provided in an embodiment of the present application. In fig. 12, an open operation such as clicking, double clicking, etc. is performed for a simulator in a display screen 1210 of a non-mobile device, and in response to acquiring the open operation for the simulator, a plurality of pending applications capable of being run by the simulator are displayed, such as a plurality of pending applications, such as AA applications, BB applications, etc., are displayed in a simulator correspondence page 1220. After the user selects two applications from the plurality of pending applications (e.g., by a circling operation such as controlling the cursor to move from the upper left corner to the diagonal of the rectangle), in response to acquiring a selection operation for the two applications from the plurality of pending applications, two applications running through the simulator are displayed, and pages corresponding to the two applications are shown as 1230 and 1240.

Therefore, a plurality of application programs can be selected to run simultaneously through the simulator, and the plurality of application programs can be of the same type or different types, so that the interaction efficiency of a user is improved, for example, the target operation is executed for the plurality of application programs later, the interaction with the plurality of application programs is realized, the user prefers to use the simulator, and the user retention rate of the simulator is improved.

The embodiment of the present application is not particularly limited to whether the plurality of application programs execute the same interactive function after executing the target operation with respect to the plurality of application programs, and will be described below.

First, the same interactive function is executed.

And in the process that N application programs are selected, in response to acquiring target operations for the N application programs, generating analog signals according to the target operations, and controlling the N application programs to respectively execute interaction functions corresponding to the analog signals.

The selection effect is used for distinguishing selected application programs from unselected application programs in application programs operated by the simulator. The embodiments of the present application are not particularly limited to selecting effects such as thickening the border of an application, highlighting the title bar of an application with other colors, etc. N is a positive integer less than M.

The preset operations and the analog signals are in one-to-one correspondence, namely one corresponding relation is corresponding to one preset operation, and the plurality of application programs commonly use the same corresponding relation, so that the same target operation is executed for the plurality of application programs, and the same interaction function can be realized.

Referring to fig. 13, a schematic diagram of a plurality of applications executing the same interactive function according to an embodiment of the present application is shown. In fig. 13, three applications are collectively run by the simulator, i.e., pages corresponding to each application are 1320, 1330, and 1340, respectively, in simulator corresponding page 1310. And two applications of the three applications are selected, and the frames of the pages corresponding to the applications are displayed as selected effects by thickening the frames of the pages, such as 1320 and 1330, are thickened. In the process of selecting the two applications, if a target operation is acquired, the target operation is performed for the two applications, and the target operation is performed for the two applications, but generates an analog signal indicating an interactive function, such as jumping to a function setting page.

Therefore, after the simulator runs multiple application programs simultaneously, the selected application programs can be displayed through the selected effect, and the multiple application programs share the same corresponding relation, namely the corresponding relation of the shared preset operation and the analog signal and the corresponding relation of the shared analog signal and the interactive function, so that after the same target operation is executed on the multiple selected application programs, the target operation is identified as the preset operation, the same interactive function can be realized on the basis of the preset operation on the multiple application programs, the user is helped to quickly realize the interaction on the multiple application programs, and the use efficiency of the user is improved.

And secondly, executing different interaction functions.

And in the process that N application programs are selected, responding to the acquisition of target operation for the N application programs, generating analog signals respectively corresponding to the N application programs according to the target operation, and controlling the N application programs to respectively execute corresponding interaction functions of the corresponding analog signals.

The same target operation may correspond to different analog signals, specifically, one preset operation has a correspondence with a plurality of analog signals, that is, one preset operation corresponds to a plurality of correspondences, and a plurality of application programs may not use the same correspondence together. For example, the same application program shares the same correspondence, and different application programs do not share the same correspondence. For another example, the type a application and the type B application share the same correspondence, and the type a application and the type C application use different correspondences. Thus, the same target operation is executed for a plurality of application programs, and different interaction functions can be realized.

Referring to fig. 14, a schematic diagram of a plurality of application programs executing different interactive functions according to an embodiment of the present application is shown. In fig. 14, three applications are collectively run by the simulator, namely, the pages corresponding to each application are 1420, 1430 and 1440, respectively, in simulator corresponding page 1410. And two applications among the three applications are selected, and the frames of the pages corresponding to the applications are displayed as selected effects by thickening the frames of the pages, such as 1420 and 1430, are thickened. In the process that the two application programs are selected, if a target operation is acquired, the target operation is executed for the two application programs, a first analog signal is generated for one application program, a second analog signal is generated for the other application program, the first analog signal indicates the application program to jump to a function setting page, and the second analog signal indicates the application program to jump to a first page of the application program, so that the same target operation is executed for a plurality of application programs, and different interactive functions are realized.

As a possible implementation manner, the corresponding relation between the preset operation and the analog signal can be set based on the simulator, and the corresponding relation between the analog signal and the interactive function can be set based on the application program, so that no invasion to the application program is realized, and the modification difficulty is reduced.

Therefore, after the simulator runs multiple application programs simultaneously, the selected application programs can be displayed through the selected effect, and at least two application programs do not share the same corresponding relation, so that the same target operation is executed for the selected application programs, but different simulation signals are generated, different interaction functions are realized for the application programs, the user is helped to quickly realize interaction of the application programs, and the use efficiency of the user is improved.

Embodiments of the present application are described again below from the perspective of the operating system.

The operating system in the non-mobile device is typically Windows Server ^TM,Mac OS X^TM,Unix^TM,Linux^TM,FreeBSD^TM or the like. While the operating system in the mobile device is typically an android system, IOS system, etc. The simulator is installed in the non-mobile device, so that the operating system of the mobile device can be simulated in the operating system of the non-mobile device, and further, application programs suitable for the mobile device are used in the non-mobile device, namely, cross-system operation is realized.

The embodiments of the present application are not particularly limited to the manner in which the operating system in the non-mobile device interacts with the operating system in the simulated mobile device (i.e., the simulated mobile device operating system), and are described below by way of example in four ways.

(1) Interaction is achieved through the interface of the simulator.

The interface can have a mapping between a peripheral device of the non-mobile device and an analog mobile device operating system. For example, by clicking a mouse of a desktop computer on a display screen of the simulator, entering text in the simulator using a keyboard, etc., the simulator may map operations from the current non-mobile device into the simulated mobile device operating system.

In addition, the interface can also interact by dragging and dropping content such as files or text into a window (or display screen) of the simulator.

(2) Interaction is achieved using an android debug bridge (android debug bridge, ADB).

Taking the simulation mobile device operating system as an android system as an example, after a touch event or a key event is acquired, the touch event or the key event can be sent through an ADB.

Touch event-the operation of the touch screen can be simulated by an ADB command, which can be ADB shell input tap < x > < y >, where < x > and < y > are coordinates on the screen corresponding to the touch event.

Key event-key operation can be simulated by ADB command, ADB command can be ADB shell input keyevent < keycode >, wherein < keycode > is key code defined in android system.

(3) Interaction is achieved using a third party tool.

The third party tool may be an automated script tool or an automated test framework, etc.

Automated scripting tools scripts may be written that automatically simulate click operations, key operations, and the like, using, for example, an automated hotkey (AutoHotkey) scripting tool for the Windows operating system, or an apple script (AppleScript) scripting tool for the macOS operating system, and the like.

And an automatic test Framework, such as Appium, a Robot Framework and other open-source automatic test tools, can write test scripts to control simulators, and realize clicking operation, sliding operation and the like.

(4) Custom applications are used.

Custom applications may be developed, such as a personal computer (personal computer, PC) side application may be developed to control interactions in the simulator by communicating with applications in the simulator via Socket communications, hypertext transfer protocol (Hypertext Transfer Protocol, HTTP) requests, or other network protocols.

By the method, cross-system interaction between interactive clicking of the PC end and the simulated mobile device operating system can be realized. These methods can be flexibly selected and combined according to specific requirements and scenes.

Referring to fig. 15, a schematic diagram of a method for simulating mobile device interaction according to an embodiment of the present application is shown.

In the operating system in the non-mobile device there are three modules, a detection module 1501, a target operation identification module 1502 and a mapping module 1503, respectively. In the operating system of the mobile device that is not being emulated by the mobile device (i.e., the emulated mobile device operating system described above), there are three modules, sensor emulation module 1504, signal identification module 1505, and event processing module 1506, respectively. The following description will be given separately.

(1) A detection module 1501 for detecting the position of the preset point.

For example, the position of a preset point in a preset time is detected, and the preset point is a point in a corresponding page of a cursor or an application program, such as detection of a mouse movement or events such as clicking operation, dragging operation, sliding operation and the like executed by a touch screen.

(2) The target operation identifying module 1502 is configured to identify whether the target operation is based on a position of a preset point. The following is an example of one way.

And determining the moving track of the preset point and the moving speed of the preset point according to the position of the preset point in the preset time. According to the moving track and the moving speed, the operation executed by the detected preset point can be determined, so that the target operation for the application program is obtained.

For example, whether a plurality of displacement operations corresponding to a shake or a preset rule symbol occurs or not may be determined according to a movement track, the movement speed is calculated by dividing the position of a preset point by time, the acceleration is a speed change rate, when it is detected that the movement speed exceeds a speed threshold, or the acceleration exceeds an acceleration threshold, and the movement track conforms to the track corresponding to the plurality of displacement operations, or the movement track conforms to the preset rule symbol, the target operation is identified to which preset operation is matched.

(3) The mapping module 1503 is configured to generate an analog signal according to the target operation and send the analog signal to the sensor simulation module 1504.

From the foregoing, it is clear that the same target operation may generate the same analog signal or different analog signals, which is not particularly limited in the present application.

(4) The sensor simulation module 1504 is configured to collect signals corresponding to the sensors in the mobile device after receiving the analog signals.

(5) The signal recognition module 1505 is configured to determine interaction kinetic energy corresponding to the analog signal according to a correspondence between the analog signal and the interaction function.

(6) The event processing module 1506 executes according to the interactive function.

It is appreciated that the sensor simulation module 1504. The signal identifying module 1505 and the event processing module 1506 are equivalent to the modules in the application program, and the embodiment of the application does not need to improve the modules, and can be constructed aiming at the detecting module 1501, the target operation identifying module 1502 and the mapping module 1503, thereby reducing the improvement difficulty and improving the user experience.

Therefore, through the mode, the simulator can realize interaction kinetic energy such as shaking under the condition that hardware such as a sensor is not available, and a novel and convenient interaction mode is provided for a user. The richness and individuation setting of the user experience are improved, meanwhile, the technology implementation process is simplified, so that the user can enjoy similar interaction experience with the mobile device on the non-mobile device, and convenience and innovation of the user experience are improved.

Aiming at the method for simulating the mobile equipment interaction, the application also provides a corresponding device for simulating the mobile equipment interaction, so that the method for simulating the mobile equipment interaction is applied and realized in practice.

Referring to fig. 16, the structure of an apparatus for simulating interaction of mobile devices according to an embodiment of the present application is shown. As shown in fig. 16, the apparatus 1600 for simulating mobile device interaction includes a display unit 1601, a generation unit 1602, and a control unit 1603;

The display unit 1601 is configured to display an application program that is run by a simulator, where the simulator is configured to simulate a running environment of the mobile device;

The generating unit 1602 is configured to generate, in response to acquiring a target operation for the application program, an analog signal according to the target operation, where the analog signal is used to simulate a signal acquired by a sensor in the mobile device, and the target operation is an operation matched with a preset operation;

The control unit 1603 is configured to control the application program to execute the interactive function corresponding to the analog signal.

As a possible implementation manner, the generating unit 1602 is specifically configured to:

in response to acquiring a plurality of displacement operations for the application program, generating the analog signal according to the plurality of displacement operations, wherein the plurality of displacement operations for the application program are target operations for the application program.

and responding to control of the application program to execute a plurality of displacement operations, generating the analog signal according to the plurality of displacement operations, wherein the control of the application program to execute the plurality of displacement operations is aimed at the application program.

And responding to the acquisition of a preset rule symbol drawn in the page corresponding to the simulator or the page corresponding to the application program, generating a simulation signal according to the preset rule symbol, and drawing the preset rule symbol as a target operation for the application program.

And responding to the shortcut instruction of the peripheral equipment aiming at the application program, and generating the simulation signal according to the shortcut instruction, wherein the shortcut instruction is the target operation aiming at the application program.

And responding to the acquisition of a target operation from the page corresponding to the simulator or the page corresponding to the application program, and generating the simulation signal according to the target operation.

As a possible implementation manner, the display unit 1601 is specifically configured to:

In response to obtaining an open operation for the simulator, displaying a plurality of pending applications executable by the simulator;

and in response to acquiring a selection operation for the application program from the plurality of pending application programs, displaying the application program running through the simulator, wherein the application program is one of the plurality of pending application programs.

As a possible implementation manner, if the number of the plurality of pending applications is K, where K is an integer greater than 1, the display unit 1601 is specifically configured to:

In response to acquiring an open operation for the simulator, displaying K pending applications that are executable by the simulator;

And in response to acquiring a selection operation for M application programs from the K application programs, displaying the M application programs running through the simulator, wherein the application program is one application program in the plurality of application programs, and M is an integer less than or equal to K.

Responding to the selection operation of N application programs in the M application programs, and displaying the selection effect of the N application programs, wherein N is a positive integer smaller than M;

in the process that N application programs are selected, responding to acquisition of target operations for the N application programs, and generating analog signals according to the target operations;

The control unit 1603 is specifically configured to:

and controlling N application programs to respectively execute the interactive functions corresponding to the analog signals.

responding to selection operation of N application programs in M application programs, and displaying selection effects of the N application programs, wherein N is a positive integer smaller than M;

in the process that N application programs are selected, responding to target operation for the N application programs, and generating analog signals corresponding to the N application programs respectively according to the target operation;

The control unit 1603 is specifically configured to:

And controlling N application programs to respectively execute corresponding interaction functions of corresponding analog signals.

As a possible implementation manner, the apparatus further includes a target operation identifying unit, configured to:

Detecting the position of a preset point in preset time, wherein the preset point is a cursor or a point in a page corresponding to the application program;

determining a moving track of the preset point and a moving speed of the preset point according to the position of the preset point in preset time;

And determining target operation which aims at the application program and is matched with the preset operation according to the moving track and the moving speed.

The embodiment of the application also provides a computer device which can be a server or a terminal device, and the computer device provided by the embodiment of the application is introduced from the aspect of hardware materialization. Fig. 17 is a schematic structural diagram of a server, and fig. 18 is a schematic structural diagram of a terminal device.

Referring to fig. 17, which is a schematic diagram of a server structure according to an embodiment of the present application, the server 1700 may have a relatively large difference between configurations or performances, and may include one or more processors 1722, such as a central processing unit (Central Processing Units, CPU), a memory 1732, one or more application programs 1742, or a storage medium 1730 (e.g., one or more mass storage devices) for data 1744. Wherein the memory 1732 and storage medium 1730 may be transitory or persistent storage. The program stored on the storage medium 1730 may include one or more modules (not shown), each of which may include a series of instruction operations on a server. Still further, a processor 1722 may be provided in communication with the storage medium 1730 for executing a series of instruction operations in the storage medium 1730 on the server 1700.

The Server 1700 may also include one or more power supplies 1726, one or more wired or wireless network interfaces 1750, one or more input/output interfaces 1758, and/or one or more operating systems 1741, such as Windows Server ^TM,Mac OS X^TM,Unix^TM,Linux^TM,FreeBSD^TM, etc.

The steps performed by the server in the above embodiments may be based on the server structure shown in fig. 17.

Wherein the processor 1722 is configured to perform the following steps:

Optionally, the processor 1722 may also perform method steps of any particular implementation of a method for simulating mobile device interactions in an embodiment of the present application.

Referring to fig. 18, the structure of a terminal device according to an embodiment of the present application is shown. Taking the example that the terminal device is a smart phone as an example, fig. 18 shows a block diagram of a part of the structure of the smart phone, where the smart phone includes a Radio Frequency (RF) circuit 1810, a memory 1820, an input unit 1830, a display unit 1840, a sensor 1850, an audio circuit 1860, a wireless fidelity (WiFi) module 1870, a processor 1880, and a power supply 1890. Those skilled in the art will appreciate that the smartphone structure shown in fig. 18 is not limiting of the smartphone and may include more or fewer components than shown, or may combine certain components, or a different arrangement of components.

The following describes each component of the smart phone in detail with reference to fig. 18:

The RF circuit 1810 may be used to receive and transmit signals during a message or call, and in particular, to receive downlink information from a base station, process it by the processor 1880, and transmit uplink data to the base station.

The memory 1820 may be used to store software programs and modules, and the processor 1880 may implement various functional applications and data processing of the smartphone by executing the software programs and modules stored in the memory 1820.

The input unit 1830 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the smart phone. In particular, the input unit 1830 may include a touch panel 1831 and other input devices 1832. The touch panel 1831, also called a touch screen, may collect touch operations on or near the user and drive the corresponding connection device according to a preset program. The input unit 1830 may include other input devices 1832 in addition to the touch panel 1831. In particular, other input devices 1832 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, mouse, joystick, etc.

The display unit 1840 may be used to display information input by a user or information provided to the user and various menus of the smart phone. The display unit 1840 may include a display panel 1841, and optionally, the display panel 1841 may be configured in the form of a Liquid Crystal Display (LCD) CRYSTAL DISPLAY, an Organic Light-Emitting Diode (OLED), or the like.

The smartphone may also include at least one sensor 1850, such as a light sensor, a motion sensor, and other sensors. Other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc. that may also be configured with the smart phone are not described in detail herein.

Audio circuitry 1860, speaker 1861, microphone 1862 may provide an audio interface between a user and a smartphone. The audio circuit 1860 may convert the received audio data into an electrical signal, transmit the electrical signal to the speaker 1861, and convert the electrical signal into a sound signal for output by the speaker 1861, while the microphone 1862 may convert the collected sound signal into an electrical signal, convert the electrical signal into audio data after receiving the audio data by the audio circuit 1860, process the audio data by the audio data output processor 1880, transmit the audio data to another smart phone, for example, via the RF circuit 1810, or output the audio data to the memory 1820 for further processing.

The processor 1880 is a control center of the smartphone, connects various portions of the entire smartphone using various interfaces and lines, performs various functions of the smartphone and processes data by running or executing software programs and/or modules stored in the memory 1820, and invoking data stored in the memory 1820. In the alternative, processor 1880 may include one or more processing units.

The smart phone also includes a power supply 1890 (e.g., a battery) for powering the various components, which may preferably be logically coupled to the processor 1880 via a power management system so as to provide for managing charging, discharging, and power consumption by the power management system.

Although not shown, the smart phone may further include a camera, a bluetooth module, etc., which will not be described herein.

In an embodiment of the present application, the memory 1820 included in the smart phone may store a computer program and transmit the computer program to the processor.

The processor 1880 included in the smart phone may perform the method of simulating mobile device interactions provided in the above embodiments according to instructions in the computer program.

The embodiment of the application also provides a computer readable storage medium for storing a computer program for executing the method for simulating mobile device interaction provided by the above embodiment.

Embodiments of the present application also provide a computer program product comprising a computer program which, when run on a computer device, causes the computer device to perform the method of simulating mobile device interactions provided in various alternative implementations of the above aspects.

It will be appreciated by those of ordinary skill in the art that implementing all or part of the steps of the above method embodiments may be implemented by hardware associated with program instructions, where the above program may be stored in a computer readable storage medium, where the program when executed performs the steps including the above method embodiments, where the storage medium may be at least one of a Read-Only Memory (ROM), a RAM, a magnetic disk, or an optical disk, etc. various media in which the computer program may be stored.

The terms "first," "second," "third," "fourth" and the like in the description and in the claims and in the above drawings, if any, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the application described herein may be implemented, for example, in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "includes" and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed or inherent to such process, method, article, or apparatus.

All data (such as target operation, application account information and the like) collected by the method are collected under the condition that an object (such as a user, an organization or an enterprise) to which the data belongs agrees and authorizes, and the collection, the use and the processing of the related data need to comply with related laws and regulations and standards of related countries and regions.

In the present embodiment, the term "module" or "unit" refers to a computer program or a part of a computer program having a predetermined function and working together with other relevant parts to achieve a predetermined object, and may be implemented in whole or in part by using software, hardware (such as a processing circuit or a memory), or a combination thereof. Also, a processor (or multiple processors or memories) may be used to implement one or more modules or units. Furthermore, each module or unit may be part of an overall module or unit that incorporates the functionality of the module or unit.

It should be noted that, in the present specification, each embodiment is described in a progressive manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment is mainly described in a different point from other embodiments. In particular, for the apparatus and system embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, with reference to the description of the method embodiments in part. The apparatus and system embodiments described above are merely illustrative, in which elements illustrated as separate elements may or may not be physically separate, and elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.

The foregoing is only one specific embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions easily contemplated by those skilled in the art within the technical scope of the present application should be included in the scope of the present application. Further combinations of the present application may be made to provide further implementations based on the implementations provided in the above aspects. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A method of simulating mobile device interactions, the method comprising:

2. The method of claim 1, wherein the generating an analog signal in accordance with the target operation in response to acquiring the target operation for the application program comprises:

3. The method of claim 1, wherein the generating an analog signal in accordance with the target operation in response to acquiring the target operation for the application program comprises:

4. The method of claim 1, wherein the generating an analog signal in accordance with the target operation in response to acquiring the target operation for the application program comprises:

5. The method of claim 1, wherein the generating an analog signal in accordance with the target operation in response to acquiring the target operation for the application program comprises:

6. The method of claim 1, wherein the generating an analog signal in accordance with the target operation in response to acquiring the target operation for the application program comprises:

7. The method of claim 1, wherein displaying the application running through the simulator comprises:

8. The method of claim 1, wherein if the number of the plurality of pending applications is K, K being an integer greater than 1, displaying the application running through the simulator comprises:

9. The method of claim 8, wherein the generating an analog signal in accordance with the target operation in response to acquiring the target operation for the application program comprises:

the controlling the application program to execute the interactive function corresponding to the analog signal includes:

10. The method of claim 8, wherein the generating an analog signal in accordance with the target operation in response to acquiring the target operation for the application program comprises:

11. The method according to any one of claims 1-10, wherein the method further comprises:

and determining target operation which is aimed at the application program and is matched with the preset operation according to the moving track and the moving speed.

12. An apparatus for simulating interaction of mobile equipment is characterized by comprising a display unit, a generation unit and a control unit;

13. A computer device, the computer device comprising a processor and a memory:

The processor is configured to perform the method of any of claims 1-11 according to the computer program.

14. A computer readable storage medium, characterized in that the computer readable storage medium is for storing a computer program for executing the method of any one of claims 1-11.

15. A computer program product comprising a computer program which, when run on a computer device, causes the computer device to perform the method of any of claims 1-11.