CN113663324B - Control method and device for terminal application and computer readable storage medium - Google Patents
Control method and device for terminal application and computer readable storage medium Download PDFInfo
- Publication number
- CN113663324B CN113663324B CN202110963735.4A CN202110963735A CN113663324B CN 113663324 B CN113663324 B CN 113663324B CN 202110963735 A CN202110963735 A CN 202110963735A CN 113663324 B CN113663324 B CN 113663324B
- Authority
- CN
- China
- Prior art keywords
- application
- terminal
- key
- terminal application
- control
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 58
- 238000013507 mapping Methods 0.000 claims description 114
- 230000004048 modification Effects 0.000 claims description 29
- 238000012986 modification Methods 0.000 claims description 29
- 230000035945 sensitivity Effects 0.000 abstract description 7
- 238000005516 engineering process Methods 0.000 abstract description 4
- 230000006870 function Effects 0.000 description 15
- 230000009471 action Effects 0.000 description 7
- 230000008569 process Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/50—Controlling the output signals based on the game progress
- A63F13/52—Controlling the output signals based on the game progress involving aspects of the displayed game scene
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
- Input From Keyboards Or The Like (AREA)
Abstract
The invention discloses a control method and device for a terminal application and a computer readable storage medium. Wherein the method comprises the following steps: the terminal sends the desktop image to the PC end for display; receiving a first control instruction from a PC end, wherein the first control instruction is used for triggering to enter a keyboard mode, and the keyboard mode is to control the operation of terminal application through a keyboard; determining whether a terminal application is currently operated locally or not, wherein a keyboard mode is entered when the terminal application is currently operated locally; receiving a second control instruction sent by the PC end, wherein the second control instruction is used for triggering a virtual key applied to the terminal; and controlling the terminal application according to the second control instruction. The invention solves the technical problems that the size of the mobile terminal in the related technology often limits the operation and the use of a user and influences the operation speed and the sensitivity.
Description
Technical Field
The present invention relates to the field of terminal application control technologies, and in particular, to a method and apparatus for controlling a terminal application, and a computer readable storage medium.
Background
With the rapid development of mobile interconnection, the development speed of mobile games (also called hand-play) is also increasing. The use experience of players on the hands is increasingly demanding and diversified. In the prior art, the size of a mobile terminal (e.g., a mobile phone, etc.) often limits the operation and use of a user, for example, when the size of a screen is relatively small during a game, the touch operation of a finger of the user is affected, and the operation speed and sensitivity are affected, so that the game experience of the user is reduced.
Aiming at the problems that the size of the mobile terminal in the related art often limits the operation and use of a user and influences the operation speed and the sensitivity, no effective solution is proposed at present.
Disclosure of Invention
The embodiment of the invention provides a control method and device for terminal application and a computer readable storage medium, which at least solve the technical problems that the size of a mobile terminal in the related technology often limits the operation and use of a user and influences the operation speed and sensitivity.
According to an aspect of an embodiment of the present invention, there is provided a control method for a terminal application, including: the terminal sends the desktop image to the PC end for display; receiving a first control instruction from the PC end, wherein the first control instruction is used for triggering to enter a keyboard mode, and the keyboard mode is to control the operation of terminal application through a keyboard; determining whether the terminal application is currently operated locally or not, wherein the keyboard mode is entered when the terminal application is currently operated locally; receiving a second control instruction sent by the PC end, wherein the second control instruction is used for triggering a virtual key applied to the terminal; and controlling the terminal application according to the second control instruction.
Optionally, determining whether the terminal is currently running the terminal application locally includes: acquiring an application program list of the terminal running locally at present; and determining whether the terminal application exists in the application program list, wherein the application names in the application program list are compared with the application names in a locally pre-stored terminal application list, and if at least one application name is successfully compared, determining that the terminal application exists in the application program list.
Optionally, after entering the keyboard mode, the method includes: and generating a preset function button on the desktop image, wherein the preset function button is used for triggering a key position mapping control interface.
Optionally, after entering the keyboard mode, the method further comprises: and carrying out key mapping on the terminal application, and establishing a key mapping relation, wherein the key mapping is to map the operation of a keyboard and/or a mouse to the application virtual key.
Optionally, after establishing the key mapping relationship, the method further includes: obtaining key position mapping modification information, wherein the key position mapping modification information comprises virtual keys and modified key position information; and updating the key mapping relation according to the key mapping modification information.
Optionally, after establishing the key mapping relationship, the method further includes: and adding an application key indication layer on an application picture of the terminal application according to the key mapping relation.
Optionally, performing a control operation on the terminal application according to the second control instruction includes: converting the second control instruction into a corresponding virtual key control instruction; and sending the virtual key control instruction to the terminal application so that the terminal application executes corresponding control operation.
According to another aspect of the embodiment of the present invention, there is also provided a control device for a terminal application, including: the sending module is used for sending the desktop image to the PC end by the terminal for display; the first receiving module is used for receiving a first control instruction from the PC end, wherein the first control instruction is used for triggering to enter a keyboard mode, and the keyboard mode is used for controlling the operation of terminal application through a keyboard; the determining module is used for determining whether the terminal application is currently and locally operated or not, wherein the keyboard mode is entered when the terminal application is currently and locally operated; the second receiving module is used for receiving a second control instruction sent by the PC end, wherein the second control instruction is used for triggering a virtual key applied to the terminal; and the control module is used for controlling the terminal application according to the second control instruction.
According to another aspect of the embodiment of the present invention, there is further provided a computer readable storage medium, where the computer readable storage medium includes a stored program, and when the program runs, the control method for controlling a device in which the computer readable storage medium is located to execute any one of the above terminal applications is provided.
According to another aspect of the embodiment of the present invention, there is further provided a processor, configured to execute a program, where the program executes the control method of the terminal application of any one of the above embodiments.
In the embodiment of the invention, a terminal is adopted to send the desktop image to a PC end for display; receiving a first control instruction from a PC end, wherein the first control instruction is used for triggering to enter a keyboard mode, and the keyboard mode is to control the operation of terminal application through a keyboard; determining whether a terminal application is currently operated locally or not, wherein a keyboard mode is entered when the terminal application is currently operated locally; receiving a second control instruction sent by the PC end, wherein the second control instruction is used for triggering a virtual key applied to the terminal; the terminal application is controlled according to the second control instruction, when the desktop image is put on the PC end through the terminal, the control operation of the terminal application is realized through the keyboard and the mouse, and the purpose of the same screen control of the terminal application is achieved, so that the game experience of a user is improved, the use scene of a mobile phone game and the technical effect of equipment are expanded, and the technical problems that the operation and the use of the user are often limited due to the size of the mobile terminal in the related art, and the operation speed and the sensitivity are influenced are solved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this specification, illustrate embodiments of the application and together with the description serve to explain the application and do not constitute a limitation on the application. In the drawings:
Fig. 1 is a flowchart of a control method of a terminal application according to an embodiment of the present invention;
fig. 2 is a schematic view of a deployment scenario of a control method of a terminal application according to an alternative embodiment of the present invention;
fig. 3 is a schematic diagram of a control device of a terminal application according to an embodiment of the present invention.
Detailed Description
In order that those skilled in the art will better understand the present invention, a technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present invention and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example 1
According to an embodiment of the present invention, there is provided an embodiment of a control method of a terminal application, it being noted that the steps shown in the flowchart of the drawings may be performed in a computer system such as a set of computer executable instructions, and that although a logical order is shown in the flowchart, in some cases the steps shown or described may be performed in an order different from that herein.
Fig. 1 is a flowchart of a control method of a terminal application according to an embodiment of the present invention, as shown in fig. 1, the method includes the steps of:
step S102, the terminal sends the desktop image to the PC end for display;
the terminal comprises, but is not limited to, a smart phone, a tablet and the like; optionally, the terminal sending the desktop image to the PC for display includes: establishing communication connection between a terminal and a PC end; and sending the desktop image to the PC end according to the communication connection so as to enable the PC end to synchronously display the desktop image.
Step S104, receiving a first control instruction from a PC end, wherein the first control instruction is used for triggering to enter a keyboard mode, and the keyboard mode is to control the operation of terminal application through a keyboard;
Optionally, the first control instruction may be a keyboard mode switching request instruction initiated by a preset combination key. For example, a keyboard mode switching request instruction may be initiated by combining keys to enter a keyboard mode in which an operation of a terminal application may be controlled by a keyboard. In addition, the common keyboard mode can be entered through the same or different combination keys, and in the common keyboard mode, clicking can be performed through a mouse and input through a keyboard.
In addition, the above-mentioned terminal applications include, but are not limited to, game applications, reading applications, news applications, and the like.
Step S106, determining whether a terminal application is currently operated locally, wherein a keyboard mode is entered when the terminal application is currently operated locally;
in an alternative implementation manner, by judging whether the terminal is currently running with the terminal application and entering the keyboard mode when the terminal is currently running with the terminal application, misoperation of a user can be effectively avoided.
Step S108, receiving a second control instruction sent by the PC end, wherein the second control instruction is used for triggering a virtual key aiming at the terminal application;
The second control command may be a mouse control command for a terminal application.
Step S110, control operation is carried out on the terminal application according to the second control instruction.
It should be noted that, the virtual key at least includes two states, namely an activated state and a hidden state, where when the virtual key is in the activated state, a corresponding key on the keyboard may be used to perform a corresponding operation; when the virtual key is in a hidden state, the corresponding key cannot perform any operation. In addition, the active state may be identified by a colored icon and the hidden state may be identified by an icon gray or vanishing.
Through the steps, when the desktop image is put on the PC end by the terminal, the control operation of the terminal application is realized through the keyboard and the mouse, and the purpose of the same screen control of the terminal application is achieved, so that the game experience of a user is improved, the use scene of a mobile game and the technical effect of equipment are expanded, and the technical problems that the operation use of the user is often limited by the size of the mobile terminal in the related art, and the operation speed and the sensitivity are influenced are solved.
Optionally, determining whether the terminal is currently running a terminal application locally includes: acquiring an application program list of a terminal running locally at present; determining whether a terminal application exists in the application program list, wherein the application names in the application program list are compared with the application names in the locally pre-stored terminal application list, and if at least one application name is successfully compared, determining that the terminal application exists in the application program list.
In an alternative embodiment, a list of applications that the terminal is currently running on its local side may be obtained, and it may be determined whether there is a terminal application in the list of applications. In the implementation process, the application names in the application program list and the application names in the locally pre-stored terminal application list can be compared, and further the existence of the terminal application in the application program list is determined according to the comparison result. It should be noted that when one or more application names in the application list are matched with the application names in the locally pre-stored terminal application list, it is possible to obtain that the terminal application exists in the application list. By the embodiment, whether the terminal application exists in the application program list or not can be accurately known.
Optionally, after entering the keyboard mode, the method includes: and generating a preset function button on the desktop image, wherein the preset function button is used for triggering a key position mapping control interface.
In an alternative embodiment, after entering the keyboard mode, a preset function button may be generated on the desktop image, through which a key mapping control interface may be triggered, and a key mapping relationship may be displayed on the key mapping control interface, so that the target object may check the key mapping relationship, and update and adjust the key mapping relationship.
Optionally, after entering the keyboard mode, the method further comprises: and carrying out key mapping on the terminal application, and establishing a key mapping relation, wherein the key mapping is to map the operation of a keyboard and/or a mouse to the application virtual key.
In an alternative embodiment, after entering the keyboard mode, the terminal application is mapped with the key positions, and a key position mapping relation is established, so that not only can each virtual key be mapped with one key position in the keyboard, thereby controlling the terminal application through the keyboard, but also one or more virtual keys can be mapped with the mouse, thereby triggering corresponding operation through clicking the mouse.
Optionally, after establishing the key mapping relationship, the method further includes: obtaining key position mapping modification information, wherein the key position mapping modification information comprises virtual keys and modified key position information; and updating the key mapping relation according to the key mapping modification information.
In an alternative embodiment, key map modification information is acquired, where the key map modification information includes virtual keys and modified key information, and then the key map relationship is updated according to the key map modification information. By the embodiment, the key mapping relation can be updated in time.
Optionally, after establishing the key mapping relationship, the method further includes: and adding an application key indication layer on an application picture of the terminal application according to the key mapping relation.
In an alternative embodiment, on the basis of the original application picture, an application key indication layer is added on the virtual key icon by identifying the virtual key icon in the application picture, wherein the application key indication layer can be a semitransparent layer, and the layer is provided with a key position corresponding to the virtual key, so that the operation of a target user can be facilitated, and the memory of a more complex key position corresponding relation of the target object can be avoided.
Optionally, performing a control operation on the terminal application according to the second control instruction includes: converting the second control instruction into a corresponding virtual key control instruction; and sending the virtual key control instruction to the terminal application so that the terminal application executes corresponding control operation.
In an alternative embodiment, when the second control instruction is converted into the corresponding virtual key control instruction, the key mapping relationship may be used to convert the second control instruction into the corresponding virtual key control instruction.
In an alternative embodiment, the virtual key control instruction may be stored in a predetermined storage space local to the terminal, and the terminal application performs the corresponding control operation by reading the predetermined storage space.
An alternative embodiment of the present invention will be described in detail below.
Fig. 2 is a schematic diagram of a deployment scenario of a control method of a terminal application according to an alternative embodiment of the present invention, as shown in fig. 2, in the scenario, a terminal is a smart phone, and communication is established between the smart phone and a PC end through a built-in soft S and soft R. The smart phone can send the desktop display image to the soft R through the soft S, so that the desktop display image is displayed through a display of the PC side. Therefore, when the mobile game is run on the smart phone, the picture can be directly pulled to the PC end for display. However, currently, under such a transmission architecture, the keyboard and the mouse on the PC side cannot control the game in the reverse direction, or can only perform the game operation by means of clicking the mouse, which is very inconvenient for the player.
Further, an alternative embodiment of the present invention provides a method for controlling a game application, where the method includes the following specific implementation steps:
step 201, after the soft S establishes connection with the soft R, the soft S sends the acquired desktop image of the mobile phone to the soft R; wherein, after decoding by soft R, display is carried out on the PC end.
Step 202, the soft R collects a mouse message (corresponding to the first control instruction) generated by a user by operating a keyboard and a mouse, and sends the collected mouse message to the soft S;
Step 203, the soft S parses the received mouse message, and when determining that the current mouse message is a game keyboard mode switching request initiated by a preset combination key, first determines whether a game application is currently running locally, if yes, then enters a game keyboard mode;
in the implementation process, the PC end user may initiate the game keyboard mode switching request through a special key mouse operation, for example, may initiate the game keyboard mode switching request through a "ctrl+shift+x" combination key, so as to enter a game keyboard mode, where the user may control the hand-play operation through a keyboard. Meanwhile, the user can enter a common keyboard mode through the same or different combination keys, and in the common keyboard mode, the user can click through a mouse and input through a keyboard.
After receiving the game keyboard mode switching request, it may be first determined whether a game application is currently running locally, if so, it may be determined that it is necessary to start the game keyboard mode (and avoid misoperation of the user), and the game keyboard mode is entered.
Specifically, the soft S determines whether a game application is currently running locally by: the soft S acquires a local running application program list; and judging whether a game application exists in the current running application program list.
Specifically, the soft S compares the application in the running application program list with the application names in the local pre-stored game application list, and if at least one application name is successfully compared, the game application is determined to be running locally. At this time, the game pad mode may be entered.
After entering the game keyboard mode, the soft S generates a key mouse mapping button on an acquisition picture aiming at the current desktop, a user can check a key mapping control interface by clicking the button, a PC end user can check the key mapping relation (default or before user-defined) in the current use in the interface, and the key mapping mode can be modified based on the self requirement.
Specifically, the soft S enters a game keyboard mode, comprising: soft S identifies the current game; the soft S performs a default key mapping based on the currently identified game.
The above-mentioned key mapping refers to mapping operations of a keyboard and/or a mouse to virtual keys of a game.
Each virtual key is mapped to a key position in the keyboard, thereby performing game control through the keyboard. Of course, one or more virtual keys may also be mapped to the mouse, triggering the corresponding operation by a mouse click. Similarly, for other games, the key mapping is performed according to the specific virtual key arrangement condition, and a key mapping control interface is generated.
For example, a queen glory game is taken as an example, a plurality of characters are involved in a hand tour, a user can select favorite characters when each game starts, each character corresponds to a plurality of touch actions, the control is performed through virtual keys in a picture, the same touch actions (such as city return, recovery, flash and the like) can exist among the characters, and the special touch actions can also exist among the characters; specifically, six virtual keys are marked with red circles, each representing one touch action of the current character. In this scenario, the key mapping may be performed according to the following rules: all virtual keys corresponding to a certain character (each virtual key corresponds to a touch action of a person) are ordered according to a certain sequence. For example, the virtual keys may be ordered according to the arrangement positions of the corresponding virtual keys on the screen, and then the ordered virtual keys are numbered, and the corresponding key positions are set according to the numbers. For example, character 1 corresponds to 6 touch actions, numbered in sequence; 1. 2, 3, 4, 5, 6; character 2 corresponds to 7 touch actions, and the serial numbers are: 1. 2, 3, 4, 5, 6, 7; each virtual key is mapped to a fixed key position according to the number, for example, 1 is mapped to Q,2 is mapped to W,3 is mapped to E,4 is mapped to R,5 is mapped to F,6 is mapped to G, 7 is mapped to H, etc., so that the corresponding virtual key is mapped to the fixed key position. The key position can be reused in a corresponding way. That is, when the user uses person 1, control is performed by the six keys QWERFG, and when switching to person 2, control is performed by the seven keys QWERFGH.
Further, the user can modify the configured key mapping relation according to own habit, in the implementation process, the soft S receives key mapping modification information submitted by the user, the key mapping modification information includes the virtual key and the modified key mapping information, and then the soft S updates the current key mapping relation according to the received key mapping modification information.
According to the above, the soft S local needs to store a cloud hand game key mapping relation table, which includes the key mapping relation corresponding to each game application that is newly defined by the current user.
Optionally, after entering the game keyboard mode, the soft S may further add a game key indication layer on the current game screen according to the current key mapping relationship, specifically, on the basis of the original game screen, by identifying the virtual key icon in the screen, a semitransparent layer is added on the icon, and the map layer is written with a key corresponding to the current virtual key, for example, Q is written corresponding to Q, so that the game player can operate conveniently, and the game player is prevented from memorizing a complex key corresponding relationship.
Step 204, after entering the game keyboard mode, the soft S receives a mouse control message (corresponding to the second control command) for the game sent by the PC end;
Step 205, the soft S converts the received control message of the mouse into a control message (corresponding to the virtual key control command) of the corresponding virtual key;
Specifically, the soft S converts the keyboard and mouse control message into a control message aiming at a corresponding virtual key according to the current key position mapping relation; for example, when the key bit corresponding to the virtual key "flash" is F, the click message of F by the user will be converted into the click message of "flash" for the key.
In the implementation process, the virtual keys in the game have two states, namely an activated state (colored icons) and a hidden state (gray or disappeared icons), when the icons are in the activated state, corresponding keys on the keyboard can be used for executing corresponding operations, and when the icons are in the hidden state, the corresponding keys do not perform any operations.
And 206, the soft S gives the converted control message to a locally operated cloud hand game application, and the cloud hand game application executes corresponding control operation.
Specifically, the soft S writes the converted control message into a local specific storage space, where the storage space is used to store the operation of the game application by the user, and the cloud hand game application executes the corresponding control message by reading the storage space.
In the above embodiment, the control method of the game application can enable the user to realize the operation of the game through the keyboard and the mouse when putting the mobile phone game picture on the PC, thereby improving the game experience of the user and expanding the use scene and equipment of the mobile phone game.
Example 2
According to another aspect of the embodiment of the present invention, there is further provided a control device for a terminal application, and fig. 3 is a schematic diagram of the control device for the terminal application according to the embodiment of the present invention, as shown in fig. 3, where the control device for the terminal application includes: a transmitting module 302, a first receiving module 304, a determining module 306, a second receiving module 308, and a control module 310. The control device of the terminal application will be described in detail.
The sending module 302 is configured to send the desktop image to the PC for display by the terminal; the first receiving module 304 is connected to the sending module 302, and is configured to receive a first control instruction from the PC end, where the first control instruction is used to trigger entering a keyboard mode, and the keyboard mode is to control an operation of a terminal application through a keyboard; a determining module 306, coupled to the first receiving module 304, configured to determine whether a terminal is currently running a terminal application, where when the terminal is currently running the terminal application, a keyboard mode is entered; the second receiving module 308 is connected to the determining module 306, and is configured to receive a second control instruction sent from the PC side, where the second control instruction is used to trigger a virtual key for the terminal application; the control module 310 is connected to the second receiving module 308, and is configured to perform a control operation on the terminal application according to the second control instruction.
It should be noted that each of the above modules may be implemented by software or hardware, for example, in the latter case, it may be implemented by: the above modules may be located in the same processor; and/or the above modules are located in different processors in any combination.
In the above embodiment, when the control device for the terminal application can put the desktop image on the PC end through the terminal, the control operation for the terminal application is realized through the keyboard and the mouse, so that the purpose of the same screen control for the terminal application is achieved, the game experience of the user is improved, the use scene of the mobile phone game and the technical effect of the equipment are expanded, and the technical problems that the operation and the use of the user are often limited due to the size of the mobile terminal in the related art, and the operation speed and the sensitivity are influenced are solved.
Here, the above-mentioned transmitting module 302, the first receiving module 304, the determining module 306, the second receiving module 308, and the control module 310 correspond to steps S102 to S110 in embodiment 1, and the above-mentioned modules are the same as examples and application scenarios implemented by the corresponding steps, but are not limited to those disclosed in embodiment 1.
Optionally, the determining module 306 includes: the acquisition unit is used for acquiring an application program list which is currently and locally operated by the terminal; and the determining unit is used for determining whether the terminal application exists in the application program list, wherein the application names in the application program list are compared with the application names in the locally pre-stored terminal application list, and if at least one application name is successfully compared, the terminal application exists in the application program list.
Optionally, the apparatus further includes: and the generating module is used for generating preset function buttons on the desktop image after entering the keyboard mode, wherein the preset function buttons are used for triggering the key position mapping control interface.
Optionally, the apparatus further includes: the establishing module is used for carrying out key mapping on the terminal application after entering the keyboard mode, and establishing a key mapping relation, wherein the key mapping is to map the operation of a keyboard and/or a mouse onto the application virtual keys.
Optionally, the apparatus further includes: the device comprises an acquisition module, a key mapping module and a key position modification module, wherein the acquisition module is used for acquiring key position mapping modification information after establishing a key position mapping relation, and the key position mapping modification information comprises a virtual key and modified key position information; and the updating module is used for updating the key mapping relation according to the key mapping modification information.
Optionally, the apparatus further includes: and the adding module is used for adding an application key indication layer on an application picture of the terminal application according to the key mapping relation after the key mapping relation is established.
Optionally, the control module 310 includes: the conversion unit is used for converting the second control instruction into a corresponding virtual key control instruction; and the sending unit is used for sending the virtual key control instruction to the terminal application so as to enable the terminal application to execute corresponding control operation.
Example 3
According to another aspect of the embodiments of the present invention, there is also provided a computer-readable storage medium including a stored program, where the program, when run, controls a device in which the computer-readable storage medium is located to execute the control method of the terminal application of any one of the above.
Optionally, the computer readable storage medium is controlled to perform the following functions when the program is run: the terminal sends the desktop image to the PC end for display; receiving a first control instruction from a PC end, wherein the first control instruction is used for triggering to enter a keyboard mode, and the keyboard mode is to control the operation of terminal application through a keyboard; determining whether a terminal application is currently operated locally or not, wherein a keyboard mode is entered when the terminal application is currently operated locally; receiving a second control instruction sent by the PC end, wherein the second control instruction is used for triggering a virtual key applied to the terminal; and controlling the terminal application according to the second control instruction.
Optionally, determining whether the terminal is currently running a terminal application locally includes: acquiring an application program list of a terminal running locally at present; determining whether a terminal application exists in the application program list, wherein the application names in the application program list are compared with the application names in the locally pre-stored terminal application list, and if at least one application name is successfully compared, determining that the terminal application exists in the application program list.
Optionally, after entering the keyboard mode, the method includes: and generating a preset function button on the desktop image, wherein the preset function button is used for triggering a key position mapping control interface.
Optionally, after entering the keyboard mode, the method further comprises: and carrying out key mapping on the terminal application, and establishing a key mapping relation, wherein the key mapping is to map the operation of a keyboard and/or a mouse to the application virtual key.
Optionally, after establishing the key mapping relationship, the method further includes: obtaining key position mapping modification information, wherein the key position mapping modification information comprises virtual keys and modified key position information; and updating the key mapping relation according to the key mapping modification information.
Optionally, after establishing the key mapping relationship, the method further includes: and adding an application key indication layer on an application picture of the terminal application according to the key mapping relation.
Optionally, performing a control operation on the terminal application according to the second control instruction includes: converting the second control instruction into a corresponding virtual key control instruction; and sending the virtual key control instruction to the terminal application so that the terminal application executes corresponding control operation.
Example 4
According to another aspect of the embodiment of the present invention, there is also provided a processor, configured to execute a program, where the program executes the control method of the terminal application of any one of the above-mentioned embodiments.
The embodiment of the invention provides equipment, which comprises a processor, a memory and a program stored in the memory and capable of running on the processor, wherein the processor realizes the following steps when executing the program: the terminal sends the desktop image to the PC end for display; receiving a first control instruction from a PC end, wherein the first control instruction is used for triggering to enter a keyboard mode, and the keyboard mode is to control the operation of terminal application through a keyboard; determining whether a terminal application is currently operated locally or not, wherein a keyboard mode is entered when the terminal application is currently operated locally; receiving a second control instruction sent by the PC end, wherein the second control instruction is used for triggering a virtual key applied to the terminal; and controlling the terminal application according to the second control instruction.
Optionally, determining whether the terminal is currently running a terminal application locally includes: acquiring an application program list of a terminal running locally at present; determining whether a terminal application exists in the application program list, wherein the application names in the application program list are compared with the application names in the locally pre-stored terminal application list, and if at least one application name is successfully compared, determining that the terminal application exists in the application program list.
Optionally, after entering the keyboard mode, the method includes: and generating a preset function button on the desktop image, wherein the preset function button is used for triggering a key position mapping control interface.
Optionally, after entering the keyboard mode, the method further comprises: and carrying out key mapping on the terminal application, and establishing a key mapping relation, wherein the key mapping is to map the operation of a keyboard and/or a mouse to the application virtual key.
Optionally, after establishing the key mapping relationship, the method further includes: obtaining key position mapping modification information, wherein the key position mapping modification information comprises virtual keys and modified key position information; and updating the key mapping relation according to the key mapping modification information.
Optionally, after establishing the key mapping relationship, the method further includes: and adding an application key indication layer on an application picture of the terminal application according to the key mapping relation.
Optionally, performing a control operation on the terminal application according to the second control instruction includes: converting the second control instruction into a corresponding virtual key control instruction; and sending the virtual key control instruction to the terminal application so that the terminal application executes corresponding control operation.
The invention also provides a computer program product adapted to perform, when executed on a data processing device, a program initialized with the method steps of: the terminal sends the desktop image to the PC end for display; receiving a first control instruction from a PC end, wherein the first control instruction is used for triggering to enter a keyboard mode, and the keyboard mode is to control the operation of terminal application through a keyboard; determining whether a terminal application is currently operated locally or not, wherein a keyboard mode is entered when the terminal application is currently operated locally; receiving a second control instruction sent by the PC end, wherein the second control instruction is used for triggering a virtual key applied to the terminal; and controlling the terminal application according to the second control instruction.
Optionally, determining whether the terminal is currently running a terminal application locally includes: acquiring an application program list of a terminal running locally at present; determining whether a terminal application exists in the application program list, wherein the application names in the application program list are compared with the application names in the locally pre-stored terminal application list, and if at least one application name is successfully compared, determining that the terminal application exists in the application program list.
Optionally, after entering the keyboard mode, the method includes: and generating a preset function button on the desktop image, wherein the preset function button is used for triggering a key position mapping control interface.
Optionally, after entering the keyboard mode, the method further comprises: and carrying out key mapping on the terminal application, and establishing a key mapping relation, wherein the key mapping is to map the operation of a keyboard and/or a mouse to the application virtual key.
Optionally, after establishing the key mapping relationship, the method further includes: obtaining key position mapping modification information, wherein the key position mapping modification information comprises virtual keys and modified key position information; and updating the key mapping relation according to the key mapping modification information.
Optionally, after establishing the key mapping relationship, the method further includes: and adding an application key indication layer on an application picture of the terminal application according to the key mapping relation.
Optionally, performing a control operation on the terminal application according to the second control instruction includes: converting the second control instruction into a corresponding virtual key control instruction; and sending the virtual key control instruction to the terminal application so that the terminal application executes corresponding control operation.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
In the foregoing embodiments of the present invention, the descriptions of the embodiments are emphasized, and for a portion of this disclosure that is not described in detail in this embodiment, reference is made to the related descriptions of other embodiments.
In the several embodiments provided in the present application, it should be understood that the disclosed technology may be implemented in other manners. The above-described embodiments of the apparatus are merely exemplary, and the division of the units, for example, may be a logic function division, and may be implemented in another manner, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be through some interfaces, units or modules, or may be in electrical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied essentially or in part or all of the technical solution or in part in the form of a software product stored in a storage medium, including instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a usb disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a removable hard disk, a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The foregoing is merely a preferred embodiment of the present invention and it should be noted that modifications and adaptations to those skilled in the art may be made without departing from the principles of the present invention, which are intended to be comprehended within the scope of the present invention.
Claims (6)
1. A control method for a terminal application, comprising:
The terminal sends the desktop image to the PC end for display;
receiving a first control instruction from the PC end, wherein the first control instruction is used for triggering to enter a keyboard mode, and the keyboard mode is to control the operation of terminal application through a keyboard;
Determining whether the terminal application is currently operated locally or not, wherein the keyboard mode is entered when the terminal application is currently operated locally;
receiving a second control instruction sent by the PC end, wherein the second control instruction is used for triggering a virtual key applied to the terminal;
Performing control operation on the terminal application according to the second control instruction; after entering the keyboard mode, the method further comprises: generating a preset function button on the desktop image, wherein the preset function button is used for triggering a key position mapping control interface; after entering the keyboard mode, the method further comprises: performing key mapping on the terminal application, and establishing a key mapping relation, wherein the key mapping is to map the operation of a keyboard and/or a mouse onto an application virtual key; after establishing the key mapping relationship, the method further comprises: according to the key mapping relation, an application key indication layer is added on an application picture of the terminal application; determining whether the terminal application is currently running locally or not, including: acquiring an application program list of the terminal running locally at present; and determining whether the terminal application exists in the application program list, wherein the application names in the application program list are compared with the application names in a locally pre-stored terminal application list, and if at least one application name is successfully compared, determining that the terminal application exists in the application program list.
2. The method of claim 1, further comprising, after establishing the key-position mapping relationship:
Obtaining key position mapping modification information, wherein the key position mapping modification information comprises virtual keys and modified key position information;
And updating the key mapping relation according to the key mapping modification information.
3. The method according to claim 1 or 2, wherein performing a control operation on the terminal application according to the second control instruction comprises:
Converting the second control instruction into a corresponding virtual key control instruction;
And sending the virtual key control instruction to the terminal application so that the terminal application executes corresponding control operation.
4. A control device for a terminal application, comprising:
the sending module is used for sending the desktop image to the PC end by the terminal for display;
the first receiving module is used for receiving a first control instruction from the PC end, wherein the first control instruction is used for triggering to enter a keyboard mode, and the keyboard mode is used for controlling the operation of terminal application through a keyboard;
The determining module is used for determining whether the terminal application is currently and locally operated or not, wherein the keyboard mode is entered when the terminal application is currently and locally operated;
The second receiving module is used for receiving a second control instruction sent by the PC end, wherein the second control instruction is used for triggering a virtual key applied to the terminal;
The control module is used for controlling the terminal application according to the second control instruction; the control device further comprises a generation module for generating a preset function button on the desktop image after entering the keyboard mode, wherein the preset function button is used for triggering a key position mapping control interface; the control device also comprises an establishing module, a key mapping module and a control module, wherein the establishing module is used for carrying out key mapping on the terminal application after entering the keyboard mode, and establishing a key mapping relation, wherein the key mapping is used for mapping the operation of a keyboard and/or a mouse onto an application virtual key; the control device also comprises an adding module, a display module and a display module, wherein the adding module is used for adding an application key indication layer on an application picture of the terminal application according to the key mapping relation after the key mapping relation is established; the determining module comprises: the acquisition unit is used for acquiring an application program list which is currently and locally operated by the terminal; and the determining unit is used for determining whether the terminal application exists in the application program list, wherein the application names in the application program list are compared with the application names in the locally pre-stored terminal application list, and if at least one application name is successfully compared, the terminal application exists in the application program list.
5. A computer-readable storage medium, characterized in that the computer-readable storage medium comprises a stored program, wherein the program, when run, controls a device in which the computer-readable storage medium is located to execute the control method of the terminal application of any one of claims 1 to 3.
6. A processor, characterized in that the processor is configured to run a program, wherein the program when run performs the control method of the terminal application according to any one of claims 1 to 3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110963735.4A CN113663324B (en) | 2021-08-20 | 2021-08-20 | Control method and device for terminal application and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110963735.4A CN113663324B (en) | 2021-08-20 | 2021-08-20 | Control method and device for terminal application and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113663324A CN113663324A (en) | 2021-11-19 |
| CN113663324B true CN113663324B (en) | 2024-08-13 |
Family
ID=78544699
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110963735.4A Active CN113663324B (en) | 2021-08-20 | 2021-08-20 | Control method and device for terminal application and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113663324B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102609192A (en) * | 2012-01-17 | 2012-07-25 | 华为终端有限公司 | Mobile terminal operating method by computer and mobile terminal |
| CN102999167A (en) * | 2012-11-14 | 2013-03-27 | 广东欧珀移动通信有限公司 | A method for operating a virtual keyboard application in a mobile terminal with keys on a PC |
| CN107894852A (en) * | 2017-11-13 | 2018-04-10 | 珠海市魅族科技有限公司 | A kind of keyboard shift method and electronic equipment |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102830925B (en) * | 2012-08-09 | 2016-06-01 | 天津三星电子有限公司 | A kind of display terminal is to the method for controlling operation thereof of mobile terminal and display terminal thereof |
| CN106873846A (en) * | 2016-12-29 | 2017-06-20 | 北京奇虎科技有限公司 | A kind of PC ends control the method and system of mobile device |
| CN108762639A (en) * | 2018-05-28 | 2018-11-06 | 努比亚技术有限公司 | A kind of control method of physical button, mobile terminal and storage medium |
| CN110109557B (en) * | 2019-05-06 | 2023-04-18 | 原点显示（深圳）科技有限公司 | Method for switching keyboard mode and adapting mobile terminal |
| CN112631535A (en) * | 2020-12-22 | 2021-04-09 | 努比亚技术有限公司 | Screen projection reverse control method and device, mobile terminal and storage medium |
| CN112667181A (en) * | 2020-12-31 | 2021-04-16 | 努比亚技术有限公司 | Screen projection method, screen projection equipment, screen projection control system and storage medium |
| CN113207018A (en) * | 2021-04-23 | 2021-08-03 | 西安万像电子科技有限公司 | Remote screen projection method, system, equipment and storage medium |
-
2021
- 2021-08-20 CN CN202110963735.4A patent/CN113663324B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102609192A (en) * | 2012-01-17 | 2012-07-25 | 华为终端有限公司 | Mobile terminal operating method by computer and mobile terminal |
| CN102999167A (en) * | 2012-11-14 | 2013-03-27 | 广东欧珀移动通信有限公司 | A method for operating a virtual keyboard application in a mobile terminal with keys on a PC |
| CN107894852A (en) * | 2017-11-13 | 2018-04-10 | 珠海市魅族科技有限公司 | A kind of keyboard shift method and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113663324A (en) | 2021-11-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10661171B2 (en) | Information processing method, terminal, and computer storage medium | |
| US12070685B2 (en) | Object display method and apparatus, storage medium, and electronic device | |
| JP6529659B2 (en) | Information processing method, terminal and computer storage medium | |
| CN113350793B (en) | Interface element setting method and device, electronic equipment and storage medium | |
| CN111773670B (en) | Method, apparatus, device and storage medium for marking in game | |
| CN113694514B (en) | Object control method and device | |
| CN112274910A (en) | Virtual key configuration method, virtual key method and related device | |
| CN113908533A (en) | Cloud game interaction method, device, terminal and processor | |
| JP5845547B1 (en) | Program, game system, electronic device, server, and game control method for improving user input operability | |
| CN112099678A (en) | Text processing method and device and computer readable storage medium | |
| US20250128176A1 (en) | In-game team-forming method, device, equipment, and storage medium | |
| KR20240026256A (en) | Methods for displaying prompt information, devices and storage media, and electronic devices | |
| CN113663324B (en) | Control method and device for terminal application and computer readable storage medium | |
| CN106527916A (en) | Operating method and device based on virtual reality equipment, and operating equipment | |
| CN111773674A (en) | Instruction processing method in game and electronic equipment | |
| CN115501581B (en) | Game control method, device, computer equipment and storage medium | |
| CN115040867B (en) | Game card control method, device, computer equipment and storage medium | |
| CN113797527B (en) | Game processing method, device, equipment, medium and program product | |
| CN116531754A (en) | Method and device for controlling virtual characters in game and electronic terminal | |
| CN113926186A (en) | Method, device and touch terminal for selecting virtual object in game | |
| CN113680051A (en) | Game control method, device, equipment and storage medium | |
| CN113975803A (en) | Control method and device of virtual role, storage medium and electronic equipment | |
| JP5938131B1 (en) | Program, game system, electronic device, server, and game control method for improving user input operability | |
| CN115193062B (en) | Game control method and device, storage medium and computer equipment | |
| CN114328272B (en) | Application testing method, device and system and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |