CN113204300A - Method and system for automatically executing operation by equipment - Google Patents
Method and system for automatically executing operation by equipment Download PDFInfo
- Publication number
- CN113204300A CN113204300A CN202110749904.4A CN202110749904A CN113204300A CN 113204300 A CN113204300 A CN 113204300A CN 202110749904 A CN202110749904 A CN 202110749904A CN 113204300 A CN113204300 A CN 113204300A
- Authority
- CN
- China
- Prior art keywords
- operation path
- path file
- event
- equipment
- preset rule
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/62—Text, e.g. of license plates, overlay texts or captions on TV images
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application relates to a method and a system for automatically executing operation by equipment, wherein an operation event corresponding to a target function is recorded by first equipment, and an operation path is generated by all the operation events corresponding to the target function; the first device stores the operation path as an operation path file according to a preset rule protocol, wherein the preset rule protocol comprises branch judgment, and the branch judgment is used for executing a corresponding next operation event according to an operation result after the operation event; the first device analyzes the operation path file according to a preset rule protocol, automatically executes the operation event corresponding to the operation path file through the automatic service, does not need manual operation step by step when next operation corresponding to the target function is executed, and solves the problems of low operation efficiency, high entrance threshold and high operation difficulty of the device.
Description
Technical Field
The present application relates to the field of computer technology, and in particular, to a method and system for automatically executing an operation by a device.
Background
With the development of technology, the operation difficulty of the equipment is higher and higher, the operation complexity of the equipment increases the entrance threshold of a new user and the operation difficulty of the user, and some professional equipment even needs a professional person to operate. In the related art, a remote controller is generally equipped for operating the equipment, and some commonly used shortcut operations are built in the remote controller to simplify the operation of the equipment. However, some devices have too many operation steps and complicated operation, cannot be operated by one key of a remote controller, and can only be operated by manpower step by step, which results in low operation efficiency of the devices, high entrance threshold and high operation difficulty.
At present, no effective solution is provided for the problems that the operation difficulty of equipment in the related art is high, the complex operation can only be performed manually, the operation efficiency of the equipment is low, the entrance threshold is high and the operation difficulty is large.
Disclosure of Invention
The embodiment of the application provides a method and a system for automatically executing operation by equipment, and aims to at least solve the problems that the equipment in the related technology is high in operation difficulty, complex operation can only be performed manually, the equipment operation efficiency is low, the entrance threshold is high and the operation difficulty is large.
In a first aspect, an embodiment of the present application provides a method for automatically executing an operation by a device, where the method includes:
the method comprises the steps that first equipment records operation events corresponding to a target function, and all the operation events corresponding to the target function generate operation paths;
the first device stores the operation path as an operation path file according to a preset rule protocol, wherein the preset rule protocol is used for performing branch judgment, and the branch judgment is used for executing a corresponding next operation event according to an operation result after the operation event;
and the first equipment analyzes the operation path file according to the preset rule protocol and automatically executes the operation event corresponding to the operation path file through an automatic service.
In some embodiments, after the first device records an operation event corresponding to a target function and generates an operation path from all the operation events corresponding to the target function, the method further includes:
and optimizing the operation path to generate an optimized operation path, wherein the optimizing the operation path comprises deleting the operation event, adding a new operation event and adding intelligent image recognition processing in the operation event.
In some embodiments, adding the smart graph recognition process to the operation event comprises:
and under the condition that an operation event needs a character or image matching function, capturing an interface image after the last operation event is executed, searching a target position of the character or image in the interface image, storing a picture-text screenshot of the target position, binding the picture-text screenshot with the last operation event, and storing the picture-text screenshot in the operation path.
In some embodiments, the automatically executing, by the automation service, the operation event corresponding to the operation path file includes:
in the process that the automation service automatically executes the operation event corresponding to the operation path file, the automation service detects the interface change of the first device and judges whether the operation at each step is correct or not;
if the judgment result is yes, the next operation is carried out, and if the judgment result is no, the automatic service is stopped, and prompt information is sent.
In some embodiments, after the first device saves the operation path as an operation path file according to a preset rule protocol, the method further includes:
and the first equipment adds identification information to the operation path file and uploads the identification information to a server side.
In some embodiments, after the first device adds identification information to the operation path file and uploads the operation path file to a server, the method further includes:
the second equipment sends a request command to the server, wherein the request command comprises the identification information;
the server returns the target operation path file corresponding to the identification information to the second device;
and the second equipment analyzes the operation path file according to the preset rule protocol and automatically executes the operation event corresponding to the operation path file through an automatic service.
In some embodiments, after the first device saves the operation path as an operation path file through the preset rule protocol, the method further includes:
the mobile terminal acquires the operation path file and the address of the second equipment and establishes communication connection with the second equipment according to the address of the second equipment;
and the mobile terminal sends the operation path file to the second equipment, and the second equipment analyzes the operation path file according to the preset rule protocol and automatically executes the operation event corresponding to the operation path file through an automatic service.
In a second aspect, the embodiment of the present application provides a system for automatically executing an operation by a device, the system includes a recording module, a saving module and an executing module,
the recording module is used for recording the operation events corresponding to the target functions, and generating operation paths by all the operation events corresponding to the target functions;
the storage module is used for storing the operation path as an operation path file according to a preset rule protocol, wherein the preset rule protocol comprises branch judgment, and the branch judgment is used for executing a corresponding next operation event according to an operation result after the operation event;
the execution module is used for analyzing the operation path file according to the preset rule protocol and automatically executing the operation event corresponding to the operation path file through an automatic service.
In a third aspect, an embodiment of the present application provides an electronic apparatus, which includes a memory, a processor, and a computer program stored on the memory and executable on the processor, and when the processor executes the computer program, the processor implements a method for automatically performing an operation by the apparatus according to the first aspect.
In a fourth aspect, the present application provides a storage medium, on which a computer program is stored, where the program is executed by a processor to implement the method for automatically performing the operation by the apparatus according to the first aspect.
Compared with the related art, the method for automatically executing the operation by the equipment provided by the embodiment of the application records the operation event corresponding to the target function through the first equipment, and generates the operation path by all the operation events corresponding to the target function; the first device stores the operation path as an operation path file according to a preset rule protocol, wherein the preset rule protocol comprises branch judgment, and the branch judgment is used for executing a corresponding next operation event according to an operation result after the operation event; the first equipment analyzes the operation path file according to a preset rule protocol, automatically executes the operation event corresponding to the operation path file through the automatic service, saves the operation path file corresponding to the target function, does not need manual operation step by step when executing the operation of the target function next time, only needs to open the operation path file, and can automatically execute a series of operations of the target function through the automatic service, so that the problems of low equipment operation efficiency, high entrance threshold and high operation difficulty are solved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
FIG. 1 is a flow diagram of a method for an apparatus to automatically perform operations according to an embodiment of the application;
FIG. 2 is a schematic diagram of an inter-device interaction process according to an embodiment of the application;
FIG. 3 is a block diagram of a system for automatically performing operations by a device according to an embodiment of the present application;
fig. 4 is an internal structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be described and illustrated below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments provided in the present application without any inventive step are within the scope of protection of the present application. Moreover, it should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another.
Reference in the specification to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the specification. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Those of ordinary skill in the art will explicitly and implicitly appreciate that the embodiments described herein may be combined with other embodiments without conflict.
Unless defined otherwise, technical or scientific terms referred to herein shall have the ordinary meaning as understood by those of ordinary skill in the art to which this application belongs. Reference to "a," "an," "the," and similar words throughout this application are not to be construed as limiting in number, and may refer to the singular or the plural. The present application is directed to the use of the terms "including," "comprising," "having," and any variations thereof, which are intended to cover non-exclusive inclusions; for example, a process, method, system, article, or apparatus that comprises a list of steps or modules (elements) is not limited to the listed steps or elements, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus. Reference to "connected," "coupled," and the like in this application is not intended to be limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. Reference herein to "a plurality" means greater than or equal to two. "and/or" describes an association relationship of associated objects, meaning that three relationships may exist, for example, "A and/or B" may mean: a exists alone, A and B exist simultaneously, and B exists alone. Reference herein to the terms "first," "second," "third," and the like, are merely to distinguish similar objects and do not denote a particular ordering for the objects.
The present embodiment provides a method for automatically executing an operation by a device, and fig. 1 is a flowchart of a method for automatically executing an operation by a device according to an embodiment of the present application, as shown in fig. 1, the method includes the following steps:
step S101, the first device records operation events corresponding to a target function, and all the operation events corresponding to the target function generate operation paths; in this embodiment, the target function is a certain function that can be implemented by the first device, in order to implement the function, a series of operation events need to be executed, where the operation events include a click button event, a touch position event, a moving path event, and the like, one device may have multiple functions, the multiple functions may correspond to multiple operation path files, the multiple operation path files are stored in a list according to a time sequence, and a user may also drag the operation path files according to a requirement, adjust a position sequence, and place commonly used operation path files in a position near the front of the list in sequence, thereby further improving operation efficiency of the device.
Step S102, the first device stores the operation path as an operation path file according to a preset rule protocol, wherein the preset rule protocol comprises branch judgment, and the branch judgment is used for executing a corresponding next operation event according to an operation result after the operation event;
in the embodiment, in order to complete the functions of recording, storing, editing, applying and sharing the highly intelligent operation path, a set of preset rule protocol with strong expansibility is designed, the preset rule protocol specifies that the operation flow is stored in a list form, each operation event is generated according to a fixed format, the fixed format is a keyword, a space and a parameter value, one operation event has at least one keyword, and the keyword comprises an operation type and an additional attribute;
exemplary operation types include click, touch, move, scroll, and Input, wherein the click command may click a button, a position coordinate, a button name, an ID, and the like, the additional attributes include search and expect, the search is used to search a page element, which may be a button, a text, an icon, a picture, and the like, the resource file such as a picture is indexed in the form of a compressed file, the expect is used for branch judgment, the device software supports a branch command when recording an operation event, and the recording program gives a prompt whether to record a branch after clicking the button.
Step S103, the first device analyzes the operation path file according to a preset rule protocol, and automatically executes the operation event corresponding to the operation path file through the automation service. In this embodiment, the operation path file is stored based on a preset rule protocol, the first device analyzes the operation path file according to the preset rule protocol to obtain an operation path recognizable by the Android system, and an automation service provided by the Android system automatically executes an operation event corresponding to the operation path file.
Illustratively, when the target function of the first device is to open a direct audio-tremble broadcast room, the result of saving the operation path corresponding to the direct audio-tremble broadcast room as the operation path file according to the preset rule protocol is as follows:
start # Each operation path file begins with a Start, identifying the Start of an instruction
location xxx, activity # location instruction represents the starting page of command execution, the device program will detect whether the starting page is currently operating, if not, the device program will not execute the command
search text buffalo # search buffalo APP
expect success click on the tremble APP button
Operation of pressing the tremble packet name to automatically open tremble homepage if tremble APP button can not be searched
location xxx, activity # location command is also used to check the result of the previous command execution, the location is used to check if the target page is reached after the click button, and the next command execution is started after the target page
click # button location or name, here the publish button
location xxx.activity
click # button location or name, here the live button
location xxx.fragment
the tip # tip command is used for displaying prompt operation and displaying a prompt box for displaying whether to add a live cover
If yes, open the cover selection interface
else, continue to execute the next operation
The expect new save # new command triggers the saving operation, the next application after the saving does not display the prompt, the last result is directly applied, if the cover needs to be reselected, the operation command can be edited again, and the new state is modified
tip # prompt box for displaying whether resolution is selected
expect yes # open resolution select Panel
expect no continue
expect never save
click # Start live button
location xxx.activity
end # Each instruction is identified by a line, a line of instructions identifies commands and parameters by spaces, and ends with an end
Compared with the prior art, the technical scheme of the application includes that the operation steps of the equipment are excessive, the operation is complex, the operation can be performed only step by step through manpower, and the problems of low operation efficiency, high door entrance threshold and high operation difficulty of the equipment are caused, the operation event corresponding to the target function is recorded through the steps from S101 to S103, the operation path is stored as the operation path file according to the preset rule protocol after the operation path is generated, the preset rule protocol can realize the functions of recording the operation path, storing, editing, applying and sharing the operation path, the operation path file is analyzed according to the preset rule protocol, the operation event corresponding to the operation path file is automatically executed through the automatic service, the operation path file corresponding to the target function is stored, the operation path file corresponding to the target function is not required to be operated step by step through manpower when the operation of the target function is executed next time, and only the operation path file is opened, the first equipment can automatically execute a series of operations of the target function through the automatic service, and the problems of low equipment operation efficiency, high entrance threshold and high operation difficulty are solved.
In some embodiments, the first device records operation events corresponding to the target function, and after operation paths are generated by all the operation events corresponding to the target function, the operation paths are optimized to generate optimized operation paths, where optimizing the operation paths includes deleting operation events, adding operation events, and adding intelligent graph recognition processing in the operation events. In this embodiment, when the first device is operated based on the target function, the first device is manually operated, and there is a step that an erroneous operation may occur in the manual operation.
Illustratively, the operation path of a certain basic function is an a operation event → a B operation event → a C operation event → a B operation event → a D operation event, and the B operation event is returned after the C operation event is executed, the first device recognizes that the B operation event → the C operation event is a redundant operation step, or the user optimizes the operation path, and if the user judges that the B operation event → the C operation event is a redundant operation step, the B operation event and the C operation event in the operation path are deleted, so as to obtain an optimized operation path which is an a operation event → a B operation event → a D operation event.
In some of these embodiments, adding the smart graph recognition process to the operational event includes: and under the condition that the operation event needs a character or image matching function, capturing an interface image after the last operation event is executed, searching the target position of the character or image in the interface image, storing the image-text screenshot of the target position, binding the image-text screenshot with the last operation event, and storing the image-text screenshot in the operation path. In this embodiment, operation events corresponding to some target functions are not fixed, and processing of a current operation event needs to be performed based on an operation result of a previous operation event, so that an intelligent graph recognition process needs to be added to the previous operation event, the operation event corresponding to the operation path file is automatically executed in the automation service, and an operation of the current operation event can be performed based on a graph recognition result of the previous operation event.
For example, focusing on an operation event corresponding to a target function of a user a is to open a corresponding APP, enter a search page, and a plurality of users who can select attention are on the search page, wherein the user a clicks the position of the upper left corner at the position of the upper left corner to focus on the user a, the recorded operation path is to click an APP icon → click an icon entering the search interface → click an icon entering the position of the upper left corner a user, after the operation path is saved as an operation path file according to a preset rule protocol, when a first device is automatically operated based on the operation path file, the position of the upper left corner on the search interface is not necessarily the user a, the operation event of "clicking the icon of the user a at the upper left corner" needs a text or image matching function, after entering the search page, a screen recording function of an automatic service is started, and an interface image after the operation event of "clicking the icon entering the search interface" is captured and executed by the screen recording function, and retrieving a target position of a user A on the interface image, cutting an image-text screenshot of the target position on the interface image, binding the image-text screenshot with an icon clicked into a search interface of a previous operation event, storing the bound image-text screenshot in an operation path, storing the operation path as an operation path file according to a preset rule protocol, and after the operation path file is analyzed by the first device, automatically executing the operation steps of clicking an APP icon → clicking the icon clicked into the retrieval interface → identifying image information through image processing algorithm matching, identifying image information consistent with the image of the target position stored in the operation path → judging the icon position of the user A based on an image identifying result → clicking the icon of the user A to finish automatic operation.
In some embodiments, automatically executing, by the automation service, the operation event corresponding to the operation path file includes: in the process that the automation service automatically executes the operation event corresponding to the operation path file, the automation service detects the interface change of the first device and judges whether the operation at each step is correct or not; if the judgment result is yes, the next operation is carried out, and if the judgment result is no, the automatic service is stopped, and prompt information is sent. In this embodiment, for the same device, if the operating environments are different, the operating paths may also be different, after the first device records the operating event corresponding to the target function based on the a operating environment and generates the operating path file, when the first device automatically executes the operating event corresponding to the operating path file, the operating environment of the first device is changed to the B operating environment, at this time, the automated service detects that the interface change of the first device is not consistent with the recorded interface change after executing a certain operating event, which indicates that the operating event is incorrect, stops the automated service, and sends the prompt information, and the user manually operates the first device based on the prompt information, and instructs the first device to record the operating event corresponding to the target function, and newly generate a new operating path.
In some embodiments, after the first device stores the operation path as the operation path file according to the preset rule protocol, the first device adds identification information to the operation path file and uploads the identification information to the server. In this embodiment, the identification information includes a name and a description, the name can uniquely determine a certain operation path file, and a user can know the purpose of the operation path file through the description, and by uploading the operation path file to the server, more users can request the operation path file from the server, so as to perform one operation and operate everywhere.
Optionally, names and descriptions of all device operation path files may be established on the table, and after a user selects a device to be learned according to the descriptions on the table, the user requests the server for the operation path file according to the name corresponding to the description, so that more people can select the device to be learned autonomously.
In some embodiments, after the first device adds identification information to the operation path file and uploads the operation path file to the server, the second device sends a request command to the server, where the request command includes the identification information and user information; the server returns the target operation path file corresponding to the identification information to the second equipment; the second equipment analyzes the operation path file according to a preset rule protocol and automatically executes the operation event corresponding to the operation path file through the automatic service. In this embodiment, a user information database may be established in advance at the server, if the operation path file requested by the user needs to be kept secret, the user information needs to be verified, if the user information is in the user information database, the verification is passed, the target operation path file corresponding to the identifier is returned to the second device, and if the user information is not in the user information database, the verification is not passed, and the request command is rejected.
The operation path file stored in the server side can be partially confidential and partially insecure, the user information needs to be verified for the operation path file requiring confidentiality, and the user information does not need to be verified for the operation path file requiring insecure.
In some embodiments, after the first device saves the operation path as the operation path file through a preset rule protocol, the mobile terminal obtains the operation path file and an address of the second device, and establishes communication connection with the second device according to the address of the second device; and the mobile terminal sends the operation path file to the second equipment, and the second equipment analyzes the operation path file according to a preset rule protocol and automatically executes the operation event corresponding to the operation path file through the automatic service. In this embodiment, the mobile terminal may obtain an address of the second device through a near field communication technology, establish an end-to-end socket connection with the second device through the address of the second device, and when the mobile terminal needs to automatically operate the second device, the mobile terminal may send the operation path file to the second device, and remotely control the second device to automatically execute an operation according to the operation path file.
Fig. 2 is a schematic diagram of an interaction process between devices according to an embodiment of the present application, and as shown in fig. 2, a first device uploads an operation path file to a server after adding identification information to the operation path file, a second device may request the operation path file from the server, and may also establish a socket connection with a mobile terminal, and the mobile terminal sends the operation path file to the second device, where the mobile terminal establishes a communication connection with the first device in advance, the first device sends the operation path file to the mobile terminal, or the mobile terminal requests the operation path file from the server in advance.
It should be noted that the steps illustrated in the above-described flow diagrams or in the flow diagrams of the figures may be performed in a computer system, such as a set of computer-executable instructions, and that, although a logical order is illustrated in the flow diagrams, in some cases, the steps illustrated or described may be performed in an order different than here.
The present embodiment also provides a system for automatically executing an operation by a device, where the system is used to implement the foregoing embodiments and preferred embodiments, and the description of the system that has been already made is omitted. As used hereinafter, the terms "module," "unit," "subunit," and the like may implement a combination of software and/or hardware for a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
Fig. 3 is a block diagram of a system for automatically executing an operation by a device according to an embodiment of the present application, and as shown in fig. 3, the system includes a recording module 31, a saving module 32, and an executing module 33, where the recording module 31 is configured to record an operation event corresponding to a target function, and an operation path is generated by all the operation events corresponding to the target function; the storage module 32 is configured to store the operation path as an operation path file according to a preset rule protocol, where the preset rule protocol is used for performing branch judgment, and the branch judgment is used to execute a corresponding next operation event according to an operation result after the operation event; the execution module 33 is configured to parse the operation path file according to a preset rule protocol, and automatically execute an operation event corresponding to the operation path file through an automation service, so as to solve the problems of low operation efficiency of the device, high entrance threshold, and high operation difficulty.
The above modules may be functional modules or program modules, and may be implemented by software or hardware. For a module implemented by hardware, the modules may be located in the same processor; or the modules can be respectively positioned in different processors in any combination.
The present embodiment also provides an electronic device comprising a memory having a computer program stored therein and a processor configured to execute the computer program to perform the steps of any of the above method embodiments.
Optionally, the electronic apparatus may further include a transmission device and an input/output device, wherein the transmission device is connected to the processor, and the input/output device is connected to the processor.
It should be noted that, for specific examples in this embodiment, reference may be made to examples described in the foregoing embodiments and optional implementations, and details of this embodiment are not described herein again.
In addition, in combination with the method for automatically executing the operation by the device in the foregoing embodiments, the embodiments of the present application may provide a storage medium to implement. The storage medium having stored thereon a computer program; the computer program, when executed by a processor, implements a method for an apparatus of any of the above embodiments to automatically perform operations.
In one embodiment, a computer device is provided, which may be a terminal. The computer device includes a processor, a memory, a network interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a method for an apparatus to automatically perform operations. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.
In one embodiment, fig. 4 is a schematic diagram of an internal structure of an electronic device according to an embodiment of the present application, and as shown in fig. 4, there is provided an electronic device, which may be a server, and its internal structure diagram may be as shown in fig. 4. The electronic device comprises a processor, a network interface, an internal memory and a non-volatile memory connected by an internal bus, wherein the non-volatile memory stores an operating system, a computer program and a database. The processor is used for providing calculation and control capability, the network interface is used for communicating with an external terminal through network connection, the internal memory is used for providing an environment for an operating system and the running of a computer program, the computer program is executed by the processor to realize a method for automatically executing the operation of the equipment, and the database is used for storing data.
Those skilled in the art will appreciate that the configuration shown in fig. 4 is a block diagram of only a portion of the configuration associated with the present application, and does not constitute a limitation on the electronic device to which the present application is applied, and a particular electronic device may include more or less components than those shown in the drawings, or combine certain components, or have a different arrangement of components.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
It should be understood by those skilled in the art that various features of the above-described embodiments can be combined in any combination, and for the sake of brevity, all possible combinations of features in the above-described embodiments are not described in detail, but rather, all combinations of features which are not inconsistent with each other should be construed as being within the scope of the present disclosure.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. A method for a device to automatically perform an operation, the method comprising:
the method comprises the steps that first equipment records operation events corresponding to a target function, and all the operation events corresponding to the target function generate operation paths;
the first device stores the operation path as an operation path file according to a preset rule protocol, wherein the preset rule protocol comprises branch judgment, and the branch judgment is used for executing a corresponding next operation event according to an operation result after the operation event;
and the first equipment analyzes the operation path file according to the preset rule protocol and automatically executes the operation event corresponding to the operation path file through an automatic service.
2. The method according to claim 1, wherein the first device records an operation event corresponding to a target function, and after an operation path is generated by all the operation events corresponding to the target function, the method further comprises:
and optimizing the operation path to generate an optimized operation path, wherein the optimizing the operation path comprises deleting the operation event, adding a new operation event and adding intelligent image recognition processing in the operation event.
3. The method of claim 2, wherein adding an intelligent graph recognition process to the operational event comprises:
and under the condition that an operation event needs a character or image matching function, capturing an interface image after the last operation event is executed, searching a target position of the character or image in the interface image, storing a picture-text screenshot of the target position, binding the picture-text screenshot with the last operation event, and storing the picture-text screenshot in the operation path.
4. The method of claim 1, wherein automatically executing, by an automation service, the operation event corresponding to the operation path file comprises:
in the process that the automation service automatically executes the operation event corresponding to the operation path file, the automation service detects the interface change of the first device and judges whether the operation at each step is correct or not;
if the judgment result is yes, the next operation is carried out, and if the judgment result is no, the automatic service is stopped, and prompt information is sent.
5. The method according to claim 1, wherein after the first device saves the operation path as an operation path file according to a preset rule protocol, the method further comprises:
and the first equipment adds identification information to the operation path file and uploads the identification information to a server side.
6. The method according to claim 5, wherein after the first device adds identification information to the operation path file and uploads the operation path file to a server, the method further comprises:
the second equipment sends a request command to the server, wherein the request command comprises the identification information;
the server returns the target operation path file corresponding to the identification information to the second device;
and the second equipment analyzes the operation path file according to the preset rule protocol and automatically executes the operation event corresponding to the operation path file through an automatic service.
7. The method according to claim 1, wherein after the first device saves the operation path as an operation path file through the preset rule protocol, the method further comprises:
the mobile terminal acquires the operation path file and the address of the second equipment and establishes communication connection with the second equipment according to the address of the second equipment;
and the mobile terminal sends the operation path file to the second equipment, and the second equipment analyzes the operation path file according to the preset rule protocol and automatically executes the operation event corresponding to the operation path file through an automatic service.
8. The system for automatically executing the operation of the equipment is characterized by comprising a recording module, a storage module and an execution module,
the recording module is used for recording the operation events corresponding to the target functions, and generating operation paths by all the operation events corresponding to the target functions;
the storage module is used for storing the operation path as an operation path file according to a preset rule protocol, wherein the preset rule protocol comprises branch judgment, and the branch judgment is used for executing a corresponding next operation event according to an operation result after the operation event;
the execution module is used for analyzing the operation path file according to the preset rule protocol and automatically executing the operation event corresponding to the operation path file through an automatic service.
9. An electronic device comprising a memory and a processor, wherein the memory has stored therein a computer program, and wherein the processor is configured to execute the computer program to perform a method of automatically performing an operation by the apparatus of any one of claims 1 to 7.
10. A storage medium having a computer program stored thereon, wherein the computer program is arranged to perform a method of automatically performing an operation of a device according to any one of claims 1 to 7 when executed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110749904.4A CN113204300A (en) | 2021-07-02 | 2021-07-02 | Method and system for automatically executing operation by equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110749904.4A CN113204300A (en) | 2021-07-02 | 2021-07-02 | Method and system for automatically executing operation by equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113204300A true CN113204300A (en) | 2021-08-03 |
Family
ID=77022615
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110749904.4A Pending CN113204300A (en) | 2021-07-02 | 2021-07-02 | Method and system for automatically executing operation by equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113204300A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114296846A (en) * | 2021-12-10 | 2022-04-08 | 北京三快在线科技有限公司 | Page guide configuration method, system and device |
| CN114596575A (en) * | 2022-03-09 | 2022-06-07 | 广州小宇宙科技有限公司 | Method, device, system and medium for searching questions based on terminal equipment |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101620565A (en) * | 2008-07-04 | 2010-01-06 | 福建升腾资讯有限公司 | Method for automatically testing functions of terminal system |
| CN102609341A (en) * | 2011-07-08 | 2012-07-25 | 李康 | Hardware equipment automation testing system and testing method thereof |
| CN104391783A (en) * | 2014-07-24 | 2015-03-04 | 贵阳朗玛信息技术股份有限公司 | Software debugging method and device |
| CN108933672A (en) * | 2017-05-25 | 2018-12-04 | 中兴通讯股份有限公司 | A kind of policing rule script configuration method, apparatus and system |
| US20190102208A1 (en) * | 2016-09-30 | 2019-04-04 | DeepAssist Inc. | Method and apparatus for automatic processing of service requests on an electronic device |
| CN110489342A (en) * | 2019-07-31 | 2019-11-22 | 广州微算互联信息技术有限公司 | A kind of Android application testing method, system, device and storage medium |
| CN110851299A (en) * | 2019-11-15 | 2020-02-28 | 深圳前海微众银行股份有限公司 | Abnormal elimination method, device, equipment and storage medium for automated process |
-
2021
- 2021-07-02 CN CN202110749904.4A patent/CN113204300A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101620565A (en) * | 2008-07-04 | 2010-01-06 | 福建升腾资讯有限公司 | Method for automatically testing functions of terminal system |
| CN102609341A (en) * | 2011-07-08 | 2012-07-25 | 李康 | Hardware equipment automation testing system and testing method thereof |
| CN104391783A (en) * | 2014-07-24 | 2015-03-04 | 贵阳朗玛信息技术股份有限公司 | Software debugging method and device |
| US20190102208A1 (en) * | 2016-09-30 | 2019-04-04 | DeepAssist Inc. | Method and apparatus for automatic processing of service requests on an electronic device |
| CN108933672A (en) * | 2017-05-25 | 2018-12-04 | 中兴通讯股份有限公司 | A kind of policing rule script configuration method, apparatus and system |
| CN110489342A (en) * | 2019-07-31 | 2019-11-22 | 广州微算互联信息技术有限公司 | A kind of Android application testing method, system, device and storage medium |
| CN110851299A (en) * | 2019-11-15 | 2020-02-28 | 深圳前海微众银行股份有限公司 | Abnormal elimination method, device, equipment and storage medium for automated process |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114296846A (en) * | 2021-12-10 | 2022-04-08 | 北京三快在线科技有限公司 | Page guide configuration method, system and device |
| CN114596575A (en) * | 2022-03-09 | 2022-06-07 | 广州小宇宙科技有限公司 | Method, device, system and medium for searching questions based on terminal equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP2016533594A (en) | WEB PAGE ACCESS METHOD, WEB PAGE ACCESS DEVICE, ROUTER, PROGRAM, AND RECORDING MEDIUM | |
| CN111026669B (en) | Test log management method, test log management device and storage medium | |
| CN108733343B (en) | Method, device and storage medium for generating voice control instruction | |
| CN111666129B (en) | Container mirror image processing method, electronic device, storage medium and system | |
| CN115176456B (en) | Content operation method, device, terminal and storage medium | |
| CN111222153B (en) | Application program authority management method and device and storage medium | |
| CN112597020A (en) | Interface testing method and device, computer equipment and storage medium | |
| CN109600385B (en) | Access control method and device | |
| CN108965383B (en) | File synchronization method and device, computer equipment and storage medium | |
| WO2015139506A1 (en) | Method and device for operating an application on the basis of a wi-fi user interface | |
| CN113615141B (en) | Account association method, device, system, server and storage medium | |
| WO2023138285A1 (en) | Binding method for smart home device and terminal | |
| CN113204300A (en) | Method and system for automatically executing operation by equipment | |
| JP6251401B2 (en) | Data backup method, apparatus, electronic device, program, and recording medium | |
| CN114124593A (en) | Multi-device calling method and device, control terminal and storage medium | |
| US20150256620A1 (en) | Information processing apparatus, information processing system, information processing method and recording medium recording information processing program | |
| US20100017863A1 (en) | Portable storage apparatus for providing working environment migration service and method thereof | |
| JP6620232B2 (en) | Technology for attaching media captured by a mobile computing device to an electronic document | |
| WO2021233115A1 (en) | Method and apparatus for modifying file name, and storage medium | |
| CN107450793B (en) | Data processing device and data processing method | |
| CN113660359A (en) | Management method and device for domain name resolution record, storage medium and electronic equipment | |
| CN110648052B (en) | Wind control decision method and device, computer equipment and storage medium | |
| WO2024093767A1 (en) | Microscopic image sharing method and microscope system | |
| CN109284429B (en) | News data pushing method, device, system and storage medium | |
| CN111159271A (en) | Data processing method, device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210803 |
|
| RJ01 | Rejection of invention patent application after publication |