CN109360065A - A kind of script execution and device - Google Patents
A kind of script execution and device Download PDFInfo
- Publication number
- CN109360065A CN109360065A CN201811244189.3A CN201811244189A CN109360065A CN 109360065 A CN109360065 A CN 109360065A CN 201811244189 A CN201811244189 A CN 201811244189A CN 109360065 A CN109360065 A CN 109360065A
- Authority
- CN
- China
- Prior art keywords
- frame image
- frame
- current picture
- script
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 claims abstract description 20
- 238000001514 detection method Methods 0.000 claims description 10
- 238000007689 inspection Methods 0.000 claims description 4
- 230000014509 gene expression Effects 0.000 claims description 3
- 230000009191 jumping Effects 0.000 abstract description 10
- 230000000875 corresponding effect Effects 0.000 description 52
- 238000010586 diagram Methods 0.000 description 8
- 238000003032 molecular docking Methods 0.000 description 6
- 238000007726 management method Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000011017 operating method Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000001454 recorded image Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Finance (AREA)
- Accounting & Taxation (AREA)
- General Physics & Mathematics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Evolutionary Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Computation (AREA)
- Development Economics (AREA)
- Economics (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- General Business, Economics & Management (AREA)
- Processing Or Creating Images (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
This application discloses a kind of script execution and devices, this method comprises: determining current pending step；Obtain the current picture frame of frame image corresponding with pending step and operation interface in script；Check whether frame image matches with current picture frame；If frame image is matched with current picture frame, the corresponding movement of frame image is executed.It is acted accordingly in operation interface by the frame image in perform script, save the trouble of manual operation, once the frame image in script, which starts to execute, to realize the automatic purpose for executing operation according to the execution for jumping logic and carrying out next frame image between frame image.In addition, movement is executed in operation interface by way of script execution, it is also possible that dock between system and operation interface system without interface existing for data to be entered, avoid the problem that between system that data can not directly enter caused by version is different or interface difference.
Description
Technical field
This application involves technical field of data processing more particularly to a kind of script execution and devices.
Background technique
ERP (Enterprise Resource Planning) system refers to that foundation on Information Technology Foundation, collects information
Technology and advanced management thought, with the management thought of systematization, provide decision making approach for enterprise staff and decision-making level
Manage platform.The essence of its " management tool " should be more importantly embodied in ERP system practical application, primary motivitation is pair
The comprehensive resources such as human, financial, and material resources, information, time and space that enterprise is possessed carry out overall balance and optimum management.
As shown in Figure 1, by taking electric business platform and dealer as an example, be mounted with the terminal device 200 of ERP system be usually provided at through
Quotient one end is sold, when user is after electric business platform places an order, electric business platform generates order information and is stored in electric business platform data system
In 100, dealer needs to obtain the ERP system of document and typing oneself from electric business platform data system 100, to facilitate to quotient
Product sales situation is managed.After one side of dealer takes document from electric business platform, it usually needs manually by data input ERP system
System, however, manual entry information it is difficult to ensure that data inputting accuracy, once and order volume it is huge, it is desirable to completely lean on people
Quickly real-time typing document is also difficult to realize to the mode of work.In order to avoid waste of manpower existing for manual entry and typing
The high problem of error rate, enterprise is all in development interface at present, so that ERP system and being similar to this data system pair of electric business platform
It picks up and, and then realize that the document of data system can be automatically into ERP system.
In fact, wanting to realize that electric business platform data system is docked with the data of ERP system, the docking of the two systems is connect
Mouth must be identical.But the ERP system about 1500-2000 kind version opened is sent out by different enterprises on the market at present, each
The interface of ERP system is all largely mutually different, and the data system for the electric business platform being mated with then needs to pacify
Many mutually different interfaces are filled to adapt to the ERP of the different editions of dealer, so, it is desirable to realize all ERP systems all
It can be highly difficult with an electric business platform data system docking.In addition, the version of some ERP systems is too low, can not also support
The mode of interface docking.Therefore, the ERP system and data system docking for how realizing different editions become those skilled in the art
Urgent problem to be solved.
Summary of the invention
This application provides a kind of script execution and devices, realize ERP system and the different data system of different editions
The problem of system docking or two different data structural systems are mutually butted.
On the one hand, the embodiment of the present application provides a kind of script execution, comprising:
Determine current pending step, the pending step is will step in operation interface in execution script
Suddenly, the script includes several steps；
The current picture frame of corresponding with the pending step frame image and operation interface in the script is obtained, it is described
Step corresponds at least one frame image, and the frame image is the image of the operation interface intercepted when script is recorded, the current picture
The current image of the operation interface that face frame intercepts when being script execution；
Check whether the frame image matches with the current picture frame；
If the frame image is matched with the current picture frame, the corresponding movement of the frame image, the frame are executed
Image is used for the movement for indicating to occur in operation interface when script is recorded, the corresponding movement of each described frame image.
Optionally, the step of whether the inspection frame image matches with the current picture frame include:
Obtain the mark in the frame image, the generation position identified for demarcating the movement, and, the frame
It include at least one mark in image；
It detects in the current picture frame and identifies unique corresponding key area with the presence or absence of with described；
Unique corresponding key area is identified with described if existed in the current picture frame, comprising the mark
Frame image is matched with the current picture frame.
Optionally, before whether the inspection frame image matches with the current picture frame, further includes:
Judge that the pending step corresponds to the quantity of frame image；
If the quantity of the frame image is equal to 1, check whether this frame image matches with the current picture frame；
If the quantity of the frame image is greater than 1, whether each frame image and the current picture frame are checked respectively for
Matching.
Optionally, if the frame image is matched with the current picture frame, the corresponding movement of the frame image is executed
The step of include:
If the frame image is matched with the current picture frame, it is determined that the movement execution position on the current picture frame
It sets；
The corresponding movement of the frame image is executed in the movement execution position.
Optionally, the current pending step in the determining script includes:
Obtain the step title of input；
According to the step title, current pending step is determined.
Optionally, the current pending step in the determining script includes:
The logic that jumps of a pending step is obtained, the execution for jumping frame image in logical expressions script is suitable
Sequence, while also illustrating that in script and executing sequence between step；
Logic is jumped according to described, determines current pending step.
Optionally, the step of mark obtained in the frame image includes:
Judge the quantity of the frame image；
If the quantity of the frame image is equal to 1, the mark in the frame image is obtained；
If the quantity of the frame image is greater than 1, the mark in each frame image is obtained respectively.
Optionally, the step of in the detection current picture frame with the presence or absence of corresponding key area unique with the mark
Include:
Judge the quantity of the mark；
If the quantity of the mark is equal to 1, detect in current picture frame with the presence or absence of unique corresponding with the mark
Key area；
If the quantity of the mark is greater than 1, detects in current picture frame and identified with the presence or absence of with described in each
Corresponding key area.
Optionally, if the frame image is matched with the current picture frame, it is determined that dynamic on the current picture frame
The step of making execution position include:
If the frame image is matched with the current picture frame, the position identified on the frame image is obtained, it is described
The generation position for demarcating the movement is identified, and, it include at least one mark in the frame image；According to the mark
Position, determine that position occurs for movement on the frame image；
Position occurs according to the movement on the frame image, determines the movement execution position on the current picture frame.
Second aspect, the embodiment of the present application provide a kind of script execution device, comprising:
Step determination unit, for determining current pending step, the pending step is will be in operation interface
Step in execution script, the script include several steps；
Acquiring unit, for obtaining working as frame image corresponding with the pending step and operation interface in the script
Preceding image frame, the step correspond at least one frame image, and the frame image is the figure of the operation interface intercepted when script is recorded
Picture, the current image of the operation interface that the current picture frame intercepts when being script execution；
Matching unit, for checking whether the frame image matches with the current picture frame；
It is corresponding to execute the frame image if matched for the frame image with the current picture frame for execution unit
Movement, the frame image is used to indicate the movement that occurs in operation interface when script is recorded, each described frame image is corresponding
One movement.
From the above technical scheme, the embodiment of the present application provides a kind of script execution and device, determine currently to
Execute step；Obtain the current picture frame of frame image corresponding with pending step and operation interface in script；Check frame image
Whether matched with current picture frame；If frame image is matched with current picture frame, the corresponding movement of frame image is executed.By holding
The frame image traveled far and wide in originally is acted accordingly in operation interface, saves the trouble of manual operation, once the frame in script
Image, which starts to execute, to realize automatic execute according to the execution for jumping logic and carrying out next frame image between frame image
The purpose of operation.In addition, movement is executed in operation interface by way of script execution, it is also possible that data to be entered are deposited
System and operation interface system between dock without interface, avoid between system version different or number caused by interface is different
The problem of according to that can not directly enter.
Detailed description of the invention
In order to illustrate more clearly of the technical solution of the application, attached drawing needed in case study on implementation will be made below
Simply introduce, it should be apparent that, for those of ordinary skills, in the premise of not making the creative labor property
Under, it is also possible to obtain other drawings based on these drawings.
Fig. 1 is the schematic diagram that electric business platform data system provided by the present application is docked with ERP system；
Fig. 2 is a kind of flow chart of script execution provided by the embodiments of the present application；
Fig. 3 is a kind of script schematic diagram provided by the embodiments of the present application；
Fig. 4 is a kind of frame image schematic diagram provided by the embodiments of the present application；
Fig. 5 is second of frame image schematic diagram provided by the embodiments of the present application；
Fig. 6 is the third frame image schematic diagram provided by the embodiments of the present application；
Fig. 7 is a kind of partial schematic diagram of frame image provided by the embodiments of the present application；
Fig. 8 is second of script schematic diagram provided by the embodiments of the present application；
Fig. 9 is a kind of structural block diagram of script execution device provided by the embodiments of the present application.
Specific embodiment
In order to make those skilled in the art better understand the technical solutions in the application, below in conjunction with attached drawing, it is right
Technical solution in the embodiment of the present application is clearly and completely described.
Referring to fig. 2, the embodiment of the present application provides a kind of script execution, comprising:
Step 101, determine current pending step, the pending step be will in operation interface execution script
In step, the script includes several steps, and carrying out for these steps is to be input to the data in a system separately
In one system.Still by taking ERP system and electric business platform data system in Fig. 1 as an example, there are a large amount of document in data system,
For the ease of information management, dealer needs to take out document from the data system of electric business platform and be stored in the ERP system of oneself
In system.The process of typing document can be decomposed into many steps on ERP system interface, these steps can be understood as wait hold
Row step.The script mentioned in the application is the set of some frame images recorded in advance, and frame image is indicated in ERP system again
The corresponding actions of upper execution.
If frame image respectively corresponds these steps as shown in figure 3, the step of containing dry run ERP system in a script
Suddenly, be also between frame image have with logic, and then also have between step it is certain jump logic, here jump logic
It indicates that frame image executes sequence in script, while also illustrating that in script and execute sequence between step, so, it is determined that currently
Pending step, so that it may determine corresponding with step frame image, after having executed this pending step, just
What can be had according to the step jumps logic, determines next pending step, i.e., current pending step.
In addition, the operation that system is inputted if there is step, can directly determine current pending step according to the step of input
Suddenly, for example, user needs to input odd numbers on current ERP system interface, and the step of known input odd numbers corresponds to foot
Step 2 in this, it is possible to directly input " step 2 " to determine current pending step in ERP system.And obtain with
" step 2 " corresponding frame image, after the execution of frame image terminates, the operation of the input odd numbers on ERP system interface also terminates,
Next pending step can be obtained according to the logic that jumps saved in the step 2 of end at this time, for example, " step 2 " and " step
Existing between rapid 3 " and jumps relationship, then next object that jumps of the frame image in " step 2 " is the frame image in " step 3 ",
So after " step 2 " executes, according to the logic that jumps saved in the step, it is available to next " step 3 " and
Frame image in " step 3 ".
Step 102, the current picture of corresponding with the pending step frame image and operation interface in the script is obtained
Face frame, the step correspond at least one frame image, and the frame image is the image of the operation interface intercepted when script is recorded, institute
State the current image of the operation interface intercepted when current picture frame is script execution.Technical solution in the embodiment of the present application is based on
Frame image in the image frame and script of operation interface compares execution, and then realizes the purpose of perform script.Frame image is preparatory
The image of the operation ERP system recorded, the screenshot of the ERP system obtained when image frame is perform script, in operation circle of ERP
On face, the screenshot frame image corresponding with the step of a current interface can be all obtained whenever carrying out a step, so as to basis
The frame image operates ERP system.For example, user needs to execute the operating procedure of " input odd numbers " in ERP operation interface, not only
The screenshot of operation interface at this time is obtained, " input odd numbers " step 2 corresponding to step of this in script is also obtained and step 2 is right
The frame image answered.
Step 103, check whether the frame image matches with the current picture frame.Frame image is matched with current picture frame
There is very important effect to the execution of script, if the two mismatches, illustrates current pending step and current acquisition
The not same or similar degree of frame image it is low, there may be the problems for obtaining mistake for frame image, or there is current pending step
Suddenly with the unmatched problem of current picture frame, and there are mistakes for the operating procedure of current ERP system.At this time, it may be necessary to obtain again
Step is taken, frame image is reacquired or reacquires current picture frame, until frame image is matched with current picture frame, and then is held
The correct script of row, is completed to ERP system logging data.
Further, check whether the frame image matches in accordance with the following steps with the current picture frame in step 103
It carries out:
Step 201, the mark in the frame image is obtained, the generation position identified for demarcating the movement, with
It and include at least one mark in the frame image；Mark in frame image is one piece for operating position in tag image
Region or several pieces of regions, this block region is due to being present on frame image, so and one block of image.In each frame image
Mark is that unique each mark in other words is unique, that is to say, that identifying included image is only in this whole image
One without two, in general, during recording script, usually on the image of recording detection one piece or several pieces and image its
The image that he is partially all different, with this block image or and block image demarcate the position of movement, can also be used to indicate this
The step of whole image represents, to play the role of mark.For example, as shown in figure 4, what is intercepted in frame image is system login
The image at interface includes the Warning Marks such as " selection set of books ", " selection operation person ", " input login password " on the image, wherein
It respectively corresponds on the right side of " selection set of books ", " selection operation person " and " input login password " Warning Mark provided with three blank columns
Related data is inputted for user, if movement corresponding to frame image is input set of books, the movement for inputting set of books should be
On image in " selection set of books " subsequent blank column of mark, at this point, needing to select in order to which the position that the movement occurs is marked
The image that " set of books " printed words are uniquely had on piece frame image is selected as mark, as shown in figure 5, rectangular area is to identify 1,
Mouse click location is movement generation position, identifies and moves with the coordinate relationship that position occurs, foundation is acted using the mark
The relative positional relationship of work, hereafter, as long as getting mark, so that it may get movement and position occurs.Alternatively, as shown in fig. 6,
It selects several images as mark, can be three images comprising " set of books ", " operator " and " password " respectively, by these three
Image resettles the relative positional relationship that position occurs with movement for three marks as mark, and position occurs to movement to realize
Positioning.
It is worth noting that mark is the one block of image chosen, the shapes and sizes of this image can be schemed according to choosing
The content of picture and determine, but rectangle is preferably selected, so that coordinate relationship is presented in a coordinate system.Above-mentioned " selection set of books " movement
Mark, as long as mutually different unique images on image, such as the image with " set of books ", but cannot select to wrap
Image containing " selection " is as mark, because " selection set of books " and " selection operation person " include this word, with this word
Image as mark is also not in whole image uniquely, and uniquely mark is not difficult to the position that accurate location action occurs
It sets, because can not determine that this identifies the position of itself.
In addition, the content chosen in mark is also possible to a pattern, as shown in fig. 7, there is a mark on this frame image
Know 2, which is to have framed the icon being different from desktop with other any one icons with a rectangle, the mark 2
Content is exactly the pattern of this icon.
Step 202, it detects in the current picture frame and identifies unique corresponding key area with the presence or absence of with described.Matching
Effect be determine obtain frame image can be executed in the corresponding operation interface of current picture frame, if without matching,
It is difficult to be completely secured that frame image is corresponding with operation interface, it, can typing if executed in operation interface using the frame image of mistake
The data of mistake continue to execute script can not, serious or even also will cause unnecessary economic loss, so matching
Process it is particularly important.Mark not only acts as the effect that position occurs for calibration movement in frame image, in frame image and image frame
Matching process also act as the effect of detection, using whether there is in label detection current picture frame unique on frame image and mark
Know corresponding unique key area, is uniquely, so key area is on current picture frame due to identifying on frame image
It should also be unique, the content which includes is identical as the content of mark, the shape of key area and the shape of mark
Shape is identical.For example, using in frame image have " login password " label detection current picture frame, need to current picture frame into
Row scanning, whether detection current picture frame has unique region for having " login password " printed words, if so, the region is exactly to close
Key range.
Further, it in step 202, detects in the current picture frame and identifies unique corresponding pass with the presence or absence of with described
Key range carries out in accordance with the following steps:
Step 301, judge the quantity of the mark.
Step 302, if the quantity of the mark is equal to 1, detecting in current picture frame whether there is and the mark
Unique corresponding key area.
Step 303, if the quantity of the mark is greater than 1, detecting in current picture frame whether there is and each institute
State all corresponding key area of mark.
Step 203, unique corresponding key area is identified with described if existed in the current picture frame, includes institute
The frame image for stating mark is matched with the current picture frame.Due to mark be in frame image it is unique, key area is currently to draw
It is unique in the frame of face, so frame image and current picture frame successful match are current at this time to draw when identifying identical as key area
The picture material of face frame and the content of frame image should be consistent.
Further, in step 201, the mark in getting frame image can also carry out in accordance with the following steps:
Step 401, judge the quantity of the frame image.In actual recording process, each step is finished, all
It can be there is a situation where jumping next step or interface, the frame image in each step may be not only one, if
Current procedures, which belong to, unidirectionally to be executed, i.e., only includes a frame image in current procedures, is only needed when then executing current procedures
To utilize this frame image；If the implementing result of previous step is uncertain or multiple, current step
The frame image for including in rapid will be it is multiple, to correspond to implementing result different in previous step.When executing current procedures, then need
Corresponding frame image is found according to the implementing result in previous step carries out execution operation again.For example, as shown in figure 8, script
In step 1 in include a frame image, include two frame images in step 2, current step 1 is the step of " input data "
Suddenly, the next step of step 1 is step 2, carries out the movement of input data to operation interface according to the frame image in step 1,
If data format input is correct, step 1 gos to step 2, executes the frame image for " inputting next data " in step 2,
If data format input error, step 1 continues to go to step 2, executes in step 2 frame of " user is reminded to re-enter "
Image has in the next step for jumping logic comprising there are two frame image with " input data " step so when recording,
It is " inputting next data " and " user is reminded to re-enter " respectively.
Step 402, if the quantity of the frame image is equal to 1, the mark in the frame image is obtained.If frame image
Quantity be 1, illustrate that the corresponding frame image of pending step is only 1, at this time, it is only necessary to by the frame image and operation interface
Current picture frame is matched.For example, jumping to current pending step is " to generate column after previous step executes
Table " then obtains " generating list " corresponding frame image and current picture frame, and then detecting the frame image and the current image frame is
No matching.
Step 403, if the quantity of the frame image is greater than 1, the mark in each frame image is obtained respectively.If
The quantity of frame image be greater than 1, illustrate the corresponding frame image of pending step be it is multiple, at this time, it may be necessary to by each frame image with
The matching of current picture frame.For example, current pending step is " selection ", " selection " step can be generated according to the result of selection when recording
Suddenly multiple frame images under can generate a corresponding frame image, if selection result is if selection result is "Yes"
"No", can also generate another corresponding frame image, when execution, then need by these frame images respectively with current picture frame
Match, that matched frame image is selected to execute.
Step 104, if the frame image is matched with the current picture frame, it is corresponding dynamic to execute the frame image
Make, the frame image is used for the movement for indicating to occur in operation interface when script is recorded, each described frame image is one corresponding
Movement.Frame image is matched with current picture frame, illustrates that frame image degree same or similar with current image frame is high, in frame image
Movement be the movement that will be executed in operation interface.It is following then it needs to be determined that the movement on the current picture frame is held
Line position is set；The corresponding movement of the frame image is executed in the movement execution position.
Further, in step 104, the movement execution position on current picture frame is determined in accordance with the following steps:
Step 501, if the frame image is matched with the current picture frame, the position identified on the frame image is obtained
It sets, the generation position identified for demarcating the movement, and, it include at least one mark in the frame image.
Step 502, according to the position of the mark, determine that position occurs for the movement on the frame image；In frame image
The generation position for calibration movement is identified, there are relative positional relationships between mark and movement generation position, then due to matching
Frame image and current picture frame after success are the equal of identical image, so identifying present in frame image, are drawn currently
On the frame of face there is also, illustrate in above content in current picture frame with to identify identical be key area, and then identify and have
Relative positional relationship is it is also assumed that key area is also to have, so according to key area and relative positional relationship, so that it may
To determine the movement execution position on current picture frame with key area with relative positional relationship.
Step 503, position is occurred according to the movement on the frame image, determines that the movement on the current picture frame executes
Position.Since current picture frame is a screenshot of operation interface, so the operating position having in current picture frame is operating
Existing for being also on interface, current picture frame is identical as current operation interface, so the operating position of the two is also identical, has found
It is the movement execution position having found in operation interface that position, which occurs, for the movement on current picture frame, after position determines
The movement on frame image is executed on this position.
According to the content in step 301 it is found that in actual recording process, each step is finished, and can all send out
It gives birth to the case where jumping next step or interface, the frame image in each step may be not only one, so in step
Before rapid 104, further includes:
Step 501, judge that the pending step corresponds to the quantity of frame image；
Step 502, if the quantity of the frame image is equal to 1, this frame image and the current picture frame are checked
Whether match；
Step 503, if the quantity of the frame image is greater than 1, each frame image and the current picture are checked respectively for
Whether face frame matches.
The embodiment of above-mentioned perform script is illustrated with an example below:
It behind user's opening operation interface, determines and currently needs the step of carrying out " login ", it is corresponding to obtain " login " step
Frame image and operation interface are ready for the current picture frame logged in, and through judging, the corresponding frame image of " login " step is one
It is a, then the frame image is matched, being identified as " user name " in getting frame image with current picture frame, detects current picture
It whether there is with mark " user name " identical key area in frame, if it is present current picture frame and frame images match,
The relative positional relationship that " user name " and movement are identified in getting frame image determines that position occurs for movement on the right side of " user name "
In blank column, further according to key area and relative positional relationship, determined in current picture frame key area " user name " and its
Movement execution position in right side blank column after determining position, finds " user in the corresponding operation interface of current picture frame
Blank column on the right side of name ", carries out input operation；After " login " step, system jumps to the use circle of the user automatically
Face jumps relationship further according to " login " step and next step, determines next step, it is currently used to obtain operation interface
The image frame at interface frame image corresponding with the step continues to match, until operation terminates.
Above-described embodiment is illustrated by taking the data system of electric business and ERP system as an example again:
When user needs the document by electric quotient data system to input into ERP system, it is first turned on the operation of ERP system
The perform script at interface and operation ERP system, acquisition currently needs the step of operating ERP system, after determining step, obtains
The current picture frame of frame image corresponding with the step and ERP system in perform script, comparing frame image with current picture frame is
No matching, if it does, then according to the position and relative positional relationship that are identified in frame image, determine on the interface of ERP system etc.
Pending movement execution position when inputting document to ERP system, determines document in frame image according to the mark in frame image
Then input position finds in ERP system and identifies identical key area, closes further according to key area and relative position
System, determines the input position of document in ERP system, after position determines, according to the operation of frame image, by electric quotient data system
Bills data be input to the position, then execute the next item down step, such as determine input finish or continue input.
It is worth noting that be only in the embodiment of the present application by taking electric quotient data system and dealer's ERP system as an example into
Go the explanation of technical solution, in actual operation, as long as the data of a system are wanted to be stored in another system, no matter
Whether the two systems have the interface of docking, if version is adapted, and can be held using the script in technical scheme
The data of one system are automatically entered into another system by row method.
From the above technical scheme, the embodiment of the present application provides a kind of script execution, by executing frame image
It is acted in operation interface, or two systems without interface is docked, so that some data can be with automatic input
Or some operations can carry out automatically, save the trouble of manual operation, once frame image start execute can be according to frame figure
The execution for jumping logic and carrying out next frame image as between, realizes the purpose of auto-action.In addition, passing through script execution
Mode executes movement in operation interface, so that without interface pair between system existing for data to be entered and operation interface system
It connects, avoids problem inconvenient caused by version is different between system.
Referring to Fig. 9, present invention also provides a kind of script execution devices, comprising:
Step determination unit 91, for determining current pending step, the pending step is will be in operation interface
Step in upper execution script, the script include several steps；
Acquiring unit 92, for obtaining frame image corresponding with the pending step and operation interface in the script
Current picture frame, the step correspond at least one frame image, and the frame image is the operation interface intercepted when script is recorded
Image, the current image of the operation interface that the current picture frame intercepts when being script execution；
Matching unit 93, for checking whether the frame image matches with the current picture frame；
Execution unit 94 executes the frame image pair if matched for the frame image with the current picture frame
The movement answered, the frame image are used for the movement for indicating to occur in operation interface when script is recorded, each described frame image pair
Answer a movement.
Optionally, the matching unit 93 includes:
Mark acquiring unit, for obtaining the mark in the frame image, the hair identified for demarcating the movement
Raw position, and, it include at least one mark in the frame image；
Region detection unit identifies unique corresponding key with the presence or absence of with described for detecting in the current picture frame
Region；
The region detection unit identifies unique corresponding pass with described if being also used to exist in the current picture frame
Key range, then the frame image comprising the mark is matched with the current picture frame.
Optionally, described device further include:
Amount of images judging unit, for judging that the pending step corresponds to the quantity of frame image；
If the quantity of the frame image is equal to 1, check whether this frame image matches with the current picture frame；
If the quantity of the frame image is greater than 1, whether each frame image and the current picture frame are checked respectively for
Matching.
Optionally, the execution unit 94 is also used to:
If the frame image is matched with the current picture frame, it is determined that the movement execution position on the current picture frame
It sets；
The corresponding movement of the frame image is executed in the movement execution position.
Optionally, described device further include: first step determination unit, for obtaining the step title of input；
According to the step title, current pending step is determined.
Optionally, described device further include: second step determination unit, for obtaining jumping for a upper pending step
Logic, it is described jump frame image in logical expressions script execute sequence, while also illustrating that the execution in script between step is suitable
Sequence；
Logic is jumped according to described, determines current pending step.
Optionally, the mark acquiring unit is also used to:
Judge the quantity of the frame image；
If the quantity of the frame image is equal to 1, the mark in the frame image is obtained；
If the quantity of the frame image is greater than 1, the mark in each frame image is obtained respectively.
Optionally, the region detection unit is also used to:
Judge the quantity of the mark；
If the quantity of the mark is equal to 1, detect in current picture frame with the presence or absence of unique corresponding with the mark
Key area；
If the quantity of the mark is greater than 1, detects in current picture frame and identified with the presence or absence of with described in each
Corresponding key area.
Optionally, the execution unit 94 is also used to:
If the frame image is matched with the current picture frame, the position identified on the frame image is obtained, it is described
The generation position for demarcating the movement is identified, and, it include at least one mark in the frame image；
According to the position of the mark, determine that position occurs for the movement on the frame image；
Position occurs according to the movement on the frame image, determines the movement execution position on the current picture frame.
From the above technical scheme, the embodiment of the present application provides a kind of script execution and device, determine currently to
Execute step；Obtain the current picture frame of frame image corresponding with pending step and operation interface in script；Check frame image
Whether matched with current picture frame；If frame image is matched with current picture frame, the corresponding movement of frame image is executed.By holding
The frame image traveled far and wide in originally is acted accordingly in operation interface, saves the trouble of manual operation, once the frame in script
Image, which starts to execute, to realize automatic execute according to the execution for jumping logic and carrying out next frame image between frame image
The purpose of operation.In addition, movement is executed in operation interface by way of script execution, it is also possible that data to be entered are deposited
System and operation interface system between dock without interface, avoid between system version different or number caused by interface is different
The problem of according to that can not directly enter.
The application can be used in numerous general or special purpose computing system environments or configuration.Such as: personal computer, service
Device computer, handheld device or portable device, laptop device, multicomputer system, microprocessor-based system, top set
Box, programmable consumer-elcetronics devices, network PC, minicomputer, mainframe computer, including any of the above system or equipment
Distributed computing environment etc..
The application can describe in the general context of computer-executable instructions executed by a computer, such as program
Module.Generally, program module includes routines performing specific tasks or implementing specific abstract data types, programs, objects, group
Part, data structure etc..The application can also be practiced in a distributed computing environment, in these distributed computing environments, by
Task is executed by the connected remote processing devices of communication network.In a distributed computing environment, program module can be with
In the local and remote computer storage media including storage equipment.
Those skilled in the art will readily occur to its of the application after considering specification and practicing application disclosed herein
Its embodiment.This application is intended to cover any variations, uses, or adaptations of the application, these modifications, purposes or
Person's adaptive change follows the general principle of the application and including the undocumented common knowledge in the art of the application
Or conventional techniques.The description and examples are only to be considered as illustrative, and the true scope and spirit of the application are by following
Claim is pointed out.
It should be understood that the application is not limited to the precise structure that has been described above and shown in the drawings, and
And various modifications and changes may be made without departing from the scope thereof.Scope of the present application is only limited by the accompanying claims.
Claims (10)
1. a kind of script execution characterized by comprising
Determine current pending step, the pending step be will step in operation interface in execution script, institute
Stating script includes several steps；
Obtain the current picture frame of corresponding with the pending step frame image and operation interface in the script, the step
At least one corresponding frame image, the frame image are the image of the operation interface intercepted when script is recorded, the current picture frame
For the current image of the operation interface intercepted when script execution；
Check whether the frame image matches with the current picture frame；
If the frame image is matched with the current picture frame, the corresponding movement of the frame image, the frame image are executed
The movement occurred in operation interface when for indicating that script is recorded, the corresponding movement of each described frame image.
2. the method according to claim 1, wherein the inspection frame image and the current picture frame whether
With the step of include:
Obtain the mark in the frame image, the generation position identified for demarcating the movement, and, the frame image
In include at least one mark；
It detects in the current picture frame and identifies unique corresponding key area with the presence or absence of with described；
Unique corresponding key area is identified with described if existed in the current picture frame, includes the frame figure of the mark
As being matched with the current picture frame.
3. the method according to claim 1, wherein the inspection frame image and the current picture frame whether
With before, further includes:
Judge that the pending step corresponds to the quantity of frame image；
If the quantity of the frame image is equal to 1, check whether this frame image matches with the current picture frame；
If the quantity of the frame image is greater than 1, check respectively for whether each frame image matches with the current picture frame.
4. the method according to claim 1, wherein if the frame image is matched with the current picture frame,
The step of then executing the frame image corresponding movement include:
If the frame image is matched with the current picture frame, it is determined that the movement execution position on the current picture frame；
The corresponding movement of the frame image is executed in the movement execution position.
5. the method according to claim 1, wherein the current pending step in the determining script includes:
Obtain the step title of input；
According to the step title, current pending step is determined.
6. the method according to claim 1, wherein the current pending step in the determining script includes:
Obtain the logic that jumps of a pending step, it is described jump frame image in logical expressions script execute sequence, together
When also illustrate that in script and execute sequence between step；
Logic is jumped according to described, determines current pending step.
7. according to the method described in claim 2, it is characterized in that, the step of mark obtained in the frame image wrap
It includes:
Judge the quantity of the frame image；
If the quantity of the frame image is equal to 1, the mark in the frame image is obtained；
If the quantity of the frame image is greater than 1, the mark in each frame image is obtained respectively.
8. according to the method described in claim 2, it is characterized in that, whether there is and the mark in the detection current picture frame
The step of knowing unique corresponding key area include:
Judge the quantity of the mark；
If the quantity of the mark is equal to 1, detects in current picture frame and identify unique corresponding pass with the presence or absence of with described
Key range；
If the quantity of the mark is greater than 1, detect in current picture frame with the presence or absence of corresponding with mark described in each
Key area.
9. according to the method described in claim 4, it is characterized in that, if the frame image is matched with the current picture frame,
The step of then determining the movement execution position on the current picture frame include:
If the frame image is matched with the current picture frame, the position identified on the frame image, the mark are obtained
For demarcating the generation position of the movement, and, it include at least one mark in the frame image；
According to the position of the mark, determine that position occurs for the movement on the frame image；
Position occurs according to the movement on the frame image, determines the movement execution position on the current picture frame.
10. a kind of script execution device characterized by comprising
Step determination unit, for determining that current pending step, the pending step are that will execute in operation interface
Script in step, the script includes several steps；
Acquiring unit, for obtaining the current picture of corresponding with the pending step frame image and operation interface in the script
Face frame, the step correspond at least one frame image, and the frame image is the image of the operation interface intercepted when script is recorded, institute
State the current image of the operation interface intercepted when current picture frame is script execution；
Matching unit, for checking whether the frame image matches with the current picture frame；
It is corresponding dynamic to execute the frame image if matched for the frame image with the current picture frame for execution unit
Make, the frame image is used for the movement for indicating to occur in operation interface when script is recorded, each described frame image is one corresponding
Movement.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811244189.3A CN109360065B (en) | 2018-10-24 | 2018-10-24 | Script execution method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811244189.3A CN109360065B (en) | 2018-10-24 | 2018-10-24 | Script execution method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109360065A true CN109360065A (en) | 2019-02-19 |
| CN109360065B CN109360065B (en) | 2022-04-19 |
Family
ID=65346598
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811244189.3A Active CN109360065B (en) | 2018-10-24 | 2018-10-24 | Script execution method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109360065B (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111298434A (en) * | 2020-02-25 | 2020-06-19 | 腾讯科技（深圳）有限公司 | Service processing method, device, equipment and storage medium |
| CN112306333A (en) * | 2020-11-11 | 2021-02-02 | 天津汇商共达科技有限责任公司 | Data filling method and device |
| CN112306885A (en) * | 2020-11-11 | 2021-02-02 | 天津汇商共达科技有限责任公司 | Method and device for script debugging |
| CN112306886A (en) * | 2020-11-11 | 2021-02-02 | 天津汇商共达科技有限责任公司 | Method and device for script debugging |
| CN112347176A (en) * | 2020-11-11 | 2021-02-09 | 天津汇商共达科技有限责任公司 | Data docking method and device based on human-computer interaction behavior |
| CN112347177A (en) * | 2020-11-11 | 2021-02-09 | 天津汇商共达科技有限责任公司 | Data docking equipment based on human-computer interaction behavior |
| CN112347178A (en) * | 2020-11-11 | 2021-02-09 | 天津汇商共达科技有限责任公司 | Data docking method and device based on human-computer interaction behavior, terminal and server |
| CN114971539A (en) * | 2022-05-13 | 2022-08-30 | 东南数字经济发展研究院 | Simulated manual operation method based on image matching |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104268006A (en) * | 2014-10-27 | 2015-01-07 | 北京奇虎科技有限公司 | Keyboard and mouse script playback method and device |
| CN104951393A (en) * | 2014-03-25 | 2015-09-30 | 中国电信股份有限公司 | Testing method and device |
| JP2016127513A (en) * | 2015-01-07 | 2016-07-11 | 株式会社クリエ・ジャパン | Moving image generation server, moving image generation program, moving image generation method, and moving image generation system |
-
2018
- 2018-10-24 CN CN201811244189.3A patent/CN109360065B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104951393A (en) * | 2014-03-25 | 2015-09-30 | 中国电信股份有限公司 | Testing method and device |
| CN104268006A (en) * | 2014-10-27 | 2015-01-07 | 北京奇虎科技有限公司 | Keyboard and mouse script playback method and device |
| JP2016127513A (en) * | 2015-01-07 | 2016-07-11 | 株式会社クリエ・ジャパン | Moving image generation server, moving image generation program, moving image generation method, and moving image generation system |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111298434A (en) * | 2020-02-25 | 2020-06-19 | 腾讯科技（深圳）有限公司 | Service processing method, device, equipment and storage medium |
| CN111298434B (en) * | 2020-02-25 | 2021-08-06 | 腾讯科技（深圳）有限公司 | Service processing method, device, equipment and storage medium |
| CN112306333A (en) * | 2020-11-11 | 2021-02-02 | 天津汇商共达科技有限责任公司 | Data filling method and device |
| CN112306885A (en) * | 2020-11-11 | 2021-02-02 | 天津汇商共达科技有限责任公司 | Method and device for script debugging |
| CN112306886A (en) * | 2020-11-11 | 2021-02-02 | 天津汇商共达科技有限责任公司 | Method and device for script debugging |
| CN112347176A (en) * | 2020-11-11 | 2021-02-09 | 天津汇商共达科技有限责任公司 | Data docking method and device based on human-computer interaction behavior |
| CN112347177A (en) * | 2020-11-11 | 2021-02-09 | 天津汇商共达科技有限责任公司 | Data docking equipment based on human-computer interaction behavior |
| CN112347178A (en) * | 2020-11-11 | 2021-02-09 | 天津汇商共达科技有限责任公司 | Data docking method and device based on human-computer interaction behavior, terminal and server |
| CN114971539A (en) * | 2022-05-13 | 2022-08-30 | 东南数字经济发展研究院 | Simulated manual operation method based on image matching |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109360065B (en) | 2022-04-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109360065A (en) | A kind of script execution and device | |
| US10216377B2 (en) | Visual regression analysis | |
| US20210081182A1 (en) | Identifying and recommending code snippets to be reused by software developer | |
| AU2016286308A1 (en) | Robotic process automation | |
| CN108509339A (en) | Method for generating test case, device based on browser and mind map and equipment | |
| CN112650670B (en) | Application testing method, device, system, electronic equipment and storage medium | |
| WO2019214109A1 (en) | Monitoring device and method for testing process, and computer readable storage medium | |
| CN109471805B (en) | Resource testing method and device, storage medium and electronic equipment | |
| US20090319995A1 (en) | Enhancing source code debugging and readability using visual symbols | |
| CN106502895A (en) | A kind of automatic test information generation device and method | |
| US20180157582A1 (en) | Automated test runs in an integrated development environment system and method | |
| CN110647523B (en) | Data quality analysis method and device, storage medium and electronic equipment | |
| EP3686750A1 (en) | Data migration | |
| CN108073517A (en) | Management method, device, medium and the computer equipment of third party software test | |
| CN114049631A (en) | Data labeling method and device, computer equipment and storage medium | |
| CN109445788A (en) | A kind of script execution and device | |
| CN113821433A (en) | Method, device, equipment, medium and product for testing cloud mobile phone application program | |
| CN111966600A (en) | Webpage testing method and device, computer equipment and computer readable storage medium | |
| CN115631374A (en) | Control operation method, control detection model training method, device and equipment | |
| CN108334443A (en) | Generate method, apparatus, equipment and the computer readable storage medium of test case | |
| US11657350B2 (en) | Information processing apparatus, workflow test apparatus, and non-transitory computer readable medium | |
| CN112084103B (en) | Interface test method, device, equipment and medium | |
| US20200065362A1 (en) | System and method for real time digitization of hand written input data | |
| CN117149266A (en) | Task processing method and device, storage medium and electronic equipment | |
| CN115099919A (en) | Method and device for managing certificate inquiry function, storage medium and computer equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |