CN108268373A - Automatic test cases management method, device, equipment and storage medium - Google Patents
Automatic test cases management method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN108268373A CN108268373A CN201710857308.1A CN201710857308A CN108268373A CN 108268373 A CN108268373 A CN 108268373A CN 201710857308 A CN201710857308 A CN 201710857308A CN 108268373 A CN108268373 A CN 108268373A
- Authority
- CN
- China
- Prior art keywords
- test
- case
- automatic
- mapping form
- backup
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 331
- 238000007726 management method Methods 0.000 title claims abstract description 22
- 238000013507 mapping Methods 0.000 claims abstract description 80
- 238000000034 method Methods 0.000 claims abstract description 25
- 238000012549 training Methods 0.000 claims description 33
- 238000004590 computer program Methods 0.000 claims description 22
- 238000009412 basement excavation Methods 0.000 claims description 18
- 238000001514 detection method Methods 0.000 claims description 16
- 238000007689 inspection Methods 0.000 claims description 14
- 230000006399 behavior Effects 0.000 claims description 7
- 238000012913 prioritisation Methods 0.000 claims description 5
- 230000015572 biosynthetic process Effects 0.000 claims description 3
- 238000003786 synthesis reaction Methods 0.000 claims description 3
- 235000015170 shellfish Nutrition 0.000 claims 1
- 230000008569 process Effects 0.000 abstract description 13
- 238000011161 development Methods 0.000 abstract description 5
- 239000011159 matrix material Substances 0.000 description 15
- 230000008859 change Effects 0.000 description 10
- 230000006870 function Effects 0.000 description 10
- 238000012986 modification Methods 0.000 description 9
- 230000004048 modification Effects 0.000 description 9
- 230000007547 defect Effects 0.000 description 7
- 238000012545 processing Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 235000013399 edible fruits Nutrition 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 238000010304 firing Methods 0.000 description 2
- 238000007781 pre-processing Methods 0.000 description 2
- 101150110972 ME1 gene Proteins 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013145 classification model Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 238000007667 floating Methods 0.000 description 1
- 238000005065 mining Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000017105 transposition Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Prevention of errors by analysis, debugging or testing of software
- G06F11/3668—Testing of software
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Prevention of errors by analysis, debugging or testing of software
- G06F11/3668—Testing of software
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The present invention relates to software automated testing technical fields, provide a kind of automatic test cases management method, device, equipment and storage medium, and automatic test cases management method includes：Mapping form is established according to test case in the database, each step of each performance testing case script in mapping form, it is modified by changing the row of the mapping form to the test case, automatic regression test is carried out to modified mapping form, if pass through automatic regression test, modified mapping form is then preserved, if not preserving modified mapping form by automatic regression test.The present invention develops test case by establishing mapping form, while carries out automatic regression test to new test case in development process, improves the efficiency of automatic test cases exploitation and regression test.
Description
Technical field
The present invention relates to software automated testing technical fields, are related specifically to a kind of automatic test cases manager
Method, device, equipment and storage medium.
Background technology
The automatic test of software is that manual testing's behavior is converted into a kind of process that machine performs test automatically.It is logical
Often, it after devising test case and passing through evaluation, is held step by step according to the regulation described in test case by tester
Row test, obtained actual result is compared with expected result.In the process, in order to save manpower, time or hardware
Resource improves testing efficiency, introduces automatic test.
During automatic test cases are developed, need to carry out regression test.Wherein, regression test refers to have modified
After old code, test is re-started to confirm modification without introducing new mistake or other codes being caused to generate mistake.
At present, the speed of software development is getting faster, in order to keep up with the speed of software development, it is necessary to further improve exploitation
The speed of automatic test cases is simultaneously carried out at the same time effective regression test.
Invention content
The embodiment of the present invention provides a kind of method, apparatus, equipment and the storage medium of automatic test cases management, can be with
It improves the speed of exploitation automatic test cases and is carried out at the same time effective regression test.
The invention is realized in this way：
First aspect present invention provides a kind of automatic test cases management method, including：
Mapping form is established according to test case in the database, tests and uses described in each behavior in the mapping form
Each step of case script；
Modified by changing the row of the mapping form to the test case, to modified mapping form into
Row automatic regression test；
If by the automatic regression test, modified mapping form is preserved；
If modified mapping form is not preserved by the automatic regression test.
Second aspect of the present invention provides a kind of automatic test cases managing device, the automatic test cases management dress
Put including：
Mapping form acquisition module, for establishing mapping form, the mapping form in the database according to test case
In each behavior described in test case script each step；
Automatic regression test module changes the row of the mapping form to be repaiied to the test case for passing through
Change, automatic regression test is carried out to modified mapping form, if by the automatic regression test, preserves modified reflect
Firing table lattice, if not preserving modified mapping form by the automatic regression test.
Third aspect present invention provides a kind of terminal device, including memory, processor and is stored in the memory
In and the computer program that can run on the processor, the processor realize such as this hair when performing the computer program
The step of bright first aspect the method.
Fourth aspect present invention provides a kind of computer readable storage medium, and the computer-readable recording medium storage has
Computer program, when the computer program is executed by processor realize as described in the first aspect of the invention method the step of.
Automatic test cases management method provided in an embodiment of the present invention, device, equipment and storage medium beneficial effect
Fruit is：Test case is developed by establishing mapping form, while new test case is carried out in development process automatic
Regression test improves the efficiency of automatic test cases exploitation and regression test.
Description of the drawings
It to describe the technical solutions in the embodiments of the present invention more clearly, below will be to embodiment or description of the prior art
Needed in attached drawing be briefly described, it should be apparent that, the accompanying drawings in the following description be only the present invention some
Embodiment, for those of ordinary skill in the art, without having to pay creative labor, can also be according to these
Attached drawing obtains other attached drawings.
Fig. 1 is the flow chart for the automatic test cases management method that the embodiment of the present invention one provides；
Fig. 2 is another flow chart for the automatic test cases management method that the embodiment of the present invention one provides；
Fig. 3 is another flow chart for the automatic test cases management method that the embodiment of the present invention one provides；
Fig. 4 is the flow chart of automatic test cases management method provided by Embodiment 2 of the present invention；
Fig. 5 is the structure diagram for the automatic test cases managing device that the embodiment of the present invention three provides；
Fig. 6 is another structure diagram for the automatic test cases managing device that the embodiment of the present invention three provides；
Fig. 7 is the structure diagram for the terminal device that another embodiment of the present invention provides.
Specific embodiment
In order to make the purpose , technical scheme and advantage of the present invention be clearer, with reference to the accompanying drawings and embodiments, it is right
The present invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and
It is not used in the restriction present invention.
Embodiment one
It please refers to Fig.1, it illustrates the flow charts of automatic test cases management method provided in an embodiment of the present invention.
Step S10, the test case in database establish mapping form, and each performance testing in mapping form is used
Each step of case script.
Wherein, database is the set of all test cases, the test case developed originally and test case newly developed
It is all stored in the database, newer state is always maintained at the progress data library of exploitation.
During automatic test cases are developed, if directly modifying to test case, need to use test
Example itself carries out the operation of text level.Due to there is a large amount of programming language in test case, directly modification is needed to programming language
It modifies, program capability is required very strong and inefficient；Once going wrong during exploitation, then may cause
Modification does not preserve or loses important progress, needs from the beginning to check and develop again, and establishes mapping form to test case
It modifies, then can solve the problems, such as these, greatly promote the speed that test case is developed.
Mapping form is the table established for test case leaved for development, there is the pass of mapping with test case to be developed
System, can be by changing modification of the mapping form realization to test case, without directly modifying to test case.
To establish mapping form can be packaged the function of test case in itself, and developer is only needed to defining
Of concern function itself is modified and do not had to function, and script is made to be easier to develop and safeguard.
Specifically, setting table in the database, test case includes multiple script units, it is specified that every a line pair of table
It should show the title that script unit stores in the database, the row of table show the content that script unit is included, by each foot
The ID that this unit is stored in database corresponds to the row on table, then will be included successively per the corresponding script unit of a line
Action type and control number be shown in the row of table, obtained table is mapping form, wherein each script unit
Corresponding to a processing mode.
Edit selection test script to be edited is carried out to test case, editor is clicked, according to test script to be edited
And pre-set table generation mapping form, wherein action type include click, long-press, dragging, button, delay and inspection
Point etc..Can with any row of Choose for user table, call database, according to the corresponding ID of the row of selection search in the database with
The corresponding data row of the script unit selects any operation and performs, such as deletes a certain step.
Step S20 modifies to the test case by changing the row of the mapping form, is reflected to modified
Firing table lattice carry out automatic regression test.
As a kind of embodiment, before automatic regression test, backup test use-case and caching test case can be generated,
As shown in Fig. 2, step S20 is specifically included：
Step S201 backs up former test case.
When modifying to former test case, former test case is backed up.
Step S202 generates backup test use-case.
Backup test use-case is generated, to be compared with cache test use-case below.
Step S203, modifies to mapping form.
Start further to develop former test case.
Step S204 generates cache test use-case.
After the exploitation that a stage has been carried out to former test case, cache test use-case is generated according to mapping form, with
The backup test use-case generated before is compared.
In order to verifying exploitation as a result, developer will carry out regression test, regression test to modified test case
Refer to the process of that carry out one to program with test case after code revision verifies again, using automatic in the technical program
Regression test.Wherein, automatic regression test refers to checking mistake in cache test use-case and backup test use-case regression test
Number and detection time carry out a comparison.
Whether step S30 judges modified mapping form by the automatic regression test.
Whether judge modified mapping form by the automatic regression test, specific steps as shown in figure 3, including：
Step S301 compares the inspection errors number of cache test use-case and detection time with backup test use-case
Compared with.
It is separately operable cache test use-case and backup test use-case carries out regression test, obtain and check errors number and inspection
The data of time are surveyed, this two groups of data are compared.
Step S302, when the inspection errors number of cache test use-case is more than backup test use-case and cache test use-case
Detection time is less than backup test use-case, then is considered as and passes through automatic regression test.
The error detection rate and detection efficiency for being judged as cache test use-case are better than backup test use-case.
Step S303, when the inspection errors number of cache test use-case is less than backup test use-case or cache test use-case
Detection time be more than backup test use-case, then be considered as and do not pass through automatic regression test.
It is judged as that cache test use-case is more advanced unlike backup test use-case.
Pass through above step, it can be determined that whether go out modified mapping form more advanced than backup test use-case, so as to
Judge whether modified mapping form passes through automatic regression test.
Step S40 when cache test use-case passes through automatic regression test, preserves modified mapping form.
If cache test use-case preserves modified mapping form, while more by automatic regression test
New test case, and the database of test case is updated, complete the stage exploitation to former test case.
If cache test use-case by automatic regression test, does not preserve mapping form, while restores former test and use
Example maintains original database, into the exploitation and test of next round.
The advantageous effect of the embodiment of the present invention is：Former test case is developed by establishing mapping form, after modification
By automatic regression test, if new test case is better than former test case, new test case is preserved, is updated simultaneously
Database conversely, then restoring former test case, carries out the exploitation and test of next round, makes the exploitation speed of automatic test cases
Degree is accelerated, and improves the efficiency of regression test.
Embodiment two
It, can former to one Test cases technology be multiple can pass through the new test of automatic regression test in embodiment one
Then use-case establishes a subset and preserves these new test cases in the database.
In order to these new test cases are carried out it is excellent in select excellent, the row of priorization is completed in the classification that Bayes can be carried out to it
Sequence so as to fulfill the target of new version software defect is found faster and more with less test case quantity, is improved to return and be surveyed
The efficiency of examination.
The method process flow of the embodiment of the present invention includes historical data pretreatment, classified excavation training set structure, classification
Excavate training and prediction, prioritizing test cases four modules of sequence.
Historical data preprocessing module is responsible for collecting and extracting test case implementing result and module under different editions
The historical data of change is converted to test case implementing result data matrix and module under the different editions needed for subsequent processing and becomes
More data matrix.
Classified excavation training set builds module, is become using test case implementing result data matrix under different editions and module
More data matrix establishes training set required when classified excavation is trained for each test case.
Classified excavation training and prediction module, using different classified excavation models, the training based on each test case
Collection is trained, using implementing result of the model prediction test case in new version after training.
According to the implementing result of prediction, priorization row is carried out to all test cases for prioritizing test cases sorting module
Sequence, it is preferential to perform the test case for coming front.
It please refers to Fig.4, it illustrates the implementation steps of above-mentioned each module：
Data preprocessing module includes two parts of test data pretreatment and module change data prediction, i.e. step
S402 and S403, process flow include：
The execution result information of test case under each version is collected and organized first.The first step first determines that test case is held
The version number n of row matrix of consequence and test case number m.The version quantity of software systems is enabled as n, version set V=v1,
V2 ..., vn }；Shared m different test cases, test use cases T={ t1, t2 ..., tm }.Then test case is established
Implementing result matrix R (m, n)=[rij] m × n, wherein rrj is matrix element, represents test case ti holding on version vj
Row result.
There are three values altogether by rij：0 represents that test passes through；1 represents that test does not pass through；Null (null value) is represented in version vj
Middle test case ti was not performed.
All elements rij is first initialized as null in matrix, then the execution knot according to test case ti on version vj
Fruit carries out assignment to each element rij in matrix.
Wherein, the flow of version change data prediction includes：
The module number that software systems include is determined first, and software systems is enabled to include the l module (criteria for classifying root of module
Defined according to software systems feature and Test coverage granularity, be a module such as by an object definition of java applet), then
Software systems System={ Mod1, Mod2 ..., Modl }.
Next it needs to be determined that sample version v0.Sample version is used as the reference standard of version change, chooses sample
Version can follow following standard：First sample version should be the stable release of one, and function and structure is complete, the second sample version
All modules of software systems System should be included, third sample version should be that test case performs error probability minimum
Version, i.e. the most stable of version of quality.
Based on sample version v0, version change matrix Δ (n, l)=[δ jk] n × l is built as unit of module, wherein becoming
Whether more matrix element δ jk represent that version vj compares with sample version v0 and are changed on module Modk.
There are two values by δ jk：0 expression version vj compares with sample version v0, is not changed on module Modk；1
Represent that version vj opposite sample version v0 on module Modk have altered.
Step S404 steps, classified excavation training set structure, i.e. classified excavation training set structure module, process flow packet
It includes：
Training set structure is changed based on module with the associated hypothesis of test case：Each test case ti is for different moulds
Block defect has different degrees of detectability, and new defect is introduced since change occurring in certain module in new version；
When some module changes, some test cases can be more sensitive, i.e., its Flaw detectability will be above other test cases,
Then module change has relevance with the implementing result of test case, can be analyzed and measured by classified excavation.
Classified excavation training set is built for each test case, the test case ti in test use cases T is given, considers to hold
Each version vj of use-case ti was gone, by the modification information δ jk and use-case ti of module Modk each in version vj in version vj
Implementing result rij is merged into a data vector：<δ j1, δ j2 ..., δ jn, rij>；Then by use-case ti each version number
Matrix is merged into according to vector, forms the training set Trainseti of use-case ti.
It is the matrix of a n ' × (l+1) to test case ti, training set Trainseti=[Δ, Ri].Wherein Δ
(n ', l) is derived from module change data matrix Δ (n, l), does not consider to be not carried out the version of use-case ti；Ri is that a n ' × 1 is vectorial,
It is the transposition of the i-th row in test case implementing result matrix R (m, n), represents execution knots of the test case ti in n version
Fruit does not consider equally to be not carried out the version of use-case ti.
In classified excavation, training set is made of one group of record (Record), and each record is divided into attribute (Attribute)
With class label (Class Label), class label corresponds to classification results.For a line of training set as a record, preceding l row are l
The alteration of module as attribute, last row both implementing result rij as class label.
Step S405, training and the training of prediction result, i.e. classified excavation and prediction module, process flow include：
The two Bayesian Classification Models of HNB and AODE are selected in classified excavation training and predicted portions.AODE is a kind of
Semi-naive Bayes technology compared with naive Bayesian technology, reduces mutual independence requirement between attribute, can actually should
The accuracy of classification results is effectively improved in.HNB is another Bayesian technique, with reference to Nave Bayesian Classifier model and Bayes
The advantages of network model, while the attribute independent for overcoming Nave Bayesian Classifier model assumes and bayesian network structure learning consumption
When the shortcomings that.
It is loaded into the two models respectively and is initialized.Since HNB does not need to set any parameter, it is being loaded into
It is initialized during HNB with default behavior.For AODE, need to set minimum frequency freq, which is integer, there is shown now at least
The combination of freq times is paid attention to.Normal condition takes 1；It if training set is larger, also can suitably increase the value of freq, reduce even
The influence so combined.
To each test case ti, it is loaded into corresponding training set Trainseti and is trained.It, can when training set is larger
The maximum train epochs of setting and maximum training time.
The module modification information of new version is got out, inspection set Testseti=is inserted with the identical call format of training set
[Δ new, θ i].Wherein new version modification information set Δ new={ δ 1, new, δ 2, new ..., δ l, new }, represents new version
In module change vector.
Inspection set is substituted into the trained classified excavation model of previous step, predicts test case ti in new version
Implementing result θ i, this value are floating point values (being between 0 and 1), represent test case ti it can be found that software lacks in new version
Sunken probability.
The prediction result of comprehensive all test cases, classified excavation training and prediction module final output are a triples
Set Prof=<Ti, θ i, type>| ti ∈ t, 0 ＜ θ i≤1,1≤i≤m, type ∈ { HNB, AODE } }, wherein ti is test
Use-case；Type is the disaggregated model selected；Probability θ i represent test case ti it can be found that the probability of new version software defect, θ i
The higher value for representing test case ti is higher, more worth preferential test.
Step S406, Test Case Prioritization, i.e. prioritizing test cases sorting module, process flow include：
It is predicted respectively using two Bayes's classification mining models of HNB and AODE, takes test case ti corresponding first
Two θ i therein summations are averaged by two triples in Prof set, are obtained test case ti and are found new version software
The final prediction probability pi of defect.According to each test case find software defect final Probability p i to all test cases into
Row sequence.Consider that the time in regression test stage is limited, the total time for enabling regression test is timemax, is chosen at
A test cases of preceding m ' that can be completed in timemax form final regression test case collection.
The advantageous effect of the embodiment of the present invention is：By carrying out historical data pretreatment to new test case training set, dividing
Class excavates training set structure, classified excavation training and the processing of prediction and prioritizing test cases sequence, and test case is carried out
It is preferred that so as to fulfill the target of new version software defect is found faster and more with less test case quantity, accelerate certainly
The development rate of dynamicization test case improves the efficiency of regression test.
Embodiment three
Fig. 5 is please referred to, it illustrates a kind of automatic test cases managing devices that another embodiment of the invention provides
40, the automatic test cases managing device 40 includes：Mapping form acquisition module 401 and automatic regression test module 402.
Mapping form acquisition module 401, for establishing mapping form, the mapping table in the database according to test case
Each step of test case script described in each behavior in lattice；
Automatic regression test module 402 changes the row of the mapping form with to test case progress for passing through
Whether modification carries out automatic regression test to modified mapping form, judge modified mapping form by described automatic
If regression test by the automatic regression test, preserves modified mapping form, if not surveyed by the automatic returning
Examination, then do not preserve modified mapping form.
Specifically, automatic regression test module 402 includes：
Backup generation backup test use-case is carried out to former test case, and caching is generated according to modified mapping form and is surveyed
Example on probation；
The cache test use-case and the backup test use-case are carried out respectively to check errors number and detection time
Test；
If the inspection errors number of the cache test use-case is more than the backup test use-case and the cache test is used
The detection time of example is then considered as through the automatic regression test less than the backup test use-case and preserves modified mapping
Table；
If the inspection errors number of the cache test use-case is less than the backup test use-case or the cache test is used
Example detection time be more than the backup test use-case, then be considered as do not preserved by the automatic regression test it is modified
Mapping form.
Fig. 6 is please referred to, as a kind of embodiment, the automatic test cases managing device 40 further includes：
Prioritization module 403, for carrying out priority ranking by the test case of the automatic regression test,
Specifically, selection Bayes's classification two classified excavation models of HNB and AODE, corresponding training set is used to each test case
Model training is carried out, according to the synthesis result of model prediction, priorization sequence is carried out to test case.
The specific work process of module in above device can refer to the corresponding process in preceding method embodiment, herein
It repeats no more.
The advantageous effect of automatic test cases managing device provided in an embodiment of the present invention is, by establishing mapping form
Test case is developed, while automatic regression test is carried out to new test case in development process, improves automation
Test case is developed and the efficiency of regression test
Another kind embodiment of the invention provides a computer readable storage medium, is stored on the computer readable storage medium
There is computer program, which realizes the noise processing method of the cloud rail in above-described embodiment when being executed by processor,
To avoid repeating, which is not described herein again.It is automated alternatively, the computer program is realized when being executed by processor in above-described embodiment
The function of each module/unit, repeats, which is not described herein again to avoid in test case management device.
Fig. 7 is the schematic diagram of terminal device in the present embodiment.As shown in fig. 7, terminal device 6 includes processor 60, storage
Device 61 and it is stored in the computer program 62 that can be run in memory 61 and on processor 60.Processor 60 performs computer
A kind of each step of automatic test cases management method in above-described embodiment, such as step shown in FIG. 1 are realized during program 62
Rapid S10, S20 and S30.Alternatively, processor 60 realizes a kind of automatic test in above-described embodiment when performing computer program 62
The function of each module/unit of case management device, mapping form acquisition module 401 as shown in Figure 6, automatic regression test module
402nd, the function of prioritization module 403.
Illustratively, computer program 62 can be divided into one or more module/units, one or more mould
Block/unit is stored in memory 61, and is performed by processor 60, can to complete the one or more module/units of the present invention
To be the series of computation machine program instruction section that can complete specific function, the instruction segment is for describing computer program 62 at end
Implementation procedure in end equipment 6.For example, computer program 62 can be with mapping form acquisition module 401, automatic regression test module
402nd, prioritization module 403.
Terminal device 60 can be the computing devices such as desktop PC, notebook, palm PC and cloud server.Eventually
End equipment may include, but be not limited only to, processor 61, memory 62.It will be understood by those skilled in the art that Fig. 6 is only eventually
The example of end equipment 60 does not form the restriction to terminal device 60, can include than illustrate more or fewer components or
Combine certain components or different components, for example, terminal device can also include input-output equipment, network access equipment,
Bus etc..
Alleged processor 61 can be central processing unit (Central Processing Unit, CPU), can also be
Other general processors, digital signal processor (Digital Signal Processor, DSP), application-specific integrated circuit
(Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field-
Programmable Gate Array, FPGA) either other programmable logic device, discrete gate or transistor logic,
Discrete hardware components etc..General processor can be microprocessor or the processor can also be any conventional processor
Deng.
Memory 62 can be the internal storage unit of terminal device 60, such as the hard disk or memory of terminal device 60.It deposits
Reservoir 62 can also be the plug-in type hard disk being equipped on the External memory equipment of terminal device 60, such as terminal device 60, intelligence
Storage card (Smart Media Card, SMC), secure digital (Secure Digital, SD) card, flash card (Flash Card)
Deng.Further, memory 62 can also both include the internal storage unit of terminal device 60 or including External memory equipment.It deposits
Reservoir 62 is used to store computer program and other programs and data needed for terminal device.Memory 62 can be also used for temporarily
When store the data that has exported or will export.
It is apparent to those skilled in the art that for convenience of description and succinctly, only with above-mentioned each work(
Can unit, module division progress for example, in practical application, can be as needed and by above-mentioned function distribution by different
Functional unit, module are completed, i.e., the internal structure of described device are divided into different functional units or module, more than completion
The all or part of function of description.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, it can also
That each unit is individually physically present, can also two or more units integrate in a unit.Above-mentioned integrated list
The form that hardware had both may be used in member is realized, can also be realized in the form of SFU software functional unit.
If the integrated module/unit realized in the form of SFU software functional unit and be independent product sale or
In use, it can be stored in a computer read/write memory medium.Based on such understanding, the present invention realizes above-mentioned implementation
All or part of flow in example method, can also instruct relevant hardware to complete, the meter by computer program
Calculation machine program can be stored in a computer readable storage medium, the computer program when being executed by processor, it can be achieved that on
The step of stating each embodiment of the method.Wherein, the computer program includes computer program code, the computer program generation
Code can be source code form, object identification code form, executable file or certain intermediate forms etc..The computer-readable medium
It can include：Any entity of the computer program code or device, recording medium, USB flash disk, mobile hard disk, magnetic can be carried
Dish, CD, computer storage, read-only memory (ROM, Read-Only Memory), random access memory (RAM,
Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium etc..It is it should be noted that described
The content that computer-readable medium includes can carry out appropriate increasing according to legislation in jurisdiction and the requirement of patent practice
Subtract, such as in certain jurisdictions, according to legislation and patent practice, computer-readable medium do not include be electric carrier signal and
Telecommunication signal.
Embodiment described above is merely illustrative of the technical solution of the present invention, rather than its limitations；Although with reference to aforementioned reality
Example is applied the present invention is described in detail, it will be understood by those of ordinary skill in the art that：It still can be to aforementioned each
Technical solution recorded in embodiment modifies or carries out equivalent replacement to which part technical characteristic；And these are changed
Or replace, the spirit and scope for various embodiments of the present invention technical solution that it does not separate the essence of the corresponding technical solution should all
It is included within protection scope of the present invention.
Claims (10)
1. a kind of automatic test cases management method, which is characterized in that the automatic test cases management method includes：
Mapping form is established according to test case in the database, test case foot described in each behavior in the mapping form
This each step；
It is modified by changing the row of the mapping form to the test case, modified mapping form is carried out certainly
Whether dynamic regression test, judge modified mapping form by the automatic regression test；
If by the automatic regression test, modified mapping form is preserved；
If modified mapping form is not preserved by the automatic regression test.
2. automation case management method according to claim 1, which is characterized in that by changing the mapping form
It goes to modify to the test case, including：
Backup generation backup test use-case is carried out to former test case, and cache test is generated according to modified mapping form and is used
Example.
3. automation case management method according to claim 2, which is characterized in that carried out to modified mapping form
If automatic regression test by the automatic regression test, preserves modified mapping form；If do not pass through described automatic time
Return test, then do not preserve modified mapping form, including：
Carry out checking the test of errors number and detection time respectively to the cache test use-case and the backup test use-case；
If the inspection errors number of the cache test use-case is more than the backup test use-case and the cache test use-case
Detection time is less than the backup test use-case, then is considered as through the automatic regression test and preserves modified mapping table
Lattice；
If the inspection errors number of the cache test use-case is less than the backup test use-case or the cache test use-case
Detection time is more than the backup test use-case, then is considered as and does not preserve modified mapping by the automatic regression test
Table.
4. automation case management method according to claim 3, which is characterized in that if the cache test use-case
Inspection errors number be more than the detection time of the backup test use-case and the cache test use-case and surveyed less than the backup
Example on probation, then be considered as through the automatic regression test, include later：
To carrying out priority ranking by the test case of the automatic regression test.
5. automation case management method according to claim 4, which is characterized in that described pair passes through the automatic returning
The test case of test carries out priority ranking, including：
Select Bayes's classification two classified excavation models of HNB and AODE, to each test case using corresponding training set into
Row model training carries out priorization sequence according to the synthesis result of model prediction to test case.
6. a kind of automatic test cases managing device, which is characterized in that the automatic test cases managing device includes：
Mapping form acquisition module, for establishing mapping form in the database according to test case, in the mapping form
Each step of test case script described in each behavior；
Automatic regression test module changes the row of the mapping form to modify to the test case for passing through, right
Modified mapping form carries out automatic regression test, judges whether modified mapping form is surveyed by the automatic returning
Examination, if by the automatic regression test, preserves modified mapping form, if not by the automatic regression test,
Modified mapping form is not preserved.
7. automatic test cases managing device as claimed in claim 6, which is characterized in that the automatic regression test module
It is additionally operable to：
Backup generation backup test use-case is carried out to former test case, and cache test is generated according to modified mapping form and is used
Example；
Carry out checking the test of errors number and detection time respectively to the cache test use-case and the backup test use-case；
If the inspection errors number of the cache test use-case is more than the backup test use-case and the cache test use-case
Detection time is less than the backup test use-case, then is considered as through the automatic regression test and preserves modified mapping table
Lattice；
If the inspection errors number of the cache test use-case is less than the backup test use-case or the cache test use-case
Detection time is more than the backup test use-case, then is considered as and does not preserve modified mapping by the automatic regression test
Table.
8. automatic test cases managing device as claimed in claim 7, which is characterized in that the automatic test cases pipe
Reason device further includes：
Prioritization module, for carrying out priority ranking by the test case of the automatic regression test, selecting shellfish
Ye Si classification two classified excavation models of HNB and AODE carry out model training to each test case using corresponding training set,
Priorization sequence is carried out to test case according to the synthesis result of model prediction.
9. a kind of terminal device, including memory, processor and it is stored in the memory and can be on the processor
The computer program of operation, which is characterized in that the processor realizes such as claim 1 to 5 when performing the computer program
The step of any one the method.
10. a kind of computer readable storage medium, the computer-readable recording medium storage has computer program, and feature exists
In when the computer program is executed by processor the step of realization such as any one of claim 1 to 5 the method.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710857308.1A CN108268373A (en) | 2017-09-21 | 2017-09-21 | Automatic test cases management method, device, equipment and storage medium |
| PCT/CN2018/080432 WO2019056720A1 (en) | 2017-09-21 | 2018-03-26 | Automated test case management method and apparatus, device, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710857308.1A CN108268373A (en) | 2017-09-21 | 2017-09-21 | Automatic test cases management method, device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108268373A true CN108268373A (en) | 2018-07-10 |
Family
ID=62771788
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710857308.1A Pending CN108268373A (en) | 2017-09-21 | 2017-09-21 | Automatic test cases management method, device, equipment and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108268373A (en) |
| WO (1) | WO2019056720A1 (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109165170A (en) * | 2018-10-16 | 2019-01-08 | 杭州安恒信息技术股份有限公司 | A kind of method and system automating request for test |
| CN109582578A (en) * | 2018-11-29 | 2019-04-05 | 泰康保险集团股份有限公司 | System, method, computer-readable medium and the electronic equipment of software test case |
| CN110737573A (en) * | 2018-07-18 | 2020-01-31 | 北京奇虎科技有限公司 | Method and device for automatically testing user interface UI |
| CN112148614A (en) * | 2020-09-29 | 2020-12-29 | 中国银行股份有限公司 | Regression testing method and device |
| CN112181835A (en) * | 2020-09-29 | 2021-01-05 | 中国平安人寿保险股份有限公司 | Automatic testing method and device, computer equipment and storage medium |
| CN112256555A (en) * | 2020-09-11 | 2021-01-22 | 上海汇付数据服务有限公司 | Automated test case management system and test case execution state transition method |
| CN112363928A (en) * | 2020-11-10 | 2021-02-12 | 网易（杭州）网络有限公司 | Test case processing method and device, processor and electronic device |
| CN112527655A (en) * | 2020-12-16 | 2021-03-19 | 平安银行股份有限公司 | Software version quality abnormity detection method and device, electronic equipment and storage medium |
| CN112860492A (en) * | 2021-03-29 | 2021-05-28 | 中信银行股份有限公司 | Automatic regression testing method and system suitable for core system |
| CN117785698A (en) * | 2023-12-27 | 2024-03-29 | 广州极点三维信息科技有限公司 | Software test case method and device, electronic equipment and storage medium |
| CN118820116A (en) * | 2024-09-14 | 2024-10-22 | 北京云行在线软件开发有限责任公司 | A method and device for quickly and automatically building system use cases based on mapping models |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101908020A (en) * | 2010-08-27 | 2010-12-08 | 南京大学 | A Test Case Prioritization Method Based on Classification Mining and Version Change |
| CN102156784A (en) * | 2011-04-18 | 2011-08-17 | 烽火通信科技股份有限公司 | Verifying environment patterned chip verifying method and device |
| CN102567193A (en) * | 2010-12-09 | 2012-07-11 | 北京新媒传信科技有限公司 | Method and system for converting test case to automated testing script |
| CN103631590A (en) * | 2013-11-29 | 2014-03-12 | 广东明创软件科技有限公司 | Method for editing automated testing script |
| CN104820636A (en) * | 2015-04-09 | 2015-08-05 | 北京轩宇信息技术有限公司 | Ant colony algorithm based parallel test case sequence generation method |
| CN106598869A (en) * | 2016-12-26 | 2017-04-26 | 北京京东金融科技控股有限公司 | Method and device for realizing automatic software testing and electronic equipment |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201402459Y (en) * | 2008-12-25 | 2010-02-10 | 深圳市同洲电子股份有限公司 | Test case management device |
| US9037915B2 (en) * | 2011-12-08 | 2015-05-19 | International Business Machines Corporation | Analysis of tests of software programs based on classification of failed test cases |
| CN104156342A (en) * | 2014-08-01 | 2014-11-19 | 福建星网视易信息系统有限公司 | Method and device for converting Excel format testing case into XML (extensive markup language) format |
-
2017
- 2017-09-21 CN CN201710857308.1A patent/CN108268373A/en active Pending
-
2018
- 2018-03-26 WO PCT/CN2018/080432 patent/WO2019056720A1/en active Application Filing
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101908020A (en) * | 2010-08-27 | 2010-12-08 | 南京大学 | A Test Case Prioritization Method Based on Classification Mining and Version Change |
| CN102567193A (en) * | 2010-12-09 | 2012-07-11 | 北京新媒传信科技有限公司 | Method and system for converting test case to automated testing script |
| CN102156784A (en) * | 2011-04-18 | 2011-08-17 | 烽火通信科技股份有限公司 | Verifying environment patterned chip verifying method and device |
| CN103631590A (en) * | 2013-11-29 | 2014-03-12 | 广东明创软件科技有限公司 | Method for editing automated testing script |
| CN104820636A (en) * | 2015-04-09 | 2015-08-05 | 北京轩宇信息技术有限公司 | Ant colony algorithm based parallel test case sequence generation method |
| CN106598869A (en) * | 2016-12-26 | 2017-04-26 | 北京京东金融科技控股有限公司 | Method and device for realizing automatic software testing and electronic equipment |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110737573A (en) * | 2018-07-18 | 2020-01-31 | 北京奇虎科技有限公司 | Method and device for automatically testing user interface UI |
| CN110737573B (en) * | 2018-07-18 | 2023-02-17 | 北京奇虎科技有限公司 | Method and device for automatically testing user interface UI |
| CN109165170B (en) * | 2018-10-16 | 2022-03-11 | 杭州安恒信息技术股份有限公司 | A method and system for automated request testing |
| CN109165170A (en) * | 2018-10-16 | 2019-01-08 | 杭州安恒信息技术股份有限公司 | A kind of method and system automating request for test |
| CN109582578A (en) * | 2018-11-29 | 2019-04-05 | 泰康保险集团股份有限公司 | System, method, computer-readable medium and the electronic equipment of software test case |
| CN109582578B (en) * | 2018-11-29 | 2022-04-05 | 泰康保险集团股份有限公司 | System, method, computer readable medium and electronic device for software test case |
| CN112256555A (en) * | 2020-09-11 | 2021-01-22 | 上海汇付数据服务有限公司 | Automated test case management system and test case execution state transition method |
| CN112181835B (en) * | 2020-09-29 | 2024-04-26 | 中国平安人寿保险股份有限公司 | Automatic test method, device, computer equipment and storage medium |
| CN112181835A (en) * | 2020-09-29 | 2021-01-05 | 中国平安人寿保险股份有限公司 | Automatic testing method and device, computer equipment and storage medium |
| CN112148614A (en) * | 2020-09-29 | 2020-12-29 | 中国银行股份有限公司 | Regression testing method and device |
| CN112148614B (en) * | 2020-09-29 | 2024-04-16 | 中国银行股份有限公司 | Regression testing method and device |
| CN112363928A (en) * | 2020-11-10 | 2021-02-12 | 网易（杭州）网络有限公司 | Test case processing method and device, processor and electronic device |
| CN112363928B (en) * | 2020-11-10 | 2023-08-22 | 网易（杭州）网络有限公司 | Processing method and device of test case, processor and electronic device |
| CN112527655A (en) * | 2020-12-16 | 2021-03-19 | 平安银行股份有限公司 | Software version quality abnormity detection method and device, electronic equipment and storage medium |
| CN112527655B (en) * | 2020-12-16 | 2024-06-25 | 平安银行股份有限公司 | Software version quality abnormality detection method and device, electronic equipment and storage medium |
| CN112860492A (en) * | 2021-03-29 | 2021-05-28 | 中信银行股份有限公司 | Automatic regression testing method and system suitable for core system |
| CN112860492B (en) * | 2021-03-29 | 2024-03-26 | 中信银行股份有限公司 | Automatic regression testing method and system suitable for core system |
| CN117785698A (en) * | 2023-12-27 | 2024-03-29 | 广州极点三维信息科技有限公司 | Software test case method and device, electronic equipment and storage medium |
| CN118820116A (en) * | 2024-09-14 | 2024-10-22 | 北京云行在线软件开发有限责任公司 | A method and device for quickly and automatically building system use cases based on mapping models |
| CN118820116B (en) * | 2024-09-14 | 2025-02-07 | 北京云行在线软件开发有限责任公司 | A method and device for quickly and automatically building system use cases based on mapping models |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019056720A1 (en) | 2019-03-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108268373A (en) | Automatic test cases management method, device, equipment and storage medium | |
| CN110968695A (en) | Intelligent labeling method, device and platform based on active learning of weak supervision technology | |
| US20080172652A1 (en) | Identifying Redundant Test Cases | |
| EP2960799A1 (en) | Defect localization in software integration tests | |
| CN105122212A (en) | Periodicity optimization in an automated tracing system | |
| CN105283851A (en) | Cost analysis for selecting trace objectives | |
| CN105283866A (en) | Optimization analysis using similar frequencies | |
| US11580425B2 (en) | Managing defects in a model training pipeline using synthetic data sets associated with defect types | |
| Shafiq et al. | Retracted: Scientific programming using optimized machine learning techniques for software fault prediction to improve software quality | |
| CN113010389A (en) | Training method, fault prediction method, related device and equipment | |
| Illes-Seifert et al. | Exploring the relationship of a file’s history and its fault-proneness: An empirical method and its application to open source programs | |
| US11971802B2 (en) | Method, electronic device, and computer program product for code defect detection | |
| US20220138032A1 (en) | Analysis of deep-level cause of fault of storage management | |
| CN113656321A (en) | Automated testing method, system, equipment and medium | |
| CN109766259A (en) | A Classifier Testing Method and System Based on Compound Metamorphosis Relation | |
| CN115185797A (en) | Test method, system, electronic device and storage medium for visual algorithm model | |
| CN113791980A (en) | Test case conversion analysis method, device, equipment and storage medium | |
| Zhang et al. | An empirical study on clone consistency prediction based on machine learning | |
| Patil et al. | Next-Generation Bug Reporting: Enhancing Development with AI Automation | |
| US11526429B1 (en) | Identifying critical methods and critical paths in software code | |
| CN110457207A (en) | Test method and related equipment based on machine learning model | |
| CN115237804A (en) | Performance bottleneck assessment method, performance bottleneck assessment device, electronic equipment, medium and program product | |
| Nasser et al. | A robust tuned K-nearest neighbours classifier for software defect prediction | |
| CN113505895A (en) | Machine learning engine service system, model training method and configuration method | |
| CN118035468A (en) | Deep learning-based equal-protection evaluation result record knowledge graph extraction method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180710 |
|
| RJ01 | Rejection of invention patent application after publication |