CN113190443A - Test method, test device, computer equipment and storage medium - Google Patents
Test method, test device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN113190443A CN113190443A CN202110468343.0A CN202110468343A CN113190443A CN 113190443 A CN113190443 A CN 113190443A CN 202110468343 A CN202110468343 A CN 202110468343A CN 113190443 A CN113190443 A CN 113190443A
- Authority
- CN
- China
- Prior art keywords
- test
- case
- cases
- tested
- file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 895
- 238000010998 test method Methods 0.000 title claims abstract description 21
- 238000000034 method Methods 0.000 claims abstract description 48
- 230000006870 function Effects 0.000 claims description 96
- 238000007619 statistical method Methods 0.000 claims description 28
- 238000004590 computer program Methods 0.000 claims description 14
- 230000008569 process Effects 0.000 abstract description 19
- 230000000694 effects Effects 0.000 abstract description 7
- 230000008676 import Effects 0.000 abstract description 5
- 230000010354 integration Effects 0.000 description 13
- 238000010586 diagram Methods 0.000 description 10
- 230000003203 everyday effect Effects 0.000 description 9
- 230000007547 defect Effects 0.000 description 4
- 238000011161 development Methods 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000013522 software testing Methods 0.000 description 3
- 238000012546 transfer Methods 0.000 description 3
- 238000003149 assay kit Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000004927 fusion Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 210000001503 joint Anatomy 0.000 description 2
- 230000002085 persistent effect Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000004883 computer application Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Prevention of errors by analysis, debugging or testing of software
- G06F11/3668—Testing of software
- G06F11/3672—Test management
- G06F11/368—Test management for test version control, e.g. updating test cases to a new software version
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Prevention of errors by analysis, debugging or testing of software
- G06F11/3668—Testing of software
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
本申请涉及一种测试方法、装置、计算机设备和存储介质。所述方法通过获取待测试项目的多个测试用例，调用各测试用例对应的测试函数，从数据库中获取各测试用例的测试文件，若获取到测试文件，则根据测试文件和对应的测试函数对测试用例进行测试，得到测试用例的测试结果，根据各测试用例的测试结果生成测试报告。上述测试方法中，由于测试函数和测试文件是分离的，因此，在测试过程中需要修改测试数据或测试逻辑时，计算机设备可以直接修改测试文件，再将修改后的测试文件导入到现有的测试函数后，就可以达到自动调整测试函数中测试代码的效果，而不需要用户再按照需要修改的测试数据或测试逻辑重新编辑一套测试代码进行测试，提高了测试效率。
The present application relates to a testing method, apparatus, computer equipment and storage medium. The method obtains a plurality of test cases of the item to be tested, calls the test function corresponding to each test case, and obtains the test file of each test case from the database. The test case is tested, the test result of the test case is obtained, and the test report is generated according to the test result of each test case. In the above test method, since the test function and the test file are separated, when the test data or test logic needs to be modified in the test process, the computer equipment can directly modify the test file, and then import the modified test file into the existing test file. After the function is tested, the effect of automatically adjusting the test code in the test function can be achieved without requiring the user to re-edit a set of test code for testing according to the test data or test logic to be modified, which improves the test efficiency.
Description
Technical Field
The present application relates to the field of computer application technologies, and in particular, to a test method, an apparatus, a computer device, and a storage medium.
Background
Continuous integration is a software development practice, and each integration is verified by constructing a compiling, publishing and testing integrated process, so that integration errors can be found as early as possible.
Currently, an OpenBMC software project starts to use a persistent integration system to develop, test and maintain the project, and in the process of testing the persistent integration, each developer in charge of the project needs to edit respective responsible parts into test cases, integrate the test cases together and manually perform repeated testing, adjustment and analysis until the test is passed, and then the software project can be released to be provided for users to use.
However, the above method for testing software items has a problem of low efficiency.
Disclosure of Invention
In view of the above, it is desirable to provide a testing method, an apparatus, a computer device and a storage medium, which can improve the efficiency of project testing and achieve continuous integration.
In a first aspect, a method of testing, the method comprising:
acquiring all test cases of the items to be tested;
calling a test function corresponding to each test case, and acquiring a test file of each test case from a database; each test file comprises test data and test logic required by each test case;
if the test file is obtained, testing the test case according to the test file and a corresponding test function to obtain a test result of the test case;
and generating a test report according to the test result of each test case.
In the test method, because the test function and the test file are separated, when the test data or the test logic needs to be modified in the test process, the computer equipment can directly modify the test file, and then the modified test file is imported into the existing test function, so that the effect of automatically adjusting the test codes in the test function can be achieved, and a user does not need to edit a set of test codes again according to the test data or the test logic which needs to be modified to obtain a new test function, so as to test according to the new test function, thereby greatly improving the test efficiency.
In one embodiment, the testing the test case according to the test file and the corresponding test function to obtain the test result of the test case includes:
reading test data and test logic in the test file;
and calling the corresponding test function to test the test case based on the test data and the test logic to obtain a test result of the test case.
In the test method described in the above embodiment, the test data and the test logic in the test file are transferred to the test function as the function parameters, and the test function for testing the test case can be obtained, so that when the test data or the test logic needs to be modified in the test process, the computer device can directly modify the test file and then directly transfer the modified test file to the test function, and the modification of the test code can be realized without manually editing and modifying the test code in the source code by the user, and the test efficiency can be improved.
In one embodiment, before obtaining all test cases of the item to be tested, the method further includes:
displaying a display interface of the test case; the display interface comprises a plurality of options of the test cases;
acquiring an input instruction of a user on the display interface; the input instruction comprises an identifier of the selected test case;
the obtaining of the plurality of test cases of the item to be tested includes:
and determining the test cases corresponding to the identifiers of the selected test cases as a plurality of test cases of the items to be tested according to the input instruction.
The test method of the embodiment can enable the computer device to selectively execute the test flow without executing unnecessary test flows when testing each test case, further improve the test efficiency and meet the application requirements of users.
In one embodiment, if the display interface comprises a graphical selection interface; the graphical selection interface comprises a plurality of options of test kits, and a sub-interface corresponding to the option of each test kit comprises a plurality of test case options; the input instruction comprises a selected test suite identifier and a selected test case identifier;
determining the test cases corresponding to the selected test case identifications as a plurality of test cases of the items to be tested according to the input instruction, including:
and determining the selected test suite identification and the test case corresponding to the test case identification as a plurality of test cases of the item to be tested according to the selection instruction.
The embodiment provides a function for a user to autonomously select a test case for testing, because in a conventional testing method, when a testing machine calls the test case to test an item to be tested, a test code of each test case is generally executed by default, and the test is completed after the execution is completed, and a function for selecting the test case for testing is not provided for the user, the testing method provided by the application greatly meets the testing requirements of the user by providing a human-computer interaction mode, provides a more humanized graphical selection interface, enables the user operation to be simpler and more convenient, and improves the experience of the user test.
In one embodiment, the test report includes at least one of an email version, a reading version, and a web page version.
According to the embodiment, the test results are displayed to the user by using the test reports of different versions, so that the user can know the reasons of test failure and test success from all dimensions, or can know the test content and the test process of the test case in detail, and technicians can conveniently maintain and adjust the test case in time, thereby reducing bug occurrence and improving the generation efficiency of the project to be tested.
In one embodiment, the method further comprises:
reporting the test result to a cloud server so that the cloud server performs statistical analysis on the test result received in a preset time period to obtain a statistical analysis result;
and receiving a statistical analysis result returned by the cloud server, and displaying the statistical analysis result on a display interface.
The embodiment combines the big data to analyze the test results accumulated in the preset time period, and visually displays the test results to the user, so that the user can know the test process and the test results more in detail and comprehensively, and the test efficiency is improved.
In one embodiment, the item to be tested is an Openbmc item, and the obtaining all test cases of the item to be tested includes:
acquiring all test cases of the Openbmc project on a Robot framework; each of the test cases was pre-constructed using a Python framework.
In the embodiment, the two frames are combined, the internal detailed test case is edited by adopting a Python frame language, the Robot frame is adopted for the external management of the test case, the respective advantages of the two frames are fully combined, the defects of complex test, logic disorder of test case compiling and the like caused by development and test only based on the Robot frame are overcome, and the defects of inconvenience in test case management and poor report readability caused by development and test only based on the Python frame are overcome.
In one embodiment, the obtaining all test cases of the items to be tested includes:
and acquiring all test cases on the Robot framework according to a preset time period based on the timing function of the Jenkins framework.
This embodiment is through nesting Jenkins frame in on Robot frame and Python frame, can realize regularly testing function, set for fixed test promptly and begin, end, report, release time, realize full automatic whole set of test flow, because in practical application, often need consume very long time when testing to the project that awaits measuring, for example the incessant repetition test of a month or a quarter, this just needs corresponding tester to test at fixed time manually every day, give the corresponding very big work load that brings of tester, therefore, the automatic testing function that this application provided has very big reduction the human cost, the easy and handing-over or fusion mistake that appear when still having avoided simultaneously because of being responsible for the technical staff of different modules to test integrated butt joint, and then improved project test efficiency.
In one embodiment, the method further comprises:
and if the test file is not obtained, executing a test function corresponding to the test case to test the test case to obtain a test result of the test case.
In a second aspect, a test apparatus, the apparatus comprising:
the acquisition module is used for acquiring a plurality of test cases of the item to be tested;
the calling module is used for calling the test function corresponding to each test case;
the test module is used for testing the test case according to the test file and the corresponding test function under the condition of obtaining the test file to obtain a test result of the test case;
and the generating module is used for generating a test report according to the test result of each test case.
In a third aspect, a computer device comprises a memory storing a computer program and a processor implementing the method of the first aspect when the processor executes the computer program.
In a fourth aspect, a computer-readable storage medium has stored thereon a computer program which, when executed by a processor, implements the method of the first aspect described above.
According to the test method, the test device, the computer equipment and the storage medium, the test cases of the items to be tested are obtained, the test functions corresponding to the test cases are called, the test files of the test cases are obtained from the database, if the test files are obtained, the test cases are tested according to the test files and the corresponding test functions, the test results of the test cases are obtained, and the test reports are generated according to the test results of the test cases. In the test method, because the test function and the test file are separated, when the test data or the test logic needs to be modified in the test process, the computer equipment can directly modify the test file, and then the modified test file is imported into the existing test function, so that the effect of automatically adjusting the test codes in the test function can be achieved, a user does not need to edit a set of test codes again according to the test data or the test logic which needs to be modified for testing, and the test efficiency is greatly improved.
Drawings
FIG. 1 is a diagram illustrating an internal structure of a computer device according to an embodiment;
FIG. 2 is a schematic flow chart of a test method in one embodiment;
FIG. 3 is a flowchart illustrating an implementation manner of S103 in the embodiment of FIG. 2;
FIG. 4 is a schematic diagram of a test file in one embodiment;
FIG. 5 is a schematic flow chart of a test method in one embodiment;
FIG. 5A is a diagram of a display interface in one embodiment;
FIG. 5B is a diagram of a display interface in one embodiment;
FIG. 6 is a diagram of a read version of a test report, under an embodiment;
FIG. 7 is a diagram of a web page version of a test report in one embodiment;
FIG. 8 is a schematic flow chart of a testing method in one embodiment;
FIG. 9 is a diagram of a display interface in one embodiment;
FIG. 10 is a schematic flow chart of a testing method in one embodiment;
FIG. 11 is a schematic flow chart of a test apparatus according to an embodiment;
FIG. 12 is a schematic flow chart of a test apparatus according to an embodiment;
FIG. 13 is a schematic flow chart of a test apparatus according to one embodiment;
FIG. 14 is a flow diagram of a test apparatus in one embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The testing method provided by the application can be applied to the computer equipment shown in fig. 1, the computer equipment can be a server, the computer equipment can also be a terminal, and the internal structure diagram can be shown in fig. 1. The computer device includes a processor, a memory, a network interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a testing method. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.
Those skilled in the art will appreciate that the architecture shown in fig. 1 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, as shown in fig. 2, a testing method is provided, which is exemplified by the method applied to the computer device in fig. 1, and includes the following steps:
s101, obtaining a plurality of test cases of the item to be tested.
The items to be tested may be any type of software application items, such as Openbmc software development items, Openbmc is a Linux release of a Baseboard Management Controller (BMC), and is intended to span heterogeneous systems, including Management of enterprises, high-performance computing, telecommunication, cloud-scale data centers, and other systems. The test case of the item to be tested is the description of the test task of the software product of the item to be tested, embodies the test scheme, method, technology and strategy, and the content of the test case comprises a test target, a test environment, input data, test steps, an expected result, a test script and the like, and finally forms a document.
In this embodiment, when a technician tests a product of an item to be tested in advance, the computer device may first construct the item to be tested on a corresponding software testing frame, and then import all test cases of the item to be tested, which are edited in advance, into the software testing frame, and then the computer device may test all the imported test cases as default test cases to be tested. Optionally, the computer device may also select a test case to be tested from all the imported test cases, and then sequentially test the selected test cases.
And S102, calling a test function corresponding to each test case, and acquiring the test file of each test case from the database.
And each test file comprises test data and test logic required by each test case. The test file may be represented in any type of document, such as an excel document, a TXT document, and the like. The test function can be pre-constructed by computer equipment and is used for acquiring the test file corresponding to the test case and completing the test of the test case. The test functions corresponding to the test cases may be the same or different. Moreover, the test function comprises test codes for testing the test case, and when the computer equipment executes the test function, each line of the test codes is executed in sequence, so that the test flow of the test case can be realized.
In this embodiment, the computer device may pre-establish a correspondence between the test case and the test file, and pre-establish a correspondence between the test case and the test function. In practical application, after obtaining a plurality of test cases of a project to be tested, the computer device can obtain the corresponding relationship between the test cases and the test functions from the database, determine the test functions corresponding to each test case of the project to be tested according to the corresponding relationship between the test cases and the test functions, obtain the corresponding relationship between the test cases and the test files from the database, and obtain the test files of each test case according to the corresponding relationship between the test cases and the test files.
S103, if the test file is obtained, testing the test case according to the test file and the corresponding test function to obtain a test result of the test case.
When the computer device obtains the test file of the test case, the computer device can directly import the test data and the test logic in the test file into the test function, automatically adjust the test code in the test function according to the imported test data and the test logic, further automatically generate the test function which can be used for testing, and execute the test function to complete the test of the test case and obtain the test result of the test case. It should be noted that the test file and the test function are separated, and when the test case needs to be modified at a later stage, the user only needs to modify the test file, and then the test function is generated according to the test file, so that an effect of automatically adjusting the test code in the test function can be achieved.
And S104, generating a test report according to the test result of each test case.
The test report comprises at least one of an email version, a reading version and a webpage version. The reading version is also the PDF version. The PDF version of the test report may provide popular and easy-to-understand test results and reasons for test failures, and is suitable for being provided to test personnel, outsiders, and customers for review. The test report of the mail version can provide simple and direct test results, can directly display the part with test failure, enables the tester to directly know the current test condition, and is suitable for being provided for research and development personnel to check. The test result of the webpage version can be displayed in a chart form, and the historical error times and time of the same test case can be recorded through different dimensions, or the test results of different test cases at the same time can be recorded.
In this embodiment, when the computer device tests multiple test cases of the item to be tested and obtains the test result of each test case, the computer device may generate test reports of different versions according to the test result of each test case; optionally, the computer device may also analyze or process each test result, and then generate a test report according to each analyzed or processed test result; optionally, the computer device may further draw a related test chart or test curve according to each test result, and generate a test report according to the test chart or test curve. It should be noted that the computer device may specifically generate a test report of an email version, may also generate a test report of a reading version, and may also generate a test report of a web page version; optionally, the computer device may further generate a plurality of versions of the test report simultaneously, for example, the test report of the mail version and the test report of the reading version are output simultaneously, the test report of the reading version and the test report of the web page version are generated simultaneously, the test report of the mail version, the test report of the reading version and the test report of the web page version are generated simultaneously, and the test report of the mail version, the test report of the reading version and the test report of the web page version are generated simultaneously.
The test method comprises the steps of obtaining a plurality of test cases of a project to be tested, calling a test function corresponding to each test case, obtaining a test file of each test case from a database, testing the test cases according to the test files and the corresponding test functions if the test files are obtained, obtaining test results of the test cases, and generating a test report according to the test results of the test cases. In the test method, because the test function and the test file are separated, when the test data or the test logic needs to be modified in the test process, the computer equipment can directly modify the test file, and then the modified test file is imported into the existing test function, so that the effect of automatically adjusting the test codes in the test function can be achieved, and a user does not need to edit a set of test codes again according to the test data or the test logic which needs to be modified to obtain a new test function, so as to test according to the new test function, thereby greatly improving the test efficiency.
In practical application, items to be tested correspond to a plurality of test cases, some test cases have associated test files, some test cases can be tested through fixed test data and test logic, so that the test cases correspond to fixed test functions, the test functions contain test codes for describing the fixed test data and the test logic, and additional test files do not need to be associated, so that some test cases may not have associated test files, so that when computer equipment calls the test functions corresponding to the test cases to obtain the test files, the test files cannot be obtained, and under the condition, the computer equipment directly executes the test functions corresponding to the test cases to test the test cases to obtain test results of the test cases.
The embodiment also considers the condition that the test case does not need to be modified in the test process, namely, in the test process, the computer equipment directly executes the test function corresponding to the test case to complete the test. Therefore, the application provides an optimal test method for an actual application scenario, that is, on one hand, when a test case of test data or test logic possibly needs to be modified at a later stage, a test file is associated with a test function corresponding to the test case, so that the purpose of improving the test efficiency is achieved by modifying the test file when the test case is modified at the later stage; on the other hand, when a test case without modifying test data or test logic at the later stage is faced, the test function is directly executed for testing, and the test efficiency is further improved.
In an embodiment, an implementation manner of the foregoing S103 is provided, and as shown in fig. 3, the "testing a test case according to a test file and a corresponding test function to obtain a test result of the test case" in the foregoing S103 includes:
s201, reading test data and test logic in the test file.
For example, the excel table type test file shown in fig. 4 includes 3 sub-cases under the power control test case: 1 power off, 2 power on, and 3 power restarts, these 3 sub-cases corresponding to respective test data and test logic. In this embodiment, when the computer device obtains the test file of the test case, the test data and the test logic of each sub-case may be sequentially read from the test file, so that the test case may be tested using the read test data and test logic of each sub-case.
S202, calling a corresponding test function to test the test case based on the test data and the test logic to obtain a test result of the test case.
In this embodiment, when the computer device reads the test data and the test logic of each sub-case from the test file, the computer device may call a test function corresponding to the test file, and transfer the read test data and the read test logic as parameters of the test function to the test function, further adjust a test code in the test function according to the test data and the test logic to obtain the test function that can be used for testing, and finally execute the test function after transferring the parameters, so that the test function can complete testing of each sub-case in the test case according to the test data and the test logic in the test file, and obtain a test result of the test case, where the test result includes a test result for each sub-case, for example, the power control test case includes 3 sub-cases: 1 power-off, 2 power-on, 3 power-on restart, after the test is finished, the test result that can obtain includes: 1 the power is normally turned off, 2 the power is normally turned on, and 3 the power is normally turned on again. It should be noted that the embodiment of fig. 3 only illustrates a test method for a test case of one associated test file, and in practical application, the computer device may use the test method described in S201-S202 to test each test case of the item to be tested, where the associated test file exists, so as to obtain a test result of each test case.
In the test method described in the above embodiment, the test data and the test logic in the test file are transferred to the test function as the function parameters, and the test function for testing the test case can be obtained, so that when the test data or the test logic needs to be modified in the test process, the computer device can directly modify the test file and then directly transfer the modified test file to the test function, and the modification of the test code in the test function can be realized without manually editing and modifying the test code in the source code by the user, and the test efficiency can be improved.
In practical application, a user may also autonomously select a test case to test an item to be tested according to a test requirement, based on which, before the computer device performs the step of S101, as shown in fig. 5, the computer device may further perform the following steps:
s301, displaying a display interface of the test case.
And the display interface comprises a plurality of test case options. The display interface may be embodied as a command line display interface (such as shown in fig. 5A) or a graphical selection interface (such as shown in fig. 5B). In this embodiment, after the computer device imports all the test cases of the pre-edited to-be-tested items into the software testing framework, the computer device can display the display interfaces of all the imported test cases, and display the test cases available for testing to the user, so that the user can select the test cases to be used autonomously according to the testing requirements.
S302, acquiring an input instruction of a user on a display interface.
And the input instruction comprises the identification of the selected test case. A user may input an instruction by checking the option of each test case on the display interface, or may input an instruction by setting a parameter value corresponding to the option of each test case, for example, when the display interface is a command line display interface, the flag bit of the selected test case may be set to 1, which indicates that the selected test case is used for testing (see fig. 5A); when the display interface is a graphical selection interface, a check may be performed in an option box of the selected test case, which indicates that the selected test case is used for testing (see fig. 5B). When the user executes the corresponding selection operation on the display interface, the computer equipment can generate an input instruction according to the identification of each selected test case.
Correspondingly, when the computer device executes the step of S101 in the embodiment of fig. 2, the computer device may specifically execute the steps of: and S1011, determining the test cases corresponding to the identifications of the selected test cases as a plurality of test cases of the items to be tested according to the input command.
In this embodiment, when the computer device obtains an input instruction of a user on the display interface, the identifier of the selected test case can be determined according to the input instruction, so as to determine the test case to be tested at a later stage, so that when the computer device tests each test case, the test flow is selectively executed without executing an unnecessary test flow, thereby further improving the test efficiency and meeting the application requirements of the user.
It should be noted that, when the display interface is a graphical selection interface, the graphical selection interface includes a plurality of options of the test suite (for example, the options of the test suite 1-7 in fig. 5B), and a sub-interface corresponding to each option of the test suite includes a plurality of test case options (for example, the test case options under the 1-Web Dashboard in fig. 5B); if the input instruction includes the selected test suite identifier and the selected test case identifier, then the step S1011 determines the test cases corresponding to the selected test case identifier as a plurality of test cases of the item to be tested according to the input instruction includes: and determining the selected test suite identification and the test case corresponding to the test case identification as a plurality of test cases of the item to be tested according to the selection instruction.
The embodiment provides a function for a user to autonomously select a test case for testing, because in a conventional testing method, when a testing machine calls the test case to test an item to be tested, a test code of each test case is generally executed by default, and the test is completed after the execution is completed, and a function for selecting the test case for testing is not provided for the user, the testing method provided by the application provides a man-machine interaction mode, greatly meets the testing requirements of the user, provides a more humanized graphical selection interface, enables the user to operate more simply and conveniently, and improves the testing experience of the user.
In one embodiment, when the computer device executes step S104 in the embodiment of fig. 2 to generate the test report, the test report of the mail version, the reading version, and the web page version may be output at the same time.
The test report of the read version can be presented in the form shown in fig. 6, for example, the test report includes two test cases (#1 physical disk state change and #2 logical disk raid creation), a case description of each test case, a duration used for testing each test case, and a test result of each test case. The web page version of the test report may be presented in the form shown in fig. 7, and the test report includes the test report after statistically analyzing the test results of all test cases, for example, the abscissa of the graph (a) in fig. 7 represents the accident level: normal, severe, untested, … …, etc., with the ordinate representing the number of test cases tested, and the chart (a) representing the number of test cases corresponding to test results of different accident levels; in fig. 7, the abscissa of the graph (b) represents the tested test case, the ordinate represents the time taken by the tested test case, and the graph (b) represents the time taken by different test cases after being tested; in fig. 7, the abscissa of the graph (c) represents the test case tested every day, the ordinate represents the time consumed by the test case subjected to the test, and the graph (c) represents the time consumed after the test is completed when the test case of the item to be tested is tested every day.
In the embodiment, the test results are displayed to the user by using the test reports of different versions, so that the user can know the reasons of test failure and test success from all dimensions, or can know the test content and the test process of the test case in detail, and technicians can conveniently maintain and adjust the test case in time, thereby reducing the bug occurrence and improving the generation efficiency of the item to be tested.
In practical applications, the computer device may report the test result to the cloud server for big data statistical analysis after completing the test each time, and therefore, after the computer device performs step S103, as shown in fig. 8, the computer device may specifically perform the steps of:
s501, reporting the test result to a cloud server so that the cloud server performs statistical analysis on the test result received in a preset time period to obtain a statistical analysis result.
And S502, receiving the statistical analysis result returned by the cloud server, and displaying the statistical analysis result on a display interface.
The preset time period can be different time periods such as one month, one quarter, one year and the like, and can be determined by the cloud server according to statistical requirements in advance. In this embodiment, after the computer device completes the test each time, the test result may be further reported to the cloud server and stored in a database (for example, Mysql database). After receiving the test result in the preset time period reported by the computer device, the cloud server may further perform statistical analysis and recording on the test result in combination with historical data (e.g., the test result obtained within a half year from the current time), obtain a statistical analysis result, and return the statistical analysis result to the computer device. When the computer equipment receives the statistical analysis result returned by the remote server, the statistical result can be displayed on a display interface for the user to view. For example, fig. 9 shows a display interface including various graphs that can show the trend of the test result.
The embodiment combines the big data to analyze the test results accumulated in the preset time period, and visually displays the test results to the user, so that a technician can know the change condition of the test results in the preset time period in detail based on the statistical analysis results after the big data statistics, and then can accurately grasp the problems occurring in the test process, and is convenient for timely correction, and further the test efficiency is improved.
In an embodiment, the present application further combines two frameworks (a Robot framework and a Python framework), and implements a test on an Openbmc project on the combined framework, so that when the computer device tests the Openbmc project by using the test method described in the foregoing embodiment and executes the step of S101 "obtaining a plurality of test cases of a to-be-tested project", the computer device may specifically execute the steps of: acquiring a plurality of test cases of the Openbmc project on a Robot framework; each test case was pre-constructed using a Python framework.
That is, when a technician tests a product of an Openbmc project in advance, the computer device may first construct the Openbmc project on the Robot framework, and then import all test cases of the Openbmc project edited in advance according to the Python framework language into the Robot framework, and then the computer device may test all the imported test cases as default test cases to be tested. In the embodiment, the two frames are combined, the internal detailed test case is edited by adopting a Python frame language, the Robot frame is adopted for the external management of the test case, the respective advantages of the two frames are fully combined, the defects of complex test, logic disorder of test case compiling and the like caused by development and test only based on the Robot frame are overcome, and the defects of inconvenience in test case management and poor report readability caused by development and test only based on the Python frame are overcome.
Based on the open source framework provided above, the present application further provides a testing method based on the framework-combined nested Jenkins framework, so that when the computer device adopts the testing method described in the foregoing embodiment to test an Openbmc project and executes the step of S101 "obtaining a plurality of test cases of a project to be tested", the method may further specifically execute the steps of: based on the timing function of the Jenkins frame, a plurality of test cases on the Robot frame are obtained according to a preset time period.
The above test method is exemplified: based on the timing function of a Jenkins frame, a preset time period is assumed to be 24 hours, the method specifically comprises the steps of packaging a test code at 18:00 o 'clock every day, detecting the quality of a sonar code, uploading the sonar code to a gitlab for reservation, continuously deploying the sonar code, downloading the test code at 21:00 o' clock every day, deploying the test code to a computer device (testing machine) for testing to obtain a test report tested every day, outputting the test report in different versions, sending the test report to a tester for checking, and automatically uploading a test result of every day to a cloud server for statistical analysis to obtain a statistical analysis result.
According to the embodiment, the Jenkins frame is nested on the Robot frame and the Python frame, a timing test function can be realized, namely, fixed test starting, ending, reporting and releasing time are set, a full-automatic whole set of test flow is realized, because in practical application, a long time is often consumed during testing of a project to be tested, for example, uninterrupted repeated testing in one month or one quarter is needed, corresponding testers are required to manually test at fixed time every day, and a large workload is correspondingly brought to the testers, so that the automatic test function provided by the application greatly reduces the labor cost, meanwhile, errors of test integration and butt joint and handover or fusion easily occur when technicians responsible for different modules perform test integration are avoided, and the project test efficiency is improved.
In summary of all the above embodiments, the present application further provides a testing method, as shown in fig. 10, the method includes:
s601, displaying display interfaces of all test cases of the Openbmc project on a Robot framework, wherein each test case is constructed in advance by using a Python framework.
S602, acquiring an input instruction of a user on a display interface. The input instruction includes an identification of a test case selected by a user.
S603, determining the test cases corresponding to the selected test case identifications as a plurality of test cases of the items to be tested according to the input instruction.
S604, calling a test function corresponding to each test case, acquiring a test file of each test case from the database, and executing the step S605 if the test file is acquired; if the test file is not acquired, step S607 is executed.
And S605, reading the test data and the test logic in each test file.
S606, calling the corresponding test function to test the test case based on the test data and the test logic to obtain the test result of the test case.
And S607, executing the test function corresponding to the test case to test the test case to obtain the test result of the test case.
And S608, generating a test report according to the test result of each test case.
And S609, reporting the test result to the cloud server so that the cloud server performs statistical analysis on the test result received in the preset time period to obtain a statistical analysis result.
And S610, receiving the statistical analysis result returned by the cloud server, and displaying the statistical analysis result on a display interface.
For the description of each step in the above embodiments, refer to the foregoing contents, which are not repeated herein.
The embodiment provides a new testing framework, namely a combination framework of a Robot framework, a Python framework and a Jenkins framework, the new testing framework is used for realizing automatic integration and continuous integration processing of the whole process of testing, issuing, reporting and the like of an Openbmc project, compared with the existing testing method for realizing continuous integration, technicians in all links must integrate testing methods of respective modules together, a large amount of human intervention is involved, and the efficiency of continuous integration is extremely low. The method can overcome the problems and realize one-key integration, processes such as automatic testing, automatic report outputting, automatic test result issuing and the like are carried out without much human intervention, repeated test flow measurement can be carried out regularly every day, manual supervision and manual operation are not needed, and therefore the generation efficiency of the Openbmc project is greatly improved.
It should be understood that although the various steps in the flow charts of fig. 2-10 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 2-10 may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed in turn or alternately with other steps or at least some of the other steps.
In one embodiment, as shown in fig. 11, there is provided a test apparatus including:
the acquisition module 11 is configured to acquire a plurality of test cases of a project to be tested;
a calling module 12, configured to call a test function corresponding to each test case;
the test module 13 is configured to test the test case according to the test file and a corresponding test function under the condition that the test file is obtained, so as to obtain a test result of the test case;
and the generating module 14 is configured to generate a test report according to the test result of each test case.
In one embodiment, the test module 12, as shown in fig. 12, includes:
a reading unit 121, configured to read test data and test logic in the test file;
and the test unit 122 is configured to call the corresponding test function to test the test case based on the test data and the test logic, so as to obtain a test result of the test case.
In one embodiment, as shown in fig. 13, the testing apparatus further includes:
the display module 15 is used for displaying a display interface of the test case; the display interface comprises a plurality of options of the test cases;
the instruction acquisition module 16 is used for acquiring an input instruction of a user on the display interface; the input instruction comprises an identifier of the selected test case;
correspondingly, the obtaining module 11 is specifically configured to determine, according to the input instruction, the test cases corresponding to the identifiers of the selected test cases as multiple test cases of the items to be tested.
In one embodiment, if the display interface comprises a graphical selection interface; the graphical selection interface comprises a plurality of options of test kits, and a sub-interface corresponding to the option of each test kit comprises a plurality of test case options; the input instruction comprises a selected test suite identifier and a selected test case identifier;
the obtaining module 11 is specifically configured to determine, according to the selection instruction, the test cases corresponding to the selected test suite identifier and the test case identifier as all test cases of the item to be tested.
In one embodiment, the test report includes at least one of an email version, a reading version, and a web page version.
In one embodiment, as shown in fig. 14, the testing apparatus further includes:
the reporting module 17 is configured to report the test result to a cloud server, so that the cloud server performs statistical analysis on the test result received within a preset time period to obtain a statistical analysis result;
and the display module 18 is configured to receive the statistical analysis result returned by the cloud server, and display the statistical analysis result on a display interface.
In one embodiment, the to-be-tested project is an Openbmc software development project, and the corresponding obtaining module 11 is specifically configured to obtain a plurality of test cases of the Openbmc software development project on a Robot framework; each of the test cases was pre-constructed using a Python framework.
In an embodiment, the obtaining module 11 is specifically configured to obtain, based on a timing function of a Jenkins frame, a plurality of test cases on the Robot frame according to a preset time period.
In an embodiment, the test module 13 is further configured to execute a test function corresponding to the test case to test the test case to obtain a test result of the test case when the test file is not obtained.
For the specific definition of the testing device, reference may be made to the above definition of the testing method, which is not described herein again. The modules in the testing device can be wholly or partially implemented by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, a computer device is provided, comprising a memory and a processor, the memory having a computer program stored therein, the processor implementing the following steps when executing the computer program:
acquiring a plurality of test cases of a project to be tested;
calling a test function corresponding to each test case, and acquiring a test file of each test case from a database; each test file comprises test data and test logic required by each test case;
if the test file is obtained, testing the test case according to the test file and a corresponding test function to obtain a test result of the test case;
and generating a test report according to the test result of each test case.
The implementation principle and technical effect of the computer device provided by the above embodiment are similar to those of the above method embodiment, and are not described herein again.
In one embodiment, a computer-readable storage medium is provided, having a computer program stored thereon, which when executed by a processor, performs the steps of:
acquiring a plurality of test cases of a project to be tested;
calling a test function corresponding to each test case, and acquiring a test file of each test case from a database; each test file comprises test data and test logic required by each test case;
if the test file is obtained, testing the test case according to the test file and a corresponding test function to obtain a test result of the test case;
and generating a test report according to the test result of each test case.
The implementation principle and technical effect of the computer-readable storage medium provided by the above embodiments are similar to those of the above method embodiments, and are not described herein again.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database or other medium used in the embodiments provided herein can include at least one of non-volatile and volatile memory. Non-volatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical storage, or the like. Volatile Memory can include Random Access Memory (RAM) or external cache Memory. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), among others.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110468343.0A CN113190443A (en) | 2021-04-28 | 2021-04-28 | Test method, test device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110468343.0A CN113190443A (en) | 2021-04-28 | 2021-04-28 | Test method, test device, computer equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113190443A true CN113190443A (en) | 2021-07-30 |
Family
ID=76980080
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110468343.0A Pending CN113190443A (en) | 2021-04-28 | 2021-04-28 | Test method, test device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113190443A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113590491A (en) * | 2021-08-06 | 2021-11-02 | 深圳市共进电子股份有限公司 | Test platform and product test method |
| CN113886257A (en) * | 2021-10-18 | 2022-01-04 | 斑马网络技术有限公司 | Multimedia framework test method, device, equipment and storage medium |
| CN114003444A (en) * | 2021-09-29 | 2022-02-01 | 浪潮电子信息产业股份有限公司 | A PC audio testing method, device, equipment and medium |
| CN114265822A (en) * | 2021-12-16 | 2022-04-01 | 凌云光技术股份有限公司 | Detection program synchronization method and system for multiple detection devices |
| CN114564385A (en) * | 2022-01-28 | 2022-05-31 | 苏州浪潮智能科技有限公司 | Software testing method and device, computer equipment and storage medium |
| CN114968823A (en) * | 2022-07-27 | 2022-08-30 | 国能日新科技股份有限公司 | Automatic testing method, device, equipment and storage medium |
| CN115766541A (en) * | 2022-11-15 | 2023-03-07 | 合众新能源汽车有限公司 | Device testing method, device, computer equipment and storage medium |
| CN117094302A (en) * | 2023-08-04 | 2023-11-21 | 广州赛意信息科技股份有限公司 | Automatic processing method, device and storage medium based on ChatGPT |
| CN117093497A (en) * | 2023-09-11 | 2023-11-21 | 苏州云体科技有限公司 | Test report processing method and device, electronic equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105630685A (en) * | 2016-01-29 | 2016-06-01 | 广州酷狗计算机科技有限公司 | Method and device for testing program interface |
| WO2019218444A1 (en) * | 2018-05-14 | 2019-11-21 | 平安科技（深圳）有限公司 | Test report generating method, apparatus and device, and storage medium |
| CN112286779A (en) * | 2019-07-23 | 2021-01-29 | 腾讯科技（深圳）有限公司 | Test task processing method, device, storage medium and computer equipment |
| CN112699055A (en) * | 2021-01-19 | 2021-04-23 | 航天恒星科技有限公司 | Software automation test method and system with low maintenance cost |
-
2021
- 2021-04-28 CN CN202110468343.0A patent/CN113190443A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105630685A (en) * | 2016-01-29 | 2016-06-01 | 广州酷狗计算机科技有限公司 | Method and device for testing program interface |
| WO2019218444A1 (en) * | 2018-05-14 | 2019-11-21 | 平安科技（深圳）有限公司 | Test report generating method, apparatus and device, and storage medium |
| CN112286779A (en) * | 2019-07-23 | 2021-01-29 | 腾讯科技（深圳）有限公司 | Test task processing method, device, storage medium and computer equipment |
| CN112699055A (en) * | 2021-01-19 | 2021-04-23 | 航天恒星科技有限公司 | Software automation test method and system with low maintenance cost |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113590491A (en) * | 2021-08-06 | 2021-11-02 | 深圳市共进电子股份有限公司 | Test platform and product test method |
| CN113590491B (en) * | 2021-08-06 | 2024-03-29 | 深圳市共进电子股份有限公司 | Test platform and product test method |
| CN114003444A (en) * | 2021-09-29 | 2022-02-01 | 浪潮电子信息产业股份有限公司 | A PC audio testing method, device, equipment and medium |
| CN113886257A (en) * | 2021-10-18 | 2022-01-04 | 斑马网络技术有限公司 | Multimedia framework test method, device, equipment and storage medium |
| CN114265822A (en) * | 2021-12-16 | 2022-04-01 | 凌云光技术股份有限公司 | Detection program synchronization method and system for multiple detection devices |
| CN114564385A (en) * | 2022-01-28 | 2022-05-31 | 苏州浪潮智能科技有限公司 | Software testing method and device, computer equipment and storage medium |
| CN114968823A (en) * | 2022-07-27 | 2022-08-30 | 国能日新科技股份有限公司 | Automatic testing method, device, equipment and storage medium |
| CN115766541A (en) * | 2022-11-15 | 2023-03-07 | 合众新能源汽车有限公司 | Device testing method, device, computer equipment and storage medium |
| CN115766541B (en) * | 2022-11-15 | 2024-05-07 | 合众新能源汽车股份有限公司 | Device testing method, device, computer equipment and storage medium |
| CN117094302A (en) * | 2023-08-04 | 2023-11-21 | 广州赛意信息科技股份有限公司 | Automatic processing method, device and storage medium based on ChatGPT |
| CN117093497A (en) * | 2023-09-11 | 2023-11-21 | 苏州云体科技有限公司 | Test report processing method and device, electronic equipment and storage medium |
| CN117093497B (en) * | 2023-09-11 | 2024-05-07 | 苏州云体科技有限公司 | Test report processing method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113190443A (en) | Test method, test device, computer equipment and storage medium | |
| CN110851356B (en) | Selenium-based Web application automatic test framework and construction method and system thereof | |
| CN109302522B (en) | Test method, test device, computer system, and computer medium | |
| CN103365770B (en) | Mobile terminal software test macro and method for testing software | |
| US8356282B1 (en) | Integrated development environment for the development of electronic signal testing strategies | |
| JP2010231782A (en) | Method and system for function automation | |
| CN107977308A (en) | interface test method and device | |
| CN110764998A (en) | Data comparison method, device and equipment based on Django framework and storage medium | |
| CN109460367A (en) | Method based on the sustainable integrated automation performance test of Jmeter | |
| CN105486998A (en) | Processor board card parameter lossless automatic test method and monitoring host device | |
| US9507692B2 (en) | Downward propagation of results for test cases in application testing | |
| CN113392002A (en) | Test system construction method, device, equipment and storage medium | |
| CN113094251B (en) | Method and device for testing embedded system, computer equipment and storage medium | |
| CN114915643B (en) | Configuration method, device, equipment and medium of railway signal centralized monitoring system | |
| CN117348848A (en) | Operator development and processing method and device, electronic equipment, system and storage medium | |
| CN110737985A (en) | Running data verification method and device, computer equipment and readable storage medium | |
| CN107451056B (en) | Method and device for monitoring interface test result | |
| CN113742228A (en) | Test, data playback and recording method, system, device, equipment and medium | |
| CN110633213B (en) | Unit test method, unit test device, computer equipment and storage medium | |
| KR20190084827A (en) | Method for automatic test of program compatibility and apparatus using the same | |
| US8773527B2 (en) | System and method for capturing debug information using a peripheral device | |
| CN105653445A (en) | Implementation method capable of meeting DO-178C test result | |
| CN110750452B (en) | Automatic test method and device | |
| US20220058018A1 (en) | Automatically generating continuous integration pipelines | |
| CN113535560A (en) | Test execution method and device, storage medium and computing equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |