KR101039874B1 - Information Communication Integrated Platform Test System - Google Patents

Abstract

The present invention obtains data by dividing the test history manually performed on the individual input media of the information communication integration platform into input data, output data, method, and performance sql information, and stores the data by integrating and storing the data. ICT integrated platform test system for automatically reproducing a test based on one data and analyzing the size of the software in the form of a function point (FP),
The test is provided by receiving information collected from the information collecting unit 100 and the information collecting unit 100 and collecting information from the information collecting unit 100 to test the information communication integrated platform 200 to the test master server 400. Information communication unit 300 and the information consumption unit 300 for consuming the information provided from the information communication integrated platform 200 to the master server 400 to perform the test of the information communication integrated platform 200. ICT integrated platform test system having a
The information communication integrated platform 200,
A socket agent 210 for acquiring data and internal call relation information according to communication with the information collecting unit 100;
An Http agent 220 for acquiring data and internal call relation information according to communication with the information consuming unit 300;
A collection information queue 230 for collecting information obtained by the socket agent 210 and the Http agent 220; And
A master association module 240 for transmitting the information provided from the collection information queue 230 to the test master server 400;
Including,
The test master server 400,
An agent linkage module 410 for storing test information received from the master linkage module 240 in a test information store 412;
A test scenario generation module 420 for generating a test unit by grouping a plurality of test information;
A test reproduction module 430 for reproducing a test scenario;
A script generation module 440 for free reproduction;
A load generation module 450 for generating a load using a script;
Security vulnerability analysis module 460 for analyzing the security vulnerability through the test reproduction;
An FP analysis module 470 for calculating a size through a transaction name and a method name and sql called during a test;
A regression test module 480 for collectively executing the stored test scenarios;
A test information store 412 storing data of a test system; And
An analysis service unit 414 which provides test performance and result analysis information;
Characterized in that it comprises a.
As such, the present invention can collectively perform a test of the entire medium based on previously performed test information without generating individual test data of the input / output medium associated with the information communication integrated platform 200. The efficiency of unit tests, integration tests, regression tests, and load tests can be improved.

Description

System for Integration Platform of Information Communication

The present invention relates to an ICT Integration Platform test system, and more particularly, to input data, output data, method, and performing test details manually performed on individual input media of the ICT Integration Platform. Data communication integrated platform test system for acquiring data, integrating and storing it by sql information, and automatically reproducing and analyzing the test based on the stored data.

In general, the information and communication integration platform collects information from various input media such as Radio Frequency Identification (RFID), Ubiquitous Sensor Network (USN), and intelligent transport system (ITS), and integrates output control such as integrated control, medical, security, and security. It is the base system to use for the purpose.

However, in such a conventional information and communication integration platform, in order to perform a test reflecting the diversity of output terminals according to various input media and types of information consumption, each of the input media and output terminals can be individually tested so that a test can be performed. It is very difficult to perform the regression test and load test from the integrated point of view that connect the entire input / output media because the test should be performed by using the corresponding media or directly. There was a hassle to manually analyze the source to see if it was equal to the Function Point.

The present invention has been made to solve the above-mentioned problems, and the test history manually performed on the individual input medium of the information communication integrated platform is divided into input data, output data, method, and performance sql information. To provide an information and communication integrated platform test method and system for acquiring data, integrating and storing it, and automatically reproducing the test based on the stored data and measuring the function point based on the test result. There is this.

In order to achieve this object,

According to one embodiment of the present invention,

The test is provided by receiving information collected from the information collecting unit 100 and the information collecting unit 100 and collecting information from the information collecting unit 100 to test the information communication integrated platform 200 to the test master server 400. Information communication unit 300 and the information consumption unit 300 for consuming the information provided from the information communication integrated platform 200 to the master server 400 to perform the test of the information communication integrated platform 200. ICT integrated platform test system having a

The information communication integrated platform 200,

A socket agent 210 for acquiring data and internal call relation information according to communication with the information collecting unit 100;

An Http agent 220 for acquiring data and internal call relation information according to communication with the information consuming unit 300;

A collection information queue 230 for collecting information obtained by the socket agent 210 and the Http agent 220; And

A master association module 240 for transmitting the information provided from the collection information queue 230 to the test master server 400;

Including,

The test master server 400,

An agent linkage module 410 for storing test information received from the master linkage module 240 in a test information store 412;

A test scenario generation module 420 for generating a test unit by grouping a plurality of test information;

A test reproduction module 430 for reproducing a test scenario;

A script generation module 440 for free reproduction;

A load generation module 450 for generating a load using a script;

Security vulnerability analysis module 460 for analyzing the security vulnerability through the test reproduction;

An FP analysis module 470 for calculating a size through a transaction name and a method name and sql called during a test;

A regression test module 480 for collectively executing the stored test scenarios;

A test information store 412 storing data of a test system; And

An analysis service unit 414 which provides test performance and result analysis information;

Characterized in that it comprises a.

The test scenario generation module 420 selects a plurality of test details using the information received from the linkage module 410 and generates one test scenario.

The security vulnerability analysis module 460 substitutes test data for analyzing a security vulnerability in input data based on the collected information, transmits the test data to a test target system, and analyzes the output data received as a result of the security vulnerability. It is characterized by checking that.

The FP analysis module 470 uses the transaction name, internal method name, and sql and sql performance result information based on the information obtained during the test and the naming rule generated to ensure consistency when building the integrated platform. The EI, EQ, EO, DET, and RET of the FP can be extracted to determine whether the scale is reasonable.

The test master server 400 is characterized by enabling the test progress management automatically by querying the number of test success / failure for each program based on the information obtained when the test is performed by date.

According to the present invention, even if a person in charge does not perform a manual test, the test information stored in the input / output medium associated with the ICT integrated platform 200 can be stored in a batch to perform the test of the entire medium. The efficiency of the unit test, the integrated test, the regression test, and the load test of 200) is improved.

In addition, input data to check for security vulnerabilities is defined in advance, transmitted to the system under test, and output data is received to analyze whether there is a security vulnerability. By identifying, you can analyze the scale of the build system based on the test results.

1 is a block diagram showing an embodiment of an information communication integrated platform test system according to the present invention.
2 is a view showing the operation of the information communication integrated platform test system shown in FIG.
3A is a diagram illustrating a communication protocol between the information communication integrated platform 200 and the test master server 400 shown in FIG. 1.
FIG. 3B is a diagram illustrating a delimiter of communication data according to FIG. 3A. FIG.
3C is a diagram illustrating an example of communication data according to FIG. 3A.
FIG. 4 is a block diagram showing that the agents 210 and 220 in the information communication integrated platform 200 shown in FIG. 1 acquire I / O data of socket communication and Http communication.
FIG. 5 is a diagram illustrating an embodiment in which agents 210 and 220 in the ICT integrated platform 200 shown in FIG. 1 collect service names, method names, and execution sql.
6 is a diagram illustrating a step-by-step process of storing data received by the agent linkage module 410 of the test master server 400 illustrated in FIG. 1 in the test information store 412.
FIG. 7A is a view showing the entire test performance screen, inquiring a transaction name, IP, source, test scenario, project / time, result, start date and time.
FIG. 7B is a test information detail screen showing a query relationship between methods, execution time per method (ms), and sql and bind variable values called by methods.
FIG. 7C is an input / output data inquiry screen, which shows input data of a tested program and displays output data in a screen form.
FIG. 7D is a diagram illustrating a screen for automatically generating test progress management information as test statistics information.
8A is a diagram illustrating an embodiment of generating a test scenario by selecting a scenario generation target on a test execution history screen.
8B is a screen illustrating a plurality of scenario generation targets selected on a test execution history screen.
8C is a diagram illustrating a management screen for registering a test scenario.
8D illustrates a screen for inquiring test scenarios in a list form.
9A is a diagram illustrating an example of automatically selecting and reproducing a test scenario.
9B is a diagram illustrating a screen for selecting a test scenario to be reproduced.
9C is a diagram illustrating a result screen of reproducing a test scenario.
10A is a diagram illustrating an embodiment of generating a script by selecting a plurality of script generation targets on a test execution history screen.
10B is a diagram illustrating a test execution history screen in which a plurality of script generation targets are selected.
10C is a diagram illustrating a screen showing a script generation result.
10D is a diagram illustrating a screen displaying a script template.
11 is a diagram illustrating an embodiment of generating a load by selecting a plurality of scripts.
12 is a diagram illustrating an embodiment of analyzing a security vulnerability after testing by processing test input data.
FIG. 13 is a diagram illustrating an embodiment of identifying a measurement item of FP, which is a software scaling technique, by analyzing transaction name, method name, and sql based on test information.
14A is a diagram illustrating a regression test performed by collectively executing stored test scenarios.
14B is a diagram illustrating a management screen for setting a regression test start time.
14C is a diagram illustrating a screen displaying regression test result summary information.
14D is a diagram illustrating a screen displaying detailed information of a regression test result.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram showing an embodiment of the information communication integrated platform test system according to the present invention, the information collecting unit 100, the information communication integrated platform 200, the information consuming unit 300, the test master server 400 , And the test performer 500.

In FIG. 1, the information collecting unit 100 refers to various input media, and the information consuming unit 300 represents a type of using information of the information communication integrated platform 200.

An agent for acquiring test information without modifying a source is installed in the information communication integration platform 200. The agent includes a socket agent 210 for acquiring TCP / IP input / output data and an Http agent for acquiring Http input / output information ( 220). The information obtained by the agents 210 and 220 is stored in the collection information queue 230, which is an internal data structure, which is periodically polled by the master association module 240 and transmitted to the test master server 400.

In the test master server 400, there is an agent linkage module 410 for storing the received test information in the test information store 412. The test scenario generation module 420 generates a test unit by grouping a plurality of test information. , A test reproducing module 430 for reproducing the test scenario, a script generation module 440 for free reproducing, a load generation module 450 for generating a load using a script, and a security vulnerability for analyzing a security vulnerability through test reproducing Analysis module 460, FP analysis module 470 for calculating the transaction name and method name and sql, which are called during the test, regression test module 480 for collectively executing the stored test scenarios, and storing the data of the test system. Test information storage 412, the analysis service unit 414 that provides test performance and analysis results.

FIG. 2 is a diagram illustrating an operation of the information communication integrated platform test system shown in FIG. 1. First, the information collecting unit 100 provides information to the information communication integration platform 200 using the TCP / IP protocol.

The information communication integration platform 200 transmits test information to the test master server 400 using the HTTP protocol.

The information communication integration platform 200 transmits the information to the information consuming unit 300 using the HTTP protocol.

The test master server 400 provides an analysis service to the test execution team 500 using the HTTP protocol.

FIG. 3A is a diagram illustrating a communication protocol between the information communication integrated platform 200 and the test master server 400 shown in FIG. 1. The major categories include a request type, a test information summary, a test information detail, and input / output data items. It consists of 23 items including transaction name, client information, thread id, total start date, total end date, database connection information, SQL execution information, and total execution time.

3B is a diagram illustrating the delimiter of the communication data according to FIG. 3A. Communication data according to the communication protocol between the information communication integrated platform 200 and the test master server 400 is divided by the delimiter. · 'And repeating items are separated by' | 'and the lowest item is separated by' ^ '.

FIG. 3C is a diagram illustrating an example of communication data according to FIG. 3A. The actual communication data is in the form of a byte stream in which a value of the corresponding item is filled in a line.

FIG. 4 is a block diagram showing that the agents 210 and 220 in the ICT integrated platform 200 obtain input / output data of socket communication and Http communication, and a physical class file is stored in a memory. At the time of loading, using the BCI (Byte Code Instrument) technique, the socket agent 210 and the Http agent 220 dynamically insert a code for obtaining input / output data for each communication protocol and collect the obtained input / output data in the collection information queue 230. To provide.

FIG. 5 is a diagram illustrating an embodiment in which agents 210 and 220 in the information communication integration platform 200 shown in FIG. 1 collect service names, method names, and execution sql. To obtain the monitoring information, push it to the method information storage socket of the transaction unit, and update the change information by popping the information stored at the start point to reflect the exit information obtained at the end of the method. Push

When the transaction is completed, the data existing in the method information storage stack is collectively popped, and the test information of the transaction unit is collectively sorted into a series of string information and provided to the collection information queue 230.

The master association module 240 periodically extracts data existing in the collection information queue 230 and transmits the data to the agent association module 410 of the test master server 400.

FIG. 6 is a diagram illustrating a step-by-step process of storing data received by the agent linkage module 410 of the test master server 400 illustrated in FIG. 1 in the test information store 412. The information communication integrated platform 200 is illustrated in FIG. The agent linkage module 410 of the test master server 400 receives the test information transmitted from the master linkage module 240 of the test master server 400 and checks the validity of the input data. The parser is parsed based on the separator as shown in FIG. 3B and stored in the test information store 412.

The test information store 412 generally refers to a database and uses an embedded database form for test automation.

FIG. 7A is a view showing the entire test performance screen, which shows the transaction name, IP, source, test scenario, scenario, project / time, result, start date, execution time, and database connection connection count. If the number of statement open that is larger or means to execute SQL is greater than the number of statement close, it means that the database resource leak occurs.

FIG. 7B is a test information detail screen. It is a view showing query relationships between methods, execution time for each method (ms), and sql and bind variable values called by the method. The method with long execution time is identified through the screen. It can be used for bottleneck analysis and can provide information to identify and tune the delayed sql by analyzing the execution time of the sql. If the number of open DB is greater than the number of database closes or the number of SQL open is greater than the number of SQL closes, it means that a database resource leak occurs.

FIG. 7C is an input / output data inquiry screen, which shows input data of a tested program and displays output data in a screen form. Input data represents HTTP and TCP request data, and output data is TCP / IP. It is displayed in full form and in the case of HTTP.

FIG. 7D is a view illustrating a screen for automatically generating test progress management information as test statistics information. In general, test progress management uses a method in which developers, testers, and administrators manually test and register a test management system. In the present invention, when the test is performed, the test progress information can be checked by automatically counting in real time.

FIG. 8A is a diagram illustrating an embodiment of generating a test scenario by selecting a test scenario generation target on a test execution history screen, and selecting a plurality of test targets simply by clicking on the basis of the previously performed test information to perform a logical test scenario Create basic information to be reproduced in test scenario unit by grouping.

FIG. 8B is a screen illustrating a plurality of test scenario targets selected from a test execution history, and selects targets to be grouped by test scenario units among test transactions.

8C is a diagram illustrating a test scenario management screen for registering a test scenario. The test scenario ID, a test scenario name, and whether to automatically log in a test scenario are input.

If you set auto login to Y, log in before executing the scenario. If set to N, the first transaction of the scenario is logged in.

FIG. 8D illustrates a screen for inquiring the generated test scenarios in a list form. When the test scenario ID, the test scenario name, and the business system are included as basic information, and the test scenario ID is clicked, FIG.

FIG. 9A is a diagram illustrating an exemplary embodiment in which a test scenario is automatically reproduced by selecting a test scenario. When the test scenario is reproduced on the test scenario screen, the test scenario information of the test information store is extracted to identify input data, target ip, and port information. The test result information is transmitted to the test target system and the result message is received to analyze the success / failure and store the test result information in the test information store 412.

9B is a diagram illustrating a screen for selecting a test scenario to be reproduced. When a mouse is placed on a link of a test scenario name on a test scenario reproducing screen, a message of reproducing a test scenario is displayed and a corresponding scenario is reproduced.

FIG. 9C is a diagram illustrating a result screen of reproducing a test scenario, and displays a calling order, a transaction name, a test result success / failure, a start time, an end time, input data, and an output screen.

FIG. 10A illustrates an embodiment of generating a script by selecting a plurality of script generation targets from a test information summary screen. A script template for each type is created and stored in order to generate various test information data as a script. In the test information summary screen, select a target to generate a script and click the script generation button to extract the input data of the test information repository 412 in order to use the test information of the script generation target, ip, port, input from the extracted input data. By identifying information such as data and performing a reflecting operation to replace @ * @ items described in the script template, the generated script is stored in the test information store 412.

10B is a diagram illustrating a test information summary screen in which a plurality of script generation targets are selected. When a plurality of test information is selected and a script generation button is clicked on, a script is generated.

10c is a diagram showing a screen showing a result of generating a script. The script is generated in the form of a Java source, which can be compiled and reproduced by a developer tool, and the compiled class is uploaded to a server and registered as a SCRIPT type of a test scenario on the server. Can be reproduced.

FIG. 10D illustrates a screen on which a script template is displayed. The script template may be created and managed for each type of input medium. A portion enclosed by @, such as @ * @, is an area for identifying a corresponding item in input data and parsing it with a script.

FIG. 11 is a diagram illustrating an embodiment of generating a load by selecting a plurality of scripts. An embodiment of reproducing a test scenario and a related screen are presented through FIG. 9, and an embodiment of generating a test scenario as a script in FIG. 10. Presented.

In the drawing, an embodiment of simultaneously reproducing a plurality of scripts generated by applying the same will be described. Compiles a plurality of scripts existing in the repository and creates them as classes, and creates a plurality of threads to execute the compiled script classes for each thread, causing a load on the test target system. The result of the load for each thread is received and stored in the test information store 412. Test Results Using the load generation result stored in the test information store 412, it is possible to verify the system performance by analyzing the TPS (Transaction Per Second), the average response time for each transaction.

12 is a diagram illustrating an embodiment of analyzing a security vulnerability after testing by processing test input data, and a principle is a method of checking whether a security vulnerability exists by analyzing a result of specific input data.

For example, in the case of sql injection security vulnerability, if you input admin '-in the login account input box, and the output data includes the login success screen, a security vulnerability exists and the cross site script security vulnerability is a frequently used search form variable name searchkeyword. If you enter <script> alert (document.cookie); </ script> as the value, a security vulnerability exists when the output data contains the same syntax.

Using this principle, the input data extracted from the test information store 412 (12-2) and the security vulnerability check input data of the test information store 412 (12-5) are extracted from the input data extracted from 12-2. The value of the specific parameter is changed to the security vulnerability identification value extracted in 12-5 (12-4), transmitted to the test target system, the output data is analyzed, and the security vulnerability check result is stored in the test information store 412.

FIG. 13 is a diagram illustrating an embodiment of identifying measurement items of FP, which is a software scaling technique, by analyzing transaction names, method names, and sql based on test information. In order to measure FP, EI, EO, EQ, DET, The RET is identified and the score is calculated based on the number of items.

In case of measuring FP manually, ILF, EIF is identified by analyzing sequence diagram and method name based on naming rule, and DET, RET is identified by analyzing ERD, and EI, EO, EQ is analyzed by analyzing transaction name. Identifies

The present invention proposes an embodiment of analyzing the test performance history and automatically measuring the FP based on the naming rule by applying this.

For example, if the trading name starts with 'retrieve', it means EQ, which is a simple query, and if it starts with 'regist', it means EI, which is an input type, and if it starts with 'calculate', it means EO, which is a calculation query. . In addition, DET and RET can be identified by analyzing SQL and column and table and join conditions.

The test information repository 412 extracts test details including transaction names, method names, and sql, and compares them with FP naming mapping information to perform FP analysis to store the results in the test information repository 412. The quantitative scale of can be estimated from the test results.

FIG. 14A is a diagram illustrating a regression test performed by collectively executing stored test scenarios. When a regression test start time is registered in the test information store 412, a job program registered in the job scheduler periodically checks the regression time. When the test execution time arrives, the test information store 412 extracts the regression test list and executes the test reproduction module. The test reproduction transmits the full text to the test target system, receives the test result output data, and stores the test result output data in the test information storage 412.

14B is a diagram illustrating a management screen for setting a regression test start time, which is described as 'hhmm' and is set to perform regression tests several times a day with; as a separator.

14C is a diagram showing a screen for displaying summary information of regression test results. The total scenarios for each regression test cycle, the number of success / failure scenarios are displayed, and the regression test start / end time and the total execution time are described.

Regression test If you click on the link, you can go to the regression test result detail screen.

FIG. 14D is a diagram illustrating a screen displaying detailed information of a regression test result. The test scenario ID, test sequence number, transaction name, success / failure, start time, end time, and execution time of each transaction can be checked.

In the present invention as described above, even if the person in charge does not individually test the input / output medium associated with the information communication integrated platform 200, the test of the entire medium can be collectively reproduced based on the previously performed test information. There is an advantage to improve the efficiency of the unit test, integration test, regression test, and load test of the integrated platform 200.

In addition, input data to check for security vulnerabilities is defined in advance, transmitted to the system under test, and output data is received to analyze whether there is a security vulnerability. By identifying, you can analyze the scale of the build system based on the test results.

Although the preferred embodiments of the present invention have been disclosed for illustrative purposes, those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the scope and spirit of the invention as disclosed in the accompanying claims. In addition, it is obvious that any person skilled in the art can make various modifications and imitations without departing from the scope of the technical idea of the present invention.

100: information collector
200: ICT integrated platform
300: information consumer
400: test master server
500: responsible for testing

Claims (5)

The test is provided by receiving information collected from the information collecting unit 100 and the information collecting unit 100 and collecting information from the information collecting unit 100 to test the information communication integrated platform 200 to the test master server 400. Information communication unit 300 and the information consumption unit 300 for consuming the information provided from the information communication integrated platform 200 to the master server 400 to perform the test of the information communication integrated platform 200. ICT integrated platform test system having a
The information communication integrated platform 200,
A socket agent 210 for acquiring data and internal call relation information according to communication with the information collecting unit 100;
An Http agent 220 for acquiring data and internal call relation information according to communication with the information consuming unit 300;
A collection information queue 230 for collecting information obtained by the socket agent 210 and the Http agent 220; And
A master association module 240 for transmitting the information provided from the collection information queue 230 to the test master server 400;
Including,

The test master server 400,
An agent linkage module 410 for storing test information received from the master linkage module 240 in a test information store 412;
A test scenario generation module 420 for generating a test unit by grouping a plurality of test information;
A test reproduction module 430 for reproducing a test scenario;
A script generation module 440 for free reproduction;
A load generation module 450 for generating a load using a script;
Security vulnerability analysis module 460 for analyzing the security vulnerability through the test reproduction;
An FP analysis module 470 for calculating a size through a transaction name and a method name and sql called during a test;
A regression test module 480 for collectively executing the stored test scenarios;
A test information store 412 storing data of a test system; And
An analysis service unit 414 which provides test performance and result analysis information;
ICT integrated platform test system comprising a.
The method according to claim 1,
The test scenario generation module (420) is an information communication integrated platform test system, characterized in that for generating a single test scenario by selecting a plurality of test details using the test history information received from the linkage module (410).
The method according to claim 1,
The security vulnerability analysis module 460 inserts test data for analyzing a security vulnerability into input data based on the collected test history information, transmits the test data to a test target system, and analyzes the output data received as a result. ICT integrated platform test system, characterized in that the presence.
The method according to claim 1,
The FP analysis module 470 uses the transaction name, internal method name and sql and sql execution result information based on the information obtained during the test and the naming rules generated to ensure consistency when the integrated platform is built, and the EI of the FP. ICT integrated platform test system, characterized in that it is possible to check whether the estimated scale by extracting the EQ, EO, DET, RET.
The method according to claim 1,
The test master server 400 is an information communication integrated platform test system, characterized in that to automatically test progress management by querying the number of test success / failure for each program based on the information obtained when performing the test.

Images