CN111162930B - Delayed response control method - Google Patents

Abstract

The invention provides a delay response control method, which comprises the following steps: configuring an application service IP and a port; crawling a module and a url in the application service by a crawler according to the IP and the port configured in the step 1; crawling a module and url in the application service according to the step 2 to obtain a crawler result; filtering the crawling result obtained in the step 3, removing the crawler result with the access type as the request, and obtaining a response request; generating a response time threshold T of the response request according to the response request and the crawling time acquired in the step 4: setting a response rule according to the response time threshold T obtained in the step 5 to obtain response floating time; and 6, obtaining page indexes according to the response rule and the response floating time obtained in the step 6: and performing response control according to the response time threshold T, the response floating time and the page index. The invention configures reasonable delay response time for abnormal or failed requests without influencing user experience.

Description

Delayed Response Control Method

technical field

The invention relates to a network technology, in particular to a delayed response control method.

Background technique

The Internet brings convenience to people's lives, and at the same time, some application services that bring convenience to people are especially deployed on the network, or due to some special needs or constant requests from some attackers, the application cannot be used normally by users. Provide services. For example, there are many crawlers on the Internet that are constantly grabbing data or accessing website URLs abnormally, causing network congestion and affecting normal use. Such as data theft, especially a large number of requests to download large files; such as brute force cracking, a large number of requests for login. These abnormal uses are becoming more and more advanced and difficult to identify.

There are following problems in prior art:

1. At present, monitoring and detection methods are used to issue alarms after discovery. These are usually methods of post-event discovery and post-event processing.

Disadvantage: Abnormal usage is getting more and more advanced and difficult to identify, and it will still cause congestion, making the application unable to provide normal services.

2. After successfully matching through the policy firewall, block it.

Defect: It may cause misjudgment and affect user experience.

Therefore, it is necessary to improve the prior art.

Contents of the invention

The technical problem to be solved by the present invention is to provide an efficient delayed response control method.

In order to solve the above-mentioned technical problems, the present invention provides a delayed response control method, comprising the following steps:

1), configure the application service IP, port;

2), according to the IP and port configured in step 1, crawl the module and url in the application service through the crawler;

3), crawl the module and url in the application service according to step 2 to obtain the crawler result;

4), filter the crawling results obtained in step 3, remove the crawler results whose access type is request, and obtain response requests;

5) According to the response request and crawling time obtained in step 4, generate the response time threshold T of the response request:

6), according to the response time threshold T obtained in step 5, set the response rule to obtain the response floating time;

7) According to the response rule and response floating time obtained in step 6, the page index is obtained:

8) Response control is performed according to the response time threshold T, response floating time, and page index.

As an improvement to the delayed response control method of the present invention:

In step 3, crawler results include but not limited to url, access type, crawling time, details; access type includes but not limited to request/response.

As a further improvement to the delayed response control method of the present invention:

Step 5 includes:

5.1), through the response request and crawling time obtained in step 4, obtain the distribution map with the response request as the abscissa and the crawling time as the ordinate; by observing the distribution map, the response request obtained in step 4 The maximum value in the crawling time, as the maximum response time t, can obtain the maximum response time t;

5.2), repeat steps 2-4 to obtain n maximum response times t;

5.3) The n largest response times t are averaged to obtain a response time threshold T.

As a further improvement to the delayed response control method of the present invention:

Step 6 includes:

6.1), configure URL rules: that is, set matching rules for the url of the response class request obtained in step 4;

6.2), configure the response time: use the response time threshold T as the request response time benchmark;

6.3) Configure response floating time: set the corresponding response floating time.

As a further improvement to the delayed response control method of the present invention:

In step 7, page indicators are obtained according to the URL rules and response floating time configured in step 6.1; page indicators include but are not limited to the sensitivity of the data contained in the response page, and the data volume of the data contained in the response page.

As a further improvement to the delayed response control method of the present invention:

The URL rule is: the response floating time is proportional or inversely proportional to the page index.

The technical advantage of the delay response control method of the present invention is:

The present invention configures a reasonable delayed response time for abnormal or failed requests without affecting user experience. Control the response time through reasonable configuration, reduce the overall network traffic, and prevent abnormal traffic from blocking services.

Detailed ways

The present invention will be further described below in conjunction with specific examples, but the protection scope of the present invention is not limited thereto.

Embodiment 1, delay response control method, specifically comprises the following steps:

1. Configure the application service IP and port.

The application service refers to a web application that provides external services, which needs to be deployed in the present invention.

2. According to the IP and port configured in step 1, use the crawler to crawl the modules and URLs in the application service.

Crawlers include but are not limited to open source crawler tools, and what the present invention uses is a self-developed web scanner.

3. After step 2, crawler results are obtained, including but not limited to url, access type, crawling time, and details.

Access types include but are not limited to request/response.

4. Filter response requests: Filter the crawling results obtained in step 3, remove crawler results whose access type is request, and obtain response requests.

5. Generate a response time threshold T:

5.1) Through the response requests and crawling time obtained in step 4, a distribution diagram with response requests as the abscissa and crawling time as the ordinate is obtained. By observing the distribution diagram, the maximum value of the crawling time in the response request obtained in step 4 is used as the maximum response time t, and the maximum response time t can be obtained;

5.2), through n times of crawling (repeat steps 2-4), the n largest response times t can be obtained;

5.3), average the n largest response times t to obtain the response time threshold T;

6. Link the protection equipment of the application service and set the response rules.

6.1), configure URL rules: that is, set matching rules for the url of the response request obtained in step 4 (the ratio between the response floating time and the page index is proportional or inversely proportional).

6.2) Configure response time: use the response time threshold T as the request response time benchmark.

6.3) Configure the response floating time: configure the rules for responding to the URL, and set the corresponding response floating time.

7. Delay response control:

7.1. According to the URL rule configured in step 6.1, the response floating time is proportional or inversely proportional to the page index.

7.2. Page indicators include but are not limited to the sensitivity of the data contained in the response page and the data volume of the data contained in the response page.

8. Perform response control according to the response time threshold T, response floating time, and page indicators.

Rules, indicators, and response floating time can be customized based on experience.

Finally, it should be noted that the above examples are only some specific embodiments of the present invention. Obviously, the present invention is not limited to the above embodiments, and many variations are possible. All deformations that can be directly derived or associated by those skilled in the art from the content disclosed in the present invention should be considered as the protection scope of the present invention.

Claims (2)

1. delay response control method, it is characterized in that: comprise the following steps: 1), configure the application service IP, port; 2) According to the IP and port configured in step 1), the module and url in the application service are crawled through the crawler; 3) According to step 2), crawl the module and url in the application service to get the crawler result; Crawler results include but not limited to url, access type, crawling time, details; access type includes but not limited to request/response; 4) Filter the crawling results obtained in step 3), remove the crawler results whose access type is request, and obtain response requests; 5) According to the response request and crawling time obtained in step 4), generate the response time threshold T of the response request: details as follows: 5.1), through the response request and crawling time obtained in step 4), get the distribution map with the response request as the abscissa and the crawling time as the ordinate; by observing the distribution map, the response obtained in step 4) The maximum value of crawling time in class requests, as the maximum response time t, can obtain the maximum response time t; 5.2), repeat steps 2)~4) n times, and obtain n maximum response times t; 5.3) Take the n largest response times t and average them to obtain the response time threshold T; 6) According to the response time threshold T obtained in step 5), set the response rule to obtain the response floating time; details as follows: 6.1), configure the URL rule: set the matching rule for the URL of the response request obtained in step 4); the matching rule is the ratio between the response floating time and the page index, which is proportional or inversely proportional; 6.2), configure the response time: use the response time threshold T as the request response time benchmark; 6.3), configure the response floating time: set the corresponding response floating time; 7) According to the response rule and response floating time obtained in step 6), the page index is obtained: details as follows: According to the URL rule configured in step 6.1), the response floating time is proportional or inversely proportional to the page index; Page indicators include but are not limited to the sensitivity of the data contained in the response page and the data volume of the data contained in the response page; 8) Response control is performed according to the response time threshold T, response floating time, and page indicators. 2. The delayed response control method according to claim 1, characterized in that: In step 1): application services refer to web applications that provide external services; Step 2): Crawlers include but are not limited to open source crawler tools.