CN109586937B - Operation and maintenance method, equipment and storage medium of cache system - Google Patents
Operation and maintenance method, equipment and storage medium of cache system Download PDFInfo
- Publication number
- CN109586937B CN109586937B CN201710899461.0A CN201710899461A CN109586937B CN 109586937 B CN109586937 B CN 109586937B CN 201710899461 A CN201710899461 A CN 201710899461A CN 109586937 B CN109586937 B CN 109586937B
- Authority
- CN
- China
- Prior art keywords
- domain name
- analyzed
- white list
- cache system
- cacheability
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012423 maintenance Methods 0.000 title claims abstract description 57
- 238000000034 method Methods 0.000 title claims abstract description 47
- 238000011156 evaluation Methods 0.000 claims abstract description 69
- 230000000694 effects Effects 0.000 claims abstract description 21
- 230000002159 abnormal effect Effects 0.000 claims description 14
- 230000009193 crawling Effects 0.000 claims description 9
- 238000012360 testing method Methods 0.000 abstract description 11
- 230000001133 acceleration Effects 0.000 description 12
- 238000010586 diagram Methods 0.000 description 7
- 238000012544 monitoring process Methods 0.000 description 6
- 238000012545 processing Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 4
- 230000004044 response Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 230000005856 abnormality Effects 0.000 description 1
- 238000007792 addition Methods 0.000 description 1
- 238000013475 authorization Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/069—Management of faults, events, alarms or notifications using logs of notifications; Post-processing of notifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/16—Threshold monitoring
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L61/00—Network arrangements, protocols or services for addressing or naming
- H04L61/45—Network directories; Name-to-address mapping
- H04L61/4505—Network directories; Name-to-address mapping using standardised directories; using standardised directory access protocols
- H04L61/4511—Network directories; Name-to-address mapping using standardised directories; using standardised directory access protocols using domain name system [DNS]
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses an operation and maintenance method, equipment and a storage medium of a cache system. The method comprises the following steps: acquiring URL resources corresponding to a domain name to be analyzed; determining a cacheability evaluation value of the domain name to be analyzed according to the URL resource; and generating a domain name white list according to the domain name to be analyzed with the cacheability evaluation value larger than a preset threshold value, so that the domain name white list takes effect in the cache system. According to the method and the device, the URL resource corresponding to the domain name is obtained in an automatic dial testing mode, the domain name is subjected to cacheability analysis, and the domain name white list is generated according to the analysis result, so that the operation and maintenance efficiency is improved, and the operation and maintenance cost is reduced.
Description
Technical Field
The present invention relates to the field of internet technologies, and in particular, to an operation and maintenance method, device, and storage medium for a cache system.
Background
In order to improve service experience of internet users, telecom, mobile and other operators introduce a Cache (Cache) system, and the Cache system can realize Cache of internet resources, provide services for broadband users and mobile users nearby, improve user experience and save traffic cost.
With the increasing number of domain name resources cached by the cache system, the operation and maintenance cost of the cache system of the current network is higher and higher, and the requirement on the efficiency of the operation and maintenance is higher and higher. Two key problems mainly exist in the operation and maintenance process of the cache system:
one key issue is that during the operation and maintenance process, the cacheability of domain names needs to be analyzed. The cacheability analysis of the domain name is a function which is used most frequently in the operation and maintenance process of the caching system, and the cacheability of the domain name depends on whether internet content corresponding to the domain name can be cached or not. For the judgment of the cacheability of the domain name, a manual dial test is usually adopted, that is, a browser and an http watch plug-in are combined to manually access a website home page corresponding to the domain name, obtain a webpage resource and analyze the cacheability of the webpage resource. At present, more than 3000 domain names exist in a domain name white list configured in a cache system, and the cache performance of analyzing the domain names in a manual dial-up test mode is high in cost, time-consuming and low in accuracy.
Another key problem is that in the operation and maintenance process, the service quality monitoring needs to be performed on the domain name white list in the cache system. The currently adopted monitoring means is passive monitoring, that is, an operation and maintenance person analyzes a user service log in a current network cache system every day so as to obtain a key index of domain name service by analyzing the log and determine the service quality of a domain name white list.
Just because of the existence of the two main problems, the operation and maintenance cost of the cache system is high, the operation and maintenance efficiency is low, and the internet service experience of the user cannot be further improved.
Disclosure of Invention
The invention aims to provide an operation and maintenance method, equipment and a storage medium of a cache system, which are used for solving the problems of high operation and maintenance cost and low operation and maintenance efficiency of the conventional cache system.
In order to solve the technical problems, the invention solves the problems by the following technical scheme:
the invention provides an operation and maintenance method of a cache system, which comprises the following steps: acquiring URL resources corresponding to a domain name to be analyzed; determining a cacheability evaluation value of the domain name to be analyzed according to the URL resource; and generating a domain name white list according to the domain name to be analyzed with the cacheability evaluation value larger than a preset threshold value, so that the domain name white list takes effect in the cache system.
The acquiring of the URL resource corresponding to the domain name to be analyzed includes: crawling URL resources corresponding to domain names to be accelerated from a network side; collecting URL resources corresponding to the domain names processed by the cache system; searching out the URL resource corresponding to the domain name to be accelerated from the URL resource corresponding to the domain name processed by the cache system; and acquiring a union set of the searched URL resource corresponding to the domain name to be accelerated and the crawled URL resource corresponding to the domain name to be accelerated, and taking the union set as the URL resource corresponding to the domain name to be analyzed.
After the domain name white list is generated according to the domain name to be analyzed whose cacheability evaluation value is greater than the preset threshold, the method further includes: re-determining the cacheability evaluation value of the domain name to be analyzed every other preset time period; and updating the domain name white list according to the domain name to be analyzed with the redetermined cacheability evaluation value, and enabling the updated domain name white list to take effect in the cache system.
Wherein after validating the domain name white list in the caching system, the method further comprises: receiving a user service log reported by the cache system; extracting domain name service parameters in the user service log; determining a service state corresponding to the domain name to be analyzed in the domain name white list according to the domain name service parameters; and updating the domain name white list according to the service state corresponding to the domain name to be analyzed in the domain name white list, and enabling the updated domain name white list to take effect in the cache system.
Wherein, updating the domain name white list according to the service state corresponding to the domain name to be analyzed in the domain name white list comprises: reserving the domain name to be analyzed with the service state being the normal state in the domain name white list; deleting the domain name to be analyzed with the service state being an abnormal state from the domain name white list; re-determining the cacheability evaluation value of the domain name to be analyzed with the service state being the intermediate state, if the cacheability evaluation value is greater than a preset threshold value, keeping the domain name to be analyzed with the intermediate state in the domain name white list, otherwise, deleting the domain name to be analyzed with the intermediate state from the domain name white list.
The invention also provides operation and maintenance equipment of the cache system, wherein the data processing equipment comprises a processor and a memory; the processor is used for executing the operation and maintenance program of the cache system stored in the memory so as to realize the following steps: acquiring URL resources corresponding to a domain name to be analyzed; determining a cacheability evaluation value of the domain name to be analyzed according to the URL resource; and generating a domain name white list according to the domain name to be analyzed with the cacheability evaluation value larger than a preset threshold value, so that the domain name white list takes effect in the cache system.
Wherein the processor is further configured to execute an operation and maintenance program of the cache system stored in the memory to implement the following steps: crawling URL resources corresponding to domain names to be accelerated from a network side; collecting URL resources corresponding to the domain names processed by the cache system; searching out the URL resource corresponding to the domain name to be accelerated from the URL resource corresponding to the domain name processed by the cache system; and acquiring a union set of the searched URL resource corresponding to the domain name to be accelerated and the crawled URL resource corresponding to the domain name to be accelerated, and taking the union set as the URL resource corresponding to the domain name to be analyzed.
After the domain name white list is generated according to the domain name to be analyzed whose cacheability evaluation value is greater than the preset threshold, the processor is further configured to execute an operation and maintenance program of a cache system stored in the memory, so as to implement the following steps: re-determining the cacheability evaluation value of the domain name to be analyzed every other preset time period; and updating the domain name white list according to the domain name to be analyzed with the redetermined cacheability evaluation value, and enabling the updated domain name white list to take effect in the cache system.
Wherein, after validating the domain name white list in the cache system, the processor is further configured to execute an operation and maintenance program of the cache system stored in the memory to implement the following steps: receiving a user service log reported by the cache system; extracting domain name service parameters in the user service log; determining a service state corresponding to the domain name to be analyzed in the domain name white list according to the domain name service parameters; and updating the domain name white list according to the service state corresponding to the domain name to be analyzed in the domain name white list, and enabling the updated domain name white list to take effect in the cache system.
Wherein the processor is further configured to execute an operation and maintenance program of the cache system stored in the memory to implement the following steps: reserving the domain name to be analyzed with the service state being the normal state in the domain name white list; deleting the domain name to be analyzed with the service state being an abnormal state from the domain name white list; re-determining the cacheability evaluation value of the domain name to be analyzed with the service state being the intermediate state, if the cacheability evaluation value is greater than a preset threshold value, keeping the domain name to be analyzed with the intermediate state in the domain name white list, otherwise, deleting the domain name to be analyzed with the intermediate state from the domain name white list.
The present invention also provides a storage medium storing one or more programs, which are executable by one or more processors to implement the operation and maintenance method of the cache system described above.
The invention has the following beneficial effects:
according to the method and the device, the URL resource corresponding to the domain name is obtained in an automatic dial testing mode, the domain name is subjected to cacheability analysis, and the domain name white list is generated according to the analysis result, so that the operation and maintenance efficiency is improved, and the operation and maintenance cost is reduced. Furthermore, the invention automatically analyzes the key parameters in the log through the service quality log reported by the cache system, determines the service quality of the domain name white list in the cache system, adjusts the domain name white list according to the service quality of the domain name white list, further realizes the purpose of automatically monitoring the service quality of the domain name white list, further reduces the operation and maintenance cost and improves the operation and maintenance efficiency.
Drawings
FIG. 1 is a flowchart of an operation and maintenance method of a cache system according to a first embodiment of the present invention;
FIG. 2 is a flowchart illustrating steps for obtaining a URL resource corresponding to a domain name according to a second embodiment of the present invention;
fig. 3 is a flowchart of the steps of determining a cacheability evaluation value according to a third embodiment of the present invention;
FIG. 4 is a flowchart of an operation and maintenance method of a cache system according to a fourth embodiment of the present invention;
FIG. 5 is a schematic illustration of a quality of service analysis according to a fourth embodiment of the present invention;
FIG. 6 is a block diagram of an operation and maintenance device of a cache system according to a fifth embodiment of the present invention;
FIG. 7 is a diagram illustrating an operation and maintenance method of a cache system according to a sixth embodiment of the present invention;
fig. 8 is a diagram illustrating a cache system according to a sixth embodiment of the present invention performing domain name acceleration processing.
Detailed Description
The present invention will be described in further detail below with reference to the drawings and examples. It should be understood that the specific embodiments described herein are merely illustrative of the invention and do not limit the invention.
Example one
The embodiment provides an operation and maintenance method of a cache system. The present embodiment will describe a process of domain name cacheability analysis. Fig. 1 is a flowchart illustrating an operation and maintenance method of a cache system according to a first embodiment of the present invention.
Step S110, obtain a URL (Uniform Resource Locator) Resource corresponding to the domain name to be analyzed.
Importing a domain name to be accelerated, and taking the domain name to be accelerated as a domain name to be analyzed; and crawling URL resources corresponding to the domain name to be analyzed from a network side.
The domain name to be accelerated refers to a domain name which is expected to be subjected to domain name acceleration processing by a cache system. The operator may be responsible for importing the domain name to be accelerated.
The types of domain names to be accelerated include: a first-level domain name and a sub-domain name.
Step S120, determining the cacheability evaluation value of the domain name to be analyzed according to the URL resource.
The cacheability evaluation value may reflect whether the internet content corresponding to the domain name to be analyzed can be cached.
The cacheability evaluation value is larger than a preset threshold value, which indicates that the internet content corresponding to the domain name to be analyzed can be cached. And the cacheability evaluation value is less than or equal to a preset threshold value, which indicates that the internet content corresponding to the domain name to be analyzed cannot be cached. The preset threshold may be an empirical value or a value obtained through experiments.
Specifically, a preset domain name quality analysis algorithm may be used to analyze the URL resource corresponding to the domain name to be analyzed, and calculate the cacheability evaluation value of the domain name to be analyzed.
Step S130, a domain name white list is generated according to the domain name to be analyzed with the cacheability evaluation value larger than a preset threshold value, and the domain name white list takes effect in the cache system.
After the domain name white list is generated, the domain name white list may be sent to an IAM (Intelligent accelerated Management) module in the cache system, and then sent to a Webcache server (cache server) and a GSLB (Global Service Load Balance) module in the cache system by the IAM, so that the domain name white list is configured in the cache system to be effective, and only if the domain name white list is configured in the cache system to be effective, the cache system may use the domain name white list to provide a domain name Acceleration Service for a user.
In this embodiment, after the domain name white list is generated, the domain name white list needs to be updated.
Due to the fact that parameters in the URL resource can be changed, the cacheability evaluation value of the domain name to be analyzed is determined again every other preset time period; and updating the domain name white list according to the domain name to be analyzed with the redetermined cacheability evaluation value, and enabling the updated domain name white list to take effect in the cache system. Further, when the cacheability evaluation value of the domain name to be analyzed is re-determined, the cacheability evaluation value may be re-determined only for the domain name to be analyzed in the domain name white list, or may be re-determined for all domain names to be analyzed that are imported by an operator, and then the domain name to be analyzed whose cacheability evaluation value is less than or equal to a preset threshold is deleted from the domain name white list.
After the domain name white list takes effect in the cache system, the operator may add new domain names to be accelerated according to the requirement, and the new domain names to be accelerated may already exist in the domain name white list, so that resource waste is caused by performing cacheability analysis on the new domain names to be accelerated, and the efficiency is reduced.
For this problem, in this embodiment, after determining the cacheability evaluation value of the domain name according to the URL resource corresponding to the domain name to be analyzed, the URL resource corresponding to the domain name to be analyzed whose cacheability evaluation value is greater than the preset threshold is stored, so that after acquiring the URL resource corresponding to the domain name to be analyzed again, if the URL resource corresponding to the domain name to be analyzed exists in the stored URL resource, the process is ended; and otherwise, determining the cacheability evaluation value of the domain name to be analyzed according to the re-acquired URL resource corresponding to the domain name to be analyzed. Further, after determining the cacheability evaluation value of the domain name according to the URL resource corresponding to the domain name to be analyzed, a domain name knowledge base may be formed according to the domain name to be analyzed whose cacheability evaluation value is greater than a preset threshold, and a URL knowledge base may be formed according to the URL resource corresponding to the domain name to be analyzed whose cacheability evaluation value is greater than the preset threshold. The domain name knowledge base comprises: domain name, port, cache suggestion, HTTPS (Hyper Text Transfer Protocol over Secure Socket Layer), etc. The URL knowledge base comprises: protocol method, URL resource size, resource type, HTTP (HyperText Transfer Protocol) Header information.
In the embodiment, the URL resource corresponding to the domain name is acquired in an automatic dial-up test mode, the cacheability of the domain name is analyzed, the domain name white list is generated according to the analysis result, and the domain name white list is automatically updated, so that the operation and maintenance efficiency is improved, the operation and maintenance time is shortened, the operation and maintenance cost is reduced, and the accuracy of the domain name cacheability analysis is improved.
Example two
A more specific way of acquiring the URL resource corresponding to the domain name is provided below.
The URL resource of the source station may only be accessible by the user, so the URL resource cannot be crawled from the network, and since a DNS (Domain Name System) request sent by the user is sent to the cache System, the URL resource corresponding to the Domain Name served by the cache System may be more comprehensive than the URL resource obtained by crawling.
Fig. 2 is a flowchart illustrating a step of acquiring a URL resource corresponding to a domain name according to a second embodiment of the present invention.
Step S210, crawling URL resources corresponding to the domain name to be accelerated from the network side.
And importing a domain name to be accelerated provided by an operator, and crawling URL resources corresponding to the domain name to be accelerated from a network side to form a first URL resource library. The first URL resource library comprises a domain name to be accelerated and a URL resource corresponding to the domain name to be accelerated. The number of URL resources corresponding to the domain name to be accelerated is multiple.
Step S220, collecting the URL resource corresponding to the domain name processed by the cache system.
And collecting URL resources corresponding to all the domain names processed by the cache system to form a second URL resource library. And the second URL resource library comprises the domain name and URL resources corresponding to the domain name. Furthermore, URL resources corresponding to domain names of all user services of the current network can be collected through the GSLB module.
Step S230, finding out the URL resource corresponding to the domain name to be accelerated from the URL resources corresponding to the domain names processed by the cache system.
Step S240, acquiring a union of the searched URL resource corresponding to the domain name to be accelerated and the crawled URL resource corresponding to the domain name to be accelerated, and using the union as the URL resource corresponding to the domain name to be analyzed.
In order to avoid that the URL resource corresponding to the domain name to be accelerated is not completely crawled, whether the domain name same as the domain name to be accelerated exists or not is searched in a second URL resource library; if not, the URL resource corresponding to the searched domain name to be accelerated is considered as a null value; if yes, all URL resources corresponding to the domain name (domain name to be accelerated) in the second URL resource library are obtained, all the obtained URL resources are compared with URL resources in the first URL resource library, whether URL resources do not exist in the first URL resource library or not is determined, if not, the URL resources in the first URL resource library are URL resources corresponding to the domain name to be analyzed, if yes, no URL resources in the first URL resource library are added into the first URL resource library, and at the moment, the URL resources in the first URL resource library are URL resources corresponding to the domain name to be analyzed.
EXAMPLE III
The present embodiment will further describe a process of determining a cacheability evaluation value of a domain name to be analyzed from a URL resource. Fig. 3 is a flowchart illustrating steps of determining a cacheability evaluation value according to a third embodiment of the present invention.
Step S310, obtaining the analysis parameters of each URL resource corresponding to the domain name to be analyzed.
Analytical parameters including, but not limited to: HTTP Header information, file suffix of URL resource, status code.
HTTP Header information includes, but is not limited to: Cache-Control, max-age (relative expiration time), expiration-time (absolute expiration time), tmax (Cache time limit), and the like.
Step S320, substituting all the obtained analysis parameters into a preset domain name quality analysis algorithm, and calculating a cacheability evaluation value of the domain name to be analyzed.
The cacheability evaluation value S ═ w1 × t1+ w2 × t2+ w3 × t3+ w4 × t 4.
w1, w2, w3 and w4 are weights. w1, w2, w3 and w4 may be empirical values or experimentally obtained values.
Determining the proportion t1 of the dynamic resources in the total number of the URL resources in all URL resources corresponding to the domain name to be analyzed; determining t2 proportion of the cacheable state code to the static resource; determining the proportion t3 of the uncacheable object in the static resource; and determining the proportion t4 of the URL resources with the max-age being larger than the tmax to the total number of the URL resources.
The URL resource containing the following characters can be judged as a dynamic resource: "? "," "/cgi-bin/", ". pl", ". asp", ". cgi",. jsp 'and. php'.
The cacheable status code includes: 200. 203, 300 and 301.
The non-cacheable object includes the following information;
no Last-Modified information;
contains "Set-Cookie";
contains http 1.0;
the http 1.1 field of "Cache-Control" is "no-Cache" or "private";
"Pragma:No-cache"；
"Authorization"；
"Cache-Control:"no-cache，no-store，private。
the characters corresponding to the dynamic resources, the cacheable status codes, and the information corresponding to the non-cacheable objects are all configurable items.
Example four
The invention can not only analyze the cacheability of the domain name in an automatic dial testing mode, but also analyze the service quality of the domain name white list after the domain name white list takes effect in a cache system, thereby realizing the service quality monitoring.
The embodiment provides an operation and maintenance method of a cache system. The present embodiment will describe the procedure of the quality of service analysis in detail. Fig. 4 is a flowchart illustrating an operation and maintenance method of a cache system according to a fourth embodiment of the present invention. Fig. 5 is a schematic diagram of quality of service analysis according to a fourth embodiment of the present invention.
Step S410, receiving the user service log reported by the cache system.
After the service is completed, the Webcache server in the cache system generates a user service log, and the Webcache server reports the user service log.
The domain name service parameters in the user service log include, but are not limited to: the domain name service success rate, the domain name first byte response time, the domain name hit rate, the domain name source returning success rate and the domain name source returning first byte response time.
Step S420, extracting the domain name service parameter in the user service log.
Step S430, determining a service state corresponding to the domain name to be analyzed in the domain name white list according to the domain name service parameter. This step is the quality of service analysis.
The service states include: normal state, intermediate state, and abnormal state.
The normal state is a state capable of normally providing the domain name acceleration service, and the service quality is good.
The intermediate state is a state between a normal state and an abnormal state, in which a domain name acceleration service can be provided to a user, but the service quality is poor.
The abnormal state is a state corresponding to service abnormality or service failure, and the domain name acceleration service cannot be provided for the user in the abnormal state.
The service state corresponding to the domain name service parameter can be distinguished through the threshold range by setting the corresponding threshold range for each domain name service parameter.
For example: setting a first domain name hit rate threshold and a second domain name hit rate threshold, wherein the first domain name hit rate threshold is larger than the second domain name hit rate threshold; when the domain name hit rate is greater than a first threshold value of the domain name hit rate, the service state is a normal state; when the domain name hit rate is less than or equal to a first threshold of the domain name hit rate and more than or equal to a second threshold of the domain name hit rate, the service state is an intermediate state; and when the domain name hit rate is smaller than the second threshold value of the domain name hit rate, the service state is an abnormal state.
One domain name service parameter may be used to determine the service status, or multiple domain name service parameters may be used to determine the service status. If various domain name service parameters are used to determine the service state, the service state with the highest proportion can be determined as the service state corresponding to the domain name to be analyzed according to the service state corresponding to each domain name service parameter.
Step S440, updating the domain name white list according to the service status corresponding to the domain name to be analyzed in the domain name white list, and enabling the updated domain name white list to take effect in the cache system.
Reserving the domain name to be analyzed with the service state being the normal state in the domain name white list;
deleting the domain name to be analyzed with the service state being an abnormal state from the domain name white list;
re-determining the cacheability evaluation value of the domain name to be analyzed with the service state being the intermediate state (domain name cacheability analysis), if the cacheability evaluation value is greater than a preset threshold value, keeping the domain name to be analyzed in the intermediate state in the domain name white list, otherwise, deleting the domain name to be analyzed in the intermediate state from the domain name white list.
And if the domain name to be analyzed in the intermediate state is deleted from the domain name white list, adding the domain name to be analyzed into a domain name grey list, and sending the domain name grey list to a cache system, so that the cache system does not accelerate by-pass aiming at the domain name to be analyzed.
In this embodiment, the updated domain name white list may be sent to the cache system, or the domain name to be analyzed that needs to be deleted in the domain name white list may be notified to the cache system through the notification message, and the cache system deletes the domain name to be analyzed from the domain name white list being used by the cache system on its own, and the cache system may further add the domain name white list to the domain name gray list according to the indication of the notification message.
In this embodiment, the service quality log reported by the cache system automatically analyzes key parameters (domain name service parameters) in the log, determines the service quality (service state) of the domain name white list in the cache system, and adjusts the domain name white list according to the service quality of the domain name white list, thereby achieving the purpose of automatically monitoring the service quality of the domain name white list, reducing the operation and maintenance cost, improving the operation and maintenance efficiency, and ensuring the service quality.
EXAMPLE five
The embodiment also provides a computer program, a storage medium storing the computer program and an operation and maintenance device of the cache system. Wherein executing the program is for implementing the steps of:
acquiring URL resources corresponding to a domain name to be analyzed; determining a cacheability evaluation value of the domain name to be analyzed according to the URL resource; and generating a domain name white list according to the domain name to be analyzed with the cacheability evaluation value larger than a preset threshold value, so that the domain name white list takes effect in the cache system.
Optionally, the obtaining of the URL resource corresponding to the domain name to be analyzed includes: crawling URL resources corresponding to domain names to be accelerated from a network side; collecting URL resources corresponding to the domain names processed by the cache system; searching out the URL resource corresponding to the domain name to be accelerated from the URL resource corresponding to the domain name processed by the cache system; and acquiring a union set of the searched URL resource corresponding to the domain name to be accelerated and the crawled URL resource corresponding to the domain name to be accelerated, and taking the union set as the URL resource corresponding to the domain name to be analyzed.
Optionally, after the determining, according to the URL resource, a cacheability evaluation value of the domain name to be analyzed, the method further includes: saving the URL resource corresponding to the domain name to be analyzed, of which the cacheability evaluation value is greater than the preset threshold value, so as to finish the process if the URL resource corresponding to the domain name to be analyzed exists in the saved URL resource after the URL resource corresponding to the domain name to be analyzed is obtained again; and otherwise, determining the cacheability evaluation value of the domain name to be analyzed according to the re-acquired URL resource corresponding to the domain name to be analyzed.
Optionally, after generating a domain name white list according to the domain name to be analyzed whose cacheability evaluation value is greater than the preset threshold, the method further includes: re-determining the cacheability evaluation value of the domain name to be analyzed every other preset time period; and updating the domain name white list according to the domain name to be analyzed with the redetermined cacheability evaluation value, and enabling the updated domain name white list to take effect in the cache system.
Optionally, after validating the domain name white list in the caching system, the method further comprises: receiving a user service log reported by the cache system; extracting domain name service parameters in the user service log; determining a service state corresponding to the domain name to be analyzed in the domain name white list according to the domain name service parameters; and updating the domain name white list according to the service state corresponding to the domain name to be analyzed in the domain name white list, and enabling the updated domain name white list to take effect in the cache system.
Optionally, updating the domain name white list according to the service state corresponding to the domain name to be analyzed in the domain name white list, including: reserving the domain name to be analyzed with the service state being the normal state in the domain name white list; deleting the domain name to be analyzed with the service state being an abnormal state from the domain name white list; re-determining the cacheability evaluation value of the domain name to be analyzed with the service state being the intermediate state, if the cacheability evaluation value is greater than a preset threshold value, keeping the domain name to be analyzed with the intermediate state in the domain name white list, otherwise, deleting the domain name to be analyzed with the intermediate state from the domain name white list.
The technical solution of the operation and maintenance method for the cache system disclosed in the foregoing embodiment may be implemented in an operation and maintenance device of the cache system to obtain the corresponding operation and maintenance device of the cache system.
In this embodiment, the operation and maintenance device running on the cache system is taken as an example for explanation, and fig. 6 is a schematic diagram of a hardware structure of the operation and maintenance device of the cache system, which is used for implementing the operation and maintenance method of the cache system according to the embodiment of the present invention. As shown in fig. 6, the operation and maintenance device 600 of the cache system may include one or more processors 610 (only one is shown in the figure) (the processors 610 may include, but are not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA), a memory 620 for storing data, and a data transceiver 630 for communication functions. It will be understood by those skilled in the art that the structure shown in fig. 6 is merely illustrative and is not intended to be a single limitation on the structure of the electronic device. For example, the operation and maintenance device 600 of the cache system may further include more or less components than those shown in fig. 6 or have a different configuration from that shown in fig. 6 by splitting or combining the above functions.
The memory 620 may be used to store software programs and modules of application software, and program instructions/modules corresponding to the operation and maintenance method of the cache system disclosed in the foregoing embodiments may be stored in the memory 620. The operation and maintenance method of the cache system has been described in detail in the previous embodiment, and this embodiment will not be repeated in detail.
The processor 610 executes various functional applications and data processing by running (executing) software programs and modules stored in the memory 620, thereby implementing the above-described method. The processor 610 is configured to execute an operation and maintenance program of the cache system stored in the memory 620. The memory 620 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 620 may further include memory located remotely from the processor 610 (cloud storage), which may be connected to the operation device 600 of the cache system via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The data transceiver 630 is used to receive or transmit data via a network. The specific example of the network may include a wireless network provided by a communication provider of the operation and maintenance device 600 of the cache system. In one example, the data transceiver 630 includes a Network adapter (NIC) that can be connected to other Network devices through a base station to communicate with the internet. In one example, the data transceiver 630 includes a Radio Frequency (RF) module for communicating with the internet by wireless.
EXAMPLE six
The following provides a more detailed description of the invention.
Fig. 7 is a schematic diagram illustrating an operation and maintenance method of a cache system according to a sixth embodiment of the invention.
The domain name dial-up module 710, the quality analysis module 720, and the policy adjustment module 730 shown in fig. 7 may be provided in the processor 610. The IAM module 740, the Webcache server, and the GSLB module 750 are provided in a cache system.
In the present embodiment, in order to make the present embodiment easier to understand, the memory 620 and the data transceiver 630 are omitted in the present embodiment. But those skilled in the art will recognize that: the domain name dial-up module 710, the quality analysis module 720, and the policy adjustment module 730 execute the operation and maintenance program of the cache system stored in the memory 620. The domain name dial-up module 710, the quality analysis module 720, and the policy adjustment module 730 interact with the cache system through the data transceiver 630.
In this embodiment, in order to make this embodiment easier to understand, the Webcache server and the GSLB module are considered as a whole.
In this embodiment, the specific implementation steps are as follows:
s11, before the cache system is online, the domain name list to be analyzed including the domain name to be analyzed is imported into the domain name dial-up module 710.
S12, the domain name dial testing module 710 crawls the URL resource corresponding to the domain name to be analyzed through the automatic dial testing function, the domain name dial testing module 710 analyzes the URL resource through the domain name quality analysis algorithm, comprehensively analyzes the cacheability of the domain name to be analyzed, obtains a cacheability evaluation value of the domain name to be analyzed, and generates a domain name white list library according to the domain name to be analyzed whose cacheability evaluation value is greater than a preset threshold.
S13, the domain name dial-up module 710 sends the domain name white list to the IAM module 740 in the cache system.
S14, the IAM module 740 in the cache system issues the received domain name white list to the Webcache server and the GSLB module 750, the configuration of the domain name white list is effective, and the cache system can provide a domain name acceleration service for the user.
S15, after the domain name acceleration service is completed, the Webcache server of the cache system generates a user service log, and uploads the user service log to the quality analysis module 720.
S16, the quality analysis module 720 analyzes the user service log to obtain a key indicator (user service parameter) in the user service log, and analyzes the service status of the domain name in the domain name white list.
S17, the policy adjustment module 730 directly bypasses the domain name with abnormal service (or service failure) according to the analysis result of the quality analysis module 720, and the IAM module 740 bypasses the domain name with abnormal service from the domain name white list according to the notification message received from the policy adjustment module 730, adjusts the domain name with abnormal service to the domain name grey list, and does not provide the user with the accelerated service of the domain name any more.
S18, the policy adjustment module 730 notifies the domain name dial testing module 710 of the domain name with poor quality of service according to the analysis result of the quality analysis module 720, the domain name dial testing module 710 re-dials the domain name, updates the domain name white list according to the cacheability evaluation value of the domain name, and sends the domain name white list to the IAM module 740.
The following describes a process of providing domain name acceleration service by the cache system according to the domain name white list. Fig. 8 is a schematic diagram illustrating a cache system according to a sixth embodiment of the invention executing domain name acceleration processing.
S21, the user sends a DNS request to LDNS (local domain Name System).
Before the user sends a DNS resolution request to the LDNS, the Webcache server and GSLB module 750 completes the domain name white list configuration.
And S22, the LDNS sends the domain name carried in the DNS resolution request to the GSLB module through a DNS Forward message.
And S23, the GSLB module determines that the domain name exists in the domain name white list and sends a DNS response message to the LDNS.
S24, the LDNS returns the DNS analysis request result to the user, and the DNS analysis request result points to the Webcache server.
S25, the user sends a domain name acceleration service request carrying the domain name to the Webcache server.
S26, the Webcache server determines whether the internet content corresponding to the domain name exists locally according to the domain name acceleration service request, and if so, directly returns the internet content, and if not (as shown in fig. 8), executes step S27, obtains the internet content from the source station corresponding to the domain name, and returns the internet content to the user through step S28.
Although the preferred embodiments of the present invention have been disclosed for illustrative purposes, those skilled in the art will appreciate that various modifications, additions and substitutions are possible, and the scope of the invention should not be limited to the embodiments described above.
Claims (11)
1. An operation and maintenance method of a cache system, comprising:
acquiring URL resources corresponding to a domain name to be analyzed;
determining the cacheability evaluation value of the domain name to be analyzed according to the URL resource, comprising: acquiring analysis parameters of each URL resource corresponding to the domain name to be analyzed; substituting the acquired analysis parameters into a preset domain name quality analysis algorithm to calculate the cacheability evaluation value of the domain name to be analyzed;
and generating a domain name white list according to the domain name to be analyzed with the cacheability evaluation value larger than a preset threshold value, so that the domain name white list takes effect in the cache system.
2. The method of claim 1, wherein the obtaining the URL resource corresponding to the domain name to be analyzed comprises:
crawling URL resources corresponding to domain names to be accelerated from a network side;
collecting URL resources corresponding to the domain names processed by the cache system;
searching out the URL resource corresponding to the domain name to be accelerated from the URL resource corresponding to the domain name processed by the cache system;
and acquiring a union set of the searched URL resource corresponding to the domain name to be accelerated and the crawled URL resource corresponding to the domain name to be accelerated, and taking the union set as the URL resource corresponding to the domain name to be analyzed.
3. The method of claim 1, wherein after generating the domain name white list according to the domain name to be analyzed whose cacheability evaluation value is greater than the preset threshold, the method further comprises:
re-determining the cacheability evaluation value of the domain name to be analyzed every other preset time period;
and updating the domain name white list according to the domain name to be analyzed with the redetermined cacheability evaluation value, and enabling the updated domain name white list to take effect in the cache system.
4. The method of any of claims 1-3, wherein after validating the domain name whitelist in the caching system, the method further comprises:
receiving a user service log reported by the cache system;
extracting domain name service parameters in the user service log;
determining a service state corresponding to the domain name to be analyzed in the domain name white list according to the domain name service parameters;
and updating the domain name white list according to the service state corresponding to the domain name to be analyzed in the domain name white list, and enabling the updated domain name white list to take effect in the cache system.
5. The method of claim 4, wherein updating the domain name white list according to the service status corresponding to the domain name to be analyzed in the domain name white list comprises:
reserving the domain name to be analyzed with the service state being the normal state in the domain name white list;
deleting the domain name to be analyzed with the service state being an abnormal state from the domain name white list;
re-determining the cacheability evaluation value of the domain name to be analyzed with the service state being the intermediate state, if the cacheability evaluation value is greater than a preset threshold value, keeping the domain name to be analyzed with the intermediate state in the domain name white list, otherwise, deleting the domain name to be analyzed with the intermediate state from the domain name white list.
6. The operation and maintenance equipment of the cache system is characterized by comprising a processor and a memory; the processor is used for executing the operation and maintenance program of the cache system stored in the memory so as to realize the following steps:
acquiring URL resources corresponding to a domain name to be analyzed;
determining the cacheability evaluation value of the domain name to be analyzed according to the URL resource, comprising: acquiring analysis parameters of each URL resource corresponding to the domain name to be analyzed; substituting the acquired analysis parameters into a preset domain name quality analysis algorithm to calculate the cacheability evaluation value of the domain name to be analyzed;
and generating a domain name white list according to the domain name to be analyzed with the cacheability evaluation value larger than a preset threshold value, so that the domain name white list takes effect in the cache system.
7. The operation and maintenance device of a cache system according to claim 6, wherein the processor is further configured to execute an operation and maintenance program of the cache system stored in the memory to implement the following steps:
crawling URL resources corresponding to domain names to be accelerated from a network side;
collecting URL resources corresponding to the domain names processed by the cache system;
searching out the URL resource corresponding to the domain name to be accelerated from the URL resource corresponding to the domain name processed by the cache system;
and acquiring a union set of the searched URL resource corresponding to the domain name to be accelerated and the crawled URL resource corresponding to the domain name to be accelerated, and taking the union set as the URL resource corresponding to the domain name to be analyzed.
8. The operation and maintenance device of a cache system according to claim 6, wherein after the domain name white list is generated according to the domain name to be analyzed whose cacheability evaluation value is greater than the preset threshold, the processor is further configured to execute an operation and maintenance program of the cache system stored in the memory to implement the following steps:
re-determining the cacheability evaluation value of the domain name to be analyzed every other preset time period;
and updating the domain name white list according to the domain name to be analyzed with the redetermined cacheability evaluation value, and enabling the updated domain name white list to take effect in the cache system.
9. The operation device of the cache system of any one of claims 6-8, wherein after validating the domain name white list in the cache system, the processor is further configured to execute an operation program of the cache system stored in the memory to implement the steps of:
receiving a user service log reported by the cache system;
extracting domain name service parameters in the user service log;
determining a service state corresponding to the domain name to be analyzed in the domain name white list according to the domain name service parameters;
and updating the domain name white list according to the service state corresponding to the domain name to be analyzed in the domain name white list, and enabling the updated domain name white list to take effect in the cache system.
10. The operation and maintenance device of a cache system according to claim 9, wherein the processor is further configured to execute an operation and maintenance program of the cache system stored in the memory to implement the following steps:
reserving the domain name to be analyzed with the service state being the normal state in the domain name white list;
deleting the domain name to be analyzed with the service state being an abnormal state from the domain name white list;
re-determining the cacheability evaluation value of the domain name to be analyzed with the service state being the intermediate state, if the cacheability evaluation value is greater than a preset threshold value, keeping the domain name to be analyzed with the intermediate state in the domain name white list, otherwise, deleting the domain name to be analyzed with the intermediate state from the domain name white list.
11. A storage medium storing one or more programs, the one or more programs being executable by one or more processors to implement the operation and maintenance method of the cache system of any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710899461.0A CN109586937B (en) | 2017-09-28 | 2017-09-28 | Operation and maintenance method, equipment and storage medium of cache system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710899461.0A CN109586937B (en) | 2017-09-28 | 2017-09-28 | Operation and maintenance method, equipment and storage medium of cache system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109586937A CN109586937A (en) | 2019-04-05 |
| CN109586937B true CN109586937B (en) | 2022-03-15 |
Family
ID=65913849
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710899461.0A Active CN109586937B (en) | 2017-09-28 | 2017-09-28 | Operation and maintenance method, equipment and storage medium of cache system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109586937B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111741065B (en) * | 2020-05-18 | 2022-03-08 | 北京直真科技股份有限公司 | Batch CDN resource cache automation device |
| CN113704649A (en) * | 2020-05-20 | 2021-11-26 | 中国移动通信集团浙江有限公司 | Caching method and device for resource website |
| CN114629919A (en) * | 2022-03-31 | 2022-06-14 | 北京百度网讯科技有限公司 | Resource acquisition method, device, equipment and storage medium |
| CN115361357B (en) * | 2022-07-22 | 2024-05-14 | 中国电信股份有限公司 | Network scheduling system, method and device, electronic equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103841045A (en) * | 2012-11-22 | 2014-06-04 | 中国移动通信集团公司 | Internet cache processing method, content detection subsystem and Cache system |
| CN105024870A (en) * | 2014-04-24 | 2015-11-04 | 中国移动通信集团公司 | A method and system for implementing dial testing |
| CN105302801A (en) * | 2014-05-27 | 2016-02-03 | 腾讯科技（深圳）有限公司 | Resource caching method and apparatus |
| CN107153663A (en) * | 2016-03-04 | 2017-09-12 | 中国移动通信集团北京有限公司 | A kind of domain name resources caching method and device |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100174829A1 (en) * | 2009-01-06 | 2010-07-08 | Barracuda Networks, Inc | Apparatus for to provide content to and query a reverse domain name system server |
| CN106411978B (en) * | 2015-07-31 | 2020-01-21 | 华为技术有限公司 | Resource caching method and device |
| CN106487846A (en) * | 2015-08-28 | 2017-03-08 | 中国电信股份有限公司 | The white list updating method of caching system, acquisition and analysis device and caching system |
| CN106921713B (en) * | 2015-12-25 | 2019-12-06 | 中国移动通信集团上海有限公司 | Resource caching method and device |
| CN106055588A (en) * | 2016-05-20 | 2016-10-26 | 青岛海信电器股份有限公司 | Off-line resource processing method and apparatus |
-
2017
- 2017-09-28 CN CN201710899461.0A patent/CN109586937B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103841045A (en) * | 2012-11-22 | 2014-06-04 | 中国移动通信集团公司 | Internet cache processing method, content detection subsystem and Cache system |
| CN105024870A (en) * | 2014-04-24 | 2015-11-04 | 中国移动通信集团公司 | A method and system for implementing dial testing |
| CN105302801A (en) * | 2014-05-27 | 2016-02-03 | 腾讯科技（深圳）有限公司 | Resource caching method and apparatus |
| CN107153663A (en) * | 2016-03-04 | 2017-09-12 | 中国移动通信集团北京有限公司 | A kind of domain name resources caching method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109586937A (en) | 2019-04-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101379864B1 (en) | Request routing using network computing components | |
| CN109586937B (en) | Operation and maintenance method, equipment and storage medium of cache system | |
| US11263284B2 (en) | Method and system for loading web page, and server | |
| US10601767B2 (en) | DNS query processing based on application information | |
| US10397360B2 (en) | Systems and methods for caching HTTP POST requests and responses | |
| US10897450B2 (en) | Communication method and communication apparatus | |
| WO2017025052A1 (en) | Resource caching method and device | |
| CN103281409A (en) | Domain name resolution method of mobile internet and DNS server based on TCP protocol | |
| CN111294372B (en) | Method, device and system for realizing cache in proxy server | |
| US10333966B2 (en) | Quarantining an internet protocol address | |
| US11019036B2 (en) | Method for privacy protection | |
| US20150006622A1 (en) | Web contents transmission method and apparatus | |
| AU2016364922B2 (en) | Accelerating connections to a host server | |
| GB2500229A (en) | Transmitting a digital resource in a client-server communication system, involving pushing secondary resources from secondary servers | |
| CN106411978A (en) | Resource caching method and apparatus | |
| CN113596105B (en) | Content acquisition method, edge node and computer readable storage medium | |
| CN112235271B (en) | CDN (content delivery network) equipment and self-adaptive safe source returning method thereof | |
| CN110865845B (en) | Method for improving interface access efficiency and storage medium | |
| CN113138943B (en) | Method and device for processing request | |
| JP6787845B2 (en) | Suspected location estimation device and suspected location estimation method | |
| US20170289299A1 (en) | Server, Client Device and Methods Therein for Handling | |
| WO2025012984A1 (en) | System and a method for bidirectional scheme translation | |
| CN116668446A (en) | Cluster node shunting method and device, computing equipment and storage medium | |
| CN116436912A (en) | Source return method, apparatus, device and computer readable storage medium | |
| CN118018613A (en) | Communication method, system, client, gateway equipment and global load balancing equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |