CN109522043A - Method and device for managing configuration data and storage medium - Google Patents

Abstract

The embodiment of the present invention discloses a configuration data management method. The method includes: monitoring whether the original configuration data pre-stored in the processing platform node changes; The updated configuration data, wherein, the updated configuration data is generated in the following manner: according to the received configuration data to be updated written into the processing platform node by the update cache in the database, the original update and generate the configuration data; judge whether the updated configuration data is stored in the preset centralized configuration data cache, and obtain the corresponding judgment result; based on the judgment result, use the corresponding processing strategy to control the processing of the The updated configuration data is processed accordingly. The embodiment of the invention also discloses a configuration data management device and a storage medium.

Description

Method, device and storage medium for managing configuration data

technical field

The present invention relates to the technical field of data processing, in particular to a management method, device and storage medium for configuration data.

Background technique

At present, in the big data environment, the business processing system often has to handle many complex businesses. In order to ensure the scalability and easy maintenance of the business processing system, business-related configuration data is usually generated to manage the business processing system. Due to the complexity of the business and the huge amount of data, a large amount of configuration data is often generated. Therefore, effective management of configuration data is of great significance to the normal operation and maintenance of business processing systems.

In related technologies, the configuration data is generally managed in the following ways:

1) Directly use the configuration file to manage the configuration data. This method is based on the configuration file interface provided by the development framework tools such as SpringBoot and Springmvc. When the business processing system is initialized, the configuration file is directly read. If you want to change the configuration data, you need to modify the configuration file. And restart the business processing system;

2) Use the Zookeeper hosting configuration file in the distributed coordination system to manage the configuration data. In this method, the configuration information is still stored in the configuration file. The difference from method 1) is that each configuration file is stored in the Znode node of Zookeeper, so that with the help of Zookeeper's monitoring/updating mechanism, when the configuration file needs to be modified, just replace the modified configuration file to the corresponding Znode node, and the Zookeeper client of the business processing system process will automatically obtain the new configuration file for reinitialization;

3) Use a relational database to store configuration data. In this method, the complex relationship between configuration data is mapped to the relationship between database tables, and the configuration data is managed through the constraint capability of the relational database itself. When the business processing system process starts, Read the configuration information from the database table and initialize it.

However, the above technical solutions for managing configuration data still have the following problems:

For the management method of directly using configuration files, it is difficult to maintain the system due to the need to restart the system process, and it does not have the real-time performance of updating configuration data;

For the management method of using Zookeeper to host configuration files, there is no need to restart the system process and the configuration can be updated in real time, which is real-time and partially easy to maintain. However, when the relationship between the configuration data is complex and the number is large, the maintenance of the configuration file becomes considerable. Difficult, which may lead to errors in configuration data modification and lack of security;

For the management method using a relational database, although this method can better deal with complex and huge configuration data, the configuration data is stored in the database table, and the complete configuration data must be read every time a small part of the configuration data is updated , resulting in a decrease in configuration data update performance and a lack of security.

Therefore, none of the methods for managing configuration data in the related art can take into account the real-time performance, security, and ease of maintenance of configuration data management at the same time.

SUMMARY OF THE INVENTION

In view of this, the embodiment of the present invention expects to provide a configuration data management method, device and storage medium, at least to solve the problem in the related art that it is difficult to simultaneously realize real-time performance, security and easy maintenance of configuration data management. question.

In order to achieve the above-mentioned purpose, the technical scheme of the embodiment of the present invention is realized as follows:

In a first aspect, an embodiment of the present invention provides a method for managing configuration data, the method including:

Monitor whether the original configuration data pre-stored in the processing platform node changes;

When it is detected that the original configuration data has changed, the updated configuration data is obtained, wherein the updated configuration data is generated in the following manner: according to the received update cache written in the database The configuration data to be updated of the processing platform node is updated to generate the original configuration data;

Judging whether the updated configuration data is stored in a preset centralized configuration data cache, and obtaining a corresponding judgment result;

Based on the judgment result, corresponding processing is performed on the updated configuration data by using a corresponding processing policy control.

In the above solution, the configuration data to be updated is written into the processing platform node when the update cache receives the first feedback information sent by the database;

Wherein, the first feedback information is used to represent a notification message that the configuration data to be updated is successfully written into the database table in the database.

In the above solution, when the configuration data to be updated is written into the database table in the database, it is also written into the update cache.

In the above solution, the configuration data to be updated is written into the processing platform node in the following manner:

Create a key-value pair with the name of the database table as the key and the content of the configuration data to be updated as the value in the update cache;

Using the storage data structure of the key-value pair, the update cache writes the configuration data to be updated into the processing platform node.

In the above solution, based on the judgment result, using a corresponding processing policy to control the corresponding processing of the updated configuration data includes:

When the judgment result indicates that the updated configuration data is stored in the centralized configuration data cache, the updated configuration data is directly reinitialized.

In the above solution, based on the judgment result, using a corresponding processing policy to control the corresponding processing of the updated configuration data includes:

When the judgment result indicates that the updated configuration data is not stored in the centralized configuration data cache, sending a request message requesting to obtain complete configuration data to the database;

After the complete configuration data is obtained based on the request message, the updated configuration data is re-initialized.

In the above solution, after the re-initialization of the updated configuration data, the method further includes:

Detecting whether there is unused configuration data within a set time interval from the current time point in the centralized configuration data cache;

When it is determined that the unused configuration data exists, delete the unused configuration data in the centralized configuration data cache within a set time interval from the current time point to obtain a corresponding cache space;

Adaptively storing the updated configuration data in the centralized configuration data cache based on the obtained cache space.

In the second aspect, the embodiment of the present invention also provides a configuration data management device, the device includes: a monitoring module, an acquisition module, a judgment module and a processing module; wherein,

The monitoring module is used to monitor whether the original configuration data pre-stored in the processing platform node changes;

The obtaining module is configured to obtain updated configuration data when it is detected that the original configuration data has changed, wherein the updated configuration data is generated in the following manner: according to the received The update buffer in writes the configuration data to be updated of the processing platform node, and updates and generates the original configuration data;

The judging module is used to judge whether the updated configuration data is stored in a preset centralized configuration data cache, and obtain a corresponding judgment result;

The processing module is configured to use a corresponding processing strategy to control the updated configuration data to be processed accordingly based on the judgment result.

In the above solution, the processing module is specifically configured to: directly re-initialize the updated configuration data when the judgment result indicates that the updated configuration data is stored in the centralized configuration data cache deal with.

In the above solution, the processing module is specifically configured to: send a request to the database to obtain complete configuration data when the judgment result indicates that the updated configuration data is not stored in the centralized configuration data cache Request message;

After the complete configuration data is obtained based on the request message, the updated configuration data is re-initialized.

In the above plan, the device also includes:

A detection module, configured to detect, after the processing module re-initializes the updated configuration data, whether there is an unused configuration data cache within a set time interval from the current time point in the centralized configuration data cache. Configuration Data;

A deletion module, configured to delete unused configuration data within a set time interval from the current time point in the centralized configuration data cache when it is determined that the unused configuration data exists, so as to obtain a corresponding cache space;

A storage module, configured to adaptively store the updated configuration data in the centralized configuration data cache based on the obtained cache space.

In the third aspect, the embodiment of the present invention also provides a device for managing configuration data, including a memory, a processor, and an executable program stored on the memory and capable of being run by the processor, and the processor runs the executable program. The program executes the steps of the configuration data management method provided by the embodiment of the present invention.

In a fourth aspect, the embodiment of the present invention further provides a storage medium on which an executable program is stored. When the executable program is executed by a processor, the steps of the method for managing configuration data provided by the embodiment of the present invention are implemented.

The configuration data management method, device, and storage medium provided by the embodiments of the present invention monitor whether the original configuration data pre-stored in the processing platform node changes; The updated configuration data, wherein, the updated configuration data is generated in the following manner: according to the received configuration data to be updated written into the processing platform node by the update cache in the database, the original update and generate the configuration data; judge whether the updated configuration data is stored in the preset centralized configuration data cache, and obtain the corresponding judgment result; based on the judgment result, use the corresponding processing strategy to control the processing of the The updated configuration data is processed accordingly. In this way, adopt the technical solution of the embodiment of the present invention, combine the processing platform such as Zookeeper platform and relational database to manage configuration data, write the configuration data to be updated from the update cache in the relational database to the processing platform node, to realize relational database The mapping of the database to the processing platform node, and the processing platform cooperates with the update cache and the centralized configuration data cache to realize the dynamic update of the configuration data, which can update the configuration data in real time and efficiently, and use the database table in the relational database to store complex and large quantities Huge configuration data can avoid configuration data modification errors, ensure the integrity and security of configuration data, and the business processing system process does not need to be restarted to facilitate later maintenance and upgrades.

Description of drawings

FIG. 1 is a schematic diagram of the implementation flow of a configuration data management method provided by an embodiment of the present invention;

FIG. 2 is a schematic diagram of an overall architecture of a configuration data management method provided by an embodiment of the present invention;

FIG. 3 is a schematic flowchart of a specific implementation of a configuration data management method provided by an embodiment of the present invention;

FIG. 4 is a schematic structural diagram describing the relationship between configuration data provided by an embodiment of the present invention;

FIG. 5 is a schematic functional structure diagram of a device for managing configuration data provided by an embodiment of the present invention;

FIG. 6 is a schematic functional structure diagram of another device for managing configuration data provided by an embodiment of the present invention;

FIG. 7 is a schematic diagram of a hardware structure of an apparatus for managing configuration data provided by an embodiment of the present invention.

Detailed ways

In order to be able to understand the features and technical contents of the embodiments of the present invention in more detail, the implementation of the embodiments of the present invention will be described in detail below with reference to the accompanying drawings. The accompanying drawings are for reference only and are not used to limit the present invention.

It should be noted that, in the following description, "some embodiments" are referred to, which describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset of all possible embodiments or different subsets and can be combined with each other without conflict.

Fig. 1 is the realization flow diagram of a kind of configuration data management method that the embodiment of the present invention provides, the management method of described configuration data can be applied in the processing platform such as Zookeeper platform; As shown in Fig. 1, provide in the embodiment of the present invention The implementation process of the configuration data management method may include the following steps:

Step 101: Monitor whether the original configuration data pre-stored in the processing platform node changes.

In the embodiment of the present invention, a processing platform node is a number of nodes deployed on a processing platform such as a Zookeeper platform, and the processing platform node can be used to store or obtain configuration data, wherein the configuration data in each database table corresponds to the storage In a processing platform node.

Step 102: Obtain updated configuration data when it is detected that the original configuration data has changed, wherein the updated configuration data is generated in the following manner: according to the received update cache in the database Write the to-be-updated configuration data of the processing platform node, and update and generate the original configuration data.

In the embodiment of the present invention, the configuration data to be updated is written into the processing platform node when the update cache receives the first feedback information sent by the database;

Wherein, the first feedback information is used to represent a notification message that the configuration data to be updated is successfully written into the database table in the database.

Here, whether the configuration data to be updated has been successfully written into the database table in the database can be judged through the mechanism of the implementation end of the Java code.

Here, the database is a relational database, and common relational databases may include, but are not limited to, MySQL databases and Oracle databases.

Specifically, the first feedback information in the embodiment of the present invention is used to represent a notification message that stores all configuration data to be updated in a relational database, such as a database table of a MySQL or Oracle database, that is, a notification message of the present invention In the embodiment, the configuration data to be updated with complex relationships is split into different database tables, and the complex relationship between the configuration data to be updated is realized through the association between database tables, and the strong constraint function of the relational database is used to ensure Integrity and correctness of the configuration data to be updated, so that there will be no wrong data between the associated configuration data to be updated, avoiding the risk of errors caused by modifying configuration files, and realizing the security of configuration data management to be updated sex.

It should be pointed out that, in the embodiment of the present invention, the configuration data to be updated can be written into the processing platform node in the following manner:

Create a key-value pair with the name of the database table as the key and the content of the configuration data to be updated as the value in the update cache;

Using the storage data structure of the key-value pair, the update cache writes the configuration data to be updated into the processing platform node.

That is to say, the embodiment of the present invention associates the processing platform node with the relational database in the form of a key-value pair whose key is the name of the database table and whose value is the content of the configuration data to be updated.

Here, the configuration data to be updated is also written into the update cache while being written into the database table in the database.

Step 103: Judging whether the updated configuration data is stored in a preset centralized configuration data cache, and obtaining a corresponding judgment result.

In order to adapt to the scene where the data volume of the updated configuration data is huge, the embodiment of the present invention improves the cache mechanism of the Zookeeper platform, that is, in addition to the cache of the Zookeeper platform itself, a centralized configuration data cache is also proposed. The configuration data cache is used to store the configuration data generated by updating the original configuration data, that is, the updated configuration data.

It should be noted that the updated configuration data cached in the centralized configuration data cache is usually some configuration data that is frequently modified, and which configuration data belongs to the frequently modified configuration data can be determined according to specific business requirements. Configuration Data. For example, in the data consistency comparison system, once a subsidiary company makes business adjustments, it needs to change the configuration of the comparison field. Therefore, the comparison field is the configuration data that often needs to be modified, that is, the configuration data that is modified more frequently; For example, in the 5+N access system of the mobile network platform, since the token (Token) certificate in the mobile network must be updated every day, the Token certificate belongs to the configuration data that changes frequently, that is, the configuration with more frequent modifications data.

In the embodiment of the present invention, the preset centralized configuration data cache may be queried based on the name of the database table, that is, whether the updated configuration data is stored in the preset centralized configuration data cache.

Step 104: Based on the judgment result, use a corresponding processing strategy to control the corresponding processing of the updated configuration data.

In some embodiments, the implementation process of step 104 may specifically include: when the judgment result indicates that the updated configuration data is stored in the centralized configuration data cache, directly Configure data for re -initialization processing.

In some embodiments, the implementation process of step 104 may specifically include: when the judgment result indicates that the updated configuration data is not stored in the centralized configuration data cache, sending a request to the database Get the request message of the complete configuration data;

After the complete configuration data is obtained based on the request message, the updated configuration data is re-initialized.

Here, the complete configuration data can be understood as the configuration data obtained by updating all the original configuration data, that is, the configuration data to be updated written into the processing platform node by the update cache in the database, completely replacing the processing platform The original configuration data stored in the node.

In the embodiment of the present invention, after the reinitialization of the updated configuration data, the method further includes:

Detecting whether there is unused configuration data within a set time interval from the current time point in the centralized configuration data cache;

When it is determined that the unused configuration data exists, delete the unused configuration data in the centralized configuration data cache within a set time interval from the current time point to obtain a corresponding cache space;

Adaptively storing the updated configuration data in the centralized configuration data cache based on the obtained cache space.

It should be pointed out that the set time interval may be set according to actual conditions, which is not limited here.

Adopt the technical scheme of the embodiment of the present invention, combine processing platform such as Zookeeper platform and relational database to manage configuration data, the configuration data to be updated is written into processing platform node by the update cache in relational database, to realize relational database to The mapping of processing platform nodes, and the processing platform cooperates with update cache and centralized configuration data cache to realize dynamic update of configuration data, which can update configuration data in real time and efficiently, and use database tables in relational databases to store complex and large-scale data Configuration data can avoid configuration data modification errors, ensure the integrity and security of configuration data, and the business processing system process does not need to be restarted, so as to facilitate later maintenance and upgrades.

Fig. 2 is a schematic diagram of an overall architecture of a method for managing configuration data provided by an embodiment of the present invention. As shown in Fig. 2 , the overall architecture of the method for managing configuration data may include two parts: a database management system (DBMS, Database Management System) In the relational database processing part and the Zookeeper platform processing part, the embodiment of the present invention adds an update cache to the relational database processing part, and adds a centralized configuration data cache to the Zookeeper platform processing part. When there is configuration data to be updated, write the configuration data to be updated into the database table of the relational database and the update cache at the same time, when the business processing system determines that the configuration data to be updated is successfully written into the database table in the relational database , the relational database feeds back a notification message that the configuration data is successfully written to the update cache. At this time, the update cache sends the configuration data to be updated to the corresponding processing platform node, such as the Znode node, to update the original stored in the Znode node. configuration data, so that updated configuration data can be generated; and the relational database notifies the Zookeeper server that the original configuration data in the Znode node has been updated, and the Zookeeper server will notify Zookeeper of the update of the original configuration data The client, the Zookeeper client requests the updated configuration data stored in the Znode node from the Zookeeper server, and uses the centralized configuration data cache to re-initialize the corresponding working components for the updated configuration data, so as to realize the dynamic update of the configuration data.

The specific implementation process of the configuration data management method provided by the embodiment of the present invention will be further described in detail below in conjunction with the overall framework of the configuration data management method shown in FIG. 2 .

FIG. 3 is a schematic diagram of a specific implementation process of a configuration data management method provided by an embodiment of the present invention. As shown in FIG. 3 , the specific implementation process of the configuration data management method may include the following steps:

Step 301: The business processing system obtains the input configuration data to be updated.

Step 302: The business processing system writes the configuration data to be updated into the database table of the relational database and the update cache at the same time.

In the embodiment of the present invention, the update cache is a newly added cache mechanism in the relational database processing part, and the update cache is mainly used to receive configuration data to be updated, such as service configuration data to be updated; the update In addition to receiving the configuration data to be updated, as described below, the update cache is also used to write the configuration data to be updated to the processing platform node when receiving the feedback information sent by the relational database, wherein , the feedback information is used to represent a notification message that the configuration data to be updated is successfully written into the database table in the relational database.

Step 303: When it is determined that the configuration data to be updated is successfully written into the database table of the relational database, the relational database sends corresponding feedback information to the update cache.

In the embodiment of the present invention, the feedback information is used to represent a notification message that the configuration data to be updated is successfully written into the database table of the relational database.

Here, it may be judged through the mechanism of the Java code implementation end whether the configuration data to be updated has been successfully written into the database table of the relational database.

In practical applications, common relational databases may include, but are not limited to, MySQL databases and Oracle databases. Specifically, the feedback information in the embodiment of the present invention is used to represent the notification message that all configuration data to be updated are stored in a relational database, such as a database table of MySQL or Oracle database, and the embodiment of the present invention uses the relational Type database to store configuration data with complex relationships and a large amount, that is, split the configuration data to be updated with complex relationships and a large amount into different database tables, and implement the configuration to be updated through the association between relational database tables For the complex relationship between data, the integrity and correctness of the configuration data to be updated are guaranteed through the strong constraint function of the relational database, so that no wrong data will appear between the associated configuration data to be updated, and configuration file modification is avoided The risk of error brought about realizes the security of the management of the configuration data to be updated.

In practical applications, for the settlement data collection system, the data collection business usually requires a lot of configuration data, and corresponding tables can be established for these configuration data, and the relationship between the configuration data can be described by using the association relationship between the tables. Fig. 4 is a schematic structural diagram describing the relationship between configuration data provided by an embodiment of the present invention. As shown in Fig. 4, the collection service is first defined, and each collection service will execute at least two collection tasks, such as collection task 1 , ..., collection task n, and to perform multiple collection tasks, it is necessary to collect configuration data such as directory, collection file name, collection host address, etc. The relationship between these configuration data can be maintained by the association relationship between tables

It should be pointed out that when it is judged that the configuration data to be updated is successfully written into the database table of the relational database, it indicates that the written configuration data to be updated conforms to the constraints of the relational database, that is, when the relational database is completed The original configuration data can only be updated after the storage verification. When it is determined that the configuration data to be updated has not been successfully written into the database table of the relational database, it indicates that there may be a problem with the configuration data to be updated. At this time, it is necessary to check the details of the problem so that the configuration data update process is completed and the configuration can be updated. Data security.

Step 304: After the update cache receives the feedback information sent by the relational database, write the configuration data to be updated into the processing platform node, and update the original configuration data pre-stored in the processing platform node to generate an updated configuration data.

In the embodiment of the present invention, a processing platform node is a number of nodes deployed on a processing platform such as a Zookeeper platform, and the processing platform node can be used to store or obtain configuration data, wherein the configuration data in each database table corresponds to the storage In a processing platform node.

In the embodiment of the present invention, the configuration data to be updated may be written to the processing platform node in the following manner:

Create a key-value pair with the name of the database table as the key and the content of the configuration data to be updated as the value in the update cache;

Using the storage data structure of the key-value pair, the update cache writes the configuration data to be updated into the processing platform node.

That is to say, the embodiment of the present invention associates the processing platform node with the relational database in the form of a key-value pair whose key is the name of the database table and whose value is the content of the configuration data to be updated. Assuming that the key (Key) is used to represent the name of the database table Table Name, and the value (Value) is used to represent the content of the configuration data to be updated Update Data, therefore, the storage data structure is in the form of a Key-Value pair, which can be expressed as <Table Name, update data>.

Here, based on the actual experience of business processing system development, only a small part of the original configuration data will be modified after the business processing system is running. If configuration files are used to manage configuration data, then the original configuration data only needs to be slightly modified , it is necessary to re-read the entire configuration file. Therefore, in the case of a huge amount of modified configuration data, the update efficiency of the configuration data will be reduced. However, the embodiment of the present invention combines a processing platform such as a Zookeeper platform and a relational database to manage Configuration data, write the configuration data to be updated from the update cache in the relational database to the processing platform node, and the configuration data to be updated will only modify a small amount of original configuration data, and only transmit the small amount of updated configuration data , which has good real-time performance for managing configuration data.

Step 305: The client side of the processing platform requests to obtain updated configuration data.

Step 306: After acquiring the updated configuration data, the processing platform judges whether the updated configuration data is stored in the centralized configuration data cache, and obtains a corresponding judgment result.

In order to adapt to the scene where the data volume of the updated configuration data is huge, the embodiment of the present invention improves the cache mechanism of the Zookeeper platform, that is, in addition to the cache of the Zookeeper platform itself, a centralized configuration data cache is also proposed. The configuration data cache is used to store the configuration data generated by updating the original configuration data, that is, the updated configuration data.

It should be noted that the updated configuration data cached in the centralized configuration data cache is usually some configuration data that is frequently modified, and which configuration data belongs to the frequently modified configuration data can be determined according to specific business requirements. Configuration Data. For example, in the data consistency comparison system, once a subsidiary company makes business adjustments, it needs to change the configuration of the comparison field. Therefore, the comparison field is the configuration data that often needs to be modified, that is, the configuration data that is modified more frequently; For example, in the mobile network platform 5+N access system, because the token certificate on the mobile network is updated every day, the token certificate is a regular configuration data that changes frequently, that is, the configuration data with more frequency modification.

In the embodiment of the present invention, the preset centralized configuration data cache may be queried based on the name of the database table, that is, whether the updated configuration data is stored in the preset centralized configuration data cache.

Step 307: When the judgment result indicates that the updated configuration data is stored in the centralized configuration data cache, the processing platform directly re-initializes the updated configuration data, and ends the current processing flow.

Step 308: When the judgment result indicates that the updated configuration data is not stored in the centralized configuration data cache, the processing platform sends a request message to the relational database requesting to obtain complete configuration data.

Step 309: After the processing platform obtains the complete configuration data based on the request message, it re-initializes the updated configuration data, and ends the current processing flow.

In the embodiment of the present invention, after the re-initialization of the updated configuration data, the method further includes:

Detecting whether there is unused configuration data within a set time interval from the current time point in the centralized configuration data cache;

When it is determined that the unused configuration data exists, delete the unused configuration data in the centralized configuration data cache within a set time interval from the current time point to obtain a corresponding cache space;

Adaptively storing the updated configuration data in the centralized configuration data cache based on the obtained cache space.

It should be pointed out that the set time interval may be set according to actual conditions, which is not limited here.

By adopting the technical solution of the embodiment of the present invention, compared with using configuration files to manage configuration data, using a relational database to manage configuration data can avoid configuration data modification errors and ensure the integrity and correctness of configuration data; in addition, using a relational database The database tables in the database store configuration data in sub-tables, which can separate a small amount of updated configuration data, and only need to pass a small amount of updated configuration data to the business process without re-reading the data of the entire configuration file, reducing the The amount of data transmission has better real-time performance; compared with only using a relational database to manage configuration data, the embodiment of the present invention combines a processing platform such as a Zookeeper platform and a relational database to jointly manage configuration data, and introduces an update cache and centralized The configuration data cache can update the original configuration data in real time and efficiently, and the business processing system does not need to be restarted, which facilitates the later maintenance and upgrade of the system.

In order to achieve the management method of the above configuration data, the embodiment of the present invention also provides a management device configuring data that configures the data can be applied to the server. Figure 5 is a configuration data provided by the invention embodiment. The functional structure diagram of the management device; as shown in Figure 5, the management device of the configuration data includes: monitoring module 51, acquisition module 52, judgment module 53, and processing module 54. The functions of the above program modules will be described below. in,

The monitoring module 51 is used to monitor whether the original configuration data pre-stored in the processing platform node changes;

The obtaining module 52 is configured to obtain updated configuration data when it is detected that the original configuration data has changed, wherein the updated configuration data is generated in the following manner: according to the received The update cache in the database writes the configuration data to be updated of the processing platform node, and updates and generates the original configuration data;

The judging module 53 is configured to judge whether the updated configuration data is stored in a preset centralized configuration data cache, and obtain a corresponding judging result;

The processing module 54 is configured to use a corresponding processing strategy to control the updated configuration data to be processed accordingly based on the judgment result.

In the embodiment of the present invention, the configuration data to be updated is written into the processing platform node when the update cache receives the first feedback information sent by the database;

Wherein, the first feedback information is used to represent a notification message that the configuration data to be updated is successfully written into the database table in the database.

In the embodiment of the present invention, when the configuration data to be updated is written into the database table in the database, it is also written into the update cache.

In the embodiment of the present invention, the configuration data to be updated is written into the processing platform node in the following manner:

Create a key-value pair with the name of the database table as the key and the content of the configuration data to be updated as the value in the update cache;

Using the storage data structure of the key-value pair, the update cache writes the configuration data to be updated into the processing platform node.

In some embodiments, for the processing module 54 to use the corresponding processing strategy to control the corresponding processing of the updated configuration data based on the judgment result, the following methods can be adopted: when the judgment result When the updated configuration data is stored in the centralized configuration data cache, the updated configuration data is directly re-initialized.

In some embodiments, for the processing module 54 to use the corresponding processing strategy to control the corresponding processing of the updated configuration data based on the judgment result, the following methods can be adopted: when the judgment result When indicating that the updated configuration data is not stored in the centralized configuration data cache, sending a request message requesting to obtain complete configuration data to the database;

After the complete configuration data is obtained based on the request message, the updated configuration data is re-initialized.

Fig. 6 is a schematic functional structure diagram of another device for managing configuration data provided by an embodiment of the present invention. As shown in Fig. 6, the device for managing configuration data further includes:

The detection module 55 is configured to detect, after the processing module 54 re-initializes the updated configuration data, whether there is any in the centralized configuration data cache that has not been processed within a set time interval from the current time point. The configuration data used;

A deletion module 56, configured to delete unused configuration data within a set time interval from the current time point in the centralized configuration data cache when the detection module 55 determines that the unused configuration data exists , To obtain the corresponding cache space;

The storage module 57 is configured to adaptively store the updated configuration data in the centralized configuration data cache based on the obtained cache space.

It should be noted that the management device of the configuration data provided by the above embodiments is managed when managing the configuration data, and only the above -mentioned program modules are divided into examples. In practical applications, the above processing can be allocated from different ones according to needs. The program module is completed, and the internal structure of the management device that is about to configure the data is divided into different program modules to complete all or part of the above description. In addition, the management devices of the configuration data provided by the above embodiments are the same concept as the management method of configuration data. For details of the specific implementation process, see the implementation examples, which will not be repeated in detail here.

In practical applications, the monitoring module 51, acquisition module 52, judgment module 53, processing module 54, detection module 55, deletion module 56 and storage module 57 can all be located on the central processing unit (CPU, Central Processing Unit) on the server, Implementations such as a microprocessor (MPU, Micro Processor Unit), a digital signal processor (DSP, Digital Signal Processor) or a field programmable gate array (FPGA, Field Programmable GateArray).

In order to implement the above configuration data management method, an embodiment of the present invention further provides a hardware structure of a configuration data management device. A configuration data management device implementing an embodiment of the present invention, which can be implemented in various forms of servers, will now be described with reference to the accompanying drawings. The hardware structure of the configuration data management device of the embodiment of the present invention will be further described below. It can be understood that FIG. 7 only shows an exemplary structure of the configuration data management device but not the entire structure, and the configuration data shown in FIG. 7 can be implemented as required. Some structures or all structures.

See Figure 7, FIG. 7 is a hardware structure diagram of the management device that configures the data provided by the invention embodiment. In practical applications, it can be applied to various servers that run the application in the aforementioned application. 700 includes: at least one processor 701, memory 702, user interface 703, and at least one network interface 704. Each component of the management device 700 of the configuration data is coupled together through the bus system 705. It is understandable that the bus system 705 is used to implement connection communication between these components. In addition to the data bus, the bus system 705 also includes a power bus, a control bus and a status signal bus. However, in order to clarify, various bus system 705 was marked in Figure 7.

Wherein, the user interface 703 may include a display, a keyboard, a mouse, a trackball, a click wheel, keys, buttons, a touch panel or a touch screen, and the like.

It will be appreciated that memory 702 may be either volatile memory or non-volatile memory, and may include both volatile and non-volatile memory.

The memory 702 in the embodiment of the present invention is used to store various types of data to support the operation of the management device 700 for configuring data. Examples of these data include: any computer program for operating on the configuration data management device 700, such as an executable program 7021 and an operating system 7022. Program 7021.

The management method of the configuration data revealed by the embodiment of the present invention can be applied to the processor 701, or it is implemented by the processor 701. The processor 701 may be an integrated circuit chip with signal processing capability. During the implementation process, each step of the management method of the above configuration data can be completed through the integrated logic circuit or software form in the processor 701. The above processor 701 may be general processors, DSPs, or other programmable logic devices, separate doors or crystal tube logic devices, and separate hardware components. The processor 701 can implement or execute the management methods, steps and logic box diagrams of each configuration data provided by the present invention. A general purpose processor may be a microprocessor or any conventional processor or the like. The steps of the configuration data provided by the embodiment provided by the invention can be directly reflected in the execution of the hardware decoding processor, or the combination of the hardware and software module in the decoder processor is completed. The software module can be located in the storage medium. The storage medium is located in the memory 702, the processor 701 reads the information in the memory 702, and combines its hardware to complete the steps of the management method provided by the embodied data provided by the invention.

In the embodiment of the present invention, the device 700 for managing configuration data includes a memory 702, a processor 701, and an executable program 7021 stored on the memory 702 and capable of being run by the processor 701, and the processor 701 runs the When the executable program 7021 is executed: monitor whether the original configuration data pre-stored in the processing platform node changes; when the original configuration data is detected to be changed, obtain updated configuration data, wherein the updated The configuration data is generated in the following manner: according to the received configuration data to be updated written into the processing platform node by the update cache in the database, the original configuration data is updated and generated; after the update is judged According to whether the configuration data is stored in the preset centralized configuration data cache, a corresponding judgment result is obtained; based on the judgment result, the corresponding processing strategy is used to control the corresponding processing of the updated configuration data.

As an implementation manner, when the processor 701 runs the executable program 7021, it is realized that the configuration data to be updated is written into the update cache when receiving the first feedback information sent by the database. The processing platform node; wherein, the first feedback information is used to represent a notification message that the configuration data to be updated is successfully written into the database table in the database.

As an implementation manner, when the processor 701 runs the executable program 7021, it is realized that: while the configuration data to be updated is written in the database table in the database, it is also written in the Update the cache.

As an implementation manner, when the processor 701 runs the executable program 7021, it is realized that: the configuration data to be updated is written into the processing platform node in the following manner: create in the update cache The name of the database table is a key, and the content of the configuration data to be updated is a key-value pair; the storage data structure of the key-value pair is used to write the configuration data to be updated by the update cache Enter the processing platform node.

As an implementation manner, when the processor 701 runs the executable program 7021, it is implemented: when the judgment result indicates that the updated configuration data is stored in the centralized configuration data cache, directly The updated configuration data is reinitialized.

As an implementation manner, when the processor 701 runs the executable program 7021, it realizes: when the judgment result indicates that the updated configuration data is not stored in the centralized configuration data cache, send the The database sends a request message requesting to obtain complete configuration data; after the complete configuration data is obtained based on the request message, the updated configuration data is re-initialized.

As an implementation manner, when the processor 701 runs the executable program 7021, it is implemented: after the re-initialization of the updated configuration data is performed, it is detected in the centralized configuration data cache whether there is Configuration data that has not been used within the set time interval from the current time point; when it is determined that there is the unused configuration data, cache the centralized configuration data that is not The used configuration data is deleted to obtain a corresponding cache space; based on the obtained cache space, the updated configuration data is adaptively stored in the centralized configuration data cache.

In an exemplary embodiment, the embodiment of the present invention further provides a storage medium, the storage medium may be a storage medium such as an optical disk, a flash memory, or a magnetic disk, and may optionally be a non-transitory storage medium.

In the embodiment of the present invention, an executable program 7021 is stored on the storage medium, and when the executable program 7021 is executed by the processor 701, it is implemented to: monitor whether the original configuration data pre-stored in the processing platform node changes; When the original configuration data changes, the updated configuration data is obtained, wherein the updated configuration data is generated in the following manner: according to the received update cache in the database, write the processing For the configuration data to be updated of the platform node, update and generate the original configuration data; judge whether the updated configuration data is stored in the preset centralized configuration data cache, and obtain the corresponding judgment result; based on the According to the judgment result, the corresponding processing policy is used to control the updated configuration data to be processed accordingly.

As an implementation manner, when the executable program 7021 is executed by the processor 701, it is realized that the configuration data to be updated is written into the update cache when the first feedback information sent by the database is received. The processing platform node; wherein, the first feedback information is used to represent a notification message that the configuration data to be updated is successfully written into the database table in the database.

As an implementation manner, when the executable program 7021 is executed by the processor 701, it is realized that: while the configuration data to be updated is written in the database table in the database, it is also written in the update In cache.

As an implementation, when the executable program 7021 is executed by the processor 701, it is realized that: the configuration data to be updated is written into the processing platform node in the following manner: create in the update cache with the The name of the database table is the key value pair based on the content of the content of the content of the configuration data to be updated; the storage data structure of the key value pair will be written by the renewal cache to write the configuration data to be updated to the update data to the updated data to the updated data to the update data to the updated data to The processing platform node.

As an implementation manner, when the executable program 7021 is executed by the processor 701, it is implemented: when the judgment result indicates that the updated configuration data is stored in the centralized configuration data cache, directly update the The subsequent configuration data is re -initialized.

As an implementation manner, when the executable program 7021 is executed by the processor 701, it realizes: when the judgment result indicates that the updated configuration data is not stored in the centralized configuration data cache, send Sending a request message requesting to obtain complete configuration data; after obtaining the complete configuration data based on the request message, performing re-initialization processing on the updated configuration data.

As an embodiment, the execution program 7021 is implemented when the processor 701 is executed: after re -initialization of the updated configuration data, check whether there is a distance in the concentrated configuration data cache in the cache of the centralized configuration data cache. The configuration data that is not used in the current time point is set in the time interval; when the unused configuration data is determined, the centralized configuration data cache is not within the set time interval of the current time point. Delete the configuration data used to obtain the corresponding cache space; based on the cache space obtained, the updated configuration data adaptability is stored in the buffer of the centralized configuration data.

In summary, the configuration data management method provided by the embodiment of the present invention combines a processing platform such as a Zookeeper platform and a relational database to manage the configuration data, and writes the configuration data to be updated into the update cache in the relational database for processing Platform nodes to realize the mapping from relational database to processing platform nodes, and the processing platform cooperates with update cache and centralized configuration data cache to realize dynamic update of configuration data, which can update configuration data in real time and efficiently. The database table stores complex and large amount of configuration data, which can avoid configuration data modification errors, ensure the integrity and security of configuration data, and the business processing system process does not need to be restarted to facilitate later maintenance and upgrades.

Those skilled in the art should understand that the technical solutions described in the embodiments of the present invention can be combined arbitrarily without conflict.

Technical personnel in the art should understand that the embodiments of the present invention can provide a method, system, or executable program product. Accordingly, the invention may take the form of a hardware embodiment, a software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of an executable program product embodied on one or more computer-usable storage media (including but not limited to magnetic disk storage, optical storage, etc.) having computer-usable program code embodied therein.

The present invention is described by reference to the method, equipment (system), and the flowchart and/or box diagram of the executable program products. It should be understood that the process chart and/or box diagram can be implemented by the executable program instructions and/or boxes in the box diagram. These executable program instructions can be provided to a processor that can be used to generate a machine with general computers, dedicated computers, embedded processing machines or reference programmable data processing devices to generate a machine, so that instructions executed by computers or reference programmable devices perform instructions to generate instructions generated by the processor execution of the processor processing device. It is used to implement a function device specified in a process diagram of a process or multiple processes and/or box diagrams.

These executable program instructions may also be stored in a computer-readable memory capable of directing a computer or reference programmable data processing apparatus to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising instruction means, the The instruction means implements the functions specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

These executable program instructions can also be loaded onto a computer or reference programmable data processing device, causing a series of operational steps to be performed on the computer or reference programmable device to produce a computer-implemented process for execution on the computer or reference programmable device The instructions provide steps for implementing the functions specified in the procedure or procedures of the flowchart and/or the block or blocks of the block diagram.

The above description is only a preferred embodiment of the present invention, and is not used to limit the protection scope of the present invention. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present invention shall be included in the Within the protection scope of the present invention.

Claims (10)

1. A management method for configuration data, characterized in that the method comprises: Monitor whether the original configuration data pre-stored in the processing platform node changes; When it is detected that the original configuration data has changed, the updated configuration data is obtained, wherein the updated configuration data is generated in the following manner: according to the received update cache written in the database The configuration data to be updated of the processing platform node is updated to generate the original configuration data; Judging whether the updated configuration data is stored in a preset centralized configuration data cache, and obtaining a corresponding judgment result; Based on the judgment result, corresponding processing is performed on the updated configuration data by using a corresponding processing policy control. 2. The management method of configuration data according to claim 1, wherein the configuration data to be updated is written into the processing when the update cache receives the first feedback information sent by the database. Platform node; Wherein, the first feedback information is used to represent a notification message that the configuration data to be updated is successfully written into the database table in the database. 3. The management method of configuration data according to claim 2, wherein the configuration data to be updated is also written in the update cache while being written in the database table in the database middle. 4. The management method of configuration data according to claim 2, characterized in that, the configuration data to be updated is written into the processing platform node in the following manner: Create a key-value pair with the name of the database table as the key and the content of the configuration data to be updated as the value in the update cache; Using the storage data structure of the key-value pair, the update cache writes the configuration data to be updated into the processing platform node. 5. The management method of the configuration data according to claim 1 is characterized by the use of the corresponding processing strategy to control the updated configuration data based on the results of the judgment, including: include: When the judgment result indicates that the updated configuration data is stored in the centralized configuration data cache, the updated configuration data is directly reinitialized. 6. The management method of configuration data according to claim 1, characterized in that, based on the judgment result, using a corresponding processing strategy to control the corresponding processing of the updated configuration data includes: When the judgment result indicates that the updated configuration data is not stored in the centralized configuration data cache, sending a request message requesting to obtain complete configuration data to the database; After the complete configuration data is obtained based on the request message, the updated configuration data is re-initialized. 7. The management method of configuration data according to claim 6, characterized in that, after the re-initialization process is performed on the updated configuration data, the method further comprises: Detecting whether there is unused configuration data within a set time interval from the current time point in the centralized configuration data cache; When it is determined that the unused configuration data exists, delete the unused configuration data in the centralized configuration data cache within a set time interval from the current time point to obtain a corresponding cache space; Adaptively storing the updated configuration data in the centralized configuration data cache based on the obtained cache space. 8. A management device for configuration data, characterized in that the device comprises: a monitoring module, an acquisition module, a judging module and a processing module; wherein, The monitoring module is used to monitor whether the original configuration data pre-stored in the processing platform node changes; The obtaining module is configured to obtain updated configuration data when it is detected that the original configuration data has changed, wherein the updated configuration data is generated in the following manner: according to the received The update buffer in writes the configuration data to be updated of the processing platform node, and updates and generates the original configuration data; The judging module is used to judge whether the updated configuration data is stored in a preset centralized configuration data cache, and obtain a corresponding judgment result; The processing module is configured to use a corresponding processing strategy to control the updated configuration data to be processed accordingly based on the judgment result. 9. A device for managing configuration data, comprising a memory, a processor, and an executable program stored on the memory and capable of being run by the processor, characterized in that, when the processor runs the executable program, it executes the following: The steps of the method for managing configuration data according to any one of claims 1 to 7. 10. A storage medium, on which an executable program is stored, wherein when the executable program is executed by a processor, the steps of the method for managing configuration data according to any one of claims 1 to 7 are realized.