CN118981505B - An integrated collation system based on multi-link data of the industrial chain - Google Patents
An integrated collation system based on multi-link data of the industrial chain Download PDFInfo
- Publication number
- CN118981505B CN118981505B CN202411455351.1A CN202411455351A CN118981505B CN 118981505 B CN118981505 B CN 118981505B CN 202411455351 A CN202411455351 A CN 202411455351A CN 118981505 B CN118981505 B CN 118981505B
- Authority
- CN
- China
- Prior art keywords
- log
- link
- production
- priority
- initial
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/219—Managing data history or versioning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses an integrated arrangement system based on industrial chain multi-link data, and relates to the technical field of data processing. The integrated arrangement system based on the industrial chain multi-link data comprises a log acquisition module, a resident database module, a single-pass database module and a storage data determination module, wherein the log acquisition module is used for acquiring a first production log under each production link of a current production stage and a second production log under each production link of a historical production stage, the resident database module is used for constructing a resident database based on each second production log, the resident database is used for storing data with guiding significance for the whole industrial chain in the historical production stage, the single-pass database module is used for constructing a single-pass database corresponding to each production link based on each first production log, the single-pass database is used for storing data with guiding significance only for the corresponding production link in the industrial chain in the current production stage, and the storage data determination module is used for determining storage data corresponding to block chain nodes of each production link in the industrial chain according to the resident database and the single-pass database.
Description
Technical Field
The invention relates to the technical field of data processing, in particular to an integrated arrangement system based on industrial chain multi-link data.
Background
Along with the advancement of digital transformation, various industries face the challenge of mass data, and how to effectively integrate data from various production links in industrial chains such as purchasing, production, logistics, sales and the like becomes an important task for improving the operation efficiency.
In the existing method, a blockchain node is built in each production link by using a blockchain technology, all data of each production link are shared into the blockchain nodes of all production links by using the blockchain technology, and therefore the data integration and arrangement of multiple links of an industrial chain are realized.
However, in the industrial chain, only a part of data is used in each production link, and all data is shared into the block chain node of each production link by the existing method, so that the data stored in each block chain node is redundant and the system performance is low.
Disclosure of Invention
The embodiment of the invention provides an integrated arrangement system based on industrial chain multi-link data, which can reduce the data quantity stored by chain link points of each block and improve the performance of the integrated arrangement system.
In a first aspect of the embodiments of the present invention, an integrated sorting system based on industrial chain multi-link data is provided, including:
The log acquisition module is used for acquiring a first production log under each production link of the current production stage and a second production log under each production link of the historical production stage;
the resident database module is used for constructing a resident database based on each second production log, and the resident database is used for storing data with guiding significance for the whole industrial chain in the historical production stage;
The single-pass database module is used for constructing a single-pass database corresponding to each production link based on each first production log, and the single-pass database is used for storing data which only has guiding significance on the corresponding production link in the industrial chain in the current production stage;
And the storage data determining module is used for determining storage data corresponding to the blockchain nodes of each production link in the industrial chain according to the resident database and the single-pass database.
In the integrated arrangement system based on the industrial chain multi-link data, the resident database module selects the data with guiding significance for the whole industrial chain to construct the resident database according to the calling condition of the log in each production link in the historical production stage. And then the single-pass database module only selects data with guiding significance for the corresponding production links in the industrial chain to construct the single-pass database module according to the calling condition of the logs in each production link in the current production stage. And finally, the stored data determining module determines the stored data corresponding to the blockchain nodes of each production link in the industrial chain according to the resident database and the single-pass database. Thus, the embodiment of the invention synchronizes only meaningful data according to the resident database and the single-pass database, while nonsensical data is not synchronized. The sharing of the local block chain data is realized, so that the data volume stored by the link points of each block is reduced, and the performance of the integrated arrangement system can be improved.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions and advantages of the prior art, the following description will briefly explain the drawings used in the embodiments or the description of the prior art, and it is obvious that the drawings in the following description are only some embodiments of the invention, and other drawings can be obtained according to the drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of an integrated management system based on industrial chain multi-link data according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a single pass database module according to one embodiment of the present invention;
FIG. 3 is a schematic diagram of a priority determining unit according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a priority correction unit according to an embodiment of the invention.
Detailed Description
In order to further describe the technical means and effects adopted by the invention to achieve the preset aim, the following is a detailed description of specific implementation, structure, characteristics and effects of an integrated finishing system based on industrial chain multi-link data according to the invention with reference to the attached drawings and the preferred embodiment. In the following description, different "one embodiment" or "another embodiment" means that the embodiments are not necessarily the same. Furthermore, the particular features, structures, or characteristics of one or more embodiments may be combined in any suitable manner.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.
It should be noted that, in the technical scheme of the invention, the acquisition, storage, use, processing and the like of the data all conform to the relevant regulations of laws and regulations.
It should be noted that, in the embodiments of the present invention, some existing solutions in the industry such as software, components, models, etc. may be mentioned, and they should be regarded as exemplary, only for illustrating the feasibility of implementing the technical solution of the present invention, but it does not mean that the applicant has or must not use the solution.
In the existing method, a blockchain node is built in each production link by using a blockchain technology, all data of each production link are shared into the blockchain nodes of all production links by using the blockchain technology, and therefore the data integration and arrangement of multiple links of an industrial chain are realized. However, in the industrial chain, only a part of data is used in each production link, and all data is shared into the block chain node of each production link by the existing method, so that the data stored in each block chain node is redundant and the system performance is low.
The invention aims to provide an integrated arrangement system based on industrial chain multi-link data. In the integrated arrangement system based on the industrial chain multi-link data, the resident database module selects the data with guiding significance for the whole industrial chain to construct the resident database according to the calling condition of the log in each production link in the historical production stage. And then the single-pass database module only selects data with guiding significance for the corresponding production links in the industrial chain to construct the single-pass database module according to the calling condition of the logs in each production link in the current production stage. And finally, the stored data determining module determines the stored data corresponding to the blockchain nodes of each production link in the industrial chain according to the resident database and the single-pass database. Thus, the embodiment of the invention synchronizes only meaningful data according to the resident database and the single-pass database, while nonsensical data is not synchronized. The sharing of the local block chain data is realized, so that the data volume stored by the link points of each block is reduced, and the performance of the integrated arrangement system can be improved.
The following describes a specific embodiment of an integrated arrangement system based on industrial chain multi-link data provided by the embodiment of the invention.
As shown in fig. 1, a schematic structural diagram of an integrated management system based on industrial chain multi-link data is provided. The integrated collation system 100 based on industrial chain multi-loop data includes a log acquisition module 110, a resident database module 120, a single pass database module 130, and a stored data determination module 140.
The log obtaining module 110 is configured to obtain a first production log under each production link of the current production stage and a second production log under each production link of the historical production stage.
In this embodiment, the first production log is used to represent the production log under each production link in the current production stage, and the second production log is used to represent the production log under each production link in the historical production stage. One production stage may include a plurality of production links, each production link may include a plurality of projects, and each project corresponds to one production log.
As an example, the log obtaining module 110 collects the production log under each production link in the current production stage in real time through an automated data collection system of each production link. Then, the production log under each production link in the previous production stage is extracted from the database. Specifically, the production log includes various log data, which may include an operator (IP address), an access time of the operator, a database address accessed by the operator, and specific operation contents.
The resident database module 120 is configured to construct a resident database based on each second production log, where the resident database is configured to store data having guiding significance for the whole industry chain in the historical production stage.
In this embodiment, the resident database is used to store data that has instructive significance for the entire industry chain during the historical production phase.
As one example, the resident database module 120 extracts data having guiding significance to the whole industrial chain through data mining and machine learning techniques based on each second production log. Such as optimal production parameters, material consumption rules, quality control criteria, etc. After verification and auditing, the data are stored in a resident database.
The single-pass database module 130 is configured to construct a single-pass database corresponding to each production link based on each first production log, where the single-pass database is configured to store data that only has guiding significance for the corresponding production link in the industrial chain in the current production stage.
In this embodiment, the single-pass database is used to store data that has only guiding significance for the corresponding production links in the industrial chain in the current production stage.
As one example, the single pass database module 130 builds a separate single pass database for each production link based on each first production log. The data stored in these single pass databases may include, in particular, production data for the current production stage, quality control records, abnormal situation handling, etc. The data of the single-pass database is updated in real time so as to ensure the accuracy and timeliness of the data.
The stored data determining module 140 is configured to determine stored data corresponding to blockchain nodes in each production link in the industrial chain according to the resident database and the single-pass database.
In this embodiment, the storage data determining module 140 determines the storage data corresponding to the blockchain node of each production link in the industry chain according to the data in the resident database and the single-pass database.
Specifically, the stored data determination module 140 packages all data in the resident database with data in each single pass database according to the data format of the blockchain, ensuring the integrity and non-tamper resistance of the data. And uploading the packed data to a blockchain node corresponding to the single-way database, so as to realize sharing and tracing of the data. That is, the data stored by the blockchain nodes of each production link in the final industrial chain includes all the data in the resident database and all the data in the corresponding single pass database.
In the integrated arrangement system 100 based on multi-link data of an industrial chain provided in this embodiment, the resident database module 120 selects data having guiding significance for the whole industrial chain to construct a resident database according to the calling condition of the log in each production link in the historical production stage. And then the single-pass database module 130 only selects data having guiding significance for the corresponding production links in the industrial chain to construct the single-pass database module according to the calling condition of the logs in each production link in the current production stage. Finally, the stored data determining module 140 determines the stored data corresponding to the blockchain node of each production link in the industrial chain according to the resident database and the single-pass database. Thus, the embodiment of the invention synchronizes only meaningful data according to the resident database and the single-pass database, while nonsensical data is not synchronized. The sharing of the local block chain data is realized, so that the data volume stored by the link points of each block is reduced, and the performance of the integrated arrangement system can be improved.
As an alternative embodiment, the historical production phases include a first historical production phase that is a previous production phase to the current production phase and a second historical production phase that is a previous production phase to the first historical production phase;
The resident database module 120 may be specifically configured to:
Screening each second production log to obtain a first historical production log in a first historical production stage and a second historical production log in a second historical production stage;
Screening a target historical production log which invokes a second historical production log from the first historical production log based on the first historical production log and the second historical production log;
And constructing a resident database based on the log data in the target historical production log.
In this embodiment, the resident database module 120 first obtains a first historical production log for each production link in the first historical production stage and a second historical production log for each production link in the second historical production stage.
Then, the resident database module 120 screens the target historical production log, which has called the second historical production log, from the first historical production logs according to the first historical production log and the second historical production log.
And finally, constructing a resident database according to the log data in the target historical production log. Specifically, the resident database includes, but is not limited to, an operator (IP address) corresponding to the target historical production log, an access time of the operator, a database address accessed by the operator, and specific operation contents. Meanwhile, in the construction process, the log data can be subjected to cleaning, de-duplication, standardization and other treatments so as to improve the accuracy and usability of the data.
Through this embodiment, the resident database module 120 obtains the history production logs corresponding to each history production stage in advance, and then screens the history production logs corresponding to each history production stage to obtain the target history production log. Thus, according to the target historical production log, a resident database containing rich historical information is constructed and used for storing data with guiding significance on the whole industrial chain in the historical production stage. Therefore, meaningless historical production logs are removed by screening the historical production logs, so that the data volume stored by the chain link points of each block is reduced, and the performance of the integrated arrangement system can be improved.
As an alternative embodiment, as shown in fig. 2, the single pass database module 130 specifically includes the following elements:
the priority determining unit 131 is configured to determine, according to a first link log and a second link log in the first production logs, an initial call priority of the first production link to each second link log, where the first link log is a log belonging to the first production link in each first production log, and the second link log is a log of each production link preceding the first production link in each first production log;
The log screening unit 132 is configured to screen, based on the order of magnitude of each initial call priority, an initial single-way log and a preliminary single-way log in each second link log, where the initial single-way log is used to represent a log with an initial call priority greater than a first priority threshold, and the preliminary single-way log is used to represent a log with an initial call priority between the first priority threshold and a second priority threshold, and the first priority threshold is greater than the second priority threshold;
The priority correction unit 133 is configured to correct the initial call priorities of the initial single-way logs and the preliminary single-way logs based on the respective priority correction coefficients of the initial single-way logs and the preliminary single-way logs, respectively, so as to obtain final call priorities of the initial single-way logs and the preliminary single-way logs;
the log screening unit 132 is further configured to screen and obtain a target single-way log from each initial single-way log and each preliminary single-way log based on the order of the final call priorities;
and the single-pass database construction unit 134 is configured to construct a single-pass database corresponding to the first production link based on the log data in the target single-pass log.
In this embodiment, one production stage includes several production links arranged in sequence. The first link logs are logs belonging to the first production links in each first production log, and the second link logs are logs belonging to production links before the first production links in each first production log.
The calling priority is used for representing the dependence degree of the first production link on the logs of each second link and the importance degree of each second link log on the first production link.
The target single pass log is a log used to build a single pass database.
As an example, in a case where it is necessary to construct a single-pass database corresponding to a first production link, the priority determination unit 131 screens out the first link logs belonging to the first production link and the second link logs belonging to the production links preceding the first production link from the respective first production logs. And according to the log calling relation between each first link log and each second link log, calculating the initial calling priority of the first production link to each second link log by using a specific algorithm or model (such as a prediction model based on machine learning).
Then, the log filtering unit 132 sets a first priority threshold and a second priority threshold according to the actual demand and the characteristics of the production process, wherein the first priority threshold is greater than the second priority threshold. And sorting the second link logs according to the initial call priority, and screening to obtain each initial single-way log with the initial call priority larger than the first priority threshold and a preparation single-way log with the initial call priority between the first priority threshold and the second priority threshold.
Then, the priority correction unit 133 determines one priority correction coefficient for each of the initial one-way log and the preliminary one-way log, respectively, based on log attributes (such as time stamp, data amount, and data quality, etc.) of the initial one-way log and the preliminary one-way log. And correcting the initial call priority of each initial single-way log and each preliminary single-way log according to the priority correction coefficient to obtain the final call priority of each log.
Finally, the log filtering unit 132 sorts the initial single-way logs and the preliminary single-way logs according to the order of the final call priority, and selects the first N logs with the maximum final call priority as the target single-way logs. The single-pass database construction unit 134 extracts the required log data from the target single-pass log, and may specifically include an operator (IP address), an access time of the operator, a database address accessed by the operator, and specific operation contents in the production link. And then constructing a single-pass database corresponding to the first production link by using the extracted log data.
With this embodiment, the single pass database module 130 determines the initial call priority of the log through the priority determining unit 131, and the log screening unit 132 performs the initial screening of the log by using the initial call priority. Then, the priority correction unit 133 further corrects the initial call priority to obtain the final call priority. The log filtering unit 132 performs final filtering of the log by using the final calling priority, so as to obtain the target single-way log. Finally, the single-pass database construction unit 134 can construct a single-pass database according to the target single-pass log. The method for constructing the single-pass database based on the call priority of the production logs is realized, and key information can be efficiently extracted from a large number of production logs, so that the data volume stored by chain link points of each block is reduced, and the performance of the integrated arrangement system is improved.
As an alternative embodiment, as shown in fig. 3, the priority determining unit 131 specifically includes the following subunits:
A parameter determining subunit 1311, configured to determine, according to the first link log and the second link log in the first production log, a relevance parameter of the first production link and each second link log;
the compactness determination subunit 1312 is configured to determine, according to the number of first link logs, the number of times each second link log is called in the first production link, and each relevance parameter, a relevance compactness between the first production link and each second link log;
the priority determining subunit 1313 is configured to normalize the association closeness by a maximum and minimum value, so as to obtain an initial call priority of the first production link to the log of each second link.
In this embodiment, the parameter determining subunit 1311 determines, based on a rule-based association method, association parameters of the first production link and each second link log according to a log call relationship between each first link log and each second link log, using a specific algorithm or model (e.g., a machine learning-based prediction model).
Then, the compactness determination subunit 1312 determines, according to the number of the first link logs, the number of times each second link log is called in the first production link, and each relevance parameter, the compactness of the association between the first production link and each second link log by the following formula 1:
Equation 1
In the formula,For characterizing the affinity of the association between the ith production link and the jth second link log in the jth production link,Used for representing the called times of the j second link log in the p production link in the i production link,For characterizing the number of first link logs in the ith production link,And the association parameter is used for representing the association parameter between the ith production link and the jth second link log in the jth production link.
Wherein, The method is used for representing the number of times of calling the j second link logs in the p-th production link in the i-th production link and the number of the first link logs in the i-th production link, namely the calling frequency. In the case of a larger call frequency or a larger relevance parameter, the stronger the relevance degree is indicated, namely the higher the corresponding relevance closeness is.
Affinity of association between the ith production link and the jth second link log in the jth production linkThe larger the log data in the j second link log in the p-th production link is used as the element of the single-pass database of the i-th production link.
Finally, the priority determination subunit 1313 converts each association affinity to an initial call priority between 0 and 1 using a maximum minimum normalization method.
Through the embodiment, the priority determining unit 131 can accurately calculate the initial call priority of the first production link to each second link log according to the number of the first link logs, the called times of each second link log in the first production link, and the corresponding relevance parameters. Therefore, the method is beneficial to screening the logs according to the initial call priority, so that the data volume stored by the link points of each block is reduced, and the performance of the integrated arrangement system is improved.
As an alternative embodiment, the parameter determination subunit 1311 may specifically be used to:
Acquiring each first link log and a target second link log from the first production log, wherein the target second link log is any one log in each second link log;
According to each first link log and the target second link log, determining the called times of the target second link log in the first production link, the number of interval logs from the second production link to the first production link and the number of interval links from the second production link to the first production link, wherein the second production link is the production link corresponding to the target second link log;
Dividing the interval log quantity by the interval link quantity to obtain a log mean value from the second production link to the first production link;
and multiplying the log mean value by the reciprocal of the called times of the target second link log, and then performing log calculation to obtain the relevance parameters of the first production link and the target second link log.
In this embodiment, the relevance parameter between the first production link and the second link log may be specifically determined by the following formula 2:
Equation 2
In the formula,For characterizing a correlation parameter between an ith production link and a jth second link log in a jth production link,The base-10 logarithm is shown,Used for representing the called times of the j second link log in the p production link in the i production link,For characterizing the number of interval logs from the p-th production link to the i-th production link,For characterizing the number of interval links from the p-th production link to the i-th production link.
Wherein, The ratio of the number of the interval logs from the p-th production link to the i-th production link to the number of the interval links from the p-th production link to the i-th production link is represented, namely the average value of the logs from the p-th production link to the i-th production link.
Correlation parameters between the ith production link and the jth second link log in the ith production linkThe larger the log of the jth second link in the p-th production link is, the more the log of the jth second link in the ith production link is calledMuch smaller than the average value of the log from the p-th production link to the i-th production linkThen the call of the log of the jth second link in the corresponding jth production link in the ith production link is unique to the ith production link, i.e. it is more prone to be an element of the single-pass database of the ith production link.
Through the embodiment, the parameter determining subunit 1311 can accurately calculate the relevance parameter between the first production link and the target second link log according to the number of times the target second link log is called in the first production link, the number of interval logs from the second production link to the first production link, and the number of interval links from the second production link to the first production link. Therefore, the method is beneficial to calculating the initial call priority of the first production link to the target second link log according to the relevance parameter. And the method is beneficial to screening the logs according to the initial call priority, so that the data volume stored by the link points of each block is reduced, and the performance of the integrated arrangement system is improved.
As an alternative embodiment, the log filtering unit 132 may specifically be configured to:
sequencing all initial call priorities according to the sequence from big to small to obtain a call priority sequence;
performing difference calculation on each two adjacent initial call priorities in the call priority sequence to obtain a plurality of call priority difference values;
Determining a first priority threshold and a second priority threshold according to the maximum difference value and the second maximum difference value in the calling priority difference values;
determining each second link log with the initial calling priority greater than the first priority threshold as an initial single-way log;
and determining each second link log with the initial calling priority smaller than or equal to the first priority threshold and larger than the second priority threshold as a preparation single-way log.
In this embodiment, the log filtering unit 132 sorts the initial call priorities of the second link logs in order from large to small, so as to obtain a call priority sequence. And then, for the ordered call priority sequence, calculating the difference between the adjacent two initial call priorities, namely subtracting the last initial call priority from the previous initial call priority or subtracting the absolute value of the previous initial call priority from the last initial call priority. In this way, a set containing multiple call priority differences can be obtained.
And then, finding out the maximum value and the second maximum value in the difference value set, selecting a first priority threshold value to be determined, which is arranged at a position in the calling priority sequence and is positioned at a position in the calling priority sequence, according to the positions of the initial calling priorities corresponding to the maximum value and the second maximum value, and selecting a first priority threshold value to be determined, which is arranged at a position in the calling priority sequence and is positioned at a later position.
For example, assuming that the call priority sequence is {30,24,14,9,6}, its corresponding set of differences is {6,10,5,3}, the maximum value is 10, and the second maximum value is 6. The initial call priorities corresponding to the maximum values are 24 and 14, and the initial call priorities corresponding to the second maximum values are 30 and 24. That is, the initial call priority corresponding to the second largest value is located further forward in the call priority sequence, and the initial call priority corresponding to the first largest value is located further backward in the call priority sequence. Thus, the first priority threshold is determined from the second maximum value and the second priority threshold is determined from the first maximum value, i.e. the first priority threshold will be greater than the second priority threshold.
Specifically, the next one of the two initial call priorities corresponding to the second maximum value may be used as the first priority threshold, and the next one of the two initial call priorities corresponding to the maximum value may be used as the second priority threshold. I.e. the first priority threshold is 24 in the example above and the second priority threshold is 14.
And finally, determining each second link log with the initial calling priority larger than the first priority threshold as an initial one-way log, and determining each second link log with the initial calling priority smaller than or equal to the first priority threshold and larger than the second priority threshold as a preparation one-way log. That is, in the above example, the second log with the initial call priority of 30 is the initial one-way log, and the second log with the initial call priority of 24 is the prepared one-way log.
According to the embodiment, the second link logs are screened according to the initial call priority of the second link logs. Only the initial one-way logs in the second link logs which are larger than the first priority threshold value are reserved, and the initial calling priority in the second link logs is smaller than or equal to the first priority threshold value and larger than the preparation one-way logs between the second priority threshold value. Therefore, the data volume stored by the chain link points of each block is reduced, and the performance of the integrated finishing system is improved.
As an alternative embodiment, as shown in fig. 4, the priority correction unit 133 may specifically include the following subunits:
a correction coefficient determining subunit 1331, configured to determine an initial correction coefficient according to a first similarity between a target correction log in the current production stage and a corresponding result log, where the target correction log is any one log of each initial single-way log and each preliminary single-way log, and the result log is a log in which the target correction log is called in the first production link;
a correction coefficient updating subunit 1332, configured to update the initial correction coefficient based on the scaling coefficient of the target correction log, so as to obtain a priority correction coefficient of the target correction log;
the priority correction subunit 1333 is configured to multiply the initial call priority of the target correction log by the priority correction coefficient to obtain the final call priority corresponding to the target correction log.
In the present embodiment, for each target correction log (either the initial one-way log or the preliminary one-way log), the result log, which is called in the first production link, is first searched for by the correction coefficient determination subunit 1331. Then, a similarity calculation method (such as cosine similarity or Jaccard similarity) is used to calculate a first similarity between the target correction log and the corresponding result log. And setting a threshold value or range according to the first similarity, and converting the first similarity into a corresponding initial correction coefficient.
Then, the correction coefficient updating sub-unit 1332 calculates a scaling factor for each target correction log based on factors such as importance thereof in the production process and frequency of use. And multiplying the proportional coefficient by the initial correction coefficient to obtain the priority correction coefficient of the target correction log.
Finally, the priority correction subunit 1333 multiplies, for each target correction log, the initial call priority thereof by the priority correction coefficient, thereby obtaining the final call priority corresponding to the target correction log.
With the present embodiment, the initial call priority is corrected by the priority correction unit 133, so that a more accurate final call priority is obtained. And further, the logs are further screened according to more accurate final calling priority, so that the data volume stored by the link points of each block is reduced, and the performance of the integrated finishing system is improved.
As an alternative embodiment, the correction coefficient determination subunit 1331 may specifically be configured to:
Performing similarity calculation between the target correction log and each corresponding result log in the current production stage to obtain a first similarity between the target correction log and each corresponding result log;
and determining an initial correction coefficient of the target correction log according to the minimum value in each first similarity.
In this embodiment, the more similar the data between the target correction log and the corresponding result log in the current production stage, the greater the reference meaning of the target correction log is, and further the call priority of the target correction log in the current production stage should be improved.
Therefore, the initial correction coefficient of the target correction log can be determined specifically by the following equation 3:
Equation 3
In the formula,An initial correction coefficient for characterizing a kth target correction log in an ith production link,() For characterizing calculations using the DTW algorithmThe distance between the two adjacent substrates is determined,For the purpose of characterizing the minimum value,A data sequence for characterizing a kth target correction log in an ith production link,And the data sequence of the p-th result log is used for representing the k-th target correction log in the i-th production link.
The target correction log and the result log include two types of log data, namely digital data and text data, so that the log data in each log needs to be vectorized to obtain a vector sequence corresponding to each log. And then, respectively carrying out standardized calculation on vector sequences corresponding to the logs, and obtaining data sequences corresponding to the logs.
Specifically, the standardized calculation modulus value is used for representing that each log data is converted according to a preset conversion rule, so that the log data meets specific distribution requirements or range requirements. For example, the normalized calculation method may include a Z-score normalization method.
Wherein, For characterising between a kth target correction log and a corresponding p-th result log in an i-th production linkDistance, i.e. first similarity. The smaller the distance, the more similar the kth target correction log and the corresponding p-th result log are, the larger the corresponding initial correction coefficient is.
According to the embodiment, similarity calculation is performed between the target correction log and the corresponding result log, so that first similarity between the target correction log and the corresponding result log is obtained, and an initial correction coefficient of the target correction log is determined according to the first similarity. Therefore, the initial call priority is corrected according to the initial correction coefficient, and the more accurate final call priority is obtained. And further, the logs are further screened according to more accurate final calling priority, so that the data volume stored by the link points of each block is reduced, and the performance of the integrated finishing system is improved.
As an alternative embodiment, before updating the initial correction coefficient based on the scaling factor of the target correction log to obtain the priority correction coefficient of the target correction log, the priority correction unit 133 specifically further includes the following subunits:
the proportionality coefficient calculating subunit is used for calculating the similarity between the target correction log and each corresponding result log in the historical production stage to obtain a plurality of second similarities;
the proportional coefficient calculating subunit is further configured to calculate a difference value between the second similarity mean value of each second similarity and the minimum similarity in each first similarity, and then obtain an absolute value of the calculated difference value, so as to obtain a similarity absolute difference value;
and the proportionality coefficient calculating subunit is also used for carrying out exponential operation on the opposite number of the absolute difference value of the similarity to obtain the proportionality coefficient of the target correction log.
In this embodiment, the amount of the product used in each generation link is different for one industry chain based on the different production requirements. However, for a complete and mature industrial chain, raw materials, process parameters and the like in each link are recorded in an equal proportion relation along with different yields, and at the moment, the change of the log data can cause the value change of the initial correction coefficient, so that the proportional change can be presented according to the log data, and the initial correction coefficient is adjusted to obtain the final priority correction coefficient of the target correction log.
Specifically, after the priority correction unit 133 obtains the target correction log and the corresponding result log in the current production stage, it also obtains the target correction log and the corresponding result log in the historical production stage. And if the target correction log does not have a corresponding result log in the historical production stage, determining that the proportionality coefficient of the target correction log is 0.
Under the condition that the corresponding result log exists in the target correction log in the historical production stage, similarity calculation is carried out between the target correction log and the corresponding result log in the historical production stage through the proportionality coefficient calculation subunit, so that a plurality of second similarities are obtained, and the obtaining mode of the second similarities is identical to that of the first similarities.
And then determining the proportionality coefficient of the target correction log according to the first similarity and the second similarity corresponding to the target correction log by the following formula 4:
Equation 4
In the formula,Used for representing the proportionality coefficient corresponding to the kth target correction log in the ith production link,For the purpose of characterizing the operation of an index,For representing the minimum similarity of the first similarities corresponding to the kth target correction log in the ith production link,And the second similarity mean value is used for representing the corresponding second similarity mean value of the kth target correction log in the historical production stage.
Wherein, The method is used for representing the difference between the minimum similarity of the first similarities corresponding to the kth target correction log in the ith production link and the second similarity mean value corresponding to the kth target correction log in the historical production stage. The smaller the difference, the more likely the explanation will exhibit a proportional relationship according to the difference in yield, the larger the corresponding proportional coefficient.
According to the embodiment, according to the first similarity between the target correction log and the corresponding result log in the current production stage and the second similarity between the target correction log and the corresponding result log in the historical production stage. The method and the system have the advantages that the proportional coefficient corresponding to the target correction log is obtained, the initial correction coefficient is updated according to the proportional coefficient, and the final priority correction coefficient of the target correction log is obtained.
As an alternative embodiment, the correction coefficient updating subunit 1332 may specifically be configured to:
multiplying the proportional coefficient by the initial correction coefficient to obtain an intermediate calculation result;
and accumulating the intermediate calculation result and the initial correction coefficient to obtain the priority correction coefficient of the target correction log.
In this embodiment, the priority correction coefficient of the target correction log may be specifically determined by the following equation 5:
Equation 5
In the formula,A priority correction coefficient for characterizing a kth target correction log in an ith production link,An initial correction coefficient for characterizing a kth target correction log in an ith production link,The method is used for representing the proportionality coefficient corresponding to the kth target correction log in the ith production link.
Wherein, The method comprises the steps of representing an initial correction coefficient of a kth target correction log in an ith production link, and adding an intermediate calculation result obtained by correcting the initial correction coefficient according to a proportional coefficient corresponding to the target correction log. The larger the initial correction coefficient corresponding to the target correction log or the larger the scale coefficient corresponding to the target correction log, the larger the final priority correction coefficient of the target correction log.
According to the embodiment, the initial correction coefficient is updated according to the proportional coefficient corresponding to the target correction log, and then the final priority correction coefficient of the target correction log is obtained. Therefore, the method is beneficial to correcting the initial call priority according to the priority correction coefficient, and the more accurate final call priority is obtained. And further, the logs are further screened according to more accurate final calling priority, so that the data volume stored by the link points of each block is reduced, and the performance of the integrated finishing system is improved.
It should be understood that the invention is not limited to the particular arrangements and instrumentality described above and shown in the drawings. For the sake of brevity, a detailed description of known methods is omitted here. In the above embodiments, several specific steps are described and shown as examples. The method processes of the present invention are not limited to the specific steps described and shown, but various changes, modifications and additions, or the order between steps may be made by those skilled in the art after appreciating the technical solution of the present invention.
It should also be noted that the exemplary embodiments mentioned in this disclosure describe some methods or systems based on a series of steps or devices. The present invention is not limited to the order of the above-described steps, that is, the steps may be performed in the order mentioned in the embodiments, or may be performed in a different order from the order in the embodiments, or several steps may be performed simultaneously.
In the foregoing, only the specific embodiments of the present invention are described, and it will be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the systems, modules and units described above may refer to the corresponding processes in the foregoing method embodiments, which are not repeated herein. It should be understood that the scope of the present invention is not limited thereto, and any equivalent modifications or substitutions can be easily made by those skilled in the art within the technical scope of the present invention, and they should be included in the scope of the present invention.
Claims (8)
1. An integrated collation system based on industrial chain multi-link data, the system comprising:
The log acquisition module is used for acquiring a first production log under each production link of the current production stage and a second production log under each production link of the historical production stage;
the resident database module is used for constructing a resident database based on each second production log, and the resident database is used for storing data with guiding significance for the whole industrial chain in the historical production stage;
The single-pass database module is used for constructing a single-pass database corresponding to each production link based on each first production log, and the single-pass database is used for storing data which only has guiding significance on the corresponding production link in the industrial chain in the current production stage;
The system comprises a storage data determining module, a storage data processing module and a storage data processing module, wherein the storage data determining module is used for determining storage data corresponding to block chain nodes of all production links in the industrial chain according to the resident database and the single-pass database, the historical production stages comprise a first historical production stage and a second historical production stage, the first historical production stage is the previous production stage of the current production stage, and the second historical production stage is the previous production stage of the first historical production stage;
the resident database module is specifically configured to:
screening each second production log to obtain a first historical production log in the first historical production stage and a second historical production log in the second historical production stage;
screening out a target historical production log of the first historical production log, which invokes the second historical production log, based on the first historical production log and the second historical production log;
constructing the resident database based on log data in the target historical production log; the single-pass database module specifically comprises the following units:
The priority determining unit is used for determining initial call priority of a first production link to each second link log according to a first link log and a second link log in the first production log, wherein the first link log is a log belonging to the first production link in each first production log, and the second link log is a log of each production link before the first production link in each first production log;
The log screening unit is used for screening and obtaining an initial single-way log and a preparation single-way log in each second link log based on the size sequence of each initial call priority, wherein the initial single-way log is used for representing the log with the initial call priority larger than a first priority threshold, the preparation single-way log is used for representing the log with the initial call priority between the first priority threshold and a second priority threshold, and the first priority threshold is larger than the second priority threshold;
the priority correction unit is used for respectively correcting the initial call priorities of the initial single-way logs and the preparation single-way logs based on the priority correction coefficients corresponding to the initial single-way logs and the preparation single-way logs to obtain final call priorities corresponding to the initial single-way logs and the preparation single-way logs;
The log screening unit is further used for screening and obtaining target single-way logs from the initial single-way logs and the prepared single-way logs based on the size sequence of the final call priority;
And the single-way database construction unit is used for constructing the single-way database corresponding to the first production link based on the log data in the target single-way log.
2. The integrated collation system based on industrial chain multi-link data according to claim 1, wherein the priority determining unit specifically comprises the following sub-units:
The parameter determining subunit is used for determining the relevance parameters of the first production link and each second link log according to the first link log and the second link log in the first production log;
The compactness determining subunit is used for respectively determining the association compactness of the first production link and each second link log according to the number of the first link logs, the called times of each second link log in the first production link and each association parameter;
and the priority determining subunit is used for carrying out maximum and minimum normalization on each association compactness to obtain the initial calling priority of the first production link to each second link log.
3. The integrated collation system based on industrial chain multi-link data according to claim 2, wherein the parameter determination subunit is specifically configured to:
acquiring each first link log and a target second link log from the first production log, wherein the target second link log is any one log in each second link log;
Determining the called times of the target second link log in the first production link, the number of interval logs from a second production link to the first production link and the number of interval links from the second production link to the first production link according to the first link log and the target second link log, wherein the second production link is a production link corresponding to the target second link log;
dividing the interval log number by the interval link number to obtain a log average value from the second production link to the first production link;
and multiplying the log mean value by the reciprocal of the called times of the target second link log, and then carrying out logarithmic calculation to obtain the relevance parameters of the first production link and the target second link log.
4. The integrated management system based on industrial chain multi-link data according to claim 1, wherein the log screening unit is specifically configured to:
Sequencing the initial call priorities according to the sequence from big to small to obtain a call priority sequence;
Performing difference calculation on each two adjacent initial call priorities in the call priority sequence to obtain a plurality of call priority difference values;
Determining the first priority threshold and the second priority threshold according to the maximum difference value and the second maximum difference value in the calling priority difference values;
Determining each of the second link logs with the initial call priority greater than the first priority threshold as the initial single-way log;
And determining each second link log with the initial calling priority smaller than or equal to the first priority threshold and larger than the second priority threshold as the preparation single-way log.
5. The integrated management system based on industrial chain multi-link data according to claim 1, wherein the priority correction unit specifically comprises the following subunits:
The correction coefficient determining subunit is used for determining an initial correction coefficient according to a first similarity between a target correction log and a corresponding result log in the current production stage, wherein the target correction log is any one log of the initial single-way log and the preparation single-way log, and the result log is the log which invokes the target correction log in the first production link;
a correction coefficient updating subunit, configured to update the initial correction coefficient based on the scaling factor of the target correction log, to obtain a priority correction coefficient of the target correction log;
and the priority correction subunit is used for multiplying the initial call priority of the target correction log by the priority correction coefficient to obtain the final call priority corresponding to the target correction log.
6. The integrated collation system based on industrial chain multi-link data according to claim 5, wherein the correction coefficient determination subunit is specifically configured to:
Performing similarity calculation between the target correction log and each corresponding result log in the current production stage to obtain the first similarity between the target correction log and each corresponding result log;
And determining an initial correction coefficient of the target correction log according to the minimum value in each first similarity.
7. The integrated finishing system based on industrial chain multi-link data according to claim 5, wherein the priority correction unit specifically further comprises the following subunits before updating the initial correction coefficient based on the scaling factor of the target correction log to obtain the priority correction coefficient of the target correction log:
The proportionality coefficient calculating subunit is used for calculating the similarity between the target correction log and each corresponding result log in the historical production stage to obtain a plurality of second similarity;
The proportionality coefficient calculating subunit is further used for calculating the difference value between the second similarity mean value of each second similarity and the minimum similarity in each first similarity and then taking the absolute value to obtain a similarity absolute difference value;
And the proportionality coefficient calculating subunit is further used for carrying out exponential operation on the opposite number of the absolute difference value of the similarity to obtain the proportionality coefficient of the target correction log.
8. The integrated collation system based on industrial chain multi-link data according to claim 5, wherein the correction coefficient updating subunit is specifically configured to:
multiplying the proportionality coefficient by the initial correction coefficient to obtain an intermediate calculation result;
And accumulating the intermediate calculation result and the initial correction coefficient to obtain the priority correction coefficient of the target correction log.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202411455351.1A CN118981505B (en) | 2024-10-18 | 2024-10-18 | An integrated collation system based on multi-link data of the industrial chain |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202411455351.1A CN118981505B (en) | 2024-10-18 | 2024-10-18 | An integrated collation system based on multi-link data of the industrial chain |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN118981505A CN118981505A (en) | 2024-11-19 |
| CN118981505B true CN118981505B (en) | 2025-02-07 |
Family
ID=93450921
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202411455351.1A Active CN118981505B (en) | 2024-10-18 | 2024-10-18 | An integrated collation system based on multi-link data of the industrial chain |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN118981505B (en) |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118154188A (en) * | 2024-03-11 | 2024-06-07 | 西安交通大学 | Block chain-based log processing method, device and equipment |
Family Cites Families (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108885634B (en) * | 2016-10-24 | 2022-09-09 | 北京亚控科技发展有限公司 | Retrieval method for data object based on space-time database |
| KR101907407B1 (en) * | 2017-08-29 | 2018-10-15 | 주식회사 엑센솔루션 | Preventive maintenance system and method of ejection equipment according to situation condition of production process |
| KR101946195B1 (en) * | 2018-03-26 | 2019-02-08 | 그래프 블록체인 리미티드 | Control system for controlling private block-chain system |
| CN113396407A (en) * | 2018-12-04 | 2021-09-14 | 泽乌科技公司 | System and method for augmenting database applications using blockchain techniques |
| CN110532244A (en) * | 2019-08-20 | 2019-12-03 | 广州华资软件技术有限公司 | A kind of lightweight legacy system data transfer device and its system |
| CN111290910B (en) * | 2020-01-20 | 2023-06-23 | Oppo（重庆）智能科技有限公司 | Log processing method, device, server and storage medium |
| US12032585B2 (en) * | 2020-08-06 | 2024-07-09 | Paypal, Inc. | Alteration of historical data representations using data repository performance metrics |
| CN112540906B (en) * | 2020-12-24 | 2024-04-26 | 北京志翔信息技术有限公司 | Intelligent analysis method and system for business and data relationship based on probe |
| CN114238258B (en) * | 2021-11-30 | 2024-02-20 | 企查查科技股份有限公司 | Database data processing method, device, computer equipment and storage medium |
| WO2023111882A1 (en) * | 2021-12-17 | 2023-06-22 | National Payments Corporation Of India | A system for data archival in a blockchain network and a method thereof |
| CN114924943A (en) * | 2022-05-27 | 2022-08-19 | 中国平安财产保险股份有限公司 | Data middling station evaluation method based on artificial intelligence and related equipment |
| US20240126849A1 (en) * | 2022-10-18 | 2024-04-18 | Bank Of America Corporation | User credential authentication using blockchain and machine learning |
| CN116414625A (en) * | 2023-03-15 | 2023-07-11 | 上海达梦数据库有限公司 | Log management method, device, equipment and storage medium |
| CN116545898A (en) * | 2023-05-04 | 2023-08-04 | 南京航空航天大学 | Production line safety protection method based on port mirror image and block chain |
| CN117785903A (en) * | 2023-12-29 | 2024-03-29 | 上海挚达科技发展股份有限公司 | Data updating method and device, electronic equipment and storage medium |
| CN117891882A (en) * | 2024-01-19 | 2024-04-16 | 中国农业银行股份有限公司 | Data management system, method, equipment and storage medium based on blockchain |
| CN118394713A (en) * | 2024-06-12 | 2024-07-26 | 中国工商银行股份有限公司 | Log data processing method, device, equipment, storage medium and program product |
-
2024
- 2024-10-18 CN CN202411455351.1A patent/CN118981505B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118154188A (en) * | 2024-03-11 | 2024-06-07 | 西安交通大学 | Block chain-based log processing method, device and equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN118981505A (en) | 2024-11-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109587713B (en) | Network index prediction method and device based on ARIMA model and storage medium | |
| CN110689190A (en) | Power grid load prediction method and device and related equipment | |
| CN112785441B (en) | Data processing method, device, terminal equipment and storage medium | |
| CN109460893B (en) | A method and system for calculating weather type correlation index of photovoltaic power station | |
| CN113223502A (en) | Speech recognition system optimization method, device, equipment and readable storage medium | |
| CN112612781A (en) | Data correction method, device, equipment and medium | |
| CN117374917A (en) | Multiple regression prediction method and device for ultra-short-term power load | |
| CN118981505B (en) | An integrated collation system based on multi-link data of the industrial chain | |
| CN110275868A (en) | A kind of multi-modal pretreated method of manufaturing data in intelligent plant | |
| CN118569613B (en) | Cross-regional auto repair resource collaborative management and sharing system based on cloud computing | |
| CN116706907B (en) | Photovoltaic power generation prediction method based on fuzzy reasoning and related equipment | |
| CN113344245A (en) | Hybrid deep learning short-term prediction model, method, storage medium, and computing device | |
| CN112101612A (en) | Prediction method of town gas usage, storage medium and terminal equipment | |
| CN117909112A (en) | Automatic diagnosis method, device, equipment and storage medium for application program faults | |
| CN113947030B (en) | Equipment demand forecasting method based on gradient descent grey Markov model | |
| CN117009752A (en) | Power consumption demand prediction method based on POA-VMD-SSA-KELM model | |
| CN113469405B (en) | Subimage segmentation-based cross-city tail gas migration prediction method, system and medium | |
| CN116523540A (en) | Ultra-short-term electricity price prediction method based on self-adaptive LGBM | |
| CN116307038A (en) | Irrigation water consumption prediction method, irrigation water consumption prediction system and computer storage medium | |
| CN115796906A (en) | Software cost estimation system | |
| CN108509984A (en) | Activation value quantifies training method and device | |
| CN114764741A (en) | Method and system for predicting running wind power of wind driven generator | |
| CN114548479A (en) | Time sequence data prediction method based on exponential smoothing | |
| CN114650230B (en) | Information processing method, device and equipment | |
| CN114357268B (en) | Method, system, equipment and medium for clustering stations in power communication service data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |