CN108804708B - Method and device for archiving and correcting business data table, computer equipment and storage medium - Google Patents
Method and device for archiving and correcting business data table, computer equipment and storage medium Download PDFInfo
- Publication number
- CN108804708B CN108804708B CN201810651440.1A CN201810651440A CN108804708B CN 108804708 B CN108804708 B CN 108804708B CN 201810651440 A CN201810651440 A CN 201810651440A CN 108804708 B CN108804708 B CN 108804708B
- Authority
- CN
- China
- Prior art keywords
- filing
- business data
- archiving
- structure information
- service data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 238000004590 computer program Methods 0.000 claims description 25
- 239000002699 waste material Substances 0.000 abstract description 7
- 238000012937 correction Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 2
- 230000008676 import Effects 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013499 data model Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The application relates to a method and a device for archiving and correcting a business data table, computer equipment and a storage medium. The method comprises the following steps: archiving the business data table to a business data archiving table; reading the corresponding table structure information in the business data table and the business data filing table; comparing the business data table with the table structure information corresponding to the business data filing table to obtain a comparison result; determining the filing problem of the business data filing table according to the comparison result; acquiring an archiving problem list generated according to the determined archiving problem; and automatically correcting the service data filing table according to the filing problem list. By adopting the method, the waste of time caused by manually configuring the table structure information of the business data filing table can be avoided, so that the efficiency of correcting the business data filing table is improved, and the efficiency of filing the business data table is further improved.
Description
Technical Field
The present application relates to the field of database technologies, and in particular, to a method and an apparatus for archiving and correcting a service data table, a computer device, and a storage medium.
Background
With the development of internet technology, databases are widely used, data can be stored in the databases to ensure the safety of the data, and the data can be conveniently sorted.
In order to more conveniently arrange the business data stored in the database, the business data can be respectively stored in a business data table and a business data filing table, the business data which needs to be frequently modified is stored in the business data table, and the data which needs to be stored for a long time is filed in the business data filing table from the business data table, so that the high-efficiency management of the database and the business data in the database can be realized.
However, in the current data archiving method, table structure information of the business data archiving table needs to be configured. When the table structure information of the business data filing table is configured, the configuration is not performed according to the specification, so that the filing is easy to fail, the table structure information of the business data filing table needs to be manually reconfigured, the time spent for filing the business data table is more, and the filing efficiency of the business data table is very low.
Disclosure of Invention
In view of the foregoing, it is desirable to provide a method, an apparatus, a computer device, and a storage medium for archiving and correcting a business data table, which can improve the efficiency of archiving the business data table.
A method for archiving and correcting a business data table comprises the following steps:
filing the business data table to a business data filing table;
reading the corresponding table structure information in the service data table and the service data filing table;
comparing the business data table with the table structure information corresponding to the business data filing table to obtain a comparison result;
determining the filing problem of the business data filing table according to the comparison result;
acquiring an archiving problem list generated according to the determined archiving problem;
and automatically correcting the service data filing table according to the filing problem list.
In one embodiment, the comparing the respective table structure information of the service data table and the service data archiving table to obtain a comparison result includes:
respectively converting the service data table and the service data filing table into respective corresponding data tables with uniform formats;
selecting records with inconsistent contents from the data tables with the unified formats respectively corresponding to the business data table and the business data filing table to obtain a difference table; the comparison results include the difference table.
In one embodiment, the archive problem includes a table structure information error; each record in the difference table has one-to-one corresponding record in the difference table; the determining the filing problem of the business data filing table according to the comparison result includes:
identifying a maximum string length for each record in the difference table;
acquiring respective maximum character string lengths of two records corresponding one to one;
when the ratio of the maximum string length of the record selected from the service data filing table to the maximum string length of the record selected from the service data table is not a preset value, then
The record which determines that the ratio is not the preset value has a table structure information error.
In one embodiment, after the obtaining of the filing question list generated according to the determined filing question, the method further comprises:
acquiring an email address of a database maintainer;
and sending the filing problem list to an electronic mailbox specified by the electronic mail address.
In one embodiment, after the obtaining the list of filing questions generated according to the determined filing questions, the method further comprises:
counting the filing problems in the filing problem list;
analyzing filing problems occurring in a preset time period;
the filing problem with the occurrence frequency exceeding a preset threshold value is marked as a high-frequency problem;
the high frequency problem is set to the top in the archive problem table.
In one embodiment, the method further comprises:
constructing an archiving problem model according to the archiving problem list;
before the business data table is filed to the business data filing table, detecting the business data table and the business data filing table through the filing problem model;
correcting errors of the detected table structure information;
and after the table structure information of the service data table and the service data filing table is corrected to be wrong, filing is carried out.
In one embodiment, the automatically revising the business data archiving table according to the archiving problem list includes:
identifying the maximum character string length recorded in the service data table;
adjusting the maximum character string length of the record corresponding to the business data table in the business data filing table to be twice of the maximum character string length of the record in the business data table;
and the business data recorded in the business data table is archived into the adjusted corresponding record in the business data archiving table.
A business data table filing and correcting device, the device comprising:
the business data table filing module is used for filing the business data table to a business data filing table;
the table structure information reading module is used for reading the corresponding table structure information in the service data table and the service data filing table;
the table structure information comparison module is used for comparing the business data table with the table structure information corresponding to the business data filing table to obtain a comparison result;
the filing problem determining module is used for determining the filing problem of the business data filing table according to the comparison result;
the filing problem list acquisition module is used for acquiring a filing problem list generated according to the determined filing problems;
and the business data filing table correcting module is used for automatically correcting the business data filing table according to the filing problem list.
A computer device comprising a memory storing a computer program and a processor implementing the steps of the method as claimed in any one of the preceding claims when the computer program is executed by the processor.
A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of the preceding claims.
After the business data table in the database is filed to the business data filing table, the respective table structure information of the business data table and the business data filing table is read and compared to obtain a comparison result. And the problem of the table structure of the business data filing table can be determined by comparing the comparison result obtained by the table structure information, so that the filing problem of the business data filing table can be determined. And then the determined filing problems are arranged into a filing problem list, so that the business data filing table can be automatically corrected according to the filing problem list, and the speed of automatically correcting the business data filing table is far higher than the speed of manually configuring the table structure information of the business data filing table, so that the waste of time for manually configuring the table structure information of the business data filing table can be avoided, the efficiency of correcting the business data filing table is improved, and the efficiency of filing the business data table is improved.
Drawings
FIG. 1 is a diagram illustrating an application scenario of a method for archiving and modifying a business data table in an embodiment;
FIG. 2 is a flowchart illustrating a method for archiving and modifying a business data table in an embodiment;
FIG. 3 is a schematic flowchart of a method for archiving and modifying a business data table in another embodiment;
FIG. 4 is a block diagram of an embodiment of a device for archiving and modifying a business data table;
FIG. 5 is a diagram illustrating an internal structure of a computer device according to an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The method for archiving and correcting the business data table can be applied to the application environment shown in fig. 1. Wherein the database 110 is in communication with the server 120 over a network, via a network or a cable. The server 120 files the business data table 112 in the database 110 to the business data filing table 114, reads the respective table structure information of the business data table 112 and the business data filing table 114, and then compares the respective table structure information of the business data table 112 and the business data filing table 114 to obtain a comparison result. The server 120 determines the filing problem occurring in the business data filing table 114 according to the comparison result, obtains a filing problem list generated according to the determined filing problem, and automatically corrects the business data filing table 114 in the database 110 according to the filing problem list. Database 110 and server 120 may be implemented as separate servers or as a server cluster composed of a plurality of servers.
In an embodiment, as shown in fig. 2, a method for archiving and modifying a service data table is provided, which is described by taking the method as an example applied to the server in fig. 1, and includes the following steps:
s202, the business data table is filed to a business data filing table.
The service data table is a table for storing service data. A TABLE (TABLE) is an object in a database that is used to store data, and is a collection of structured data. The business data archive table is a table for storing archived business data. Archiving is the process of storing organized data. The archiving specifically can be a process of sorting the processed service data with the storage value by the system and then delivering the service data to a service data archiving table for storage.
In one embodiment, the server reads the newly added service data from the service data table and imports the newly added service data into the service data archiving table.
In one embodiment, the server compares the service data table with the service data archiving table, and imports service data different from the service data archiving table into the service data archiving table.
S204, reading the corresponding table structure information in the business data table and the business data filing table.
Wherein the table structure information is structure information of the data table. The table structure information may specifically include at least one of a file name of the data table, fields included in the data table, field names of the fields, field attributes of the fields, field types of the fields, widths of the fields, and the like.
The field names may be less than 64 characters in length, may include letters, characters, numbers, spaces, and other characters, and may not include periods. ", exclamation point"! ", brackets" [ ] ", and accent", field names may not begin with leading spaces. The field type may specifically be at least one of a text type, a note-on type, a numeric type, a time-of-day type, a currency type, an automatic number type, a yes/no type, an OLE object type, a hyperlink type, a look-up guide type, and the like. The field attribute may specifically be at least one of field size, format, default value, mandatory field, validity rule, validity text, index, and the like.
In one embodiment, the server reads the field name, field attribute, field type and field length of each record in the service data table, and reads the field name, field attribute, field type and field length of the record corresponding to the record of the service data table in the service data archiving table.
S206, comparing the respective table structure information of the business data table and the business data filing table to obtain a comparison result.
Wherein the comparison result is a comparison result of the table structure information. Comparing the respective table structure information of the service data table and the service data filing table, which may specifically be comparing the maximum field length of the respective records of the service data table and the service data filing table. The record is the minimum unit for storing data in the data table, and the record may be specifically a row of the data table.
And S208, determining the archiving problem of the business data archiving table according to the comparison result.
The archiving problem is that the business data table is wrongly archived to the business data archiving table. Specifically, the server determines the filing problem of the business data filing table according to the type of the comparison result.
In one embodiment, the server identifies the comparison result according to the filing problem judgment rule, and determines the filing problem occurring in the business data filing table.
S210, an archiving problem list generated according to the determined archiving problems is obtained.
Wherein the filing problem list is an integrated list of filing problems. Specifically, the server arranges the determined filing problems in a filing problem list according to the determined order of the filing problems.
In one embodiment, the server obtains a filing problem list from the database, enters the determined filing problem into the filing problem list, marks the filing problem entered into the filing problem list as a filing problem to be corrected, and marks the corrected filing problem as a historical filing problem.
In one embodiment, the server sends the determined filing problems to the verification email box, screens the filing problems according to the determination result after receiving the determination result fed back by the verification email box, and generates a filing problem list according to the filing problems obtained after screening.
S212, automatically correcting the business data filing table according to the filing problem list.
In one embodiment, the server sends the filing problem list to the correction terminal, corrects the table structure information of the business data filing table when receiving a correction instruction fed back by the correction terminal, and re-files the business data of the business data table to the business data filing table.
In the method for filing and correcting the business data table, after the business data table in the database is filed to the business data filing table, the comparison result is obtained by reading and comparing the respective table structure information of the business data table and the business data filing table. And the problem of the table structure of the business data filing table can be determined by comparing the comparison result obtained by the table structure information, so that the filing problem of the business data filing table can be determined. And then the determined filing problems are arranged into a filing problem list, so that the business data filing table can be automatically corrected according to the filing problem list, and the speed of automatically correcting the business data filing table is far higher than the speed of manually configuring the table structure information of the business data filing table, so that the waste of time for manually configuring the table structure information of the business data filing table can be avoided, the efficiency of correcting the business data filing table is improved, and the efficiency of filing the business data table is improved.
In one embodiment, the comparing the table structure information corresponding to the service data table and the service data archiving table to obtain a comparison result includes: respectively converting the service data table and the service data filing table into respective corresponding data tables with uniform formats; selecting records with inconsistent contents from the data tables with the unified formats respectively corresponding to the business data table and the business data filing table to obtain a difference table; the comparison results include the difference table.
The data table with the uniform format may be a data table with the same table structure. The difference table is a data table for storing records different in table structure information.
In one embodiment, the server multiplies the maximum string length of each record in the service data table by a preset value to obtain a service data table with a modified table structure, compares the service data table with the service data filing table with the modified structure, and selects corresponding records with different table structure information in the service data table with the modified structure and the service data filing table to generate a difference table.
In this embodiment, the business data table and the business data filing table are converted into the data table with the uniform format, so that the difference between the respective table structures of the business data table and the business data filing table can be found more quickly, inconsistent records are selected from the data tables with the uniform format corresponding to the business data table and the business data filing table, corresponding table structure information is recorded in the selected records, and the obtained difference table stores the comparison result between the business data table and the business data filing table.
In one embodiment, the archive problem includes a table structure information error; each record in the difference table has one-to-one corresponding record in the difference table; the determining the filing problem of the business data filing table according to the comparison result includes: identifying a maximum string length for each record in the difference table; acquiring respective maximum character string lengths of two one-to-one corresponding records; and when the ratio of the maximum character string length of the record selected from the business data filing table to the maximum character string length of the record selected from the business data filing table is not a preset value, determining that the record with the ratio not being two has table structure information errors.
The table structure information error may specifically be that the maximum string lengths of records corresponding to the service data table and the service data archiving table are not matched. The maximum string length is the maximum length of a string that a record can store. The preset value is a preset condition for archiving the business data table to the business data archiving table. The preset ratio may be 1.5 or 2. And may also be 2.5. The record corresponding to one is specifically a record in the service data table for storing the service data to be archived and a record in the service data archiving table for archiving the service data.
In this embodiment, by identifying the maximum string length of each record in the difference table, and when the ratio of the maximum string length of the record selected from the business data archiving table to the maximum string length of the record selected from the business data archiving table is not a preset value, determining that the record with the ratio not being the preset value has a table structure information error, the archiving problem can be quickly determined, so that the archiving problem can be corrected more quickly, and the archiving efficiency of the business data table can be further improved.
In one embodiment, after the obtaining the list of filing questions generated according to the determined filing questions, the method further comprises: acquiring an email address of a database maintainer; and sending the filing problem list to an electronic mailbox specified by the electronic mail address.
The database maintenance personnel are workers who can manually operate the database. The email address is a network address required for the email box to receive and send email.
In the embodiment, after the filing problem list is obtained, the filing problem list is sent to the e-mail box of the database maintenance personnel in an e-mail mode, so that errors can be made during automatic correction, and correction can also be made in a manual correction mode, so that the data sheet filing is ensured not to be made errors.
In one embodiment, after the obtaining the list of filing questions generated according to the determined filing questions, the method further comprises: counting the filing problems in the filing problem list; analyzing filing problems occurring in a preset time period; the filing problem of which the occurrence frequency exceeds a preset threshold value is marked as a high-frequency problem; the high frequency problem is set to the top of the archive problem table.
The preset time period is specifically a time period for counting archiving problems. The preset time period may be set to one week. The preset threshold is a trigger condition for an archival problem to be flagged as a high frequency problem. The high-frequency problem is particularly an archiving problem which needs to be solved preferentially in an archiving problem list. The high-frequency problems are placed at the top in the filing problem list, specifically, the high-frequency problems are arranged in the filing problem list according to the corresponding occurrence times, or the high-frequency problems are sequentially arranged in the filing problem list according to the time marked as the high-frequency problems.
In one embodiment, the server counts the occurrence time and the occurrence frequency of the historical filing problems in the filing problem list, and adjusts the positions of the filing problems to be corrected corresponding to the historical filing problems in the filing problem list according to the counted occurrence time and the occurrence frequency.
In the embodiment, the filing problem occurring more times than the preset threshold is marked as a high-frequency problem by counting the filing problems in the filing problem list, and the high-frequency problem is set in the filing problem list, so that the set high-frequency problem in the filing problem list can be preferentially corrected, the easy-to-occur filing problem is preferentially solved, the speed of correcting the filing problem filed by the business data table is increased, and the efficiency of filing the business data table is improved.
In one embodiment, the method further comprises: constructing an archiving problem model according to the archiving problem list; before filing the business data table to the business data filing table, detecting the business data table and the business data filing table through the filing problem model; correcting errors of the detected table structure information; and after the table structure information of the service data table and the service data filing table is corrected to be wrong, filing is carried out.
The archiving problem model is a data model for predicting the occurrence of an archiving problem in the business data archiving table. The method comprises the steps of detecting a business data table and a business data filing table through a filing problem model, and specifically, importing table structure information of the business data table and the business data filing table into the filing problem model. The detected table structure error is corrected, specifically, the table structure information of the service data archiving table may be reconfigured according to the table structure information of the service data table.
In one embodiment, the server acquires the position information and the problem type corresponding to the record with the filing problem in the filing problem list, inputs the acquired position information and the acquired problem type into the filing problem model to be trained, and acquires the filing problem model after continuously inputting the position information and the problem type to the filing problem model to be trained for a preset time. Wherein the preset time period may be fifteen days.
In one embodiment, when the business data table is filed and the filing of the business data table fails, the server quickly determines a filing problem according to the filing problem model, corrects the business data filing table according to the determined filing problem, and re-files the business data in the business data table to the business data filing table.
In this embodiment, by constructing the filing problem model according to the filing problem list, an error of the table structure information of the business data filing table can be detected before filing the business data table to the business data filing table, and filing can be performed after the error of the table structure information is corrected, so that an error occurring when the business data table is filed can be avoided, and the time spent for filing can be increased, thereby improving the efficiency of filing the business data table.
In one embodiment, the automatically revising the business data archiving table according to the archiving problem list includes: identifying the maximum character string length recorded in the service data table; adjusting the maximum character string length of the record corresponding to the business data table in the business data filing table to be twice as long as the maximum character string length of the record in the business data table; and the business data recorded in the business data table is archived into the adjusted corresponding record in the business data archiving table.
The business data recorded in the business data table is archived to the adjusted corresponding record in the business data archiving table, specifically, the business data in the record with the archiving problem is archived again.
In one embodiment, the server identifies the maximum string length of the corresponding record in the service data table according to the filing problem list, adjusts the maximum string length of the record corresponding to the service data table in the service data filing table to a preset multiple of the maximum string length of the record in the service data table, and then re-files the service data of the record corresponding to the filing problem list in the service data table to the adjusted corresponding record in the service data filing table.
In this embodiment, by adjusting the maximum string length of the record corresponding to the business data table in the business data filing table to be twice the maximum string length of the record in the business data table, the business data in the business data table can be successfully filed in the business data filing table, so that the problem of failed filing of the business data table can be corrected.
As shown in fig. 3, in an embodiment, a method for archiving and correcting a service data table is further provided, which specifically includes the following steps:
s302, the business data table is filed to a business data filing table.
S304, reading the respective table structure information of the service data table and the service data filing table.
S306, converting the service data table and the service data filing table into a data table with a uniform format.
S308, selecting inconsistent records from the service data table and the data table with the uniform format corresponding to the service data filing table to obtain a difference table.
The comparison result comprises the difference table; each record in the difference table has a one-to-one correspondence record.
S310, the maximum character string length of each record in the difference table is identified.
S312, acquiring the respective maximum character string lengths of the two one-to-one corresponding records.
When the ratio of the maximum string length of the record selected from the service data archiving table to the maximum string length of the record selected from the service data archiving table is not two, step S314 is executed.
S314, judging that the record with the ratio not being two has table structure information error.
S316, identifying the maximum character string length of the record with the table structure information error in the service data table.
S318, adjusting the maximum string length of the record corresponding to the service data table in the service data filing table to be twice as long as the maximum string length of the record in the service data table.
S320, the service data recorded in the service data table is archived into the adjusted corresponding record in the service data archiving table.
In the method for filing and correcting the business data table, after the business data table in the database is filed to the business data filing table, the comparison result is obtained by reading and comparing the respective table structure information of the business data table and the business data filing table. And the problem of the table structure of the business data filing table can be determined by comparing the comparison result obtained by the table structure information, so that the filing problem of the business data filing table can be determined. And then the determined filing problems are arranged into a filing problem list, so that the business data filing table can be automatically corrected according to the filing problem list, and the speed of automatically correcting the business data filing table is far higher than the speed of manually configuring the table structure information of the business data filing table, so that the waste of time for manually configuring the table structure information of the business data filing table can be avoided, the efficiency of correcting the business data filing table is improved, and the efficiency of filing the business data table is improved.
It should be understood that, although the steps in the flowchart of fig. 3 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not limited to being performed in the exact order illustrated and, unless explicitly stated herein, may be performed in other orders. Moreover, at least a portion of the steps in fig. 3 may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.
In one embodiment, as shown in fig. 4, there is provided a service data table archiving and modifying apparatus 400, including: a business data table filing module 402, a table structure information reading module 404, a table structure information comparing module 406, a filing problem determining module 408, a filing problem list obtaining module 410 and a business data filing table modifying module 412, wherein: a business data table filing module 402, configured to file a business data table to a business data filing table; a table structure information reading module 404, configured to read respective corresponding table structure information in the service data table and the service data archiving table; a table structure information comparison module 406, configured to compare the service data table with the table structure information corresponding to the service data filing table, and obtain a comparison result; the filing problem determining module 408 is configured to determine, according to the comparison result, a filing problem occurring in the business data filing table; an archival problem list acquisition module 410 for acquiring an archival problem list generated according to the determined archival problem; and a service data filing table modifying module 412, configured to automatically modify the service data filing table according to the filing problem list.
The above-mentioned business data table filing and correcting apparatus 400 obtains the comparison result by reading and comparing the respective table structure information of the business data table and the business data filing table after filing the business data table in the database to the business data filing table. And the problem of the table structure of the business data filing table can be determined by comparing the comparison result obtained by the table structure information, so that the filing problem of the business data filing table can be determined. The determined filing problems are arranged into a filing problem list, the business data filing table can be automatically corrected according to the filing problem list, and the speed of automatically correcting the business data filing table is far higher than the speed of manually configuring the table structure information of the business data filing table, so that the waste time of manually configuring the table structure information of the business data filing table can be avoided, the efficiency of correcting the business data filing table is improved, and the efficiency of filing the business data table is improved.
In one embodiment, the apparatus further comprises: the data table conversion module is used for respectively converting the business data table and the business data filing table into respective corresponding data tables with unified formats; the difference table generating module is used for selecting records with inconsistent contents from the business data table and the business data filing table which respectively correspond to the data tables with the unified format to obtain a difference table; the comparison results include the difference table.
In one embodiment, the archive problem includes a table structure information error; each record in the difference table has one-to-one corresponding record in the difference table; the device also includes: a character string length identification module for identifying the maximum character string length of each record in the difference table; the character string length acquisition module is used for acquiring the respective maximum character string lengths of two records which correspond one to one; and the error judgment module is used for determining that the record with the ratio not being the preset value has the list structure information error when the ratio of the maximum character string length of the record selected from the business data filing list to the maximum character string length of the record selected from the business data list is not the preset value.
In one embodiment, after the obtaining of the filing question list generated according to the determined filing question, the method further comprises:
acquiring an email address of a database maintainer;
and sending the filing problem list to an electronic mailbox specified by the electronic mail address.
In one embodiment, the apparatus further comprises: the filing problem counting module is used for counting the filing problems in the filing problem list; the archiving problem analysis module is used for analyzing the archiving problems occurring in the preset time period; the high-frequency problem marking module is used for marking the filing problems with the occurrence times exceeding a preset threshold value as high-frequency problems; and the high-frequency problem top setting module is used for setting the high-frequency problem in the filing problem table.
In one embodiment, the apparatus further comprises: the model construction module is used for constructing an archiving problem model according to the archiving problem list; the data table detection module is used for detecting the business data table and the business data filing table through the filing problem model before filing the business data table to the business data filing table; the service data archiving table correcting module 412, configured to correct the detected error of the table structure information; the service data table archiving module 402 is further configured to archive the service data table and the service data archiving table after correcting the table structure information error of the service data table and the service data archiving table.
In one embodiment, the character string length identifying module is further configured to identify a maximum character string length recorded in the service data table; the device also includes: a character string length adjusting module, configured to adjust a maximum character string length of a record corresponding to the service data table in the service data filing table to be twice the maximum character string length of the record in the service data table; the service data table filing module 402 is further configured to archive the service data recorded in the service data table into the adjusted corresponding record in the service data filing table again.
For specific limitations of the service data table filing and correcting device, reference may be made to the above limitations on the service data table filing and correcting method, and details are not described herein again. All or part of each module in the service data table archiving and correcting device can be realized by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, a computer device is provided, which may be a server, the internal structure of which may be as shown in fig. 5. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The database of the computer device is used for storing at least one of a business data table and a business data filing table. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to realize a business data table archiving and correcting method.
Those skilled in the art will appreciate that the architecture shown in fig. 5 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, there is provided a computer device comprising a memory storing a computer program and a processor implementing the following steps when the processor executes the computer program: archiving the business data table to a business data archiving table; reading the corresponding table structure information in the business data table and the business data filing table; comparing the business data table with the table structure information corresponding to the business data filing table to obtain a comparison result; determining the filing problem of the business data filing table according to the comparison result; acquiring an archiving problem list generated according to the determined archiving problem; and automatically correcting the service data filing table according to the filing problem list.
After the business data table in the database is filed to the business data filing table, the computer device reads and compares the respective table structure information of the business data table and the business data filing table to obtain a comparison result. And the problem of the table structure of the business data filing table can be determined by comparing the comparison result obtained by the table structure information, so that the filing problem of the business data filing table can be determined. And then the determined filing problems are arranged into a filing problem list, so that the business data filing table can be automatically corrected according to the filing problem list, and the speed of automatically correcting the business data filing table is far higher than the speed of manually configuring the table structure information of the business data filing table, so that the waste of time for manually configuring the table structure information of the business data filing table can be avoided, the efficiency of correcting the business data filing table is improved, and the efficiency of filing the business data table is improved.
In one embodiment, the computer program when executed by the processor further performs the steps of: respectively converting the service data table and the service data filing table into respective corresponding data tables with uniform formats; selecting records with inconsistent contents from the data tables with the unified formats respectively corresponding to the business data table and the business data filing table to obtain a difference table; the comparison results include the difference table.
In one embodiment, the computer program when executed by the processor further performs the steps of: identifying a maximum string length for each record in the difference table; acquiring respective maximum character string lengths of two records corresponding one to one; and when the ratio of the maximum character string length of the record selected from the business data filing table to the maximum character string length of the record selected from the business data table is not a preset value, determining that the record with the ratio not being the preset value has table structure information errors.
In one embodiment, the computer program when executed by the processor further performs the steps of: acquiring an email address of a database maintainer; and sending the filing problem list to an electronic mailbox specified by the electronic mail address.
In one embodiment, the computer program when executed by the processor further performs the steps of: counting the filing problems in the filing problem list; analyzing filing problems occurring in a preset time period; the filing problem of which the occurrence frequency exceeds a preset threshold value is marked as a high-frequency problem; the high frequency problem is set to the top in the archive problem table.
In one embodiment, the computer program when executed by the processor further performs the steps of: constructing an archiving problem model according to the archiving problem list; before the business data table is filed to the business data filing table, detecting the business data table and the business data filing table through the filing problem model; correcting errors of the detected table structure information; and after the table structure information of the service data table and the service data filing table is corrected to be wrong, filing is carried out.
In one embodiment, the computer program when executed by the processor further performs the steps of: identifying the maximum character string length recorded in the service data table; adjusting the maximum character string length of the record corresponding to the business data table in the business data filing table to be twice of the maximum character string length of the record in the business data table; and the business data recorded in the business data table is archived into the adjusted corresponding record in the business data archiving table.
In one embodiment, a computer-readable storage medium is provided, having a computer program stored thereon, which when executed by a processor, performs the steps of: filing the business data table to a business data filing table; reading the corresponding table structure information in the business data table and the business data filing table; comparing the business data table with the table structure information corresponding to the business data filing table to obtain a comparison result; determining the filing problem of the business data filing table according to the comparison result; acquiring an archiving problem list generated according to the determined archiving problem; and automatically correcting the service data filing table according to the filing problem list.
The computer-readable storage medium obtains a comparison result by reading and comparing respective table structure information of the business data table and the business data filing table after filing the business data table in the database to the business data filing table. And the problem of the table structure of the business data filing table can be determined by comparing the comparison result obtained by the table structure information, so that the filing problem of the business data filing table can be determined. The determined filing problems are arranged into a filing problem list, the business data filing table can be automatically corrected according to the filing problem list, and the speed of automatically correcting the business data filing table is far higher than the speed of manually configuring the table structure information of the business data filing table, so that the waste time of manually configuring the table structure information of the business data filing table can be avoided, the efficiency of correcting the business data filing table is improved, and the efficiency of filing the business data table is improved.
In one embodiment, the computer program when executed by the processor further performs the steps of: respectively converting the service data table and the service data filing table into respective corresponding data tables with uniform formats; selecting records with inconsistent contents from the data tables with the unified formats respectively corresponding to the business data table and the business data filing table to obtain a difference table; the comparison results include the difference table.
In one embodiment, the computer program when executed by the processor further performs the steps of: identifying a maximum string length for each record in the difference table; acquiring respective maximum character string lengths of two one-to-one corresponding records; and when the ratio of the maximum character string length of the record selected from the business data filing table to the maximum character string length of the record selected from the business data table is not a preset value, determining that the record with the ratio not being the preset value has table structure information errors.
In one embodiment, the computer program when executed by the processor further performs the steps of: acquiring an email address of a database maintainer; and sending the filing problem list to an electronic mailbox specified by the electronic mail address.
In one embodiment, the computer program when executed by the processor further performs the steps of: counting the filing problems in the filing problem list; analyzing filing problems occurring in a preset time period; the filing problem of which the occurrence frequency exceeds a preset threshold value is marked as a high-frequency problem; the high frequency problem is set to the top of the archive problem table.
In one embodiment, the computer program when executed by the processor further performs the steps of: constructing an archiving problem model according to the archiving problem list; before filing the business data table to the business data filing table, detecting the business data table and the business data filing table through the filing problem model; correcting errors of the detected table structure information; and after the table structure information of the service data table and the service data filing table is corrected to be wrong, filing is carried out.
In one embodiment, the computer program when executed by the processor further performs the steps of: identifying the maximum character string length recorded in the service data table; adjusting the maximum character string length of the record corresponding to the business data table in the business data filing table to be twice of the maximum character string length of the record in the business data table; and the business data recorded in the business data table is archived into the adjusted corresponding record in the business data archiving table.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), rambus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent application shall be subject to the appended claims.
Claims (10)
1. A method for archiving and correcting a business data table, the method comprising:
archiving the business data table to a business data archiving table;
reading the corresponding table structure information in the service data table and the service data filing table;
comparing the table structure information corresponding to the business data table and the business data filing table to obtain a comparison result;
determining the filing problem of the business data filing table according to the comparison result;
acquiring an archiving problem list generated according to the determined archiving problem;
and automatically correcting the service data filing table according to the filing problem list.
2. The method according to claim 1, wherein said comparing the table structure information corresponding to the service data table and the service data archiving table to obtain a comparison result, comprises:
respectively converting the service data table and the service data filing table into respective corresponding data tables with uniform formats;
selecting records with inconsistent contents from the data tables with the unified formats corresponding to the service data table and the service data filing table respectively to obtain a difference table; the comparison results include the difference table.
3. The method of claim 2, wherein the archive problem comprises a table structure information error; each record in the difference table has one-to-one corresponding record in the difference table; the determining the archiving problem of the business data archiving table according to the comparison result includes:
identifying a maximum string length for each record in the difference table;
acquiring respective maximum character string lengths of two one-to-one corresponding records;
when the ratio of the maximum character string length of the record selected from the business data filing table to the maximum character string length of the record selected from the business data table is not a preset value, then
And determining that the record of which the ratio is not the preset value has table structure information error.
4. The method of claim 1, wherein after obtaining the list of filing questions generated from the determined filing questions, the method further comprises:
acquiring an email address of a database maintainer;
and sending the filing problem list to an electronic mailbox specified by the electronic mail address.
5. The method of claim 1, wherein after obtaining the list of filing questions generated from the determined filing questions, the method further comprises:
the archiving problems in the archiving problem list are counted;
analyzing filing problems occurring in a preset time period;
the filing problem of which the occurrence frequency exceeds a preset threshold value is marked as a high-frequency problem;
and setting the high-frequency problem at the top of the filing problem table.
6. The method of claim 5, further comprising:
constructing an archiving problem model according to the archiving problem list;
before archiving the business data table to the business data archiving table, detecting the business data table and the business data archiving table through the archiving problem model;
correcting errors of the detected table structure information;
and after the table structure information of the business data table and the business data filing table is corrected to be wrong, filing.
7. The method according to any one of claims 1 to 6, wherein said automatically revising said business data archiving table according to said archiving question list comprises:
identifying the maximum character string length recorded in the service data table;
adjusting the maximum character string length of the record corresponding to the business data table in the business data filing table to be twice of the maximum character string length of the record in the business data table;
and the business data recorded in the business data table is archived into the adjusted corresponding record in the business data archiving table.
8. A device for archiving and modifying a business data table, the device comprising:
the business data table filing module is used for filing the business data table to a business data filing table;
a table structure information reading module, configured to read corresponding table structure information in the service data table and the service data archiving table;
the table structure information comparison module is used for comparing the business data table with the table structure information corresponding to the business data filing table to obtain a comparison result;
the archiving problem determining module is used for determining the archiving problem of the business data archiving table according to the comparison result;
the filing problem list acquisition module is used for acquiring a filing problem list generated according to the determined filing problems;
and the business data filing table correcting module is used for automatically correcting the business data filing table according to the filing problem list.
9. A computer device comprising a memory and a processor, the memory storing a computer program, wherein the processor implements the steps of the method of any one of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 7.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810651440.1A CN108804708B (en) | 2018-06-22 | 2018-06-22 | Method and device for archiving and correcting business data table, computer equipment and storage medium |
| PCT/CN2018/104751 WO2019242113A1 (en) | 2018-06-22 | 2018-09-10 | Service data table filing correction method, device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810651440.1A CN108804708B (en) | 2018-06-22 | 2018-06-22 | Method and device for archiving and correcting business data table, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108804708A CN108804708A (en) | 2018-11-13 |
| CN108804708B true CN108804708B (en) | 2023-04-07 |
Family
ID=64084491
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810651440.1A Active CN108804708B (en) | 2018-06-22 | 2018-06-22 | Method and device for archiving and correcting business data table, computer equipment and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108804708B (en) |
| WO (1) | WO2019242113A1 (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110287182B (en) * | 2019-05-05 | 2021-09-14 | 浙江吉利控股集团有限公司 | Big data comparison method, device, equipment and terminal |
| CN110286883B (en) * | 2019-06-03 | 2024-01-30 | 中国建设银行股份有限公司 | Intelligent database coding monitoring method and device and electronic equipment |
| CN112308571B (en) * | 2019-07-15 | 2024-09-24 | 北京汇钧科技有限公司 | Intelligent customer service response method and device, storage medium and electronic equipment |
| CN111400304A (en) * | 2020-02-19 | 2020-07-10 | 中国建设银行股份有限公司 | Method and device for acquiring total data of section dates, electronic equipment and storage medium |
| CN112148612B (en) * | 2020-09-28 | 2024-12-13 | 百行征信有限公司 | Credit investigation business detection method, device, computer equipment and storage medium |
| CN114547183B (en) * | 2020-11-26 | 2025-07-11 | 中冶京诚工程技术有限公司 | Oracle database synchronization method and device |
| CN113435169B (en) * | 2021-06-24 | 2024-08-13 | 平安国际智慧城市科技股份有限公司 | Electronic seal data configuration method, device, equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2000068819A1 (en) * | 1999-05-10 | 2000-11-16 | Transenda International Llc | Apparatus and process for electronic filing of forms |
| CN101814110A (en) * | 2009-02-25 | 2010-08-25 | 中国联合网络通信集团有限公司 | Data archiving method, system and front end processor thereof |
| CN102207951A (en) * | 2010-03-29 | 2011-10-05 | 软件Ag公司 | Systems and/or methods for distributed data archiving |
| CN103294724A (en) * | 2012-03-05 | 2013-09-11 | 百度在线网络技术（北京）有限公司 | Method for managing database structures and system for method |
| CN106774861A (en) * | 2016-12-01 | 2017-05-31 | 北京奇虎科技有限公司 | Smart machine and behavioral data correcting method and device |
| US9824093B1 (en) * | 2014-06-30 | 2017-11-21 | EMC IP Holding Company LLC | Datacenter maintenance |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8938430B2 (en) * | 2012-02-22 | 2015-01-20 | International Business Machines Corporation | Intelligent data archiving |
| CN105653560B (en) * | 2014-11-28 | 2019-05-14 | 华为软件技术有限公司 | Data archiving method and device |
-
2018
- 2018-06-22 CN CN201810651440.1A patent/CN108804708B/en active Active
- 2018-09-10 WO PCT/CN2018/104751 patent/WO2019242113A1/en active Application Filing
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2000068819A1 (en) * | 1999-05-10 | 2000-11-16 | Transenda International Llc | Apparatus and process for electronic filing of forms |
| CN101814110A (en) * | 2009-02-25 | 2010-08-25 | 中国联合网络通信集团有限公司 | Data archiving method, system and front end processor thereof |
| CN102207951A (en) * | 2010-03-29 | 2011-10-05 | 软件Ag公司 | Systems and/or methods for distributed data archiving |
| CN103294724A (en) * | 2012-03-05 | 2013-09-11 | 百度在线网络技术（北京）有限公司 | Method for managing database structures and system for method |
| US9824093B1 (en) * | 2014-06-30 | 2017-11-21 | EMC IP Holding Company LLC | Datacenter maintenance |
| CN106774861A (en) * | 2016-12-01 | 2017-05-31 | 北京奇虎科技有限公司 | Smart machine and behavioral data correcting method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019242113A1 (en) | 2019-12-26 |
| CN108804708A (en) | 2018-11-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108804708B (en) | Method and device for archiving and correcting business data table, computer equipment and storage medium | |
| CN109325865B (en) | Exception handling method, exception handling device, computer equipment and storage medium | |
| CN109359283B (en) | Summarizing method of form data, terminal equipment and medium | |
| CN110309125B (en) | Data verification method, electronic device and storage medium | |
| CN112036144B (en) | Data analysis method, device, computer equipment and readable storage medium | |
| CN109669844B (en) | Equipment fault processing method, device, equipment and storage medium | |
| CN107861991B (en) | Receipt data processing method and device, computer equipment and storage medium | |
| CN109766483B (en) | Regular expression generation method, device, computer equipment and storage medium | |
| CN109740760B (en) | Text quality inspection automatic training method, electronic device and computer equipment | |
| CN109597763B (en) | Consistency verification method and device for normalizing multiple items of data | |
| CN110069364B (en) | Spare part data error correction method and device, computer equipment and storage medium | |
| CN112667424A (en) | Abnormal data processing method and device, computer equipment and storage medium | |
| CN112328631A (en) | Production fault analysis method and device, electronic equipment and storage medium | |
| CN110727710B (en) | Data analysis method and device, computer equipment and storage medium | |
| CN110855652A (en) | Safety baseline configuration compliance detection method and device, computer equipment and medium | |
| CN112818937A (en) | Excel file identification method and device, electronic equipment and readable storage medium | |
| CN109325058B (en) | Rule batch comparison method, device, computer equipment and storage medium | |
| CN119204992A (en) | A method, device, equipment, medium and product for automated quality inspection of archives | |
| CN112395266A (en) | Data file processing method, first server and computer storage medium | |
| CN109495380A (en) | E-mail sending method, device, computer equipment and storage medium | |
| CN110191097B (en) | Method, system, equipment and storage medium for detecting security of login page | |
| CN111966339A (en) | Method and device for recording buried point parameters, computer equipment and storage medium | |
| CN111400435A (en) | Mail alarm convergence method, device, computer equipment and storage medium | |
| CN117932971B (en) | Stamping process design method and device, electronic equipment and storage medium | |
| CN115641090B (en) | Item distribution method, system, computer device and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |