CN116401302A

CN116401302A - SAP system upgrading period initial data conversion method

Info

Publication number: CN116401302A
Application number: CN202310385480.7A
Authority: CN
Inventors: 张立鑫; 韩昌善; 王丽; 梁俊
Original assignee: Cosco Shipping Technology Beijing Co Ltd
Current assignee: Cosco Shipping Technology Beijing Co Ltd
Priority date: 2023-04-12
Filing date: 2023-04-12
Publication date: 2023-07-07
Also published as: ZA202305200B

Abstract

The embodiment of the invention discloses a data conversion method at the beginning of an SAP system upgrading period; the method comprises the following steps: s1, establishing a data conversion platform; the data conversion platform comprises a subject conversion mapping relation module, an auxiliary accounting field mapping relation module, a company code module, a user module, a role authority module, an original data merging module, an original data splitting module, a successful data conversion module, a transmission record result module and an operation record locking module; s2, initializing part of basic data of the data conversion platform; s3, summarizing and merging the initial data of the SAP system period imported into the original data module; s4, splitting the summarized and combined data. Further still, S5: and verifying the split data. The initial data conversion method saves labor cost, improves accuracy and automation degree of data conversion, improves data conversion efficiency and data conversion quality, and reduces workload of financial staff.

Description

SAP system upgrading period initial data conversion method

Technical Field

The invention belongs to the technical field of data processing, and particularly relates to an SAP system upgrading period initial data conversion method.

Background

When the SAP system upgrades the system in the year, the historical data and the occurrence data in the year are required to be imported into a new system, and the auxiliary accounting fields of the historical data and the data in the year are converted into data of a new standard.

When the traditional SAP system is upgraded, if the data quantity is smaller and the unit quantity is smaller, the data can be manually exported to perform in-vitro operation in Excel, and historical data is retreaded; the main fields of the retreaded history data include: subject codes, cost centers, profit centers, account opening lines, account identification, business ranges and the like, the difficulty in refreshing historical data is that the amount of the historical data is huge, and the selection of certain fields in a new system can have hard constraint on the values of other fields, if the refreshing operation is performed manually, the hard constraint on the field values can not be performed in Excel, so that the error probability is greatly increased after the historical data is imported; and after the renovation operation is finished, the data needs to be checked manually to ensure that the data is correct, and then the imported historical data is imported into a new SAP system manually for manual posting, and a certificate is generated. In general, a large volume of secondary corporate vouchers is on the order of hundreds of millions, and it is very difficult to manually retrofit such data in months if the data is brought online and successfully imported on time.

Disclosure of Invention

In view of this, some embodiments provide a method for data conversion at the beginning of an upgrade period of an SAP system, comprising:

s1, establishing a data conversion platform; the data conversion platform comprises a subject conversion mapping relation module, an auxiliary accounting field mapping relation module, a company code module, a user module, a role authority module, an original data merging module, an original data splitting module, a successful data conversion module, a transmission record result module and an operation record locking module;

s2, initializing part of basic data of the data conversion platform;

s3, summarizing and merging the initial data of the SAP system period imported into the original data module;

s4, splitting the summarized and combined data.

Further, the SAP system upgrade period initial data conversion method disclosed in some embodiments further includes:

s5: and verifying the split data.

The step S2 of the method for converting the initial data of the SAP system in the upgrade period disclosed in some embodiments includes initializing basic data of a subject conversion mapping relationship module, and specifically includes:

uploading an excel file with a standard format, reading a structure file, and classifying subjects needing to be converted.

The step S2 of the method for converting the initial data of the SAP system upgrade period disclosed in some embodiments includes initializing basic data of the auxiliary accounting field mapping relation module, and specifically includes:

uploading a regular auxiliary accounting field mapping table, and distinguishing the classification and the function of each auxiliary accounting field through the identification field.

Some embodiments disclose a method for converting data at the beginning of an upgrade period of an SAP system, wherein step S2 includes:

and collecting user information and filling the user information into a template file, uploading the template file to a background program to automatically generate data to the company code module, the user module and the role authority module, and generating data to initialize the company code module, the user module and the role authority module.

The step S2 of the method for converting data in the early stage of the SAP system upgrade disclosed in some embodiments includes initializing an original data module, and specifically includes:

and importing the initial period data of the SAP system into an original data module, triggering the preliminary cleaning of the data through the storage process of the database, and realizing the classification of formatting time, splitting part of fields and re-marking the data.

The step S3 of the SAP system upgrade period initial data conversion method disclosed by some embodiments comprises the step of carrying out primary summarization and merging on the SAP system period initial data, so as to realize flexible screening and accurate positioning selection on the period initial data.

Some embodiments disclose a method for converting data at the beginning of an upgrade period of an SAP system, wherein step S3 includes: and the access subject conversion mapping module and the auxiliary accounting field mapping module are used for merging and classifying the initial data through a Java language dynamic reflection technology.

In some embodiments, the step S3 of merging the initial data includes merging the fully-automatically convertible data and the semi-automatically convertible data.

In the method for converting the data at the beginning of the upgrade period of the SAP system disclosed by some embodiments, the step S4 of splitting the data comprises splitting the data on line, downloading the data to be split into Excel, and splitting the data with the same classification.

The SAP system upgrading period initial data conversion method disclosed by the embodiment of the invention saves labor cost, improves the accuracy and the automation degree of data conversion, can realize full automation aiming at partial data, and does not need participation and perception of front-end service personnel; aiming at partial problematic historical data, auditing and correcting the data to a certain extent in a controllable range, and cleaning out the non-compliant data in the historical data so as to meet the requirements of a new system on the data quality; the data conversion efficiency and the data conversion quality are improved, and the workload of financial staff is reduced.

Drawings

Some embodiments of fig. 1 disclose a flow chart for data conversion at the beginning of an upgrade period of an SAP system.

Detailed Description

The word "embodiment" as used herein does not necessarily mean that any embodiment described as "exemplary" is preferred or advantageous over other embodiments. Performance index testing in the examples of the present invention, unless otherwise specified, was performed using conventional testing methods in the art. It should be understood that the terminology used in the description of the embodiments of the invention presented is for the purpose of describing particular embodiments only, and is not intended to be limiting of the disclosure of the embodiments of the invention.

Unless otherwise defined, technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which embodiments of the invention belong; other test methods and techniques not specifically identified in the examples of the present invention are those generally employed by those skilled in the art.

The terms "substantially" and "about" are used herein to describe small fluctuations. For example, they may refer to less than or equal to ±5%, such as less than or equal to ±2%, such as less than or equal to ±1%, such as less than or equal to ±0.5%, such as less than or equal to ±0.2%, such as less than or equal to ±0.1%, such as less than or equal to ±0.05%. Numerical data presented or represented herein in a range format is used only for convenience and brevity and should therefore be interpreted flexibly to include not only the numerical values explicitly recited as the limits of the range, but also to include all the individual numerical values or sub-ranges encompassed within that range. For example, a numerical range of "1 to 5%" should be interpreted to include not only the explicitly recited values of 1% to 5%, but also include individual values and sub-ranges within the indicated range. Thus, individual values, such as 2%, 3.5% and 4%, and subranges, such as 1% to 3%, 2% to 4% and 3% to 5%, etc., are included in this numerical range. The same principle applies to ranges reciting only one numerical value. Moreover, such an interpretation applies regardless of the breadth of the range or the characteristics being described.

In this document, including the claims, conjunctions such as "comprising," including, "" carrying, "" having, "" containing, "" involving, "" containing, "and the like are to be construed as open-ended, i.e., to mean" including, but not limited to. Only the conjunctions "consisting of … …" and "consisting of … …" are closed conjunctions.

Numerous specific details are set forth in the following examples in order to provide a better understanding of the present invention. It will be understood by those skilled in the art that the present invention may be practiced without some of these specific details. In the examples, some methods, means, instruments, devices, etc. well known to those skilled in the art are not described in detail in order to highlight the gist of the present invention.

On the premise of no conflict, the technical features disclosed by the embodiment of the invention can be combined at will, and the obtained technical scheme belongs to the disclosure of the embodiment of the invention.

In some embodiments, the SAP system upgrade period initial data conversion method comprises:

s1, establishing a data conversion platform; the data conversion platform comprises a subject conversion mapping relation module, an auxiliary accounting field mapping relation module, a company code module, a user module, a role authority module, an original data merging module, an original data splitting module, a successful data conversion module, a transmission record result module and an operation record locking module; the data conversion platform processes the fields and the relations of the early date by utilizing the functional modules, so that the early date in the SAP system upgrading process is converted; generally, the initial period data refers to all historical data existing in the SAP system when the system is upgraded;

s2, initializing part of basic data of the data conversion platform;

s4, splitting the summarized and combined data.

Typically, the subject conversion mapping relationship module includes mapping relationships between new subjects and old subjects, such as a one-to-one relationship, a one-to-many relationship, a many-to-one relationship, and the like, and also includes allowable conversion field enumeration values in subjects, and the like; the subject conversion mapping relation module is a basis and a root of data line project data conversion, and one line project data comprises a plurality of auxiliary accounting fields; the auxiliary accounting field mapping relation contains new and old auxiliary accounting field meanings, conversion corresponding relation, constraint relation, classification relation and the like. The auxiliary accounting field mapping relation module takes each field of 'new and old subject mapping relation + ID + data version + subject type' as a uniquely matched key, records all possible auxiliary accounting fields, and each auxiliary accounting field has an identifier to indicate whether the auxiliary accounting field of the data can be automatically converted; if a certain piece of data relates to a field which cannot be automatically converted, dividing the data into a data set which cannot be automatically converted in the subsequent data cleaning and marking step;

for example, the subject conversion module converts the old subject 1000000000 into the new subject 20000000000, which is a one-to-one conversion, and the piece of data has the condition of automatic conversion only from the viewpoint of subject conversion; further, it is necessary to see whether the new-old conversion relationships of the auxiliary accounting fields other than the subjects in the piece of data simultaneously satisfy a one-to-one condition, if so; checking the requirement of the new subject on the auxiliary accounting field, for example, whether the number of the old fields can meet the requirement of the new subject on the number of the auxiliary accounting fields or whether the necessary fields in the new subject are not empty in the old data and meet the data requirement; if the conditions are met, merging and classifying the data after sorting and cleaning the data, and marking the data as automatically convertible data; otherwise, the fields marked as manual processing data and not meeting the requirements of new subjects are recorded, the user is prompted to pay attention to when the page is manually split, only the fields allow the user to modify, and other fields which can be automatically converted are all converted and cannot be modified, so that misoperation is avoided to change correct data into error data.

In general, the original data module refers to an original data module transmitted from an old SAP system, where original data in the original data module is used as an original data source for all subsequent data operations, and the original data module has functions of data cleaning, sorting, marking, conversion, tracing, and the like; the data after the data cleaning, sorting and merging marks enter an original data merging module; the original data splitting module is a functional module, the functional module comprises logic loading, data processing and some auxiliary functions, the coupling degree of the original data splitting module and other modules is higher, all data converted automatically and manually enter a data module which is successfully converted after all the data converted are completed, transmission record marks are made, and the transmission record marks are recorded in a development system (DEV), a test system (QAS) and a production system (PRD) of an SAP new system so as to conveniently judge which data are transmitted or not transmitted, and whether the transmission is successful or not; when an error occurs in the data transmission process, the ID of the data is recorded in a record table of the transmission record result module, and the error reporting reason is recorded and stored in the transmission record result module.

In general, users allowed to log in by the current company are recorded under each company code in the company code module, and because of the large number of companies, in order to avoid misoperation of other company data, the users of the user module have different roles, and the role authority module binds the authorities of the users, so that the menu functions on which pages can be used by each user are determined; because a plurality of staff under one company can operate one piece of data at the same time, when a certain user of the same company edits the data, a lock of the user on the piece of data can be created in the background when the record locking module is operated, and other users under the company can not operate the locked piece of data at the moment, so that data coverage is avoided.

In some embodiments, as shown in fig. 1, the SAP system upgrade period initial data conversion method includes:

s1, establishing a data conversion platform;

s2, initializing part of basic data of the data conversion platform;

s4, splitting summarized and combined data;

s5: and verifying the split data.

The step S2 of the method for converting the initial data of the SAP system in the upgrade period disclosed in some embodiments includes initializing basic data of a subject conversion mapping relationship module, and specifically includes: uploading an excel file with a standard format, reading a structure file, and classifying subjects needing to be converted. Generally, an administrator logs in a background management interface, uploads an excel structure file with a standard format written by a service person, reads the excel structure file, and classifies subjects to be converted; the subjects to be converted are generally divided into full-automatic processing subjects and semi-automatic processing subjects; meanwhile, for the auxiliary accounting field in each old subject, generating data needing to be subjected to retreading, splitting, merging and converting constraint rule conditions so as to carry out subsequent data conversion.

The step S2 of the method for converting the initial data of the SAP system upgrade period disclosed in some embodiments includes initializing basic data of the auxiliary accounting field mapping relation module, and specifically includes: uploading a regular auxiliary accounting field mapping table, and distinguishing the classification and the function of each auxiliary accounting field through the identification field. In general, the auxiliary accounting field mapping relation module records the new and old range values and conversion mapping relation of each auxiliary accounting field, and the initialization of the module can log in a background management system interface through an administrator, upload a regular auxiliary accounting field mapping table written by service personnel, and distinguish the classification and the function of each auxiliary accounting field through an identification field; wherein the auxiliary accounting field which needs to be converted and renovated in each subject is recorded in the subject table, and the value of the auxiliary accounting field is generally contained in the auxiliary accounting field mapping relation module.

Some embodiments disclose a method for converting data at the beginning of an upgrade period of an SAP system, wherein step S2 includes: and collecting user information and filling the user information into a template file, uploading the template file to a background program to automatically generate data to the company code module, the user module and the role authority module, and generating data to initialize the company code module, the user module and the role authority module. In general, the initialization of the company code module, the user module and the role authority module can be implemented by collecting data from a user and filling the data into a template file, uploading the template file by an administrator, automatically generating data into a data table of the modules by a background program, and after generating corresponding data, the user can log in the system to modify a unified password into a custom password with compliance.

The step S2 of the method for converting data in the early stage of the SAP system upgrade disclosed in some embodiments includes initializing an original data module, and specifically includes: and importing the initial period data of the SAP system into an original data module, triggering the preliminary cleaning of the data through the storage process of the database, and realizing the classification of formatting time, splitting part of fields and re-marking the data. The initial data of the SAP old system can be exported generally, the initial data is imported into the data table of the original data module through an ETL tool, and the preliminary cleaning of the data is triggered through the storage process of the database, so that the formatting time, the partial field splitting and the data classification re-marking are realized.

Generally, after primary summary combination is performed on the initial data of the SAP system, flexible screening can be performed on the initial data, for example, data of a certain company or a plurality of companies can be selected to be operated; meanwhile, other dimensions can be selected in a refined manner, such as subjects, cost centers, profit centers, lenders, business ranges, time ranges, classification and other dimensions, so as to achieve the purpose of accurate positioning and selection of data; the introduction of the initial data is usually carried out in batches, and the old SAP system can continuously generate new data in the use process before the new SAP system is on line, so that the generated new data also needs to be accurately positioned to ensure the accuracy of data operation.

In some embodiments, the data conversion platform uses a dual database structure design of a MySQL database and a ClickHouse database, in which the MySQL database and the ClickHouse database dynamically interact with each other and update in real time so as to realize synchronous update of data in the two databases; original data can be stored in a MySQL database generally so as to realize quick reading and writing of the data; raw data is read from the clickHouse database to enable fast reading of static data.

In general, in the processing operation of the original data, the initialized subject mapping table, the auxiliary accounting field mapping table, the calculation rules and other tables are accessed as the basis of the data processing rules, and massive historical data are combined and classified through the dynamic reflection technology of Java language; generally, imported initial period data is divided into two types, the first is a cumulative count of historical years, the second is an occurrence detail count of the current year, and the two types of initial period data are marked and classified into fully-automatic convertible data and semi-automatic convertible data; therefore, the data needs to be combined at the beginning of the period; usually, a user is required to manually select enumerated values for multiple fields according to service requirements; in addition, some initial data books can become data capable of being converted fully automatically, but data loss occurs due to the quality problem of historical data or other problems, and finally the initial data cannot be converted fully, and at the moment, the lost fields are usually divided into a semi-automatic processing data table according to configuration; the missing fields, typically divided into semi-automatically processed data tables, are accompanied by corresponding flags, i.e., field values marked as missing, to alert the user to the particular processed fields and the specific reasons.

In some embodiments, the conversion of the initial data includes the processing of the fully automatic retreaded data, and a proper data processing method is adopted, so that the data processing efficiency is improved, and the capability of the server to process the data can be monitored. Generally, the processing method for fully and automatically refreshing data comprises the steps of firstly counting data volume according to dimensions of different companies, different years, different subjects and the like, then automatically creating different numbers of multithreading according to different data volume and the capability of a server for processing the data, fully utilizing the performance advantage of the server to carry out multithreading processing on the data, and improving the automatic processing capability and efficiency of the data; if the data quality problem is encountered in the automatic processing process, re-dividing the data with the quality problem into semi-automatic processing data classification, and making special marking description; and storing the automatically processed data into a new data table and recording the serial numbers of the original data so as to trace back the original data of the new data and check which original data the new data is converted from.

In general, the initial data conversion method performs mass calculation and automatic data processing functions on mass data through a data conversion platform, so that the data capable of realizing full-automatic retreading can be automatically converted, the data type capable of being fully automatically converted and retreaded can be determined through a background configuration mode, and the data type of an enumeration value required to be fully filled by a user is determined, thereby meeting the requirements of an SAP new system on data quality and the compliance of service data; furthermore, a friendly and concise data splitting user operation interface is provided, so that some users are prevented from misoperation of data under the condition of not knowing the changed service, and non-compliance data are generated.

In the method for converting the data at the beginning of the upgrade period of the SAP system disclosed by some embodiments, the step S4 of splitting the data comprises splitting the data on line, downloading the data to be split into Excel, and splitting the data with the same classification. In general, the same category data refers to data of the same subject and the same auxiliary accounting field.

In some embodiments, the on-line data splitting is used for the same sort of data splitting. Generally, the online splitting of the data can ensure that the split data has higher accuracy, and meanwhile, the original data detail of the data to be split and converted can be checked; the prior split data is usually converted automatically, and the constraint relation between the fields is determined by accessing a subject mapping table, an auxiliary accounting field mapping table, a split rule table and other core background database tables; when splitting data, if the user splits the line item amount of the certificate into a plurality of pieces, verifying the certificate amount during submission, and avoiding the situation that the total line item amount in the certificate is uneven; because part of auxiliary accounting fields are automatically converted into new auxiliary accounting field values by the program, only fields which cannot be automatically converted can be changed in the splitting process, or the fields with enumerated values are manually selected by a user, so that the user is prevented from filling errors or selecting errors; after the user finishes processing a certain piece of data, clicking a submit button, and transmitting the data to a new SAP system by a program to perform simulated posting verification, so that the correctness of splitting and converting the data by the user can be verified, and the integrity of configuration in the new SAP system can be verified.

In some embodiments, the data to be split is downloaded to Excel to split the same sort data. In general, a user can select a button through the dimension of a page for some data capable of being operated in batch, download the data line, and after the data is downloaded to Excel, the fields needing to be split and replaced have explicit prompts, and the fields needing not to be converted and split do not need to be changed. For the fields which definitely need to be split and replaced, the user splits and replaces the data in batches according to the service requirement, if the user fills out the non-compliant data, the user is prompted to modify the re-uploading data and locate the non-compliant data when the data is transmitted back to the SAP system; after the data is verified to be correct, the converted data is stored in a new data table; when returning the data again, the data conversion platform can automatically identify the source of the original data to be split according to the data characteristics without selecting the same data screening conditions, and automatically marks the split original data; the user downloads the data to be processed in vitro into excel through the selected downloading function in the system page, and carries out quick batch processing on the data, and after the processing is finished, the data is uploaded into the SAP system again to be automatically matched, the splitting of the data is marked, the data is stored into a splitting completion data module, and the processed data form also has the functions of simulated posting and verification of the amount of money and is compared with the original data; the data after the user manually processes the data also has a tracing function, so that the user can conveniently check the data source.

In some embodiments, after the data is split, the split data is validated. In general, the data after the automatic processing of the data conversion platform and the manual splitting of the converted data by the user form a complete data conversion result, and the user can further compare the converted data with the original data for verification. The verification of the split data can be automatically performed on a data splitting platform, and a user can check the comparison result of the original data and the converted data on a data checking interface. In general, because few subjects and auxiliary accounting fields are many-to-many, partial data differences can occur, and the situation requires users to manually check original data and split data according to splitting rules and business requirements; after the user confirms, the verification result is submitted, and after receiving the information, the manager background transmits the data through the data conversion platform and the user-defined interface of the SAP system, and respectively transmits and generates certificates to a development system (DEV), a test system (QAS) and a production system (PRD) of the SAP new system.

The technical solutions disclosed in the embodiments of the present invention and the technical details disclosed in the embodiments of the present invention are only exemplary to illustrate the inventive concept of the present invention, and do not constitute a limitation on the technical solutions of the embodiments of the present invention, and all conventional changes, substitutions or combinations of the technical details disclosed in the embodiments of the present invention have the same inventive concept as the present invention, and are within the scope of the claims of the present invention.

Claims

The SAP system upgrade period initial data conversion method is characterized by comprising the following steps:

s1, establishing a data conversion platform; the data conversion platform comprises a subject conversion mapping relation module, an auxiliary accounting field mapping relation module, a company code module, a user module, a role authority module, an original data merging module, an original data splitting module, a successful conversion data module, a transmission record result module and an operation record locking module;

s2, initializing part of basic data of the data conversion platform;

s3, summarizing and merging the initial data of the SAP system period imported into the original data module;

s4, splitting the summarized and combined data.
2. The SAP system upgrade initial data conversion method of claim 1, further comprising:

s5: and verifying the split data.
3. The SAP system upgrade stage initial data conversion method according to claim 1 or 2, wherein step S2 includes initializing the basic data of the subject conversion mapping relation module, specifically including:

uploading an excel file with a standard format, reading a structure file, and classifying subjects needing to be converted.
4. The SAP system upgrade stage initial data conversion method of claim 1 or 2, wherein step S2 comprises initializing the basic data of the auxiliary accounting field mapping relation module, specifically comprising:

uploading a regular auxiliary accounting field mapping table, and distinguishing the classification and the function of each auxiliary accounting field through the identification field.
5. The SAP system upgrade initial data conversion method according to claim 1 or 2, wherein step S2 comprises:

and collecting user information and filling the user information into a template file, uploading the template file to a background program to automatically generate data to the company code module, the user module and the role authority module, and generating data to initialize the company code module, the user module and the role authority module.
6. The SAP system upgrade stage initial data conversion method according to claim 1 or 2, wherein step S2 comprises initializing the original data module, specifically comprising:

and importing the initial period data of the SAP system into an original data module, triggering the preliminary cleaning of the data through the storage process of the database, and realizing the classification of formatting time, splitting part of fields and re-marking the data.
7. The method for converting the initial data of the upgrade of the SAP system according to claim 1 or 2, wherein the step S3 includes performing initial summary merging on the initial data of the SAP system, so as to implement flexible screening and accurate positioning selection on the initial data.
8. The SAP system upgrade initial data conversion method as set forth in claim 4, wherein step S3 includes: and the access subject conversion mapping module and the auxiliary accounting field mapping module are used for merging and classifying the initial data through a Java language dynamic reflection technology.
9. The SAP system upgrade initial data conversion method of claim 8, wherein the merging of initial data in step S3 includes merging fully automatically convertible data with semi-automatically convertible data.
10. The method for converting data at the beginning of an upgrade period of an SAP system according to claim 1 or 2, wherein the splitting of the data in step S4 includes splitting the data on-line, downloading the data to be split into Excel, and splitting the data classified in the same category.