CN112001710A - Big data reading and integrating system in steel product production process - Google Patents
Big data reading and integrating system in steel product production process Download PDFInfo
- Publication number
- CN112001710A CN112001710A CN202010927330.0A CN202010927330A CN112001710A CN 112001710 A CN112001710 A CN 112001710A CN 202010927330 A CN202010927330 A CN 202010927330A CN 112001710 A CN112001710 A CN 112001710A
- Authority
- CN
- China
- Prior art keywords
- data
- reading
- production process
- module
- type
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004519 manufacturing process Methods 0.000 title claims abstract description 36
- 229910000831 Steel Inorganic materials 0.000 title claims abstract description 29
- 239000010959 steel Substances 0.000 title claims abstract description 29
- 230000010354 integration Effects 0.000 claims abstract description 23
- 238000012360 testing method Methods 0.000 claims abstract description 17
- 238000013499 data model Methods 0.000 claims description 6
- 238000004364 calculation method Methods 0.000 claims description 4
- 238000012545 processing Methods 0.000 claims description 4
- 238000006243 chemical reaction Methods 0.000 claims description 2
- 238000000034 method Methods 0.000 abstract description 26
- 238000012544 monitoring process Methods 0.000 abstract description 6
- 238000003326 Quality management system Methods 0.000 abstract description 2
- 238000011161 development Methods 0.000 abstract description 2
- XEEYBQQBJWHFJM-UHFFFAOYSA-N Iron Chemical compound [Fe] XEEYBQQBJWHFJM-UHFFFAOYSA-N 0.000 description 4
- 238000010586 diagram Methods 0.000 description 2
- 238000005098 hot rolling Methods 0.000 description 2
- 229910052742 iron Inorganic materials 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000004886 process control Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
- G06Q10/103—Workflow collaboration or project management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/02—Agriculture; Fishing; Forestry; Mining
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Strategic Management (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Marketing (AREA)
- Tourism & Hospitality (AREA)
- Entrepreneurship & Innovation (AREA)
- Economics (AREA)
- Data Mining & Analysis (AREA)
- General Business, Economics & Management (AREA)
- Life Sciences & Earth Sciences (AREA)
- Quality & Reliability (AREA)
- Operations Research (AREA)
- General Engineering & Computer Science (AREA)
- Agronomy & Crop Science (AREA)
- Animal Husbandry (AREA)
- Marine Sciences & Fisheries (AREA)
- Mining & Mineral Resources (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Primary Health Care (AREA)
- General Factory Administration (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention relates to a big data reading and integrating system in the production process of steel products, which comprises: the data reading module is used for reading any production process data table in any type of database; the data integration module is used for taking each type of product as a large type, taking a data table related to the type of product as the attribute of the type, and building new attributes according to the requirement of an upper application system, wherein all the data tables are associated with the ID codes of the products; and the data test module is used for checking and verifying whether the data reading and the data integration are correct or not. The finished steel coil is taken as a core, and the data of all the procedures in the whole process is read and integrated into a record to be provided for an upper application system, so that the high-efficiency connection between the upper application system and a data environment is realized. The method provides an efficient and convenient way for upper application systems (quality monitoring systems, quality management systems and the like) in the steel industry to acquire big data of the production process of products, and improves the efficiency for the development of the application systems in the steel industry.
Description
Technical Field
The invention belongs to the field of large data of steel industry, and particularly relates to a large data reading and integrating system for a steel product production process.
Background
In iron and steel enterprises, in order to meet user requirements and improve product quality, the enterprises may develop upper-level application systems, such as a product quality monitoring system for monitoring the data state of a product production process, so as to monitor the production process data of the product. The technical and management personnel can monitor or inquire the full-flow production process data of each coil of steel from a similar upper application system according to the ID number of the steel coil.
The production process of the steel product is long, the processes are multiple and complex, dozens of production processes are needed from the beginning of the molten iron pretreatment to the production of the steel coil finished product, and each process comprises hundreds of process control points. Each control data point has both continuous data and discrete data; both switching value data and character type data exist; the sampling period is also long or short; the data sources are diverse, both from the L1 control system data, and from the L2 process data and L3 production plan data. How to take the finished steel coil as a core, reading and integrating the data of all the procedures of the whole process into a record, and realizing the high-efficiency connection between a quality monitoring system and a data environment is actively explored.
Disclosure of Invention
The invention aims to provide a big data reading and integrating system for the production process of steel products, which can efficiently and conveniently read and integrate the big data in the production process of the steel products and provide the read and integrated big data to an upper application system (a product quality monitoring system) and create effective connection between the upper application system and a data environment.
The technical scheme adopted by the invention for solving the technical problems is as follows: a big data reading and integrating system in the production process of steel products comprises:
the data reading module is used for reading any production process data table in any type of database;
the data integration module is used for taking each type of product as a large type, taking a data table related to the type of product as the attribute of the type, and building new attributes according to the requirement of an upper application system, wherein all the data tables are associated with the ID codes of the products;
and the data test module is used for checking and verifying whether the data reading and the data integration are correct or not.
Further, when the data reading module reads the data table, the data table is classified according to the service requirement: one is directly reading the original data table data; one is reading the original data after calculation processing conversion.
Further, the data reading module reads the data tables including the table structure and the table data, and takes each data table as a data type.
Furthermore, the data integration module can also carry out integration configuration on a plurality of data schemes according to business needs, and each scheme configuration can be stored as a data model version.
Furthermore, the data integration module also provides a test environment for the data test module.
Further, a product major name is input into the data testing module, the testing module lists all attributes under the product major, a specific product ID code is input, and a specific data value of the ID code is listed under each attribute for checking whether data integration is correct.
The invention has the following beneficial effects: the big data reading and integrating system takes the finished steel coil as a core, reads and integrates the data of all the procedures in the whole process into a record, and provides the record for an upper application system, thereby realizing the high-efficiency connection between the upper application system and a data environment. The method provides an efficient and convenient way for upper application systems (quality monitoring systems, quality management systems and the like) in the steel industry to acquire big data of the production process of products, and improves the efficiency for the development of the application systems in the steel industry.
Drawings
FIG. 1 is a schematic view of the big data reading and integrating process in the production process of steel products.
FIG. 2 is a schematic diagram of a data integration model of hot rolled products according to the present invention.
Detailed Description
The following are specific examples of the present invention and further describe the technical solutions of the present invention, but the scope of the present invention is not limited to these examples. All changes, modifications and equivalents that do not depart from the spirit of the invention are intended to be included within the scope thereof.
A big data reading and integrating system in the production process of steel products comprises a data reading module, a data integrating module and a data testing module. A schematic diagram of a big data reading and integrating process in the production process of steel products is shown in fig. 1. The method comprises the steps of firstly linking a data reading and integrating system with a database interface of each process link in the production process, reading a data sheet related to each process in the production process of a product into the data reading and integrating system through a data reading module, dividing the data sheet into original sheet data which is not read by any change according to the data content requirement of the data sheet, or reading the original sheet data after calculation processing, creating mapping when reading the data, giving each field a data type of one system, and setting one data type for each data sheet mapped in the system. The data integration module takes each type of product as a large type, takes a data table related to the type of product as the attribute of the type, and can newly build and increase the attribute according to the requirement of an upper application system, wherein all the data tables are related by a product ID code. The data integration module can carry out integration configuration on a plurality of data schemes according to business needs, and each scheme configuration can be stored as a data model version. The data integration system also provides a test environment to test the results.
Steel products are generally classified into hot rolled products, cold rolled products, thick plate products, etc. according to product types. The present embodiment takes a hot rolled product as an example, and describes a method for reading and integrating data of a production process of a hot rolled product.
According to the requirements of an upper application system, process data of each process link in the production process of the hot rolled product and issued production instruction data need to be read, and data matching and association are carried out by taking the ID number of the hot rolled product as a key field.
The method comprises the steps of firstly linking a data reading and integrating system with a database interface of each process link of a hot rolling production line, reading a data sheet related to each process in each production process of each hot rolling product into the data reading and integrating system, dividing the data sheet into original sheet data according to the data content requirement of the data sheet without any change reading, or reading the original sheet data after calculation processing, creating mapping when reading the data, endowing each field with a data type of one system, and setting one data type for each data sheet mapped in the system.
Specifically, taking a hot-rolled Product class as an example, a data reading module links and reads production process data tables of each process link in the production process of the hot-rolled Product, each data table takes a Product ID as a key field, a hot-rolled Product class HSM _ Product is established in a data integration module, a read-in hot-rolled Product related data table is taken as an attribute of the HSM _ Product class, and data association is carried out through the ID number of the Product.
The hot-rolled product class data list after integration is shown in fig. 2, the integrated hot-rolled product class data structure can be stored in a data reading and integrating system and stored as a data model file which can be read by a data integrating module, when data needs to be added or deleted in the hot-rolled product data integration, a new integrated data structure can be stored after the integrated data is modified every time and stored as a new version of the data model file, the data integrating module can read the data model file of the different version according to the requirements of an upper application system, and an efficient and convenient data integration mode is provided for upper application.
The integrated hot-rolled product class data can be checked and checked in the system through the data testing module to check whether the data reading and the data integration are correct.
The method comprises the steps of inputting a major name HSM _ Product of a hot-rolled Product into a data testing module, listing all attributes of the major HSM _ Product of the hot-rolled Product by the testing module, inputting a specific ID code of the hot-rolled Product, listing a specific data value of the ID code under each attribute, and visually checking whether data integration is correct or not.
The present invention is not limited to the above embodiments, and any structural changes made under the teaching of the present invention shall fall within the scope of the present invention, which is similar or similar to the technical solutions of the present invention.
The techniques, shapes, and configurations not described in detail in the present invention are all known techniques.
Claims (6)
1. A big data reading and integrating system in the production process of steel products is characterized by comprising:
the data reading module is used for reading any production process data table in any type of database;
the data integration module is used for taking each type of product as a large type, taking a data table related to the type of product as the attribute of the type, and building new attributes according to the requirement of an upper application system, wherein all the data tables are associated with the ID codes of the products;
and the data test module is used for checking and verifying whether the data reading and the data integration are correct or not.
2. The big data reading and integrating system for the steel product production process as claimed in claim 1, wherein when the data reading module reads the data table, the data table is classified according to the business requirements: one is directly reading the original data table data; one is reading the original data after calculation processing conversion.
3. The steel product production process big data reading and integrating system as claimed in claim 1, wherein the data reading module reads the data table including the table structure and the table data and treats each data table as a data type.
4. The big data reading and integrating system for the steel product production process as claimed in claim 1, wherein the data integrating module is further capable of integrating and configuring a plurality of data schemes according to business needs, and each scheme configuration can be stored as a data model version.
5. The system of claim 1, wherein the data integration module further provides a testing environment for the data testing module.
6. The big data reading and integrating system for steel product production process as claimed in claim 1, wherein the product big class name is inputted into the data testing module, the testing module will list all the attributes under the product big class, input the specific product ID code, under each attribute, list the specific data value of the ID code for checking whether the data integration is correct.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010927330.0A CN112001710A (en) | 2020-09-07 | 2020-09-07 | Big data reading and integrating system in steel product production process |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010927330.0A CN112001710A (en) | 2020-09-07 | 2020-09-07 | Big data reading and integrating system in steel product production process |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112001710A true CN112001710A (en) | 2020-11-27 |
Family
ID=73470073
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010927330.0A Pending CN112001710A (en) | 2020-09-07 | 2020-09-07 | Big data reading and integrating system in steel product production process |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112001710A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1826578A (en) * | 2003-02-18 | 2006-08-30 | 邓百氏公司 | Data integration method |
| CN105045904A (en) * | 2015-08-07 | 2015-11-11 | 北京京东尚科信息技术有限公司 | User data integration method and system based on data warehouse |
| CN107480235A (en) * | 2017-08-08 | 2017-12-15 | 四川长虹电器股份有限公司 | A kind of database framework of data platform |
| CN107992519A (en) * | 2017-10-31 | 2018-05-04 | 中国电力科学研究院有限公司 | The multi-source heterogeneous data verification system and method for a kind of smart grid-oriented big data |
| CN108874644A (en) * | 2018-06-06 | 2018-11-23 | 平安科技（深圳）有限公司 | Data monitoring method, device, computer equipment and storage medium |
| CN109582667A (en) * | 2018-10-16 | 2019-04-05 | 中国电力科学研究院有限公司 | A kind of multiple database mixing storage method and system based on power regulation big data |
| CN110851667A (en) * | 2019-09-25 | 2020-02-28 | 中国移动通信集团河南有限公司 | Integrated analysis method and tool for multi-source large data |
-
2020
- 2020-09-07 CN CN202010927330.0A patent/CN112001710A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1826578A (en) * | 2003-02-18 | 2006-08-30 | 邓百氏公司 | Data integration method |
| CN105045904A (en) * | 2015-08-07 | 2015-11-11 | 北京京东尚科信息技术有限公司 | User data integration method and system based on data warehouse |
| CN107480235A (en) * | 2017-08-08 | 2017-12-15 | 四川长虹电器股份有限公司 | A kind of database framework of data platform |
| CN107992519A (en) * | 2017-10-31 | 2018-05-04 | 中国电力科学研究院有限公司 | The multi-source heterogeneous data verification system and method for a kind of smart grid-oriented big data |
| CN108874644A (en) * | 2018-06-06 | 2018-11-23 | 平安科技（深圳）有限公司 | Data monitoring method, device, computer equipment and storage medium |
| CN109582667A (en) * | 2018-10-16 | 2019-04-05 | 中国电力科学研究院有限公司 | A kind of multiple database mixing storage method and system based on power regulation big data |
| CN110851667A (en) * | 2019-09-25 | 2020-02-28 | 中国移动通信集团河南有限公司 | Integrated analysis method and tool for multi-source large data |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Du et al. | RFID and multi-agent based architecture for information sharing in prefabricated component supply chain | |
| CN106296042B (en) | Teaching and production management information system oriented to college engineering training center | |
| CN107909300A (en) | Intelligent plant management platform and method | |
| Zhang et al. | Process comprehension for shopfloor manufacturing knowledge reuse | |
| CN203324786U (en) | Intelligent type self-service flow production line based on internet of things | |
| CN114462825A (en) | A system and method for intelligent operation and maintenance of industrial equipment | |
| CN102646221A (en) | System and method for real-time tracking and tracing quality of discrete manufacturing process logistics | |
| CN102436238A (en) | A production line data acquisition and information management system and acquisition method | |
| CN104407576A (en) | Realization method for general type production and manufacturing unit and control system thereof | |
| Zhong et al. | Design and Implementation of DMES Based on RFID | |
| CN105321051A (en) | Extra-high voltage substation intelligent operation and maintenance management and method for generating report thereof | |
| CN103049558A (en) | Method and system for generating report forms in Factory Talk View SE (site edition) configuration environment | |
| CN101364284A (en) | Production management system for electrical power system | |
| CN104392297A (en) | Method and system for realizing non-business process irregularity detection in large data environment | |
| CN102163055A (en) | Comprehensive intelligent check method of industrial distributed control system (DCS) | |
| CN201845360U (en) | Electronic operation guidance system for assembly line | |
| CN117591079A (en) | Design construction method of enterprise-level integrated operation management system | |
| Chang et al. | Research on intelligent manufacturing development approach for China's local valve industry | |
| CN112633850A (en) | Method for realizing service flow automation by managing, calling and monitoring RPA robot | |
| CN101699483A (en) | Production collaboration method, device and system | |
| CN112001710A (en) | Big data reading and integrating system in steel product production process | |
| CN109064362B (en) | AI technology-based power grid material management and training system | |
| CN110826926A (en) | Intelligent manufacturing execution system for surface assembly production line | |
| CN107230031A (en) | Eco industrial park Third Party Reverse Logistics system network platform | |
| CN117667065A (en) | A low-code application configuration platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201127 |
|
| RJ01 | Rejection of invention patent application after publication |