CN113012278B - Web-side digital factory visual monitoring method, system and storage medium - Google Patents
Web-side digital factory visual monitoring method, system and storage medium Download PDFInfo
- Publication number
- CN113012278B CN113012278B CN202110280150.2A CN202110280150A CN113012278B CN 113012278 B CN113012278 B CN 113012278B CN 202110280150 A CN202110280150 A CN 202110280150A CN 113012278 B CN113012278 B CN 113012278B
- Authority
- CN
- China
- Prior art keywords
- equipment
- dimensional
- model
- dimensional model
- workshop
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 69
- 230000000007 visual effect Effects 0.000 title claims abstract description 33
- 238000000034 method Methods 0.000 title claims abstract description 30
- 238000003860 storage Methods 0.000 title claims abstract description 10
- 238000004519 manufacturing process Methods 0.000 claims abstract description 169
- 238000012800 visualization Methods 0.000 claims abstract description 4
- 238000004590 computer program Methods 0.000 claims description 17
- 238000010586 diagram Methods 0.000 claims description 17
- 238000003708 edge detection Methods 0.000 claims description 10
- 239000007787 solid Substances 0.000 claims description 7
- 238000012423 maintenance Methods 0.000 claims description 4
- 238000013506 data mapping Methods 0.000 claims description 3
- 239000000047 product Substances 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- 238000013461 design Methods 0.000 description 5
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 238000000605 extraction Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 239000000463 material Substances 0.000 description 4
- 238000013507 mapping Methods 0.000 description 3
- 238000012806 monitoring device Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000001629 suppression Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000012517 data analytics Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000009499 grossing Methods 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/04—Manufacturing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/20—Image enhancement or restoration using local operators
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/70—Denoising; Smoothing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/13—Edge detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30232—Surveillance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2210/00—Indexing scheme for image generation or computer graphics
- G06T2210/61—Scene description
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
- G06T2219/20—Indexing scheme for editing of 3D models
- G06T2219/2016—Rotation, translation, scaling
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- Computer Graphics (AREA)
- Software Systems (AREA)
- General Health & Medical Sciences (AREA)
- Human Resources & Organizations (AREA)
- Manufacturing & Machinery (AREA)
- Architecture (AREA)
- Health & Medical Sciences (AREA)
- Economics (AREA)
- General Engineering & Computer Science (AREA)
- Computer Hardware Design (AREA)
- Marketing (AREA)
- Primary Health Care (AREA)
- Strategic Management (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Geometry (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a web-side digital factory visual monitoring method, a system and a storage medium, which comprises the steps of accessing all production equipment of a workshop to a gateway and collecting data, establishing a workshop three-dimensional model of the factory at a web side according to a workshop two-dimensional graph of the factory, acquiring state data of the production equipment on the workshop three-dimensional model from a monitoring database in a polling or long connection mode, acquiring contained production equipment identity information according to a query request, and changing the display state of the corresponding production equipment presented on the workshop three-dimensional model graph of the web side according to the production equipment identity information. The progress data of each production device in the workshop is specific and visual in the visual mode of three-dimensional visualization, so that the completion progress condition of each production device can be intuitively and rapidly obtained.
Description
Technical Field
The invention relates to the technical field of intelligent manufacturing, in particular to a visual monitoring method, a visual monitoring system and a storage medium for a web-side digital factory.
Background
With the adoption of various innovative technologies by enterprises, new digital factories are silently leading up to the transition of the manufacturing industry and driving the center of the manufacturing industry to step toward highly customized products and systems. The digital factory can not only cover all business links from research and development to after-sale, but also expand the transverse supplier management field. Leading manufacturing enterprises are adopting a series of advanced technologies to achieve production and even digitization of the entire supply chain. These technologies include big data analytics solutions, end-to-end real-time planning and interconnection, autonomous systems, digital twinning, etc. By means of these techniques, efficiency is improved and enterprises can mass-produce highly customized products. Therefore, the digital factory production command center plays a vital role in monitoring the production quality, process parameters, production energy efficiency, material inventory and the like of enterprises.
Plant monitoring also goes into an important role of the plant as digital plants evolve. At present, people commonly used in the industry monitor two-dimensional configuration and monitor modes accompanied with manual patrol, so that the monitoring range and the monitoring timeliness are limited. The two-dimensional configuration monitoring scheme and the professional technology are high in binding degree, so that only professional technicians can understand the two-dimensional configuration monitoring scheme, and the requirement on operators is high. Meanwhile, the response speed and the strain capacity of the factory are reduced because decision-making personnel cannot drink monitoring personnel for communication in time. Meanwhile, most of the existing workshop monitoring systems are mainly displayed in a form of table summarization and two-dimensional curves in the aspect of data display. These two-dimensional tables and curves are very helpful for summarization and reporting, but are not suitable for real-time monitoring, status localization and fault handling in a workshop.
Disclosure of Invention
Aiming at the defects in the prior art, the invention provides a visual monitoring method for a web-end digital factory, which comprises the following steps:
s1, accessing all production equipment of the workshop to a gateway, collecting data and transmitting the data to a monitoring database;
s2, establishing a three-dimensional workshop model of the factory at the web end according to the two-dimensional workshop graphs of the factory;
s3, acquiring the state data of each production device on the three-dimensional model of the workshop from the monitoring database in a polling or long connection mode;
and S4, acquiring the identity information of the contained production equipment according to the query request, changing the first display characteristics of the three-dimensional model of the corresponding production equipment presented on the three-dimensional model diagram of the web end workshop according to the identity information of the production equipment, and adding or updating the second display characteristics of the three-dimensional model presented on the corresponding production equipment according to the state data of the production equipment.
Preferably, the step S1 includes: and (3) forming associated structural data by using workshops as units and all production equipment positioned on the same product line, production line and/or combined equipment, establishing independent data mapping tables for the workshops, the product lines, the production lines, the combined equipment and the production equipment, and regularly storing the collected production equipment data in a monitoring database through a gateway.
Preferably, the step S2 includes:
s21, acquiring an equipment layer of the workshop two-dimensional graph, carrying out edge detection on graphic elements in the equipment layer, and splitting into independent equipment characteristic graphs;
s22, setting identification information of each equipment feature pattern and a position anchor point on the equipment layer, and recording a first interval of the equipment feature patterns, wherein the first interval is a distance between the equipment feature pattern and at least one adjacent equipment feature pattern;
s23, inquiring a two-dimensional model image matched with the device characteristic graph and a bound device three-dimensional model in a first-level model library of a corresponding layer according to the device characteristic graph;
and S24, arranging corresponding equipment three-dimensional models according to the identification information of the equipment characteristic graph and the position anchor points, and respectively adjusting the size of each equipment three-dimensional model according to the first interval.
Preferably, the step S23 specifically includes:
s231, inquiring in a top view, a side view or an axis view contained in a first-level model library of the layer according to the device characteristic graph, and if the similarity is greater than a first preset value, taking a corresponding device three-dimensional model as a three-dimensional image of the device three-dimensional model;
and S232, if the similarity is smaller than a preset value, a simple three-dimensional model corresponding to the equipment feature graph is reproduced and generated.
Preferably, the step S232 further includes:
s2321, if the similarity is smaller than a preset value, judging whether one or more connection regions exist in the device characteristic graph, wherein the connection regions are regions with the region width smaller than the specific proportion of the two ends of the region and the size proportion of the two end regions separated by the connection regions in a preset interval;
s2322, if a connection region exists, the device characteristic pattern is divided along two ends of the connection region to form a plurality of sub-device characteristic patterns;
s2323, according to the feature patterns of the sub-devices, querying a matched three-dimensional model in a top view, a side view or an axis view included in a first-level model library of the layer, and querying a corresponding combined model in a second-level model library of the layer according to the three-dimensional models matched with the feature patterns of all the sub-devices and the number of components, wherein a two-dimensional model image, a three-dimensional model of the combined device, identity information of the three-dimensional models of the sub-devices and the number of the sub-devices corresponding to the combined model are stored in the second-level model library;
s2324, if the connection region does not exist, a cuboid model with the same length-width ratio as the device feature pattern is generated, and a simple three-dimensional model corresponding to the device feature pattern is formed by acquiring the actual picture of the device and combining the picture with the cuboid model.
Preferably, the step S3 further includes: according to the three-dimensional model identity information of the production equipment, the production equipment state data corresponding to each three-dimensional model is obtained from the monitoring database at regular time by using the interface, and the real-time display content of the corresponding three-dimensional model is modified according to the state data and the three-dimensional model identity information, wherein the display content comprises but is not limited to error reporting, alarming, warranty maintenance and normal operation.
Preferably, the step S4 specifically includes:
s41, retrieving the monitoring database according to the query request, and acquiring the identity information and the state data of the production equipment of the corresponding equipment, wherein the query request comprises the project, the company or the contract corresponding to the production task;
s42, switching the first display characteristic of the corresponding three-dimensional model from the first display state to the second display state according to the identity information of the production equipment, or switching the first display characteristic of the rest production equipment which does not appear in the query request from the second display state to the third display state;
and S43, adjusting or updating parameters of a second display characteristic in the three-dimensional model corresponding to the identity information of the production equipment according to the state data of the production equipment, wherein the second display characteristic is the completion progress of the corresponding production equipment in the project, company or contract contained in the query request.
The invention also discloses a visual monitoring system for the web-side digital factory, which comprises the following components: the access module is used for accessing all production equipment of a workshop to the gateway, acquiring data and transmitting the data to the monitoring database; the three-dimensional model creating module is used for creating a workshop three-dimensional model of the factory at a web end according to each workshop two-dimensional graph of the factory; the data acquisition module is used for acquiring the state data of each production device on the three-dimensional workshop model from the monitoring database in a polling or long connection mode; and the display module is used for acquiring the contained identity information of the production equipment according to the query request, changing a first display characteristic of a three-dimensional model of the corresponding production equipment presented on the three-dimensional model diagram of the web end workshop according to the identity information of the production equipment, and adding or updating a second display characteristic of the three-dimensional model presented on the corresponding production equipment according to the state data of the production equipment.
The invention also discloses a web-end digital factory visual monitoring device which comprises a memory, a processor and a computer program stored in the memory and capable of running on the processor, wherein the processor executes the computer program to realize the steps of the method.
The invention also discloses a computer-readable storage medium, in which a computer program is stored, which computer program, when being executed by a processor, realizes the steps of the method as described above.
The invention discloses a visual monitoring method for a web-side digital factory, which comprises the steps of accessing all production equipment of a workshop to a gateway, acquiring data and transmitting the data to a monitoring database, and acquiring state data of all the production equipment on a three-dimensional model of the workshop from the monitoring database in a polling or long-connection mode; and finally, acquiring the contained identity information of the production equipment according to the query request, and changing the display state and the task completion progress of the three-dimensional model of the corresponding production equipment presented on the three-dimensional model graph of the web end workshop according to the identity information of the production equipment. Therefore, the progress data of each production device in the workshop is very specific and intuitive in the intuitive mode of three-dimensional visualization, and workshop personnel, a workshop master and a factory decision maker can intuitively and quickly know the production devices participated in each project or contract and respective completion progress conditions, so that the function of monitoring the state of the whole workshop on a large screen is realized.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
fig. 1 is a schematic flow chart of a web-end digital factory visual monitoring method disclosed in this embodiment.
Fig. 2 is a schematic flowchart of step S2 disclosed in this embodiment.
Fig. 3 is a schematic view of the anchor point setting disclosed in this embodiment.
Fig. 4 is a schematic flowchart of step S23 disclosed in this embodiment.
Fig. 5 is a schematic diagram of a model library disclosed in this embodiment.
Fig. 6 is a schematic specific flowchart of step S232 disclosed in this embodiment.
Fig. 7 is a schematic flowchart of step S2323 disclosed in this embodiment.
Fig. 8 is a schematic flowchart of step S24 disclosed in this embodiment.
Fig. 9 is another specific flowchart of step S24 disclosed in this embodiment.
Fig. 10 is a schematic specific flowchart of step S4 disclosed in this embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the drawings of the embodiments of the present invention. It is to be understood that the embodiments described are only a few embodiments of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the described embodiments of the invention without any inventive step, are within the scope of protection of the invention.
In the description of the present invention, it is to be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", "clockwise", "counterclockwise", and the like, indicate orientations and positional relationships based on those shown in the drawings, and are used only for convenience of description and simplicity of description, and do not indicate or imply that the device or element being referred to must have a particular orientation, be constructed and operated in a particular orientation, and thus, should not be considered as limiting the present invention.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or to implicitly indicate the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present invention, "a plurality" means two or more unless specifically defined otherwise.
In the present invention, unless otherwise expressly specified or limited, the terms "mounted," "connected," "secured," and the like are to be construed broadly and can, for example, be fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.
In the present invention, unless otherwise expressly stated or limited, "above" or "below" a first feature means that the first and second features are in direct contact, or that the first and second features are not in direct contact but are in contact with each other via another feature therebetween. Also, the first feature being "on," "above" and "over" the second feature includes the first feature being directly on and obliquely above the second feature, or merely indicating that the first feature is at a higher level than the second feature. A first feature being "under," "below," and "beneath" a second feature includes the first feature being directly under and obliquely below the second feature, or simply meaning that the first feature is at a lesser elevation than the second feature.
Unless defined otherwise, technical or scientific terms used herein shall have the ordinary meaning as understood by one of ordinary skill in the art to which this invention belongs. The use of "first," "second," and similar terms in the description and in the claims of the present application does not denote any order, quantity, or importance, but rather the terms are used to distinguish one element from another. Also, the use of the terms "a" or "an" and the like do not denote a limitation of quantity, but rather denote the presence of at least one.
In the existing digital factory production command center system, three-dimensional factory scene layout design relates to the three-dimensional model modeling design which needs to be carried out according to equipment, a production line and the like of a customer factory, subsequent customer equipment type replacement, scene change and scene model change are carried out manually, and the three-dimensional factory scene layout design excessively depends on user experience and capability. For example, the modeling of the three-dimensional scene of a digital factory is mostly carried out manually by single model modeling design, then the splicing design of the whole model is carried out according to a two-dimensional scene drawing, and the modification and the updating of the whole scene of the subsequent single model are very difficult, time consumption is great, modification quality cannot be guaranteed necessarily, and the influence on the project is great. In order to greatly reduce the modeling time, improve the project maintenance efficiency and reduce the management cost, a modeling system capable of replacing a large amount of manpower is urgently needed, and the whole three-dimensional scene is efficiently and stably maintained and optimized through a computer technology.
Fig. 1 is a schematic diagram of a method for visually monitoring a web-end digital factory, which is disclosed in this embodiment and specifically includes the following steps:
and step S1, accessing all production equipment of the workshop to the gateway, collecting data and transmitting the data to the monitoring database.
And (3) forming associated structural data by using workshops as units and all production equipment positioned on the same product line, production line and/or combined equipment, establishing independent data mapping tables for the workshops, the product lines, the production lines, the combined equipment and the production equipment, and regularly storing the collected production equipment data in a monitoring database through a gateway.
And step S2, establishing a three-dimensional workshop model of the factory at the web end according to the two-dimensional workshop graphs of the factory. Modeling the whole workshop, importing three-dimensional model data of the workshop at a Web end, and displaying a page as a three-dimensional layout state of the whole workshop. By means of the html5 technology, the style of each model of the page end can be directly controlled, and a unique number is marked for each device on the web end, so that developers can accurately find the corresponding devices, and the corresponding device styles are modified according to the real-time state of the workshop acquired by the background. In the three-dimensional model of the Web end workshop, each equipment model is marked with an equipment number, a data list of equipment states is acquired from the server at regular time by using an interface, then the model style is modified according to the equipment number of the model, and the real-time state of the workshop, such as error reporting, alarming, warranty and normal operation, can be displayed on a page.
As shown in fig. 2, step S2 specifically includes the following steps:
and step S21, acquiring an equipment layer of the workshop two-dimensional graph, carrying out edge detection on graphic elements in the equipment layer, and splitting an independent equipment characteristic graph.
Specifically, by setting a two-dimensional map extraction rule, taking the layers of various elements on a two-dimensional map of a workshop as a basis, taking production equipment as an example, setting a single production equipment element as a minimum unit by default, extracting edge features of the elements on the equipment layer of the two-dimensional map by using a Canny edge detection algorithm, splitting the whole layer, and storing the split independent equipment feature patterns. The two-dimensional workshop graph is a CAD graph which classifies and isolates elements such as production equipment, auxiliary facilities, landmarks, fire fighting equipment and the like on different layers.
The method comprises the following specific steps of extracting edge features of elements of an equipment layer through a Canny edge detection algorithm: smoothing the image by a Gaussian filter; calculating the amplitude and direction of the gradient by using finite difference of first-order partial derivatives; carrying out non-maximum suppression on the gradient amplitude; and detecting and connecting edges by using a dual-threshold algorithm. Two thresholds θ 1 and θ 2 are applied to the non-maximum suppression image, and the relationship θ 1 is 0.4 × θ 2. Let us set the gray value of the pixel with gradient value smaller than θ 1 to 0, resulting in image one. Then, the gray value of the pixel with the gradient value smaller than θ 2 is set to 0, and a second image is obtained. Since the threshold for image two is high, most of the noise is removed, but at the same time useful edge information is also lost. While the threshold for image one is lower, more information is retained, and we can link the edges of the image based on image two and supplemented with image one.
The specific steps for connecting the edges of the image are as follows: and scanning the image two, and tracking the contour line taking p (x, y) as a starting point until an end point q (x, y) of the contour line when encountering a pixel p (x, y) with non-zero gray. Consider the neighborhood of point s (x, y) in image one, which corresponds to the location of q (x, y) in image two. If a non-zero pixel s (x, y) exists in the neighborhood of the s (x, y) point, it is included in image two as the r (x, y) point. Starting from r (x, y), the first step is repeated until we cannot continue in both image one and image two. When the concatenation of the contour line containing p (x, y) is completed, this contour line is marked as visited. And returning to the first step, and searching the next contour line. Repeating the above steps to smooth the image by using a Gaussian filter; calculating the amplitude and direction of the gradient by using finite difference of first-order partial derivatives; and thirdly, carrying out non-maximum suppression on the gradient amplitude. Until no new contour line can be found in image two. At this point, the edge detection of the Canny operator is completed.
Step S22, setting identification information of each device feature pattern and a position anchor point on the device layer, and recording a first distance between the device feature pattern and at least one adjacent device feature pattern.
Specifically, the position anchor point of the device feature graph in the layer is set, and the setting manner may select four corners of the image, for example, the program is set to 0, 1, 2, and 3, and the four positions are corresponding to the upper left, the upper right, the lower left, and the lower right. And simultaneously recording identification information of the device feature pattern, which is used for indicating the position of the device feature pattern in the layer diagram, and recording a first interval of the device feature pattern, wherein the first interval is the distance between the device feature pattern and at least one adjacent device feature pattern. The first distance may also be information of a plurality of distances between the device feature pattern and other adjacent surrounding device feature patterns, so that the positions of elements are automatically adjusted during subsequent three-dimensional scene reconstruction, and special situations such as model congestion and superposition are avoided. As shown in fig. 3, the dashed outline of the device is the minimum unit mark after the graph is split, which indicates that the device is an independent unit body, and performs feature extraction on the device, the identifier of the upper right corner is position location, the set anchor point adopts the upper right mode of the above four modes, and then performs matching location placement of the three-dimensional model according to the anchor point.
And step S23, inquiring the matched two-dimensional model image and the bound three-dimensional model of the equipment in the first-level model library of the corresponding layer according to the characteristic graph of the equipment. Specifically, as shown in fig. 4, this step may include the following.
And S231, inquiring in a top view, a side view or an axis view included in the first-level model library of the layer according to the device feature graph, and if the similarity is greater than a first preset value, taking the corresponding device three-dimensional model as a three-dimensional image of the device.
Wherein, each layer is provided with a plurality of corresponding model libraries. As shown in fig. 5, the model library is a modular database formed by pre-designing three-dimensional models of key devices and conventional devices according to industry characteristics, and packaging the models and device attributes, such as device names, device models, device three-views, and the like, wherein each device module has unique identity information and identity information. And each layer corresponds to different databases according to different equipment attributes. In this embodiment, the generation device map layer further corresponds to a plurality of module libraries, where the first-level model library includes a production device of the most basic unit, and the production device of this level cannot be split into a plurality of individual devices and is arranged in the two-dimensional workshop map respectively.
In some embodiments, the two-dimensional map of the workshop provided in the industry is based on a top plan and a side plan, so that the scene reconstruction is performed based on the top plan. In addition, because the equipment models in the three-dimensional model library have bound two-dimensional top view information, the matched three-dimensional models can be quickly extracted by matching the bound two-dimensional top view information in the comparison library with the equipment feature patterns in the workshop two-dimensional graph provided by a customer.
After obtaining the characteristic graphs of each device on the device layer of the two-dimensional diagram of the workshop, quickly querying a two-dimensional Image matched with the characteristic graphs and a bound three-dimensional model diagram in a first-level model library through Image Retrieval algorithms such as Image Retrieval, wherein the two-dimensional Image can be a top view, a side view or an axis view, and if the similarity is greater than a first preset value, taking the corresponding three-dimensional model of the device as a three-dimensional Image of the device. The first preset value is a preset similarity and is used for judging whether the equipment characteristic graph and the two-dimensional image in the three-dimensional model are the same equipment. For example, the similarity is preset to a value (e.g. 80%) and is higher than the preset value (80%), which is considered to be appropriate, and then the three-dimensional model bound with the similarity is pulled out and set as the three-dimensional model of the device corresponding to the device feature image.
And step S232, if the similarity is smaller than a preset value, a simple three-dimensional model corresponding to the equipment feature graph is reproduced and generated.
Specifically, when the similarity between a device feature pattern and a two-dimensional image of all devices contained in the first-level model library is smaller than a first preset value, it is determined that there is no image matched with the device feature pattern. At the moment, the three-dimensional model is reconstructed by using a simple model and a map mode so as to supplement a unique model library, and meanwhile, the reconstructed three-dimensional model is redrawn and bound with corresponding two-dimensional images, namely a top view, a side view and an axis view. The computer automation processing flow is established according to the rule, the cycle is continuous, the model base is enriched and perfected over time, the subsequent model is more and more accurate, and the matching degree is higher and higher. The simple model can be a model with the highest similarity in a model library or a square three-dimensional model with the same size as the target image, the two-dimensional image is combined with the angle photos of the actual equipment, and the image is converted into a normal map so as to calculate the illumination and shadow of the model in the three-dimensional scene, so that the space occupied by the model can be greatly reduced.
In some embodiments, the space occupied by the three-dimensional scene model is reduced by custom depth matting, distance hiding, view hiding, occlusion culling, and the like. In the aspect of mapping, materials of each mapping are made into various types of shaders through programming, the colors, attributes, reflection, smoothness and the like of the materials are optimized one by one, and the occupied space is compressed as much as possible on the premise of guaranteeing the quality of the model by combining the normal direction data of each pixel of the picture.
As shown in fig. 6, step S232 further includes the following contents.
Step S2321, if the similarity is smaller than a preset value, whether one or more connection regions exist in the device feature graph is judged, and the connection regions are regions with the region width smaller than the specific proportion of the two ends of the region and the size proportion of the two end regions separated by the connection regions in a preset interval.
In some embodiments, because there is a connection relationship between some production devices for material transportation before and after, or some parts of the production devices are staggered up and down due to the arrangement of the workshop space, so that on the two-dimensional workshop map, especially the two-dimensional workshop map with the top view of the production device as the graphic element, the device feature patterns of the production devices on the two-dimensional workshop map exhibit an interconnected state rather than independent graphic elements, and therefore, the production devices connected with each other cannot be divided into independent device feature patterns through the aforementioned step S21, and only can be identified as an integral device feature pattern by edge detection, and thus, a three-dimensional model matching with the device feature patterns cannot be found in the first-level model library by using the similarity.
In this embodiment, the combination equipment feature pattern composed of a plurality of production equipments is divided by identifying the connection area between the production equipments in the combination equipment feature pattern, because the width of the connection area between the production equipments is often much smaller than that of the production equipment main bodies on both sides, and the size difference between the main body areas as the production equipments on both ends of the connection area is not too large. Therefore, the specific area can be used as the connection area by identifying some specific areas in the characteristic graph of the combined equipment, the width of the specific area is smaller than the specific proportion of the two ends of the area, and the size proportion of the two end main body areas separated by the area is within a preset interval. That is, the connection region may be a region having a width smaller than a specific ratio of the two ends of the region and a size ratio of the two end regions separated by the connection region within a predetermined interval.
Step S2322, if a connection region exists, the device characteristic pattern is divided along two ends of the connection region to form a plurality of sub-device characteristic patterns.
And dividing the two ends of the identified connecting area to obtain the device image characteristics of the main bodies of the sub-production devices forming the combined device characteristic graph.
Step S2323, according to the sub-device feature patterns, a matched three-dimensional model is inquired in a top view, a side view or an axis view included in a first-level model base of the layer, and according to the three-dimensional models matched with all the sub-device feature patterns and the number of components, a corresponding combined model is inquired in a second-level model base of the layer, wherein a two-dimensional model image, a combined device three-dimensional model, identity information of each sub-device three-dimensional model and the number of sub-devices corresponding to the combined model are stored in the second-level model base.
The second-level model library stores a combined model formed by combining all production equipment, and comprises a two-dimensional model image, a combined equipment three-dimensional model, identity information of all sub-equipment three-dimensional models and the number of sub-equipment, which correspond to the combined model. The sub-equipment of the combined model is the production equipment in the first-level model library, and the three-dimensional model identity information of the sub-equipment is also the three-dimensional model identity information of the corresponding production equipment in the first-level model library. According to the connection relation and the workshop layout of each production device, the combination model of the second-level model base comprises various possible combination modes of connection or superposition of various production devices in a workshop two-dimensional graph.
As shown in fig. 7, the step S2323 specifically includes the following steps.
Step S201, setting a position anchor point of each sub-device feature pattern on the layer, and recording a second distance between each sub-device feature pattern, where the second distance is a distance between the device feature pattern and an adjacent sub-device feature pattern.
Step S202, a matched three-dimensional model is inquired in a top view, a side view or an axis view included in a first-level model library of the layer according to the characteristic graph of the sub-device, if the similarity is larger than a second preset value, identity information of the corresponding three-dimensional model is obtained, and the second preset value is smaller than the first preset value. Since there is a connection region and it is impossible to determine to which side of the production apparatus the connection region belongs, the approximation degree of the sub-apparatus image feature segmented in the combined apparatus feature pattern to the two-dimensional image of the matching three-dimensional model may be reduced due to the lack of a possible connection region portion.
Step S203, according to the number of all the formed sub-equipment feature graphs and the corresponding three-dimensional model identity information, a matched combined model is inquired in a second-level model library of the layer, and the combined model is configured to have position parameters for adjusting the main body distance of the included sub-equipment modules.
Specifically, the combined model stored in the second-level model library may further include a position parameter for adjusting the distance between the sub-device module bodies included in the combined model, in addition to the corresponding two-dimensional model image, the combined device three-dimensional model, the identity information of the sub-device three-dimensional models, and the number of the sub-devices. By adjusting and setting the position parameters, the distance between the sub-production equipment bodies in the combined model can be changed. By adjusting the position parameters, the main body spacing of each sub-device can be changed while the sub-devices are still in a connection state or a staggered state, and the arrangement position of each production device on a two-dimensional diagram of a workshop is adapted.
And S204, adjusting the position parameters of the combined model according to the second distance of each sub-equipment feature pattern to form a combined model matched with the equipment feature pattern. And adjusting the position parameters of the combined model according to the second distance of the characteristic graph of each piece of sub-equipment until the main body distance of each piece of sub-equipment meets the requirement of the second distance.
Step S2324, if no connection area exists, a cuboid model with the same length-width ratio as the device feature pattern is generated, and a simple three-dimensional model corresponding to the device feature pattern is formed by acquiring an actual picture of the device and combining the picture and the cuboid model.
And step S24, arranging corresponding equipment three-dimensional models according to the position anchor points and the identification information of the equipment feature graphs, and respectively adjusting the sizes of the equipment three-dimensional models according to the first interval.
Although the three-dimensional models are arranged at equal intervals in the workshop two-dimensional graph in an equal proportion, the situation of excessive density cannot occur, the size relation between the three-dimensional models of the production equipment and the size proportion between the equipment in the actual workshop two-dimensional graph go in and out, and therefore the three-dimensional models of the production equipment need to be adjusted in size to meet the arrangement position and the equipment interval in the workshop two-dimensional graph.
As shown in fig. 8, the step S24 specifically includes the following contents.
Step S241, traversing the three-dimensional models corresponding to all the device feature graphs in the graph, and determining whether there is an adjacent three-dimensional model of the device of the same model.
And step S242, if the device feature pattern exists, obtaining a group of adjacently arranged three-dimensional models of devices of the same model, querying and obtaining corresponding first intervals according to the device feature pattern identification information, and scaling the group of three-dimensional models of devices of the same model in an equal proportion to the first intervals according to the first intervals corresponding to the device feature patterns.
And step S243, scaling the scaled three-dimensional models of devices of the same model from near to far to the three-dimensional models of devices matched with the feature patterns of other devices one by one until the scaled three-dimensional models of devices of the same model are the starting point, and the scaled three-dimensional models of devices are in line with the corresponding first distance.
The three-dimensional models of the same type of production equipment are same in size, the adjacent same type of production equipment is preferably adjusted in size, then the adjusted three-dimensional graph of the production equipment is taken as a reference, and the equipment three-dimensional models matched with the characteristic graphs of other equipment are gradually zoomed from near to far to meet the corresponding first interval by utilizing the first interval between the adjusted three-dimensional graph of the production equipment and the adjacent other production equipment.
In other embodiments, as shown in fig. 9, the step S24 further includes the following steps.
Step S244, if there is no adjacent device three-dimensional model with the same model, obtaining a first device model with a first attribute from the device three-dimensional models corresponding to all device feature graphs included in the layer.
In the embodiment, the three-dimensional model of the production equipment is given to a first attribute and a second attribute according to the occupied space of the production equipment in the real workshop, wherein the first attribute represents that the production equipment needs to be arranged preferentially when the volume is larger, and the second attribute represents that the production equipment is arranged in an adjusting mode according to the first attribute equipment.
Step S245, obtaining a reference ratio of the length or width of the device characteristic graph corresponding to the first device model and the distance between two adjacent anchor points, and scaling the first device model according to the reference ratio.
Step S246, taking the scaled first device model as a starting point, scaling the second device models with the second attribute one by one from near to far to meet the corresponding first distance.
In the embodiment, a first-level model library containing independent production equipment and a second-level model library containing combined production equipment are simultaneously and respectively arranged in a layered mode, and after corresponding three-dimensional models are found in the model libraries, the three-dimensional scenes are reconstructed by means of anchor point positioning, direction movement, model size scaling and the like, so that the whole model libraries can be quickly searched, the features are accurately matched, and meanwhile, the integrity of three-dimensional modeling of the whole scene can be guaranteed. After the two-dimensional graphic features are extracted, the two-dimensional graphic features are matched with the model features in the model library, and the model is quickly positioned through the unique identity information; meanwhile, the whole three-dimensional scene is reconstructed in a one-to-one mapping mode by combining the matched three-dimensional models according to the set anchor points, and the scene modeling accuracy is improved. According to the method, unique identity information is set for each device according to the three-view attribute of a device model; identifying the model content in the two-dimensional map of the workshop, and splitting and extracting features by taking equipment, a production line and the like as minimum units; setting a position anchor point on a two-dimensional diagram of a workshop by taking equipment, a production line and the like as minimum units; and according to the features extracted from the two-dimensional graph, performing retrieval comparison in the modular database, and performing matching modeling according to the position anchor points, thereby establishing a complete three-dimensional scene model. The method can save the work of position adaptation, scene splicing, subsequent model modification and whole scene updating in the three-dimensional scene modeling process.
And step S3, acquiring the status data of each production device on the three-dimensional model of the workshop from the monitoring database in a polling or long-connection mode.
The step S3 further includes: according to the three-dimensional model identity information of the production equipment, the production equipment state data corresponding to each three-dimensional model is obtained from the monitoring database at regular time by using the interface, and the real-time display content of the corresponding three-dimensional model is modified according to the state data and the three-dimensional model identity information, wherein the display content comprises but is not limited to error reporting, alarming, warranty maintenance and normal operation.
And step S4, acquiring the identity information of the production equipment according to the query request, changing the first display characteristics of the three-dimensional model of the corresponding production equipment presented on the three-dimensional model diagram of the web end workshop according to the identity information of the production equipment, and adding or updating the second display characteristics of the three-dimensional model presented on the corresponding production equipment according to the state data of the production equipment.
As shown in fig. 10, the step S4 specifically includes:
step S41, retrieving the monitoring database according to the query request, and obtaining the identity information and status data of the production equipment of the corresponding multiple equipment, where the query request includes the item, company or contract corresponding to the production task. Specifically, each item, company or contract corresponding to each production task includes production devices required to participate in production of the item, or production devices produced for a company serving as a client, or production devices required to participate in production of the contract. The query request comprises a project number, a company number or a contract number, all the corresponding production equipment identity information is queried and obtained in a factory ERP system according to the project number, the company number or the contract number after the query request is analyzed, and the production equipment identity information and the state data of the corresponding multiple equipment are obtained by retrieving the monitoring database according to the production equipment identity information.
And step S42, switching the first display characteristic of the corresponding three-dimensional model from the first display state to the second display state according to the identity information of the production equipment, or switching the first display characteristic of the rest production equipment which is not present in the query request from the first display state to the third display state. Wherein the first display characteristic may be a display size of the three-dimensional model of the production equipment on the three-dimensional model diagram of the plant, and the first display state may be a normal size; the second display state may be that the original three-dimensional volume size is enlarged by a preset proportion, for example, by 20%; and the third display state may be a state in which the original three-dimensional volume is reduced by a predetermined ratio, for example, by 20%. So that the operator can quickly see which production equipment is in the inquiry request on the three-dimensional model diagram of the workshop. In other embodiments, wherein the first display characteristic may be a display color shading of the three-dimensional model of the production facility on the three-dimensional model map of the plant, the first display state may be a normal shading; the second display state can be that the original three-dimensional model display effect is highlighted; and the third display state may be to dim the original three-dimensional model display effect. And the operator can quickly see which production equipment is in the inquiry request on the three-dimensional model diagram of the workshop.
Step S43, adjusting or updating parameters of a second display characteristic in the three-dimensional model corresponding to the identity information of the production equipment according to the status data of the production equipment, where the second display characteristic is a completion progress of the corresponding production equipment in the project, company, or contract included in the query request. The second display characteristic is a task completion progress display bar on the three-dimensional model of the production equipment, the task completion progress display bar can display the completion progress of a task which is performed by the production equipment, and the task progress data can be obtained from the monitoring database in real time.
The invention discloses a visual monitoring method for a web-side digital factory, which comprises the steps of accessing all production equipment of a workshop to a gateway, acquiring data and transmitting the data to a monitoring database, and acquiring state data of all the production equipment on a three-dimensional model of the workshop from the monitoring database in a polling or long-connection mode; and finally, acquiring the contained identity information of the production equipment according to the query request, and changing the display state and the task completion progress of the three-dimensional model of the corresponding production equipment presented on the three-dimensional model graph of the web end workshop according to the identity information of the production equipment. Therefore, the progress data of each production device in the workshop is very specific and visual in a three-dimensional visual intuitive mode, no matter workshop personnel, a workshop master or a factory decision maker can intuitively and quickly know the production device participated by each project or contract and the respective completion progress condition, and the function of monitoring the state of the whole workshop on a large screen is realized.
In other embodiments, the system further discloses a web-side digital factory visual monitoring system, which comprises an access module, wherein the access module is used for accessing all production equipment of a workshop to a gateway, collecting data and transmitting the data to a monitoring database. And the three-dimensional model creating module is used for creating a workshop three-dimensional model of the factory at the web end according to each workshop two-dimensional graph of the factory. And the data acquisition module is used for acquiring the state data of each production device on the three-dimensional workshop model from the monitoring database in a polling or long connection mode. And the display module is used for acquiring the contained identity information of the production equipment according to the query request, changing a first display characteristic of a three-dimensional model of the corresponding production equipment presented on the three-dimensional model diagram of the web end workshop according to the identity information of the production equipment, and adding or updating a second display characteristic of the three-dimensional model presented on the corresponding production equipment according to the state data of the production equipment.
In this embodiment, the three-dimensional model creating module may further include a feature extraction module, an anchor point information obtaining module, a model matching module, and a model arrangement module, where the feature extraction module is configured to obtain an equipment layer of a two-dimensional workshop map, perform edge detection on graphical elements in the equipment layer, and split an independent equipment feature map; and the anchor point information acquisition module is used for setting a position anchor point of each equipment characteristic graph on the equipment layer and recording the identification information and a first interval of each corresponding equipment characteristic graph, wherein the first interval is the distance between the equipment characteristic graph and at least one adjacent equipment characteristic graph. And the model matching module is used for inquiring the two-dimensional model image matched with the equipment characteristic image and the bound equipment three-dimensional model in the first-stage model library of the corresponding layer according to the equipment characteristic image. And the model arrangement module is used for arranging corresponding equipment three-dimensional models according to the identification information of the equipment characteristic graph and the position anchor point and respectively adjusting the size of each equipment three-dimensional model according to the first interval information.
In this embodiment, the model matching module further includes: and the query module is used for querying in a top view, a side view or an axis view contained in the first-level model library of the layer according to the device characteristic graph, and if the similarity is greater than a first preset value, taking the corresponding device three-dimensional model as a three-dimensional image of the device three-dimensional model. And the model setting module is used for reproducing and generating the simple three-dimensional model corresponding to the equipment characteristic graph if the similarity is smaller than a preset value.
The model setting module is further configured to judge whether one or more connection regions exist in the device characteristic graph if the similarity is smaller than a preset value, wherein the connection regions are regions with the region width smaller than a specific proportion of two ends of the region and the size proportion of two end regions separated by the connection regions in a preset interval; if a connection area exists, the device characteristic graph is divided along two ends of the connection area to form a plurality of sub-device characteristic graphs; inquiring a matched three-dimensional model in a top view, a side view or an axis view contained in a first-level model base of the layer according to the characteristic graphs of the sub-equipment, and inquiring a corresponding combined model in a second-level model base of the layer according to the three-dimensional models matched with the characteristic graphs of all the sub-equipment and the composition quantity, wherein a two-dimensional model image, a three-dimensional model of the combined equipment, the identity information of the three-dimensional models of all the sub-equipment and the quantity of the sub-equipment which correspond to the combined model are stored in the second-level model base; and if the connection area does not exist, generating a rectangular solid model with the same length-width ratio as the device characteristic graph, and forming a simple three-dimensional model corresponding to the device characteristic graph by acquiring the actual picture of the device and combining the picture with the rectangular solid model.
The model setting module is further configured to set a position anchor point of each sub-device feature pattern on the layer, and record a second interval of each sub-device feature pattern, wherein the second interval is a distance between the device feature pattern and an adjacent sub-device feature pattern; inquiring a matched three-dimensional model in a top view, a side view or an axis view contained in a first-level model library of the layer according to the characteristic graph of the sub-equipment, and if the similarity is greater than a second preset value, acquiring identity information of the corresponding three-dimensional model, wherein the second preset value is smaller than the first preset value; inquiring a matched combined model in a second-level model library of the layer according to the quantity of all the formed sub-equipment feature graphs and the corresponding three-dimensional model identity information, wherein the combined model is configured to have position parameters for adjusting the distance between the included sub-equipment module bodies; and adjusting the position parameters of the combined model according to the second intervals of the characteristic patterns of the sub-equipment to form the combined model matched with the characteristic patterns of the equipment.
In this embodiment, the model arrangement module includes: the same model retrieval module is used for traversing the three-dimensional models corresponding to all the equipment feature graphs in the graph and judging whether adjacent equipment three-dimensional models of the same model exist or not; the first adjusting module is used for acquiring a group of adjacent equipment three-dimensional models with the same model when the adjacent equipment three-dimensional models with the same model exist, inquiring and acquiring corresponding first interval information according to the equipment feature pattern identification information, and scaling the group of equipment three-dimensional models with the same model in an equal proportion to meet the first interval of each equipment feature pattern according to the first interval corresponding to each equipment feature pattern; and the second adjusting module is used for zooming the zoomed device three-dimensional models matched with the characteristic patterns of other devices one by one from near to far to meet the corresponding first distance by taking the zoomed device three-dimensional models with the same model as a starting point.
In this embodiment, the model arrangement module is further configured to, if there is no adjacent device three-dimensional model of the same model, obtain a first device model having a first attribute from the device three-dimensional models corresponding to all device feature graphs included in the layer; acquiring a reference ratio of the length or width of an equipment feature pattern corresponding to a first equipment model and the distance between two adjacent anchor points, and scaling the first equipment model according to the reference ratio; and taking the first equipment model after the scaling as a starting point, and scaling the second equipment models with the second attribute one by one from near to far until the second equipment models meet the corresponding first distance.
It should be noted that, in the present specification, each embodiment is described in a progressive manner, and each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments may be referred to each other. The web-end digital factory visual monitoring system disclosed by the embodiment corresponds to the web-end digital factory visual monitoring method disclosed by the embodiment, so that the description is simple, and relevant parts can be referred to the method part for description.
In other embodiments, a web-end digital plant visual monitoring apparatus is further provided, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the computer program, the processor implements the steps of the web-end digital plant visual monitoring method described in the embodiments above.
The device for visually monitoring the web-end digital factory can include, but is not limited to, a processor and a memory. It will be understood by those skilled in the art that the schematic diagram is merely an example of an apparatus for web-side digital plant visual monitoring, and does not constitute a limitation of apparatus equipment for web-side digital plant visual monitoring, and may include more or fewer components than those shown, or some components in combination, or different components, for example, the apparatus equipment for web-side digital plant visual monitoring may also include input and output devices, network access devices, buses, etc.
The Processor may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. The general purpose processor may be a microprocessor or the processor may be any conventional processor or the like, the processor is a control center of the web-side digital plant visual monitoring equipment, and various interfaces and lines are used to connect various parts of the whole web-side digital plant visual monitoring equipment.
The memory can be used for storing the computer program and/or module, and the processor can realize various functions of the web-end digital factory visual monitoring device equipment by operating or executing the computer program and/or module stored in the memory and calling the data stored in the memory. The memory may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function, and the like, and the memory may include a high speed random access memory, and may further include a non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), at least one magnetic disk storage device, a Flash memory device, or other volatile solid state storage device.
The web-side digital factory visual monitoring device can be stored in a computer readable storage medium if the device is implemented in the form of a software functional unit and sold or used as an independent product. Based on such understanding, all or part of the processes in the method according to the above embodiments may also be implemented by a computer program, which may be stored in a computer readable storage medium and used by a processor to implement the steps of the above embodiments of the web-end digital factory visual monitoring method. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
In summary, the above-mentioned embodiments are only preferred embodiments of the present invention, and all equivalent changes and modifications made in the claims of the present invention should be covered by the claims of the present invention.
Claims (8)
1. A visual monitoring method for a web-end digital factory is characterized by comprising the following steps:
s1, accessing all production equipment of the workshop to a gateway, collecting data and transmitting the data to a monitoring database;
s2, establishing a three-dimensional workshop model of the factory at the web end according to the two-dimensional workshop graphs of the factory; acquiring an equipment layer of a workshop two-dimensional graph, performing edge detection on graphic elements in the equipment layer, and splitting an independent equipment characteristic graph; inquiring in a first-level model library of the layer according to the device characteristic graph, and if the similarity is greater than a first preset value, taking a corresponding device three-dimensional model as a three-dimensional image of the device three-dimensional model;
if the similarity is smaller than a preset value, judging whether one or more connection areas exist in the equipment characteristic graph, wherein the connection areas are areas with the area width smaller than the specific proportion of the two ends of the area and the size proportion of the areas at the two ends separated by the connection areas in a preset interval;
if the connection area exists, the device characteristic graph is divided along the two ends of the connection area to form a plurality of sub-device characteristic graphs;
inquiring a matched three-dimensional model in a top view, a side view or an axis view contained in a first-level model base of the layer according to the characteristic graphs of the sub-equipment, and inquiring a corresponding combined model in a second-level model base of the layer according to the three-dimensional models matched with the characteristic graphs of all the sub-equipment and the number of components, wherein a two-dimensional model image corresponding to the combined model, a three-dimensional model of the combined equipment, the identity information of the three-dimensional model of each sub-equipment and the number of the sub-equipment are stored in the second-level model base;
if the connection area does not exist, generating a rectangular solid model with the same length-width ratio as the device characteristic graph, and forming a simple three-dimensional model corresponding to the device characteristic graph by acquiring an actual picture of the device and combining the picture with the rectangular solid model;
s3, acquiring the state data of each production device on the workshop three-dimensional model from the monitoring database in a polling or long connection mode;
s4, acquiring the identity information of the production equipment according to the query request, changing the first display characteristics of the three-dimensional model of the corresponding production equipment presented on the three-dimensional model diagram of the web end workshop according to the identity information of the production equipment, and adding or updating the second display characteristics of the three-dimensional model presented on the corresponding production equipment according to the state data of the production equipment.
2. The web-end digital factory visualization monitoring method according to claim 1, wherein said step S1 includes:
and forming associated structural data by using the workshops as units and all production equipment positioned on the same product line, production line and/or combined equipment, establishing independent data mapping tables for the workshops, the product lines, the production lines, the combined equipment and the production equipment, and regularly storing the collected production equipment data in a monitoring database through a gateway.
3. The web-end digital factory visualization monitoring method according to claim 2, wherein said step S2 includes:
s21, acquiring an equipment layer of the workshop two-dimensional graph, carrying out edge detection on graphic elements in the equipment layer, and splitting into independent equipment characteristic graphs;
s22, setting identification information of each equipment characteristic graph and a position anchor point on the equipment layer, and recording a first interval of the equipment characteristic graphs, wherein the first interval is a distance between the equipment characteristic graph and at least one adjacent equipment characteristic graph;
s23, inquiring a two-dimensional model image matched with the device characteristic graph and a bound device three-dimensional model in a first-level model library of a corresponding layer according to the device characteristic graph;
and S24, arranging corresponding equipment three-dimensional models according to the identification information of the equipment characteristic graph and the position anchor points, and respectively adjusting the size of each equipment three-dimensional model according to the first interval.
4. The web-end digital factory visual monitoring method according to any one of claims 1-3, wherein said step S3 further comprises: according to the three-dimensional model identity information of the production equipment, the production equipment state data corresponding to each three-dimensional model is obtained from the monitoring database at regular time by using the interface, and the real-time display content of the corresponding three-dimensional model is modified according to the state data and the three-dimensional model identity information, wherein the display content comprises but is not limited to error reporting, alarming, warranty maintenance and normal operation.
5. The visual monitoring method for the web-end digital factory as claimed in claim 4, wherein said step S4 specifically includes:
s41, retrieving the monitoring database according to the query request, and obtaining the production equipment identity information and the state data of a plurality of corresponding equipment, wherein the query request comprises the items, companies or contracts corresponding to the production tasks;
s42, switching the first display characteristic of the corresponding three-dimensional model from the first display state to the second display state according to the identity information of the production equipment, or switching the first display characteristic of the rest production equipment which does not appear in the query request from the second display state to the third display state;
and S43, adjusting or updating parameters of a second display characteristic in the three-dimensional model corresponding to the identity information of the production equipment according to the state data of the production equipment, wherein the second display characteristic is the completion progress of the corresponding production equipment in the project, company or contract contained in the query request.
6. A web-side digital plant visual monitoring system, comprising:
the access module is used for accessing all production equipment of a workshop to the gateway, acquiring data and transmitting the data to the monitoring database;
the three-dimensional model creating module is used for creating a workshop three-dimensional model of the factory at the web end according to each workshop two-dimensional graph of the factory; acquiring an equipment layer of a workshop two-dimensional graph, carrying out edge detection on graphic elements in the equipment layer, and splitting an independent equipment characteristic graph; inquiring in a first-level model library of the layer according to the device characteristic graph, and if the similarity is greater than a first preset value, taking a corresponding device three-dimensional model as a three-dimensional image of the device three-dimensional model; if the similarity is smaller than a preset value, judging whether one or more connection areas exist in the equipment characteristic graph, wherein the connection areas are areas with the area width smaller than the specific proportion of the two ends of the area and the size proportion of the areas at the two ends separated by the connection areas in a preset interval; if the connection area exists, the device characteristic graph is divided along the two ends of the connection area to form a plurality of sub-device characteristic graphs; inquiring a matched three-dimensional model in a top view, a side view or an axis view contained in a first-level model base of the layer according to the characteristic graphs of the sub-equipment, and inquiring a corresponding combined model in a second-level model base of the layer according to the three-dimensional models matched with the characteristic graphs of all the sub-equipment and the composition quantity, wherein a two-dimensional model image, a three-dimensional model of the combined equipment, the identity information of the three-dimensional models of all the sub-equipment and the quantity of the sub-equipment which correspond to the combined model are stored in the second-level model base; if the connection area does not exist, generating a rectangular solid model with the same length-width ratio as the device characteristic graph, and forming a simple three-dimensional model corresponding to the device characteristic graph by acquiring an actual picture of the device and combining the picture with the rectangular solid model;
the data acquisition module is used for acquiring the state data of each production device on the workshop three-dimensional model from the monitoring database in a polling or long connection mode;
and the display module is used for acquiring the contained identity information of the production equipment according to the query request, changing a first display characteristic of a three-dimensional model of the corresponding production equipment presented on the three-dimensional model diagram of the web end workshop according to the identity information of the production equipment, and adding or updating a second display characteristic of the three-dimensional model presented on the corresponding production equipment according to the state data of the production equipment.
7. A web-side digital plant visual monitoring apparatus comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: the processor, when executing the computer program, realizes the steps of the method according to any of claims 1-5.
8. A computer-readable storage medium storing a computer program, the computer program characterized in that: the computer program when executed by a processor implementing the steps of the method as claimed in any one of claims 1 to 5.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110280150.2A CN113012278B (en) | 2021-03-16 | 2021-03-16 | Web-side digital factory visual monitoring method, system and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110280150.2A CN113012278B (en) | 2021-03-16 | 2021-03-16 | Web-side digital factory visual monitoring method, system and storage medium |
Publications (2)
Publication Number | Publication Date |
---|---|
CN113012278A CN113012278A (en) | 2021-06-22 |
CN113012278B true CN113012278B (en) | 2022-09-13 |
Family
ID=76408041
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202110280150.2A Active CN113012278B (en) | 2021-03-16 | 2021-03-16 | Web-side digital factory visual monitoring method, system and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN113012278B (en) |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113255170B (en) * | 2021-07-06 | 2021-09-14 | 江苏中车数字科技有限公司 | Cloud-edge cooperative factory digital twin monitoring modeling system and modeling method |
CN113901039A (en) * | 2021-10-11 | 2022-01-07 | 杭萧钢构股份有限公司 | A three-dimensional visual monitoring method, device, storage medium and terminal of a steel structure factory |
CN116187921A (en) * | 2022-09-07 | 2023-05-30 | 浙江极氪智能科技有限公司 | Factory management method, factory management device, client, and storage medium |
CN116957309B (en) * | 2023-09-21 | 2024-01-09 | 深圳市明心数智科技有限公司 | Textile scene dynamic monitoring method, system and medium |
CN118898477B (en) * | 2024-10-08 | 2025-02-14 | 株洲大衍软件科技有限公司 | Production line equipment maintenance management device and production line equipment dynamic display method |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102017126389A1 (en) * | 2017-11-10 | 2019-05-16 | Liebherr-Werk Biberach Gmbh | Method and device for providing a workpiece representation at a production location |
EP3686700B1 (en) * | 2018-07-27 | 2020-12-16 | Eisenmann SE | Method for monitoring an automation system |
CN109375595B (en) * | 2018-10-25 | 2020-11-10 | 北京理工大学 | Visual workshop monitoring method, device and equipment |
CN112231355A (en) * | 2020-10-17 | 2021-01-15 | 洛阳帝印智能科技有限公司 | Visualization platform system of digital factory |
CN112435328A (en) * | 2020-11-30 | 2021-03-02 | 中冶南方工程技术有限公司 | Three-dimensional visualization method for traveling operation of steelmaking workshop, terminal equipment and storage medium |
-
2021
- 2021-03-16 CN CN202110280150.2A patent/CN113012278B/en active Active
Also Published As
Publication number | Publication date |
---|---|
CN113012278A (en) | 2021-06-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN113012278B (en) | Web-side digital factory visual monitoring method, system and storage medium | |
CN112669454B (en) | Three-dimensional scene construction method, system, device and storage medium for digital factory | |
CN113435773B (en) | Production progress monitoring method, system and storage medium for digital factory | |
US8897483B2 (en) | System and method for inventorying vegetal substance | |
CN109564619A (en) | The method for tracking the placement of the product on the shelf in shop | |
CN117057719B (en) | Prefabricated food storage and replenishment management method and system based on big data | |
EP2455708A1 (en) | A method and a system for automatic measurement and tracking of logs, industrial wood and boards | |
CN108734414A (en) | A kind of marine environmental monitoring data normalization storage and the system of analysis and appraisal | |
CN104050599A (en) | Edible agricultural product quality safety traceability system and method based on video playback | |
CN117078157B (en) | Modeling management method for storage vertical warehouse based on digital twin technology | |
KR101476909B1 (en) | Real-time Process Monitoring System using Block Image | |
CN113850105A (en) | Information processing method, device and equipment | |
CN118674886B (en) | Intelligent geographic mapping data processing method and system | |
CN118194608B (en) | Material monitoring and 3D simulation method and system based on digital twinning | |
CN116502810B (en) | Standardized production monitoring method based on image recognition | |
CN108269036A (en) | A kind of normalization is taken an inventory of warehouses system online | |
JP2011227794A (en) | Site analysis system | |
CN104965497A (en) | On-line production data rapid generation and management method and system | |
CN119919061B (en) | Warehouse performance diagnosis and evaluation method and system | |
CN116823237B (en) | Circulation packing management system | |
CN114841949B (en) | Pallet access method, device, computer equipment and storage medium | |
CN119850930B (en) | Electronic price tag position recognition method and system | |
CN118918183B (en) | Substation target distance measurement method based on multiple cameras | |
CN117010773B (en) | A method and system for monitoring and analyzing warehouse logistics inventory data in a smart park | |
KR20250075052A (en) | Method for analyzing cadastral survey data, platform for analyzing data and computationally-implementable storage medium for analyzing data |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
CB02 | Change of applicant information |
Address after: 310056 room 1701, 17th floor, building 3, No. 316, Jianghong South Road, Changhe street, Binjiang District, Hangzhou, Zhejiang Applicant after: Mingdu Zhiyun (Zhejiang) Technology Co.,Ltd. Address before: 310000 1, 3 building, No. 316 Jianghong Road, Changhe street, Binjiang District, Hangzhou, Zhejiang. Applicant before: ZHEJIANG MINGDU INTELLIGENT CONTROL TECHNOLOGY Co.,Ltd. |
|
CB02 | Change of applicant information | ||
GR01 | Patent grant | ||
GR01 | Patent grant |