CN114554148A - A remote early warning method, device, medium and equipment based on visual detection - Google Patents

Abstract

The invention discloses a remote early warning method based on visual detection, which comprises the following steps: acquiring an image containing monitoring parameters of a monitoring point by using image acquisition equipment; transmitting the image to a monitoring center through a 5G transmission network; extracting the monitoring parameters from the image through the monitoring center; and generating early warning information based on the monitoring parameters and the set reference parameters. According to the invention, the acquired data is acquired through the 5G network, so that the conventional defects of high network delay, narrow bandwidth and the like of a wireless network are solved, the problem of intelligent integration and application of key equipment in a complex industrial control environment is solved, and the data transmission efficiency is improved; flexibility and stability of network layout; and flexible expansion of equipment distribution points is realized, and the method is suitable for industrial application.

Description

A remote early warning method, device, medium and equipment based on visual detection

technical field

The invention relates to the technical field of visual detection, in particular to a remote early warning method, device, medium and equipment based on visual detection.

Background technique

In the traditional industrial environment in the past, a large part of applications used WIFI network to transmit data. Before the birth of 5G wireless network, WIFI network had its own application advantages, but as we all know, WIFI network has several obvious defects:

WIFI coverage is limited: In order to meet the network requirements of the workshop and achieve signal coverage without dead ends, the number of APs is very large, which naturally increases the probability of system failure;

High installation and difficult maintenance: APs in the production workshop are generally arranged on relatively high walls or brackets in the workshop. There are many shelves and production equipment in the workshop. Once the network equipment fails, maintenance is very troublesome;

Relatively poor scalability: Even if it is a wireless network, APs and front-end devices still need to be connected through a wired network. When the workshop is expanded or the equipment is expanded, the additional wireless signal transmission points need to be connected through wired connections. There is a certain amount of system expansion. limitations;

The packet loss rate is high; even if the 802.11k/v/r protocol and the same SSID are used, packet loss is almost inevitable when the WIFI network switches between frequencies, which will affect workshop equipment, especially mobile equipment and management platforms. The communication is interrupted, resulting in the loss of equipment data, which brings a lot of inconvenience to the normal production and operation;

Limited access: Due to the limited coverage of APs and the poor network carrying capacity, the number of users under one AP is only a few dozen, but within the range of one 5G network, the number of access points increases exponentially.

Large delay, small bandwidth, and poor stability: WIFI network has certain defects in transmission delay and bandwidth, and the network stability is poor, and signal fluctuations often occur.

SUMMARY OF THE INVENTION

In view of the above-mentioned shortcomings of the prior art, the purpose of the present invention is to provide a remote early warning method, device, medium and device based on visual inspection, which are used to solve at least one defect in the prior art.

To achieve the above purpose and other related purposes, the present invention provides a remote early warning method based on visual detection, including:

Use image acquisition equipment to collect images including monitoring parameters of monitoring points;

transmitting the image to the monitoring center through the 5G transmission network;

Extracting the monitoring parameters from the image by the monitoring center;

Early warning information is generated based on the monitoring parameters and the set reference parameters.

Optionally, generating early warning information based on the monitoring parameters and the set reference parameters includes:

Compare the monitoring parameter with the reference parameter, determine whether the difference between the monitoring parameter and the reference parameter is within a preset threshold range, and if the difference is not within the preset threshold range, generate Warning information.

Optionally, the method further includes:

Determining that the monitoring parameter whose difference exceeds the preset threshold range is recorded as an abnormal parameter;

Obtain the collection time point of the abnormal parameter, and record it as the abnormal time point;

Obtain the abnormal parameters that appear in the second time period after the abnormal time point; wherein the second time period is the time period after the first time period starting from the abnormal time point, and the second time period starts late at the end time of the first time period;

If the number of the abnormal parameters is greater than the preset number threshold, early warning information is sent, and the early warning information is used to indicate the abnormal parameters and the abnormal time points of the corresponding abnormal parameters.

Optionally, the method further includes:

generating a first parameter curve based on the monitoring parameters;

Determine whether the change trend of the first parameter curve conforms to the change trend of the first preset curve; if not, generate early warning information.

Optionally, the method further includes:

Determining that the monitoring parameter whose difference exceeds the preset threshold range is recorded as an abnormal parameter;

Obtain the collection time point of the abnormal parameter, and record it as the abnormal time point;

Obtain a second parameter curve composed of monitoring parameters that occurs in a second time period after the abnormal time point; wherein the second time period is the time period after the first time period starting from the abnormal time point, and the second time period is the time period after the first time period. The start time of the time period is later than the end time of the first time period;

The second parameter curve is compared with the second preset curve, and if the change trend of the second parameter curve does not conform to the change trend of the second preset curve, an early warning message is issued.

Optionally, a display screen including monitoring parameters of the monitoring point is collected according to a preset frequency.

Optionally, it also includes: sending the warning information to a mobile terminal, wherein the warning information is displayed on a notification bar of the mobile terminal; or, popping up an interface frame on the current interface of the mobile terminal, and displaying the warning information on the mobile terminal The warning information corresponding to the monitoring point is displayed on the interface frame, and the size of the interface frame is smaller than the size of the current interface.

In order to achieve the above purpose and other related purposes, the present invention provides a remote early warning device based on visual detection, including:

an image acquisition module, used for acquiring an image including monitoring parameters of a monitoring point by using an image acquisition device;

an image transmission module for transmitting the image to the monitoring center through the 5G transmission network;

a parameter extraction module for extracting the monitoring parameters from the image through the monitoring center;

An early warning information generation module is configured to generate early warning information based on the monitoring parameters and the set reference parameters.

To achieve the above purpose and other related purposes, the present invention provides a training device for a feature mining model, including:

memory for storing computer programs;

The processor is configured to execute the computer program stored in the memory, so that the device executes the remote early warning method.

In order to achieve the above object and other related objects, the present invention provides a storage medium, which stores a computer program, and the computer program executes the remote early warning method when the computer program is run by a processor.

As described above, a visual detection-based remote early warning method, device, medium and device of the present invention have the following beneficial effects:

A remote early warning method based on visual detection of the present invention includes: using an image acquisition device to collect an image including monitoring parameters of a monitoring point; transmitting the image to a monitoring center through a 5G transmission network; The monitoring parameters are extracted from the image; early warning information is generated based on the monitoring parameters and the set reference parameters. The invention collects the collected data through the 5G network, solves the conventional drawbacks of the wireless network such as "high network delay and narrow bandwidth", as well as the intelligent integration and application of key equipment in a complex industrial control environment, and improves the data transmission efficiency; network layout flexibility , stability; to achieve flexible expansion of equipment layout, suitable for industrial applications.

Description of drawings

1 is a flowchart of a remote early warning method based on visual detection according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of the hardware structure of a remote early warning device based on visual detection according to an embodiment of the present invention.

Detailed ways

The embodiments of the present invention are described below through specific specific examples, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and various details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of the present invention. It should be noted that the following embodiments and features in the embodiments may be combined with each other under the condition of no conflict.

It should be noted that the drawings provided in the following embodiments are only used to illustrate the basic concept of the present invention in a schematic way, so the drawings only show the components related to the present invention rather than the number, shape and number of components in actual implementation. For dimension drawing, the type, quantity and proportion of each component can be arbitrarily changed in actual implementation, and the component layout may also be more complicated.

As shown in FIG. 1 , an embodiment of the present application provides a remote early warning method based on visual detection, including:

S100 uses an image acquisition device to acquire an image including monitoring parameters of the monitoring point;

S101 transmits the image to a monitoring center through a 5G transmission network;

S102 extracts the monitoring parameter from the image through the monitoring center;

S103 generates early warning information based on the monitoring parameters and the set reference parameters.

The invention collects the collected data through the 5G network, solves the conventional drawbacks of the wireless network such as "high network delay and narrow bandwidth", as well as the intelligent integration and application of key equipment in a complex industrial control environment, and improves the data transmission efficiency; network layout flexibility , stability; to achieve flexible expansion of equipment layout, suitable for industrial applications.

The image acquisition device may be a camera, and the image acquisition of the target object is performed through the camera. Wherein, in this embodiment, the target object is a monitoring parameter of a monitoring point, and the monitoring parameter can be displayed on a display screen or can be displayed on a table.

After collecting the image containing the monitoring parameters, the image is transmitted to the monitoring center through the 5G network. Wherein, the monitoring center is provided with a control module, and the image including the monitoring parameters is transmitted to the control module. Of course, it can be understood that the control module may include a server, a single-chip microcomputer or other simple CPUs. In the present invention, the collected images are transmitted through the 5G network, which improves the data transmission efficiency. At the same time, in this application, the collected images are transmitted to the monitoring center, so as to be far away from the source of danger. Compared with the original industrial equipment, it is in an independent electrical state and communication link, which will not bring adverse effects on the complex industrial environment. . After the monitoring center receives the image collected by the image acquisition device, the parameter control parameters in the image are extracted by the server to obtain the monitoring parameters. The monitored parameter can be temperature, which can be presented numerically or by color.

In an embodiment, the generating early warning information based on the monitoring parameters and the set reference parameters includes:

Compare the monitoring parameter with the reference parameter, determine whether the difference between the monitoring parameter and the reference parameter is within a preset threshold range, and if the difference is not within the preset threshold range, generate Warning information.

Specifically, for example, if the monitoring parameter is A and the reference parameter is B, the monitoring parameter A and the reference parameter B are subtracted to obtain the difference C between the monitoring parameter A and the reference parameter B, and the difference C is equal to the preset threshold range D[ D1, D2] are compared, if the difference C is within the preset threshold range D, that is, C belongs to [D1, D2], then it can be considered that the monitoring parameter A conforms to the specifications of the monitoring point, and the monitoring point is considered normal. If C is not within the preset threshold range D, it is considered that the monitoring parameter A does not meet the specifications of the monitoring point, and the monitoring point is considered abnormal. At this time, an early warning message needs to be issued, and the early warning information is used to prompt the monitoring point to fail.

In one embodiment, the method further includes:

Determine the monitoring parameter whose difference exceeds the preset threshold range, and record it as an abnormal parameter; obtain the collection time point of the abnormal parameter, and record it as an abnormal time point; Abnormal parameters; wherein the second time period is the time period after the first time period starting from the abnormal time point, and the start time of the second time period is later than the end time of the first time period; if the abnormality occurs When the number of parameters is greater than the preset number threshold, early warning information is issued, and the early warning information is used to indicate abnormal parameters and abnormal time points of the corresponding abnormal parameters.

Due to the abnormality of the equipment, that is, the abnormality of the collected monitoring parameters may belong to the abnormality caused by random interference or the equipment damage or the real abnormality caused by the monitoring parameters. Therefore, in the monitoring process, it is necessary to determine whether the abnormality of the monitoring parameters is caused by random interference or a real abnormality. exception. If it is an abnormality caused by random interference, it will return to the normal state after the abnormal time point, and if it is a real abnormality, the collected monitoring parameters will still be abnormal parameters after the abnormal time point. Therefore, in order to distinguish the abnormality caused by random interference from the real abnormality, it is necessary to collect the monitoring parameters within a period of time after the abnormal time point, and judge whether the device is truly abnormal through the monitoring parameters in this period of time. Then obtain the abnormal parameters that appear in the second time period after the abnormal time point; wherein the second time period is the time period after the first time period starting from the abnormal time point, and the timeout time of the second time period later than the end time of the first time period; if the number of the abnormal parameters is greater than the preset number threshold, early warning information is sent, and the early warning information is used to indicate the abnormal parameters and the abnormal time points of the corresponding abnormal parameters.

In one embodiment, the method further includes:

Generate a first parameter curve based on the monitoring parameters; determine whether the change trend of the first parameter curve conforms to the change trend of the first preset curve; if not, generate early warning information.

In the process of obtaining the first parameter curve, the monitoring parameters of the monitoring point can be continuously monitored, and then the first parameter curve can be drawn according to the continuously monitored monitoring parameters; a plurality of discrete parameters can also be monitored according to preset time intervals. Monitoring parameters, and then drawing a first parameter curve of the monitoring parameters according to the plurality of discrete monitoring parameters. The shorter the time interval, the more accurate the drawn first parameter curve.

In one embodiment, the method further includes:

Determining that the monitoring parameter whose difference exceeds the preset threshold range is recorded as an abnormal parameter;

Obtain the collection time point of the abnormal parameter, and record it as the abnormal time point;

Obtain a second parameter curve composed of monitoring parameters that occurs in a second time period after the abnormal time point; wherein the second time period is the time period after the first time period starting from the abnormal time point, and the second time period is the time period after the first time period. The start time of the time period is later than the end time of the first time period;

The second parameter curve is compared with the second preset curve, and if the change trend of the second parameter curve does not conform to the change trend of the second preset curve, an early warning message is issued.

In one embodiment, images including monitoring parameters of monitoring points are collected at a preset frequency.

In an embodiment, the method further includes: sending the warning information to the mobile terminal, wherein the warning information is displayed on the notification bar of the mobile terminal; The warning information corresponding to the monitoring point is displayed on the interface frame, and the size of the interface frame is smaller than the size of the current interface.

Display warning information on the notification bar of the mobile terminal. When the user clicks on the warning information on the notification bar, the user can directly enter the home page of the mobile terminal, and then learn more detailed warning information on the home page of the mobile terminal.

An interface frame pops up on the current interface of the mobile terminal, and warning information is displayed on the interface frame, and the size of the interface frame is smaller than the size of the current interface (ie, the display screen of the mobile terminal).

In this embodiment, the monitoring point includes one, and may also include multiple ones. When there are multiple monitoring points, the mobile terminal can display early warning information corresponding to the multiple monitoring points in a list.

In one embodiment, the monitoring point may be a brazing furnace, and the monitoring parameter may be temperature. If the monitoring point is a brazing furnace, the monitoring parameters may include temperatures at multiple locations, and there will be multiple temperature values on the display. After the image containing the monitoring parameters is collected, in the process of extracting the temperature value, the collected image can be divided to obtain a plurality of images, and each sub-image includes a temperature value. Then, the temperature value of each sub-image is extracted, and finally the temperature value is used for early warning judgment.

As shown in FIG. 2 , an embodiment of the present application provides a remote early warning device based on visual detection, including:

The image acquisition module 200 is used for acquiring an image including monitoring parameters of the monitoring point by using an image acquisition device;

The image transmission module 201 is used to transmit the image to the monitoring center through the 5G transmission network;

A parameter extraction module 202, configured to extract the monitoring parameters from the image through the monitoring center;

The early warning information generation module 203 is configured to generate early warning information based on the monitoring parameters and the set reference parameters.

It should be noted that, since the embodiments of the apparatus part and the embodiments of the method part correspond to each other, for the content of the embodiments of the apparatus part, please refer to the description of the embodiments of the method part, which will not be repeated here.

The present invention also provides a storage medium storing a computer program, and the computer program executes the foregoing remote early warning method when the computer program is run by a processor.

The present invention also provides a device, comprising:

memory for storing computer programs;

A processor for executing a computer program stored in the memory, so that the device executes the aforementioned remote warning method.

The processor may be a central processing unit (Central Processing Unit, CPU), or other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), field Programmable Gate Array (FieldProgrammable GateArray, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

The memory may be an internal storage unit or an external storage device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital card (Secure Digital, SD), a flash memory card (Flash Card), and the like. Further, the memory may also include both an internal storage unit and an external storage device. The memory is used to store the computer program and other programs and data. The memory may also be used to temporarily store data that has been or will be output.

Those skilled in the art can clearly understand that, for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned functions can be allocated to different functional units, Module completion, that is, dividing the internal structure of the device into different functional units or modules to complete all or part of the functions described above. Each functional unit and module in the embodiment may be integrated in one processing unit, or each unit may exist physically alone, or two or more units may be integrated in one unit, and the above-mentioned integrated units may adopt hardware. It can also be realized in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing from each other, and are not used to limit the protection scope of the present application. For the specific working process of the units and modules in the above-mentioned system, reference may be made to the corresponding process in the foregoing method embodiments, which will not be repeated here.

In the foregoing embodiments, the description of each embodiment has its own emphasis. For parts that are not described or described in detail in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of the present invention.

In the embodiments provided by the present invention, it should be understood that the disclosed apparatus/terminal device and method may be implemented in other manners. For example, the apparatus/terminal device embodiments described above are only illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units. Or components may be combined or may be integrated into another system, or some features may be omitted, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.

The integrated modules/units, if implemented in the form of software functional units and sold or used as independent products, may be stored in a computer-readable storage medium. Based on this understanding, the present invention can implement all or part of the processes in the methods of the above embodiments, and can also be completed by instructing relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer When the program is executed by the processor, the steps of the foregoing method embodiments can be implemented. Wherein, the computer program includes computer program code, and the computer program code may be in the form of source code, object code, executable file or some intermediate form, and the like. The computer-readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM, Read-Only Memory) , Random Access Memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium, etc.

The above-mentioned embodiments merely illustrate the principles and effects of the present invention, but are not intended to limit the present invention. Anyone skilled in the art can make modifications or changes to the above embodiments without departing from the spirit and scope of the present invention. Therefore, all equivalent modifications or changes made by those with ordinary knowledge in the technical field without departing from the spirit and technical idea disclosed in the present invention should still be covered by the claims of the present invention.

Claims (10)

1. a long-range early warning method based on visual detection, is characterized in that, comprises: Use image acquisition equipment to collect images including monitoring parameters of monitoring points; transmitting the image to the monitoring center through the 5G transmission network; Extracting the monitoring parameters from the image by the monitoring center; Early warning information is generated based on the monitoring parameters and the set reference parameters. 2. The long-range early warning method based on visual detection according to claim 1, wherein the generation of early warning information based on the monitoring parameters and the set reference parameters, comprises: Compare the monitoring parameter with the reference parameter, determine whether the difference between the monitoring parameter and the reference parameter is within a preset threshold range, and if the difference is not within the preset threshold range, generate Warning information. 3. The long-range early warning method based on visual detection according to claim 2, wherein the method further comprises: Determining that the monitoring parameter whose difference exceeds the preset threshold range is recorded as an abnormal parameter; Obtain the collection time point of the abnormal parameter, and record it as the abnormal time point; Obtain the abnormal parameters that appear in the second time period after the abnormal time point; wherein the second time period is the time period after the first time period starting from the abnormal time point, and the second time period starts late at the end time of the first time period; If the number of the abnormal parameters is greater than the preset number threshold, early warning information is sent, and the early warning information is used to indicate the abnormal parameters and the abnormal time points of the corresponding abnormal parameters. 4. The long-range early warning method based on visual detection according to claim 3, is characterized in that, this method also comprises: generating a first parameter curve based on the monitoring parameters; Determine whether the change trend of the first parameter curve conforms to the change trend of the first preset curve; if not, generate early warning information. 5. The long-range early warning method based on visual detection according to claim 4, wherein the method further comprises: Determining that the monitoring parameter whose difference exceeds the preset threshold range is recorded as an abnormal parameter; Obtain the collection time point of the abnormal parameter, and record it as the abnormal time point; Obtain a second parameter curve composed of monitoring parameters that occurs in a second time period after the abnormal time point; wherein the second time period is the time period after the first time period starting from the abnormal time point, and the second time period is the time period after the first time period. The start time of the time period is later than the end time of the first time period; The second parameter curve is compared with the second preset curve, and if the change trend of the second parameter curve does not conform to the change trend of the second preset curve, an early warning message is issued. 6 . The remote early warning method based on visual detection according to claim 1 , wherein images including monitoring parameters of monitoring points are collected according to a preset frequency. 7 . 7. The visual detection-based remote early warning method according to claim 1, further comprising: sending the early warning information to a mobile terminal, wherein the early warning information is displayed on a notification bar of the mobile terminal; or, An interface frame pops up on the current interface of the mobile terminal, and the warning information corresponding to the monitoring point is displayed on the interface frame, and the size of the interface frame is smaller than the size of the current interface. 8. A remote warning device based on visual detection, characterized in that, comprising: an image acquisition module, used for acquiring an image including monitoring parameters of a monitoring point by using an image acquisition device; an image transmission module for transmitting the image to the monitoring center through the 5G transmission network; a parameter extraction module for extracting the monitoring parameters from the image through the monitoring center; An early warning information generation module is configured to generate early warning information based on the monitoring parameters and the set reference parameters. 9. A remote early warning device based on visual detection, characterized in that, comprising: memory for storing computer programs; A processor for executing a computer program stored in the memory, so that the device executes the remote early warning method according to any one of claims 1 to 7. 10 . A storage medium storing a computer program, wherein the computer program executes the remote early warning method according to any one of claims 1 to 7 when the computer program is run by a processor. 11 .

Images