[go: up one dir, main page]

CN108830261A - Equipment fault diagnosis method and device based on image recognition - Google Patents

Equipment fault diagnosis method and device based on image recognition Download PDF

Info

Publication number
CN108830261A
CN108830261A CN201810804705.7A CN201810804705A CN108830261A CN 108830261 A CN108830261 A CN 108830261A CN 201810804705 A CN201810804705 A CN 201810804705A CN 108830261 A CN108830261 A CN 108830261A
Authority
CN
China
Prior art keywords
picture
fault
failure
target device
sampling
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810804705.7A
Other languages
Chinese (zh)
Other versions
CN108830261B (en
Inventor
刘晓枫
范福林
宋玉标
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Hannenghua Science & Technology Co Ltd
Original Assignee
Beijing Hannenghua Science & Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Hannenghua Science & Technology Co Ltd filed Critical Beijing Hannenghua Science & Technology Co Ltd
Priority to CN201810804705.7A priority Critical patent/CN108830261B/en
Publication of CN108830261A publication Critical patent/CN108830261A/en
Application granted granted Critical
Publication of CN108830261B publication Critical patent/CN108830261B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/30Scenes; Scene-specific elements in albums, collections or shared content, e.g. social network photos or video

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Measurement Of Mechanical Vibrations Or Ultrasonic Waves (AREA)
  • Image Analysis (AREA)

Abstract

本发明公开了基于图像识别的设备故障诊断方法和装置。所述方法包括:获取包含目标设备运行时振动的时域波形的采样图片;基于图像识别算法从故障数据库中查找出与所述采样图片相匹配的故障图片;根据所述故障图片对应的故障描述信息确定所述目标设备的故障。该技术方案能够大大减少故障诊断的操作和消耗的资源,并显著提升诊断效率,节约诊断时间,同时能够保证一定的准确度,适于工业实用,应用场景广泛。

The invention discloses a device fault diagnosis method and device based on image recognition. The method includes: acquiring a sampling picture containing a time-domain waveform of vibration of the target device during operation; finding a fault picture matching the sampling picture from a fault database based on an image recognition algorithm; information identifying a failure of the target device. This technical solution can greatly reduce the operation and resource consumption of fault diagnosis, significantly improve diagnosis efficiency, save diagnosis time, and at the same time ensure a certain degree of accuracy, which is suitable for industrial practicality and has a wide range of application scenarios.

Description

基于图像识别的设备故障诊断方法和装置Method and device for equipment fault diagnosis based on image recognition

技术领域technical field

本发明涉及故障诊断领域,具体涉及基于图像识别的设备故障诊断方法和装置。The invention relates to the field of fault diagnosis, in particular to a device fault diagnosis method and device based on image recognition.

背景技术Background technique

目前,设备的故障诊断通常是在由检测设备采集振动的时域波形,通过一系列复杂处理后才能诊断出故障,非常麻烦,浪费了大量资源,需要一种效率更高、资源消耗更少的故障诊断方式。At present, the fault diagnosis of equipment is usually based on the time-domain waveform of vibration collected by the detection equipment, and the fault can only be diagnosed after a series of complicated processing, which is very troublesome and wastes a lot of resources. A more efficient and less resource-consuming method is needed Fault diagnosis method.

发明内容Contents of the invention

鉴于上述问题,提出了本发明以便提供一种克服上述问题或者至少部分地解决上述问题的基于图像识别的设备故障诊断方法和装置。In view of the above problems, the present invention is proposed to provide a device fault diagnosis method and device based on image recognition that overcomes the above problems or at least partially solves the above problems.

依据本发明的一个方面,提供了一种基于图像识别的设备故障诊断方法,包括:According to one aspect of the present invention, a method for diagnosing equipment faults based on image recognition is provided, including:

获取包含目标设备运行时振动的时域波形的采样图片;Obtain a sample picture of the time-domain waveform containing the vibration of the target device during operation;

基于图像识别算法从故障数据库中查找出与所述采样图片相匹配的故障图片;Find out the fault picture matching the sampled picture from the fault database based on the image recognition algorithm;

根据所述故障图片对应的故障描述信息确定所述目标设备的故障。The fault of the target device is determined according to the fault description information corresponding to the fault picture.

可选地,该方法还包括:Optionally, the method also includes:

当故障数据库中不存在与所述采样图片相匹配的故障图片时,根据所述采样图片中的时域波形进行分析,确定所述目标设备的故障,生成相应的故障描述信息;When there is no fault picture matching the sampling picture in the fault database, analyze according to the time-domain waveform in the sampling picture, determine the fault of the target device, and generate corresponding fault description information;

根据所述采样图片生成与确定的故障对应的故障图片,在所述故障数据库中将生成的故障图片与生成的故障描述信息对应保存。A fault picture corresponding to the determined fault is generated according to the sampled picture, and the generated fault picture is correspondingly stored with the generated fault description information in the fault database.

可选地,所述获取包含目标设备振动时的时域波形的采样图片包括:Optionally, the acquisition of the sampling picture containing the time-domain waveform when the target device vibrates includes:

根据所述目标设备的故障周期确定与所述采样图片对应的采样时间,以使所述采样图片中至少包含若干个故障周期的时域波形;所述故障周期是根据所述目标设备的参数确定的;Determine the sampling time corresponding to the sampling picture according to the failure period of the target device, so that the sampling picture contains at least time-domain waveforms of several failure periods; the failure period is determined according to the parameters of the target device of;

所述基于图像识别算法从故障数据库中查找出与所述采样图片相匹配的故障图片包括:Finding the fault picture matching the sampling picture from the fault database based on the image recognition algorithm includes:

从所述故障数据库中查找出与所述目标设备的参数对应的故障图片作为备选图片,从所述备选图片中查找出与所述采样图片相匹配的故障图片。A fault picture corresponding to the parameter of the target device is found from the fault database as a candidate picture, and a fault picture matching the sampling picture is found from the candidate picture.

可选地,所述获取包含目标设备振动的时域波形的采样图片包括:Optionally, the acquisition of the sampling picture containing the time-domain waveform of the vibration of the target device includes:

由对所述目标设备进行检测的检测设备采集目标设备振动时的时域波形,通过拍摄和/或截屏方式生成包含所述时域波形的采样图片。The detection device that detects the target device collects the time-domain waveform of the target device when it vibrates, and generates a sampling picture containing the time-domain waveform by shooting and/or screenshotting.

依据本发明的另一方面,提供了一种基于图像识别的设备故障诊断装置,包括:According to another aspect of the present invention, a device fault diagnosis device based on image recognition is provided, including:

采样图片获取单元,用于获取包含目标设备运行时振动的时域波形的采样图片;A sampling picture acquisition unit, configured to acquire a sampling picture comprising a time-domain waveform of vibration of the target device during operation;

识别单元,用于基于图像识别算法从故障数据库中查找出与所述采样图片相匹配的故障图片;An identification unit, configured to find a fault picture that matches the sampled picture from the fault database based on an image recognition algorithm;

故障诊断单元,用于根据所述故障图片对应的故障描述信息确定所述目标设备的故障。A fault diagnosis unit, configured to determine the fault of the target device according to the fault description information corresponding to the fault picture.

可选地,所述故障诊断单元,还用于当故障数据库中不存在与所述采样图片相匹配的故障图片时,根据所述采样图片中的时域波形进行分析,确定所述目标设备的故障,生成相应的故障描述信息;根据所述采样图片生成与确定的故障对应的故障图片,在所述故障数据库中将生成的故障图片与生成的故障描述信息对应保存。Optionally, the fault diagnosis unit is further configured to, when there is no fault picture matching the sampled picture in the fault database, analyze the time-domain waveform in the sampled picture to determine the fault, generating corresponding fault description information; generating a fault picture corresponding to the determined fault according to the sampled picture, and correspondingly saving the generated fault picture and the generated fault description information in the fault database.

可选地,所述采样图片获取单元,用于根据所述目标设备的故障周期确定与所述采样图片对应的采样时间,以使所述采样图片中至少包含若干个故障周期的时域波形;所述故障周期是根据所述目标设备的参数确定的;Optionally, the sampling picture acquisition unit is configured to determine the sampling time corresponding to the sampling picture according to the failure period of the target device, so that the sampling picture at least includes time-domain waveforms of several failure periods; The failure period is determined according to the parameters of the target device;

所述识别单元,用于从所述故障数据库中查找出与所述目标设备的参数对应的故障图片作为备选图片,从所述备选图片中查找出与所述采样图片相匹配的故障图片。The identification unit is configured to find out a fault picture corresponding to the parameters of the target device from the fault database as a candidate picture, and find a fault picture that matches the sampling picture from the candidate pictures .

可选地,所述采样图片获取单元,用于由对所述目标设备进行检测的检测设备采集目标设备振动时的时域波形,通过拍摄和/或截屏方式生成包含所述时域波形的采样图片。Optionally, the sampling picture acquisition unit is configured to use the detection device that detects the target device to collect the time-domain waveform of the target device when it vibrates, and generate a sample that includes the time-domain waveform by taking pictures and/or screenshots. picture.

依据本发明的又一方面,提供了一种电子设备,包括:处理器;以及被安排成存储计算机可执行指令的存储器,所述可执行指令在被执行时使所述处理器执行如上述任一所述的方法。According to yet another aspect of the present invention, there is provided an electronic device, comprising: a processor; and a memory arranged to store computer-executable instructions that, when executed, cause the processor to perform any of the above a method as described.

依据本发明的再一方面,提供了一种计算机可读存储介质,其中,所述计算机可读存储介质存储一个或多个程序,所述一个或多个程序当被处理器执行时,实现如上述任一所述的方法。According to still another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores one or more programs, and when the one or more programs are executed by a processor, the following is implemented: any of the methods described above.

由上述可知,本发明的技术方案,预先在故障数据库中保存故障描述信息和对应的故障图片,在获取到包含目标设备运行时振动的时域波形的采样图片后,基于图像识别算法从故障数据库中查找出与采样图片相匹配的故障图片,根据故障图片对应的故障描述信息确定目标设备的故障。该技术方案能够大大减少故障诊断的操作和消耗的资源,并显著提升诊断效率,节约诊断时间,同时能够保证一定的准确度,适于工业实用,应用场景广泛。As can be seen from the above, the technical solution of the present invention saves the fault description information and corresponding fault pictures in the fault database in advance, and after obtaining the sampled pictures containing the time-domain waveform of the vibration of the target equipment during operation, based on the image recognition algorithm, from the fault database Find the fault picture that matches the sampling picture, and determine the fault of the target device according to the fault description information corresponding to the fault picture. This technical solution can greatly reduce the operation and resource consumption of fault diagnosis, significantly improve diagnosis efficiency, save diagnosis time, and at the same time ensure a certain degree of accuracy. It is suitable for industrial practicality and has a wide range of application scenarios.

上述说明仅是本发明技术方案的概述,为了能够更清楚了解本发明的技术手段,而可依照说明书的内容予以实施,并且为了让本发明的上述和其它目的、特征和优点能够更明显易懂,以下特举本发明的具体实施方式。The above description is only an overview of the technical solution of the present invention. In order to better understand the technical means of the present invention, it can be implemented according to the contents of the description, and in order to make the above and other purposes, features and advantages of the present invention more obvious and understandable , the specific embodiments of the present invention are enumerated below.

附图说明Description of drawings

通过阅读下文优选实施方式的详细描述,各种其他的优点和益处对于本领域普通技术人员将变得清楚明了。附图仅用于示出优选实施方式的目的,而并不认为是对本发明的限制。而且在整个附图中,用相同的参考符号表示相同的部件。在附图中:Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiment. The drawings are only for the purpose of illustrating a preferred embodiment and are not to be considered as limiting the invention. Also throughout the drawings, the same reference numerals are used to designate the same components. In the attached picture:

图1示出了根据本发明一个实施例的一种基于图像识别的设备故障诊断方法的流程示意图;Fig. 1 shows a schematic flow chart of an image recognition-based equipment fault diagnosis method according to an embodiment of the present invention;

图2示出了根据本发明一个实施例的一种基于图像识别的设备故障诊断装置的结构示意图;Fig. 2 shows a schematic structural diagram of a device fault diagnosis device based on image recognition according to an embodiment of the present invention;

图3示出了根据本发明一个实施例的电子设备的结构示意图;FIG. 3 shows a schematic structural diagram of an electronic device according to an embodiment of the present invention;

图4示出了根据本发明一个实施例的计算机可读存储介质的结构示意图。Fig. 4 shows a schematic structural diagram of a computer-readable storage medium according to an embodiment of the present invention.

具体实施方式Detailed ways

下面将参照附图更详细地描述本公开的示例性实施例。虽然附图中显示了本公开的示例性实施例,然而应当理解,可以以各种形式实现本公开而不应被这里阐述的实施例所限制。相反,提供这些实施例是为了能够更透彻地理解本公开,并且能够将本公开的范围完整的传达给本领域的技术人员。Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

图1示出了根据本发明一个实施例的一种基于图像识别的设备故障诊断方法的流程示意图。如图1所示,该方法包括:Fig. 1 shows a schematic flowchart of a method for diagnosing equipment faults based on image recognition according to an embodiment of the present invention. As shown in Figure 1, the method includes:

步骤S110,获取包含目标设备运行时振动的时域波形的采样图片。例如,这里的目标设备可以是机械设备,在运行时会产生振动,因此可以通过检测设备如各类传感器等采集到相应的时域波形。由于设备在发生故障时的振动不同于正常工况下的振动,因此产生的时域波形也是不同的。Step S110, acquiring a sampled picture including a time-domain waveform of vibration of the target device during operation. For example, the target device here may be a mechanical device that generates vibration during operation, so the corresponding time-domain waveform can be collected through detection devices such as various sensors. Since the vibration of the equipment when it fails is different from the vibration under normal working conditions, the generated time domain waveforms are also different.

这里需要说明的是,采样图片可以是单独采集的一幅或几幅图片,也可以是一段采样视频中的各个帧。也就是说,实际采集的可以是图片或是视频。It should be noted here that the sampled picture may be one or several pictures collected separately, or each frame in a sampled video. That is to say, what is actually collected can be a picture or a video.

步骤S120,基于图像识别算法从故障数据库中查找出与采样图片相匹配的故障图片。Step S120, based on the image recognition algorithm, find the fault picture matching the sampled picture from the fault database.

这里的图像识别算法可以利用现有技术实现,实际上是识别采样图片中的时域波形是否与故障图片中的时域波形相似,如果相似度达到一定阈值则认为是匹配的。例如,采样图片与故障数据库中的故障图片A的相似度(这里的相似度也可以是基于图像识别模型中的置信度得到的)达到95%,超过了预设的阈值90%,则认为采样图片与故障图片A匹配。这里的预设阈值是可以根据需求进行设定的,并且可以与设备的参数相关,例如针对大轴承设定85%的阈值,针对小轴承设定95%的阈值。The image recognition algorithm here can be implemented using existing technologies. In fact, it is to identify whether the time-domain waveform in the sampled picture is similar to the time-domain waveform in the fault picture. If the similarity reaches a certain threshold, it is considered a match. For example, if the similarity between the sampled picture and the fault picture A in the fault database (the similarity here can also be obtained based on the confidence in the image recognition model) reaches 95%, exceeding the preset threshold of 90%, then the sampling The picture matches the fault picture A. The preset threshold here can be set according to requirements, and can be related to the parameters of the equipment, for example, a threshold of 85% is set for a large bearing, and a threshold of 95% is set for a small bearing.

步骤S130,根据故障图片对应的故障描述信息确定目标设备的故障。Step S130, determine the fault of the target device according to the fault description information corresponding to the fault picture.

一个故障图片可以对应一个故障,即目标设备可能是轴承的滚动体损坏;也可以对应于多个故障,即相对应的时域波形是目标设备在同时发生了多处故障时振动所产生的,例如不仅是滚动体损坏,内环或外环也可能损坏。在故障数据库中可以保存有与各类故障对应的故障图片,并附有相应的故障描述信息,使得在匹配到相应的故障图片后,可以根据故障描述信息直接确定故障的类型。A fault picture can correspond to one fault, that is, the target equipment may be damaged rolling elements of the bearing; it can also correspond to multiple faults, that is, the corresponding time domain waveform is generated by the vibration of the target equipment when multiple faults occur at the same time, For example, not only the rolling elements are damaged, but also the inner or outer ring. The fault pictures corresponding to various faults can be stored in the fault database, and the corresponding fault description information is attached, so that after matching the corresponding fault pictures, the fault type can be directly determined according to the fault description information.

可见,图1所示的方法,通过预先在故障数据库中保存故障描述信息和对应的故障图片,在获取到包含目标设备运行时振动的时域波形的采样图片后,基于图像识别算法从故障数据库中查找出与采样图片相匹配的故障图片,根据故障图片对应的故障描述信息确定目标设备的故障。该技术方案能够大大减少故障诊断的操作和消耗的资源,并显著提升诊断效率,节约诊断时间,同时能够保证一定的准确度,适于工业实用,应用场景广泛。It can be seen that the method shown in Figure 1 saves the fault description information and the corresponding fault pictures in the fault database in advance, after obtaining the sampled pictures containing the time-domain waveform of the vibration of the target equipment during operation, based on the image recognition algorithm, from the fault database Find the fault picture that matches the sampling picture, and determine the fault of the target device according to the fault description information corresponding to the fault picture. This technical solution can greatly reduce the operation and resource consumption of fault diagnosis, significantly improve diagnosis efficiency, save diagnosis time, and at the same time ensure a certain degree of accuracy. It is suitable for industrial practicality and has a wide range of application scenarios.

在本发明的一个实施例中,上述方法还包括:当故障数据库中不存在与采样图片相匹配的故障图片时,根据采样图片中的时域波形进行分析,确定目标设备的故障,生成相应的故障描述信息;根据采样图片生成与确定的故障对应的故障图片,在故障数据库中将生成的故障图片与生成的故障描述信息对应保存。In one embodiment of the present invention, the above method further includes: when there is no fault picture matching the sampled picture in the fault database, analyze according to the time domain waveform in the sampled picture, determine the fault of the target device, and generate a corresponding Fault description information: Generate a fault picture corresponding to the determined fault according to the sampled picture, and store the generated fault picture and the generated fault description information in the fault database correspondingly.

一般而言,需要进行故障诊断的设备是确实存在一定故障的,但是也可能存在操作人员误判断的情况。因此采用图片中的时域波形可能实际对应于某种或某几种故障,也可能对应于正常工况。在正常工况的情况下,显然是不会从故障数据库中查找出相匹配的故障图片的;另外,也可能存在的情况是,设备的故障并没有被收录在故障数据库中。因此当数据库中不存在与采样图片相匹配的故障图片时,需要采用将时域波形转换为频域波形、经过傅里叶变换等一系列方式进行故障分析,具体可以采用现有技术中的方式实现;分析得到的结果可能是目标设备没有故障,此时可以不进行其他的后续处理;另一种结果可能是目标设备确实存在故障,而且这个故障没有被收录在故障数据库中。这时我们需要生成与这个新故障对应的故障图片,例如直接将采样图片作为故障图片;也可以是由于采样图片中包含的时域波形包含的故障周期过多,仅选取与一个故障周期对应的时域波形生成故障图片。Generally speaking, the equipment that requires fault diagnosis does have certain faults, but there may also be cases where operators misjudge. Therefore, the time-domain waveforms in the picture may actually correspond to one or several kinds of faults, or may correspond to normal working conditions. Under normal working conditions, it is obviously impossible to find a matching fault picture from the fault database; in addition, there may also be situations where the fault of the equipment has not been included in the fault database. Therefore, when there is no fault picture matching the sampling picture in the database, it is necessary to use a series of methods such as converting the time-domain waveform into a frequency-domain waveform and undergoing Fourier transform for fault analysis. Specifically, the methods in the prior art can be used Realization; the result of the analysis may be that the target device is not faulty, and other follow-up processing may not be performed at this time; another result may be that the target device does have a fault, and this fault is not included in the fault database. At this time, we need to generate a fault picture corresponding to this new fault, for example, directly use the sampling picture as the fault picture; it may also be because the time domain waveform contained in the sampling picture contains too many fault cycles, and only select the one corresponding to one fault cycle The time-domain waveform generates a picture of the fault.

这样,就实现了故障数据库的不断完善,能够迭代更新,满足实际需求。In this way, the continuous improvement of the fault database is realized, which can be iteratively updated to meet actual needs.

在本发明的一个实施例中,上述方法中,获取包含目标设备振动时的时域波形的采样图片包括:根据目标设备的故障周期确定与采样图片对应的采样时间,以使采样图片中至少包含若干个故障周期的时域波形;故障周期是根据目标设备的参数确定的;基于图像识别算法从故障数据库中查找出与采样图片相匹配的故障图片包括:从故障数据库中查找出与目标设备的参数对应的故障图片作为备选图片,从备选图片中查找出与采样图片相匹配的故障图片。In an embodiment of the present invention, in the above method, obtaining the sampled picture containing the time-domain waveform when the target device vibrates includes: determining the sampling time corresponding to the sampled picture according to the fault period of the target device, so that the sampled picture contains at least The time-domain waveforms of several fault cycles; the fault cycle is determined according to the parameters of the target equipment; based on the image recognition algorithm, finding the fault pictures that match the sampling pictures from the fault database includes: finding the fault pictures that match the target equipment from the fault database The fault picture corresponding to the parameter is used as a candidate picture, and the fault picture matching the sampling picture is found from the candidate picture.

其中,目标设备的参数可以包括设备型号、转速等等。为了保证图像识别的准确性,一般需要采集的时域波形至少包含一个故障周期,可选地也可以包含多个故障周期。而在故障数据库中的故障图片可以是至少包含一个故障周期的,这样如果采样图片中的时域波形的至少一部分与一张故障图片中的时域波形相似,则二者就视为匹配。Wherein, the parameters of the target device may include device model, rotation speed and so on. In order to ensure the accuracy of image recognition, it is generally required that the collected time-domain waveforms contain at least one fault cycle, and may optionally contain multiple fault cycles. The fault pictures in the fault database may contain at least one fault cycle, so if at least a part of the time-domain waveform in the sampled picture is similar to the time-domain waveform in a fault picture, the two are considered to match.

由于不同设备的参数可能不同,因此故障时采集到的时域波形也不同,将不同设备的时域波形进行比较是意义不大的,因此在本实施例中还先根据目标设备的参数选取出与参数对应的故障图片,减小了匹配的范围,提高了图像识别的准确度,减少了误匹配率。Since the parameters of different devices may be different, the time-domain waveforms collected during the failure are also different. It is meaningless to compare the time-domain waveforms of different devices. Therefore, in this embodiment, the parameters of the target device are selected first. The fault picture corresponding to the parameters reduces the matching range, improves the accuracy of image recognition, and reduces the false matching rate.

在本发明的一个实施例中,上述方法中,获取包含目标设备振动的时域波形的采样图片包括:由对目标设备进行检测的检测设备采集目标设备振动时的时域波形,通过拍摄和/或截屏方式生成包含时域波形的采样图片。In an embodiment of the present invention, in the above method, acquiring the sampled picture containing the time-domain waveform of the vibration of the target device includes: collecting the time-domain waveform of the vibration of the target device by the detection device that detects the target device, by photographing and/or Or generate a sample picture including a time domain waveform by taking a screenshot.

有的时候我们检测设备并没有提供较好的数据处理接口,不能够直接获取到时域波形生成图片,但是这些检测设备可以在显示屏上输出时域波形,因此本实施例中,可以采用对输出时域波形的显示设备进行拍摄或是截屏,不通过接口的方式获取到时域波形。可以看出,本发明实施例虽然本质上是识别时域波形是否相似,但是并非是通过直接识别时域波形而实现的,而是通过识别图片是否相似来实现的。Sometimes our detection equipment does not provide a good data processing interface, and cannot directly obtain time-domain waveforms to generate pictures, but these detection equipment can output time-domain waveforms on the display screen, so in this embodiment, we can use the The display device that outputs the time-domain waveform takes pictures or screenshots, and the time-domain waveform is not obtained through the interface. It can be seen that although the embodiment of the present invention essentially identifies whether the time-domain waveforms are similar, it is not realized by directly identifying the time-domain waveforms, but by identifying whether the pictures are similar.

图2示出了根据本发明一个实施例的一种基于图像识别的设备故障诊断装置的结构示意图。如图2所示,基于图像识别的设备故障诊断装置200包括:Fig. 2 shows a schematic structural diagram of an apparatus for fault diagnosis of equipment based on image recognition according to an embodiment of the present invention. As shown in Figure 2, the device fault diagnosis device 200 based on image recognition includes:

采样图片获取单元210,用于获取包含目标设备运行时振动的时域波形的采样图片。例如,这里的目标设备可以是机械设备,在运行时会产生振动,因此可以通过检测设备如各类传感器等采集到相应的时域波形。由于设备在发生故障时的振动不同于正常工况下的振动,因此产生的时域波形也是不同的。The sampling picture acquiring unit 210 is configured to acquire a sampling picture including a time-domain waveform of vibration of the target device during operation. For example, the target device here may be a mechanical device that generates vibration during operation, so the corresponding time-domain waveform can be collected through detection devices such as various sensors. Since the vibration of the equipment when it fails is different from the vibration under normal working conditions, the generated time domain waveforms are also different.

这里需要说明的是,采样图片可以是单独采集的一幅或几幅图片,也可以是一段采样视频中的各个帧。也就是说,实际采集的可以是图片或是视频。It should be noted here that the sampled picture may be one or several pictures collected separately, or each frame in a sampled video. That is to say, what is actually collected can be a picture or a video.

识别单元220,用于基于图像识别算法从故障数据库中查找出与采样图片相匹配的故障图片。The recognition unit 220 is configured to find fault pictures that match the sampled pictures from the fault database based on an image recognition algorithm.

这里的图像识别算法可以利用现有技术实现,实际上是识别采样图片中的时域波形是否与故障图片中的时域波形相似,如果相似度(这里的相似度也可以是基于图像识别模型中的置信度得到的)达到一定阈值则认为是匹配的。例如,采样图片与故障数据库中的故障图片A的相似度达到95%,超过了预设的阈值90%,则认为采样图片与故障图片A匹配。这里的预设阈值是可以根据需求进行设定的,并且可以与设备的参数相关,例如针对大轴承设定85%的阈值,针对小轴承设定95%的阈值。The image recognition algorithm here can be implemented using existing technologies. In fact, it is to identify whether the time-domain waveform in the sampling picture is similar to the time-domain waveform in the fault picture. If the similarity (the similarity here can also be based on the image recognition model) The confidence obtained) reaches a certain threshold and is considered a match. For example, if the similarity between the sampled picture and the faulty picture A in the fault database reaches 95%, and exceeds the preset threshold of 90%, then the sampled picture is considered to match the faulty picture A. The preset threshold here can be set according to requirements, and can be related to the parameters of the equipment, for example, a threshold of 85% is set for a large bearing, and a threshold of 95% is set for a small bearing.

故障诊断单元230,用于根据故障图片对应的故障描述信息确定目标设备的故障。The fault diagnosis unit 230 is configured to determine the fault of the target device according to the fault description information corresponding to the fault picture.

一个故障图片可以对应一个故障,即目标设备可能是轴承的滚动体损坏;也可以对应于多个故障,即相对应的时域波形是目标设备在同时发生了多处故障时振动所产生的,例如不仅是滚动体损坏,内环或外环也可能损坏。在故障数据库中可以保存有与各类故障对应的故障图片,并附有相应的故障描述信息,使得在匹配到相应的故障图片后,可以根据故障描述信息直接确定故障的类型。A fault picture can correspond to one fault, that is, the target equipment may be damaged rolling elements of the bearing; it can also correspond to multiple faults, that is, the corresponding time domain waveform is generated by the vibration of the target equipment when multiple faults occur at the same time, For example, not only the rolling elements are damaged, but also the inner or outer ring. The fault pictures corresponding to various faults can be stored in the fault database, and the corresponding fault description information is attached, so that after matching the corresponding fault pictures, the fault type can be directly determined according to the fault description information.

可见,图2所示的装置,通过各单元的相互配合,预先在故障数据库中保存故障描述信息和对应的故障图片,在获取到包含目标设备运行时振动的时域波形的采样图片后,基于图像识别算法从故障数据库中查找出与采样图片相匹配的故障图片,根据故障图片对应的故障描述信息确定目标设备的故障。该技术方案能够大大减少故障诊断的操作和消耗的资源,并显著提升诊断效率,节约诊断时间,同时能够保证一定的准确度,适于工业实用,应用场景广泛。It can be seen that the device shown in Figure 2 saves the fault description information and corresponding fault pictures in the fault database in advance through the mutual cooperation of each unit. The image recognition algorithm finds the fault pictures that match the sampling pictures from the fault database, and determines the fault of the target device according to the fault description information corresponding to the fault pictures. This technical solution can greatly reduce the operation and resource consumption of fault diagnosis, significantly improve diagnosis efficiency, save diagnosis time, and at the same time ensure a certain degree of accuracy. It is suitable for industrial practicality and has a wide range of application scenarios.

在本发明的一个实施例中,上述装置中,故障诊断单元230,还用于当故障数据库中不存在与采样图片相匹配的故障图片时,根据采样图片中的时域波形进行分析,确定目标设备的故障,生成相应的故障描述信息;根据采样图片生成与确定的故障对应的故障图片,在故障数据库中将生成的故障图片与生成的故障描述信息对应保存。In one embodiment of the present invention, in the above-mentioned device, the fault diagnosis unit 230 is also used to analyze the time-domain waveform in the sampled picture and determine the target when there is no fault picture matching the sampled picture in the fault database. For equipment faults, generate corresponding fault description information; generate fault pictures corresponding to the determined faults according to the sampled pictures, and store the generated fault pictures and the generated fault description information in the fault database correspondingly.

一般而言,需要进行故障诊断的设备是确实存在一定故障的,但是也可能存在操作人员误判断的情况。因此采用图片中的时域波形可能实际对应于某种或某几种故障,也可能对应于正常工况。在正常工况的情况下,显然是不会从故障数据库中查找出相匹配的故障图片的;另外,也可能存在的情况是,设备的故障并没有被收录在故障数据库中。因此当数据库中不存在与采样图片相匹配的故障图片时,需要采用将时域波形转换为频域波形、经过傅里叶变换等一系列方式进行故障分析,具体可以采用现有技术中的方式实现;分析得到的结果可能是目标设备没有故障,此时可以不进行其他的后续处理;另一种结果可能是目标设备确实存在故障,而且这个故障没有被收录在故障数据库中。这时我们需要生成与这个新故障对应的故障图片,例如直接将采样图片作为故障图片;也可以是由于采样图片中包含的时域波形包含的故障周期过多,仅选取与一个故障周期对应的时域波形生成故障图片。Generally speaking, the equipment that requires fault diagnosis does have certain faults, but there may also be cases where operators misjudge. Therefore, the time-domain waveforms in the picture may actually correspond to one or several kinds of faults, or may correspond to normal working conditions. Under normal working conditions, it is obviously impossible to find a matching fault picture from the fault database; in addition, there may also be situations where the fault of the equipment has not been included in the fault database. Therefore, when there is no fault picture matching the sampling picture in the database, it is necessary to use a series of methods such as converting the time-domain waveform into a frequency-domain waveform and undergoing Fourier transform for fault analysis. Specifically, the methods in the prior art can be used Realization; the result of the analysis may be that the target device is not faulty, and other follow-up processing may not be performed at this time; another result may be that the target device does have a fault, and this fault is not included in the fault database. At this time, we need to generate a fault picture corresponding to this new fault, for example, directly use the sampling picture as the fault picture; it may also be because the time domain waveform contained in the sampling picture contains too many fault cycles, and only select the one corresponding to one fault cycle The time-domain waveform generates a picture of the fault.

这样,就实现了故障数据库的不断完善,能够迭代更新,满足实际需求。In this way, the continuous improvement of the fault database is realized, which can be iteratively updated to meet actual needs.

在本发明的一个实施例中,上述装置中,采样图片获取单元210,用于根据目标设备的故障周期确定与采样图片对应的采样时间,以使采样图片中至少包含若干个故障周期的时域波形;故障周期是根据目标设备的参数确定的;识别单元220,用于从故障数据库中查找出与目标设备的参数对应的故障图片作为备选图片,从备选图片中查找出与采样图片相匹配的故障图片。In one embodiment of the present invention, in the above-mentioned device, the sampling picture acquisition unit 210 is configured to determine the sampling time corresponding to the sampling picture according to the failure period of the target device, so that the sampling picture at least includes the time domain of several failure periods Waveform; the fault period is determined according to the parameters of the target device; the identification unit 220 is used to find out the fault picture corresponding to the parameter of the target device from the fault database as an alternative picture, and find out the fault picture corresponding to the sampling picture from the alternative picture. Matching fault pictures.

其中,目标设备的参数可以包括设备型号、转速等等。为了保证图像识别的准确性,一般需要采集的时域波形至少包含一个故障周期,可选地也可以包含多个故障周期。而在故障数据库中的故障图片可以是至少包含一个故障周期的,这样如果采样图片中的时域波形的至少一部分与一张故障图片中的时域波形相似,则二者就视为匹配。Wherein, the parameters of the target device may include device model, rotation speed and so on. In order to ensure the accuracy of image recognition, it is generally required that the collected time-domain waveforms contain at least one fault cycle, and may optionally contain multiple fault cycles. The fault pictures in the fault database may contain at least one fault cycle, so if at least a part of the time-domain waveform in the sampled picture is similar to the time-domain waveform in a fault picture, the two are considered to match.

由于不同设备的参数可能不同,因此故障时采集到的时域波形也不同,将不同设备的时域波形进行比较是意义不大的,因此在本实施例中还先根据目标设备的参数选取出与参数对应的故障图片,减小了匹配的范围,提高了图像识别的准确度,减少了误匹配率。Since the parameters of different devices may be different, the time-domain waveforms collected during the failure are also different. It is meaningless to compare the time-domain waveforms of different devices. Therefore, in this embodiment, the parameters of the target device are selected first. The fault picture corresponding to the parameters reduces the matching range, improves the accuracy of image recognition, and reduces the false matching rate.

在本发明的一个实施例中,上述装置中,采样图片获取单元210,用于由对目标设备进行检测的检测设备采集目标设备振动时的时域波形,通过拍摄和/或截屏方式生成包含时域波形的采样图片。In one embodiment of the present invention, in the above-mentioned device, the sampling picture acquisition unit 210 is used to collect the time-domain waveform of the target device by the detection device that detects the target device, and generate the A sample picture of the domain waveform.

有的时候我们检测设备并没有提供较好的数据处理接口,不能够直接获取到时域波形生成图片,但是这些检测设备可以在显示屏上输出时域波形,因此本实施例中,可以采用对输出时域波形的显示设备进行拍摄或是截屏,不通过接口的方式获取到时域波形。可以看出,本发明实施例虽然本质上是识别时域波形是否相似,但是并非是通过直接识别时域波形而实现的,而是通过识别图片是否相似来实现的。Sometimes our detection equipment does not provide a good data processing interface, and cannot directly obtain time-domain waveforms to generate pictures, but these detection equipment can output time-domain waveforms on the display screen, so in this embodiment, we can use the The display device that outputs the time-domain waveform takes pictures or screenshots, and the time-domain waveform is not obtained through the interface. It can be seen that although the embodiment of the present invention essentially identifies whether the time-domain waveforms are similar, it is not realized by directly identifying the time-domain waveforms, but by identifying whether the pictures are similar.

综上所述,本发明的技术方案,通过预先在故障数据库中保存故障描述信息和对应的故障图片,在获取到包含目标设备运行时振动的时域波形的采样图片后,基于图像识别算法从故障数据库中查找出与采样图片相匹配的故障图片,根据故障图片对应的故障描述信息确定目标设备的故障。该技术方案能够大大减少故障诊断的操作和消耗的资源,并显著提升诊断效率,节约诊断时间,同时能够保证一定的准确度,适于工业实用,应用场景广泛。In summary, the technical solution of the present invention saves the fault description information and the corresponding fault pictures in the fault database in advance, after obtaining the sampled pictures containing the time-domain waveform of the vibration of the target device during operation, based on the image recognition algorithm, from The fault picture matching the sampling picture is found in the fault database, and the fault of the target device is determined according to the fault description information corresponding to the fault picture. This technical solution can greatly reduce the operation and resource consumption of fault diagnosis, significantly improve diagnosis efficiency, save diagnosis time, and at the same time ensure a certain degree of accuracy. It is suitable for industrial practicality and has a wide range of application scenarios.

需要说明的是:It should be noted:

在此提供的算法和显示不与任何特定计算机、虚拟装置或者其它设备固有相关。各种通用装置也可以与基于在此的示教一起使用。根据上面的描述,构造这类装置所要求的结构是显而易见的。此外,本发明也不针对任何特定编程语言。应当明白,可以利用各种编程语言实现在此描述的本发明的内容,并且上面对特定语言所做的描述是为了披露本发明的最佳实施方式。The algorithms and displays presented herein are not inherently related to any particular computer, virtual appliance, or other device. Various general purpose devices can also be used with the teachings based on this. The structure required to construct such an apparatus will be apparent from the foregoing description. Furthermore, the present invention is not specific to any particular programming language. It should be understood that various programming languages can be used to implement the content of the present invention described herein, and the above description of specific languages is for disclosing the best mode of the present invention.

在此处所提供的说明书中,说明了大量具体细节。然而,能够理解,本发明的实施例可以在没有这些具体细节的情况下实践。在一些实例中,并未详细示出公知的方法、结构和技术,以便不模糊对本说明书的理解。In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure the understanding of this description.

类似地,应当理解,为了精简本公开并帮助理解各个发明方面中的一个或多个,在上面对本发明的示例性实施例的描述中,本发明的各个特征有时被一起分组到单个实施例、图、或者对其的描述中。然而,并不应将该公开的方法解释成反映如下意图:即所要求保护的本发明要求比在每个权利要求中所明确记载的特征更多的特征。更确切地说,如下面的权利要求书所反映的那样,发明方面在于少于前面公开的单个实施例的所有特征。因此,遵循具体实施方式的权利要求书由此明确地并入该具体实施方式,其中每个权利要求本身都作为本发明的单独实施例。Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, in order to streamline this disclosure and to facilitate an understanding of one or more of the various inventive aspects, various features of the invention are sometimes grouped together in a single embodiment, figure, or its description. This method of disclosure, however, is not to be interpreted as reflecting an intention that the claimed invention requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the Detailed Description are hereby expressly incorporated into this Detailed Description, with each claim standing on its own as a separate embodiment of this invention.

本领域那些技术人员可以理解,可以对实施例中的设备中的模块进行自适应性地改变并且把它们设置在与该实施例不同的一个或多个设备中。可以把实施例中的模块或单元或组件组合成一个模块或单元或组件,以及此外可以把它们分成多个子模块或子单元或子组件。除了这样的特征和/或过程或者单元中的至少一些是相互排斥之外,可以采用任何组合对本说明书(包括伴随的权利要求、摘要和附图)中公开的所有特征以及如此公开的任何方法或者设备的所有过程或单元进行组合。除非另外明确陈述,本说明书(包括伴随的权利要求、摘要和附图)中公开的每个特征可以由提供相同、等同或相似目的的替代特征来代替。Those skilled in the art can understand that the modules in the device in the embodiment can be adaptively changed and arranged in one or more devices different from the embodiment. Modules or units or components in the embodiments may be combined into one module or unit or component, and furthermore may be divided into a plurality of sub-modules or sub-units or sub-assemblies. All features disclosed in this specification (including accompanying claims, abstract and drawings) and any method or method so disclosed may be used in any combination, except that at least some of such features and/or processes or units are mutually exclusive. All processes or units of equipment are combined. Each feature disclosed in this specification (including accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

此外,本领域的技术人员能够理解,尽管在此所述的一些实施例包括其它实施例中所包括的某些特征而不是其它特征,但是不同实施例的特征的组合意味着处于本发明的范围之内并且形成不同的实施例。例如,在下面的权利要求书中,所要求保护的实施例的任意之一都可以以任意的组合方式来使用。Furthermore, those skilled in the art will understand that although some embodiments described herein include some features included in other embodiments but not others, combinations of features from different embodiments are meant to be within the scope of the invention. and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.

本发明的各个部件实施例可以以硬件实现,或者以在一个或者多个处理器上运行的软件模块实现,或者以它们的组合实现。本领域的技术人员应当理解,可以在实践中使用微处理器或者数字信号处理器(DSP)来实现根据本发明实施例的基于图像识别的设备故障诊断装置中的一些或者全部部件的一些或者全部功能。本发明还可以实现为用于执行这里所描述的方法的一部分或者全部的设备或者装置程序(例如,计算机程序和计算机程序产品)。这样的实现本发明的程序可以存储在计算机可读介质上,或者可以具有一个或者多个信号的形式。这样的信号可以从因特网网站上下载得到,或者在载体信号上提供,或者以任何其他形式提供。The various component embodiments of the present invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art should understand that a microprocessor or a digital signal processor (DSP) can be used in practice to implement some or all of some or all of the components in the device fault diagnosis device based on image recognition according to the embodiment of the present invention Function. The present invention can also be implemented as an apparatus or an apparatus program (for example, a computer program and a computer program product) for performing a part or all of the methods described herein. Such a program for realizing the present invention may be stored on a computer-readable medium, or may be in the form of one or more signals. Such a signal may be downloaded from an Internet site, or provided on a carrier signal, or provided in any other form.

例如,图3示出了根据本发明一个实施例的电子设备的结构示意图。该电子设备包括处理器310和被安排成存储计算机可执行指令(计算机可读程序代码)的存储器320。存储器320可以是诸如闪存、EEPROM(电可擦除可编程只读存储器)、EPROM、硬盘或者ROM之类的电子存储器。存储器320具有存储用于执行上述方法中的任何方法步骤的计算机可读程序代码331的存储空间330。例如,用于存储计算机可读程序代码的存储空间330可以包括分别用于实现上面的方法中的各种步骤的各个计算机可读程序代码331。计算机可读程序代码331可以从一个或者多个计算机程序产品中读出或者写入到这一个或者多个计算机程序产品中。这些计算机程序产品包括诸如硬盘,紧致盘(CD)、存储卡或者软盘之类的程序代码载体。这样的计算机程序产品通常为例如图4所述的计算机可读存储介质。图4示出了根据本发明一个实施例的一种计算机可读存储介质的结构示意图。该计算机可读存储介质400存储有用于执行根据本发明的方法步骤的计算机可读程序代码331,可以被电子设备300的处理器310读取,当计算机可读程序代码331由电子设备300运行时,导致该电子设备300执行上面所描述的方法中的各个步骤,具体来说,该计算机可读存储介质存储的计算机可读程序代码331可以执行上述任一实施例中示出的方法。计算机可读程序代码331可以以适当形式进行压缩。For example, FIG. 3 shows a schematic structural diagram of an electronic device according to an embodiment of the present invention. The electronic device comprises a processor 310 and a memory 320 arranged to store computer executable instructions (computer readable program code). Memory 320 may be electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read Only Memory), EPROM, hard disk, or ROM. The memory 320 has a storage space 330 storing computer readable program code 331 for performing any method step in the method described above. For example, the storage space 330 for storing computer-readable program codes may include respective computer-readable program codes 331 for respectively implementing various steps in the above methods. The computer readable program code 331 can be read from or written into one or more computer program products. These computer program products comprise program code carriers such as hard disks, compact disks (CDs), memory cards or floppy disks. Such a computer program product is typically, for example, a computer-readable storage medium as described in FIG. 4 . Fig. 4 shows a schematic structural diagram of a computer-readable storage medium according to an embodiment of the present invention. The computer-readable storage medium 400 stores computer-readable program code 331 for executing the method steps according to the present invention, which can be read by the processor 310 of the electronic device 300, when the computer-readable program code 331 is run by the electronic device 300 , causing the electronic device 300 to execute each step in the method described above, specifically, the computer-readable program code 331 stored in the computer-readable storage medium may execute the method shown in any of the foregoing embodiments. The computer readable program code 331 can be compressed in a suitable form.

应该注意的是上述实施例对本发明进行说明而不是对本发明进行限制,并且本领域技术人员在不脱离所附权利要求的范围的情况下可设计出替换实施例。在权利要求中,不应将位于括号之间的任何参考符号构造成对权利要求的限制。单词“包含”不排除存在未列在权利要求中的元件或步骤。位于元件之前的单词“一”或“一个”不排除存在多个这样的元件。本发明可以借助于包括有若干不同元件的硬件以及借助于适当编程的计算机来实现。在列举了若干装置的单元权利要求中,这些装置中的若干个可以是通过同一个硬件项来具体体现。单词第一、第二、以及第三等的使用不表示任何顺序。可将这些单词解释为名称。It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means can be embodied by one and the same item of hardware. The use of the words first, second, and third, etc. does not indicate any order. These words can be interpreted as names.

Claims (10)

1. a kind of equipment fault diagnosis method based on image recognition, which is characterized in that this method includes:
Obtain the sampling picture of the time domain waveform comprising vibrating when target device operation;
The failure picture to match with the sampling picture is found out from Mishap Database based on image recognition algorithm;
The failure of the target device is determined according to the corresponding failure-description information of the failure picture.
2. the method as described in claim 1, which is characterized in that this method further includes:
When the failure picture to match with the sampling picture is not present in Mishap Database, according in the sampling picture Time domain waveform is analyzed, and determines the failure of the target device, generates corresponding failure-description information;
Failure picture corresponding with the failure determined is generated according to the sampling picture, by generation in the Mishap Database Failure picture is corresponding with the failure-description information of generation to be saved.
3. the method as described in claim 1, which is characterized in that the time domain waveform when acquisition includes target device vibration Sampling picture includes:
The sampling time corresponding with the sampling picture is determined according to the inaction interval of the target device, so that the sample graph The time domain waveform of several inaction intervals is included at least in piece;The inaction interval is determined according to the parameter of the target device 's;
It is described to find out the failure picture packet to match with the sampling picture from Mishap Database based on image recognition algorithm It includes:
Failure picture corresponding with the parameter of the target device alternately picture is found out from the Mishap Database, from The failure picture to match with the sampling picture is found out in the alternative picture.
4. the method as described in claim 1, which is characterized in that described to obtain adopting for the time domain waveform comprising target device vibration Master drawing piece includes:
Time domain waveform when being vibrated by the detection device acquisition target device detected to the target device, passes through shooting And/or screenshotss mode generates the sampling picture comprising the time domain waveform.
5. a kind of equipment fault diagnosis device based on image recognition, which is characterized in that the device includes:
Picture acquiring unit is sampled, for obtaining the sampling picture of the time domain waveform comprising vibrating when target device operation;
Recognition unit, for finding out the event to match with the sampling picture from Mishap Database based on image recognition algorithm Hinder picture;
Failure diagnosis unit, for determining the event of the target device according to the corresponding failure-description information of the failure picture Barrier.
6. device as claimed in claim 5, which is characterized in that
The failure diagnosis unit is also used to when there is no the failure pictures to match with the sampling picture in Mishap Database When, it is analyzed according to the time domain waveform in the sampling picture, determines the failure of the target device, generate corresponding failure Description information;Failure picture corresponding with the failure determined is generated according to the sampling picture, it will in the Mishap Database The failure picture of generation and the failure-description information of generation it is corresponding save.
7. device as claimed in claim 5, which is characterized in that
The sampling picture acquiring unit, for corresponding with the sampling picture according to the determination of the inaction interval of the target device Sampling time so that it is described sampling picture in include at least several inaction intervals time domain waveform;The inaction interval is It is determined according to the parameter of the target device;
The recognition unit, for finding out fault graph corresponding with the parameter of the target device from the Mishap Database Piece alternately picture, finds out and failure picture that the sampling picture matches from the alternative picture.
8. device as claimed in claim 5, which is characterized in that
The sampling picture acquiring unit, for the detection device acquisition target device vibration by being detected to the target device Time domain waveform when dynamic generates the sampling picture comprising the time domain waveform by shooting and/or screenshotss mode.
9. a kind of electronic equipment, wherein the electronic equipment includes:Processor;And it is arranged to the executable finger of storage computer The memory of order, the executable instruction execute the processor as described in any one of claim 1-4 Method.
10. a kind of computer readable storage medium, wherein the computer-readable recording medium storage one or more program, One or more of programs when being executed by a processor, realize such as method of any of claims 1-4.
CN201810804705.7A 2018-07-20 2018-07-20 Equipment fault diagnosis method and device based on image recognition Active CN108830261B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810804705.7A CN108830261B (en) 2018-07-20 2018-07-20 Equipment fault diagnosis method and device based on image recognition

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810804705.7A CN108830261B (en) 2018-07-20 2018-07-20 Equipment fault diagnosis method and device based on image recognition

Publications (2)

Publication Number Publication Date
CN108830261A true CN108830261A (en) 2018-11-16
CN108830261B CN108830261B (en) 2021-11-30

Family

ID=64141188

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810804705.7A Active CN108830261B (en) 2018-07-20 2018-07-20 Equipment fault diagnosis method and device based on image recognition

Country Status (1)

Country Link
CN (1) CN108830261B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109584232A (en) * 2018-11-28 2019-04-05 成都天衡智造科技有限公司 Equipment use state online monitoring method, system and terminal based on image recognition
CN110443316A (en) * 2019-08-07 2019-11-12 上海金智晟东电力科技有限公司 Board turning recognition methods, device and the distribution network failure of fault detector monitor system
CN111160420A (en) * 2019-12-13 2020-05-15 北京三快在线科技有限公司 Map-based fault diagnosis method and device, electronic equipment and storage medium
CN111324637A (en) * 2020-02-05 2020-06-23 北京工业大数据创新中心有限公司 Fault symptom searching method and system for industrial time sequence data
CN114638973A (en) * 2022-03-30 2022-06-17 苏州科达科技股份有限公司 Target image detection method and image detection model training method

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102902958A (en) * 2012-09-19 2013-01-30 四川大学 Digital nuclear signal processing and multi-parameter nuclear information acquisition method based on image recognition
CN103018330A (en) * 2011-09-22 2013-04-03 北京理工大学 Full time domain waveform acquisition and analysis technique applied to ultrasonic microscope
CN104634592A (en) * 2014-12-18 2015-05-20 成都铁安科技有限责任公司 Train running gear fault diagnosis method and train running gear fault diagnosis device
CN106168539A (en) * 2016-10-21 2016-11-30 常州信息职业技术学院 Fault Diagnosis of Roller Bearings based on convolutional neural networks and system
US20180172675A1 (en) * 2016-10-12 2018-06-21 Viasphere, Llc Compositions and methods for disease diagnosis using single cell analysis
CN108256556A (en) * 2017-12-22 2018-07-06 上海电机学院 Wind-driven generator group wheel box method for diagnosing faults based on depth belief network

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103018330A (en) * 2011-09-22 2013-04-03 北京理工大学 Full time domain waveform acquisition and analysis technique applied to ultrasonic microscope
CN102902958A (en) * 2012-09-19 2013-01-30 四川大学 Digital nuclear signal processing and multi-parameter nuclear information acquisition method based on image recognition
CN104634592A (en) * 2014-12-18 2015-05-20 成都铁安科技有限责任公司 Train running gear fault diagnosis method and train running gear fault diagnosis device
US20180172675A1 (en) * 2016-10-12 2018-06-21 Viasphere, Llc Compositions and methods for disease diagnosis using single cell analysis
CN106168539A (en) * 2016-10-21 2016-11-30 常州信息职业技术学院 Fault Diagnosis of Roller Bearings based on convolutional neural networks and system
CN108256556A (en) * 2017-12-22 2018-07-06 上海电机学院 Wind-driven generator group wheel box method for diagnosing faults based on depth belief network

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
张铧予 等.: "日本艾普斯龙火箭的发射场测发控技术分析", 《中国航天》 *

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109584232A (en) * 2018-11-28 2019-04-05 成都天衡智造科技有限公司 Equipment use state online monitoring method, system and terminal based on image recognition
CN113034431A (en) * 2018-11-28 2021-06-25 成都天衡智造科技有限公司 Equipment use state online monitoring method, system, storage medium and terminal
CN113034431B (en) * 2018-11-28 2022-06-17 成都天衡智造科技有限公司 Equipment use state online monitoring method, system, storage medium and terminal
CN110443316A (en) * 2019-08-07 2019-11-12 上海金智晟东电力科技有限公司 Board turning recognition methods, device and the distribution network failure of fault detector monitor system
CN111160420A (en) * 2019-12-13 2020-05-15 北京三快在线科技有限公司 Map-based fault diagnosis method and device, electronic equipment and storage medium
CN111160420B (en) * 2019-12-13 2023-10-10 北京三快在线科技有限公司 Map-based fault diagnosis method, map-based fault diagnosis device, electronic equipment and storage medium
CN111324637A (en) * 2020-02-05 2020-06-23 北京工业大数据创新中心有限公司 Fault symptom searching method and system for industrial time sequence data
CN114638973A (en) * 2022-03-30 2022-06-17 苏州科达科技股份有限公司 Target image detection method and image detection model training method

Also Published As

Publication number Publication date
CN108830261B (en) 2021-11-30

Similar Documents

Publication Publication Date Title
CN108830261A (en) Equipment fault diagnosis method and device based on image recognition
CN113743607B (en) Training method of anomaly detection model, anomaly detection method and device
JP6751806B2 (en) Entity recognition that uses multiple data streams to supplement missing information related to an entity
WO2021027213A1 (en) Detection method and apparatus, electronic device and computer-readable medium
WO2018086513A1 (en) Target detection method and device
CN108063698A (en) Unit exception detection method and device, program product and storage medium
WO2017107843A1 (en) Periodic task processing method and apparatus, computer program, and readable medium
CN110987404B (en) Rotating speed identification method and computing equipment
CN109168052B (en) Method and device for determining service satisfaction degree and computing equipment
CN105630566A (en) Application page loading duration determining method and application page loading duration determining device
JP2015197436A (en) Method for detecting events in a signal subject to periodic stationary background noise
CN106803083A (en) The method and device of pedestrian detection
CN110245074B (en) Log record generation method and device, storage medium and server
CN108378835A (en) Blood pressure prediction technique and device
CN109711545A (en) Creation method, device, system and the computer-readable medium of network model
CN109960648A (en) Application testing method and device
CN111290905A (en) Test method and device for IoT cloud platform
CN111358460A (en) Arrhythmia identification method and device and electronic equipment
CN108052927B (en) Video data-based gesture processing method and device, and computing device
JP2020187412A (en) Information processing device and information processing method
Verma et al. Android app for intelligent CBM
US20240168855A1 (en) Machine learning pipeline automation
US11798675B2 (en) Generating and searching data structures that facilitate measurement-informed treatment recommendation
CN110985425A (en) Information detection method, electronic equipment and computer readable storage medium
CN109710521A (en) Multimedia application performance test methods, device, computer equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
PE01 Entry into force of the registration of the contract for pledge of patent right

Denomination of invention: Equipment fault diagnosis method and device based on image recognition

Granted publication date: 20211130

Pledgee: Zhongguancun Branch of Bank of Beijing Co.,Ltd.

Pledgor: BEIJING HAN ENERGY TECHNOLOGY CO.,LTD.

Registration number: Y2024980046966

PE01 Entry into force of the registration of the contract for pledge of patent right