CN108830261A - Equipment fault diagnosis method and device based on image recognition - Google Patents
Equipment fault diagnosis method and device based on image recognition Download PDFInfo
- Publication number
- CN108830261A CN108830261A CN201810804705.7A CN201810804705A CN108830261A CN 108830261 A CN108830261 A CN 108830261A CN 201810804705 A CN201810804705 A CN 201810804705A CN 108830261 A CN108830261 A CN 108830261A
- Authority
- CN
- China
- Prior art keywords
- picture
- fault
- failure
- target device
- sampling
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/30—Scenes; Scene-specific elements in albums, collections or shared content, e.g. social network photos or video
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Measurement Of Mechanical Vibrations Or Ultrasonic Waves (AREA)
- Image Analysis (AREA)
Abstract
本发明公开了基于图像识别的设备故障诊断方法和装置。所述方法包括:获取包含目标设备运行时振动的时域波形的采样图片;基于图像识别算法从故障数据库中查找出与所述采样图片相匹配的故障图片;根据所述故障图片对应的故障描述信息确定所述目标设备的故障。该技术方案能够大大减少故障诊断的操作和消耗的资源,并显著提升诊断效率,节约诊断时间,同时能够保证一定的准确度,适于工业实用,应用场景广泛。
The invention discloses a device fault diagnosis method and device based on image recognition. The method includes: acquiring a sampling picture containing a time-domain waveform of vibration of the target device during operation; finding a fault picture matching the sampling picture from a fault database based on an image recognition algorithm; information identifying a failure of the target device. This technical solution can greatly reduce the operation and resource consumption of fault diagnosis, significantly improve diagnosis efficiency, save diagnosis time, and at the same time ensure a certain degree of accuracy, which is suitable for industrial practicality and has a wide range of application scenarios.
Description
技术领域technical field
本发明涉及故障诊断领域,具体涉及基于图像识别的设备故障诊断方法和装置。The invention relates to the field of fault diagnosis, in particular to a device fault diagnosis method and device based on image recognition.
背景技术Background technique
目前,设备的故障诊断通常是在由检测设备采集振动的时域波形,通过一系列复杂处理后才能诊断出故障,非常麻烦,浪费了大量资源,需要一种效率更高、资源消耗更少的故障诊断方式。At present, the fault diagnosis of equipment is usually based on the time-domain waveform of vibration collected by the detection equipment, and the fault can only be diagnosed after a series of complicated processing, which is very troublesome and wastes a lot of resources. A more efficient and less resource-consuming method is needed Fault diagnosis method.
发明内容Contents of the invention
鉴于上述问题,提出了本发明以便提供一种克服上述问题或者至少部分地解决上述问题的基于图像识别的设备故障诊断方法和装置。In view of the above problems, the present invention is proposed to provide a device fault diagnosis method and device based on image recognition that overcomes the above problems or at least partially solves the above problems.
依据本发明的一个方面,提供了一种基于图像识别的设备故障诊断方法,包括:According to one aspect of the present invention, a method for diagnosing equipment faults based on image recognition is provided, including:
获取包含目标设备运行时振动的时域波形的采样图片;Obtain a sample picture of the time-domain waveform containing the vibration of the target device during operation;
基于图像识别算法从故障数据库中查找出与所述采样图片相匹配的故障图片;Find out the fault picture matching the sampled picture from the fault database based on the image recognition algorithm;
根据所述故障图片对应的故障描述信息确定所述目标设备的故障。The fault of the target device is determined according to the fault description information corresponding to the fault picture.
可选地,该方法还包括:Optionally, the method also includes:
当故障数据库中不存在与所述采样图片相匹配的故障图片时,根据所述采样图片中的时域波形进行分析,确定所述目标设备的故障,生成相应的故障描述信息;When there is no fault picture matching the sampling picture in the fault database, analyze according to the time-domain waveform in the sampling picture, determine the fault of the target device, and generate corresponding fault description information;
根据所述采样图片生成与确定的故障对应的故障图片,在所述故障数据库中将生成的故障图片与生成的故障描述信息对应保存。A fault picture corresponding to the determined fault is generated according to the sampled picture, and the generated fault picture is correspondingly stored with the generated fault description information in the fault database.
可选地,所述获取包含目标设备振动时的时域波形的采样图片包括:Optionally, the acquisition of the sampling picture containing the time-domain waveform when the target device vibrates includes:
根据所述目标设备的故障周期确定与所述采样图片对应的采样时间,以使所述采样图片中至少包含若干个故障周期的时域波形;所述故障周期是根据所述目标设备的参数确定的;Determine the sampling time corresponding to the sampling picture according to the failure period of the target device, so that the sampling picture contains at least time-domain waveforms of several failure periods; the failure period is determined according to the parameters of the target device of;
所述基于图像识别算法从故障数据库中查找出与所述采样图片相匹配的故障图片包括:Finding the fault picture matching the sampling picture from the fault database based on the image recognition algorithm includes:
从所述故障数据库中查找出与所述目标设备的参数对应的故障图片作为备选图片,从所述备选图片中查找出与所述采样图片相匹配的故障图片。A fault picture corresponding to the parameter of the target device is found from the fault database as a candidate picture, and a fault picture matching the sampling picture is found from the candidate picture.
可选地,所述获取包含目标设备振动的时域波形的采样图片包括:Optionally, the acquisition of the sampling picture containing the time-domain waveform of the vibration of the target device includes:
由对所述目标设备进行检测的检测设备采集目标设备振动时的时域波形,通过拍摄和/或截屏方式生成包含所述时域波形的采样图片。The detection device that detects the target device collects the time-domain waveform of the target device when it vibrates, and generates a sampling picture containing the time-domain waveform by shooting and/or screenshotting.
依据本发明的另一方面,提供了一种基于图像识别的设备故障诊断装置,包括:According to another aspect of the present invention, a device fault diagnosis device based on image recognition is provided, including:
采样图片获取单元,用于获取包含目标设备运行时振动的时域波形的采样图片;A sampling picture acquisition unit, configured to acquire a sampling picture comprising a time-domain waveform of vibration of the target device during operation;
识别单元,用于基于图像识别算法从故障数据库中查找出与所述采样图片相匹配的故障图片;An identification unit, configured to find a fault picture that matches the sampled picture from the fault database based on an image recognition algorithm;
故障诊断单元,用于根据所述故障图片对应的故障描述信息确定所述目标设备的故障。A fault diagnosis unit, configured to determine the fault of the target device according to the fault description information corresponding to the fault picture.
可选地,所述故障诊断单元,还用于当故障数据库中不存在与所述采样图片相匹配的故障图片时,根据所述采样图片中的时域波形进行分析,确定所述目标设备的故障,生成相应的故障描述信息;根据所述采样图片生成与确定的故障对应的故障图片,在所述故障数据库中将生成的故障图片与生成的故障描述信息对应保存。Optionally, the fault diagnosis unit is further configured to, when there is no fault picture matching the sampled picture in the fault database, analyze the time-domain waveform in the sampled picture to determine the fault, generating corresponding fault description information; generating a fault picture corresponding to the determined fault according to the sampled picture, and correspondingly saving the generated fault picture and the generated fault description information in the fault database.
可选地,所述采样图片获取单元,用于根据所述目标设备的故障周期确定与所述采样图片对应的采样时间,以使所述采样图片中至少包含若干个故障周期的时域波形;所述故障周期是根据所述目标设备的参数确定的;Optionally, the sampling picture acquisition unit is configured to determine the sampling time corresponding to the sampling picture according to the failure period of the target device, so that the sampling picture at least includes time-domain waveforms of several failure periods; The failure period is determined according to the parameters of the target device;
所述识别单元,用于从所述故障数据库中查找出与所述目标设备的参数对应的故障图片作为备选图片,从所述备选图片中查找出与所述采样图片相匹配的故障图片。The identification unit is configured to find out a fault picture corresponding to the parameters of the target device from the fault database as a candidate picture, and find a fault picture that matches the sampling picture from the candidate pictures .
可选地,所述采样图片获取单元,用于由对所述目标设备进行检测的检测设备采集目标设备振动时的时域波形,通过拍摄和/或截屏方式生成包含所述时域波形的采样图片。Optionally, the sampling picture acquisition unit is configured to use the detection device that detects the target device to collect the time-domain waveform of the target device when it vibrates, and generate a sample that includes the time-domain waveform by taking pictures and/or screenshots. picture.
依据本发明的又一方面,提供了一种电子设备,包括:处理器;以及被安排成存储计算机可执行指令的存储器,所述可执行指令在被执行时使所述处理器执行如上述任一所述的方法。According to yet another aspect of the present invention, there is provided an electronic device, comprising: a processor; and a memory arranged to store computer-executable instructions that, when executed, cause the processor to perform any of the above a method as described.
依据本发明的再一方面,提供了一种计算机可读存储介质,其中,所述计算机可读存储介质存储一个或多个程序,所述一个或多个程序当被处理器执行时,实现如上述任一所述的方法。According to still another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores one or more programs, and when the one or more programs are executed by a processor, the following is implemented: any of the methods described above.
由上述可知,本发明的技术方案,预先在故障数据库中保存故障描述信息和对应的故障图片,在获取到包含目标设备运行时振动的时域波形的采样图片后,基于图像识别算法从故障数据库中查找出与采样图片相匹配的故障图片,根据故障图片对应的故障描述信息确定目标设备的故障。该技术方案能够大大减少故障诊断的操作和消耗的资源,并显著提升诊断效率,节约诊断时间,同时能够保证一定的准确度,适于工业实用,应用场景广泛。As can be seen from the above, the technical solution of the present invention saves the fault description information and corresponding fault pictures in the fault database in advance, and after obtaining the sampled pictures containing the time-domain waveform of the vibration of the target equipment during operation, based on the image recognition algorithm, from the fault database Find the fault picture that matches the sampling picture, and determine the fault of the target device according to the fault description information corresponding to the fault picture. This technical solution can greatly reduce the operation and resource consumption of fault diagnosis, significantly improve diagnosis efficiency, save diagnosis time, and at the same time ensure a certain degree of accuracy. It is suitable for industrial practicality and has a wide range of application scenarios.
上述说明仅是本发明技术方案的概述,为了能够更清楚了解本发明的技术手段,而可依照说明书的内容予以实施,并且为了让本发明的上述和其它目的、特征和优点能够更明显易懂,以下特举本发明的具体实施方式。The above description is only an overview of the technical solution of the present invention. In order to better understand the technical means of the present invention, it can be implemented according to the contents of the description, and in order to make the above and other purposes, features and advantages of the present invention more obvious and understandable , the specific embodiments of the present invention are enumerated below.
附图说明Description of drawings
通过阅读下文优选实施方式的详细描述,各种其他的优点和益处对于本领域普通技术人员将变得清楚明了。附图仅用于示出优选实施方式的目的,而并不认为是对本发明的限制。而且在整个附图中,用相同的参考符号表示相同的部件。在附图中:Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiment. The drawings are only for the purpose of illustrating a preferred embodiment and are not to be considered as limiting the invention. Also throughout the drawings, the same reference numerals are used to designate the same components. In the attached picture:
图1示出了根据本发明一个实施例的一种基于图像识别的设备故障诊断方法的流程示意图;Fig. 1 shows a schematic flow chart of an image recognition-based equipment fault diagnosis method according to an embodiment of the present invention;
图2示出了根据本发明一个实施例的一种基于图像识别的设备故障诊断装置的结构示意图;Fig. 2 shows a schematic structural diagram of a device fault diagnosis device based on image recognition according to an embodiment of the present invention;
图3示出了根据本发明一个实施例的电子设备的结构示意图;FIG. 3 shows a schematic structural diagram of an electronic device according to an embodiment of the present invention;
图4示出了根据本发明一个实施例的计算机可读存储介质的结构示意图。Fig. 4 shows a schematic structural diagram of a computer-readable storage medium according to an embodiment of the present invention.
具体实施方式Detailed ways
下面将参照附图更详细地描述本公开的示例性实施例。虽然附图中显示了本公开的示例性实施例,然而应当理解,可以以各种形式实现本公开而不应被这里阐述的实施例所限制。相反,提供这些实施例是为了能够更透彻地理解本公开,并且能够将本公开的范围完整的传达给本领域的技术人员。Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.
图1示出了根据本发明一个实施例的一种基于图像识别的设备故障诊断方法的流程示意图。如图1所示,该方法包括:Fig. 1 shows a schematic flowchart of a method for diagnosing equipment faults based on image recognition according to an embodiment of the present invention. As shown in Figure 1, the method includes:
步骤S110,获取包含目标设备运行时振动的时域波形的采样图片。例如,这里的目标设备可以是机械设备,在运行时会产生振动,因此可以通过检测设备如各类传感器等采集到相应的时域波形。由于设备在发生故障时的振动不同于正常工况下的振动,因此产生的时域波形也是不同的。Step S110, acquiring a sampled picture including a time-domain waveform of vibration of the target device during operation. For example, the target device here may be a mechanical device that generates vibration during operation, so the corresponding time-domain waveform can be collected through detection devices such as various sensors. Since the vibration of the equipment when it fails is different from the vibration under normal working conditions, the generated time domain waveforms are also different.
这里需要说明的是,采样图片可以是单独采集的一幅或几幅图片,也可以是一段采样视频中的各个帧。也就是说,实际采集的可以是图片或是视频。It should be noted here that the sampled picture may be one or several pictures collected separately, or each frame in a sampled video. That is to say, what is actually collected can be a picture or a video.
步骤S120,基于图像识别算法从故障数据库中查找出与采样图片相匹配的故障图片。Step S120, based on the image recognition algorithm, find the fault picture matching the sampled picture from the fault database.
这里的图像识别算法可以利用现有技术实现,实际上是识别采样图片中的时域波形是否与故障图片中的时域波形相似,如果相似度达到一定阈值则认为是匹配的。例如,采样图片与故障数据库中的故障图片A的相似度(这里的相似度也可以是基于图像识别模型中的置信度得到的)达到95%,超过了预设的阈值90%,则认为采样图片与故障图片A匹配。这里的预设阈值是可以根据需求进行设定的,并且可以与设备的参数相关,例如针对大轴承设定85%的阈值,针对小轴承设定95%的阈值。The image recognition algorithm here can be implemented using existing technologies. In fact, it is to identify whether the time-domain waveform in the sampled picture is similar to the time-domain waveform in the fault picture. If the similarity reaches a certain threshold, it is considered a match. For example, if the similarity between the sampled picture and the fault picture A in the fault database (the similarity here can also be obtained based on the confidence in the image recognition model) reaches 95%, exceeding the preset threshold of 90%, then the sampling The picture matches the fault picture A. The preset threshold here can be set according to requirements, and can be related to the parameters of the equipment, for example, a threshold of 85% is set for a large bearing, and a threshold of 95% is set for a small bearing.
步骤S130,根据故障图片对应的故障描述信息确定目标设备的故障。Step S130, determine the fault of the target device according to the fault description information corresponding to the fault picture.
一个故障图片可以对应一个故障,即目标设备可能是轴承的滚动体损坏;也可以对应于多个故障,即相对应的时域波形是目标设备在同时发生了多处故障时振动所产生的,例如不仅是滚动体损坏,内环或外环也可能损坏。在故障数据库中可以保存有与各类故障对应的故障图片,并附有相应的故障描述信息,使得在匹配到相应的故障图片后,可以根据故障描述信息直接确定故障的类型。A fault picture can correspond to one fault, that is, the target equipment may be damaged rolling elements of the bearing; it can also correspond to multiple faults, that is, the corresponding time domain waveform is generated by the vibration of the target equipment when multiple faults occur at the same time, For example, not only the rolling elements are damaged, but also the inner or outer ring. The fault pictures corresponding to various faults can be stored in the fault database, and the corresponding fault description information is attached, so that after matching the corresponding fault pictures, the fault type can be directly determined according to the fault description information.
可见,图1所示的方法,通过预先在故障数据库中保存故障描述信息和对应的故障图片,在获取到包含目标设备运行时振动的时域波形的采样图片后,基于图像识别算法从故障数据库中查找出与采样图片相匹配的故障图片,根据故障图片对应的故障描述信息确定目标设备的故障。该技术方案能够大大减少故障诊断的操作和消耗的资源,并显著提升诊断效率,节约诊断时间,同时能够保证一定的准确度,适于工业实用,应用场景广泛。It can be seen that the method shown in Figure 1 saves the fault description information and the corresponding fault pictures in the fault database in advance, after obtaining the sampled pictures containing the time-domain waveform of the vibration of the target equipment during operation, based on the image recognition algorithm, from the fault database Find the fault picture that matches the sampling picture, and determine the fault of the target device according to the fault description information corresponding to the fault picture. This technical solution can greatly reduce the operation and resource consumption of fault diagnosis, significantly improve diagnosis efficiency, save diagnosis time, and at the same time ensure a certain degree of accuracy. It is suitable for industrial practicality and has a wide range of application scenarios.
在本发明的一个实施例中,上述方法还包括:当故障数据库中不存在与采样图片相匹配的故障图片时,根据采样图片中的时域波形进行分析,确定目标设备的故障,生成相应的故障描述信息;根据采样图片生成与确定的故障对应的故障图片,在故障数据库中将生成的故障图片与生成的故障描述信息对应保存。In one embodiment of the present invention, the above method further includes: when there is no fault picture matching the sampled picture in the fault database, analyze according to the time domain waveform in the sampled picture, determine the fault of the target device, and generate a corresponding Fault description information: Generate a fault picture corresponding to the determined fault according to the sampled picture, and store the generated fault picture and the generated fault description information in the fault database correspondingly.
一般而言,需要进行故障诊断的设备是确实存在一定故障的,但是也可能存在操作人员误判断的情况。因此采用图片中的时域波形可能实际对应于某种或某几种故障,也可能对应于正常工况。在正常工况的情况下,显然是不会从故障数据库中查找出相匹配的故障图片的;另外,也可能存在的情况是,设备的故障并没有被收录在故障数据库中。因此当数据库中不存在与采样图片相匹配的故障图片时,需要采用将时域波形转换为频域波形、经过傅里叶变换等一系列方式进行故障分析,具体可以采用现有技术中的方式实现;分析得到的结果可能是目标设备没有故障,此时可以不进行其他的后续处理;另一种结果可能是目标设备确实存在故障,而且这个故障没有被收录在故障数据库中。这时我们需要生成与这个新故障对应的故障图片,例如直接将采样图片作为故障图片;也可以是由于采样图片中包含的时域波形包含的故障周期过多,仅选取与一个故障周期对应的时域波形生成故障图片。Generally speaking, the equipment that requires fault diagnosis does have certain faults, but there may also be cases where operators misjudge. Therefore, the time-domain waveforms in the picture may actually correspond to one or several kinds of faults, or may correspond to normal working conditions. Under normal working conditions, it is obviously impossible to find a matching fault picture from the fault database; in addition, there may also be situations where the fault of the equipment has not been included in the fault database. Therefore, when there is no fault picture matching the sampling picture in the database, it is necessary to use a series of methods such as converting the time-domain waveform into a frequency-domain waveform and undergoing Fourier transform for fault analysis. Specifically, the methods in the prior art can be used Realization; the result of the analysis may be that the target device is not faulty, and other follow-up processing may not be performed at this time; another result may be that the target device does have a fault, and this fault is not included in the fault database. At this time, we need to generate a fault picture corresponding to this new fault, for example, directly use the sampling picture as the fault picture; it may also be because the time domain waveform contained in the sampling picture contains too many fault cycles, and only select the one corresponding to one fault cycle The time-domain waveform generates a picture of the fault.
这样,就实现了故障数据库的不断完善,能够迭代更新,满足实际需求。In this way, the continuous improvement of the fault database is realized, which can be iteratively updated to meet actual needs.
在本发明的一个实施例中,上述方法中,获取包含目标设备振动时的时域波形的采样图片包括:根据目标设备的故障周期确定与采样图片对应的采样时间,以使采样图片中至少包含若干个故障周期的时域波形;故障周期是根据目标设备的参数确定的;基于图像识别算法从故障数据库中查找出与采样图片相匹配的故障图片包括:从故障数据库中查找出与目标设备的参数对应的故障图片作为备选图片,从备选图片中查找出与采样图片相匹配的故障图片。In an embodiment of the present invention, in the above method, obtaining the sampled picture containing the time-domain waveform when the target device vibrates includes: determining the sampling time corresponding to the sampled picture according to the fault period of the target device, so that the sampled picture contains at least The time-domain waveforms of several fault cycles; the fault cycle is determined according to the parameters of the target equipment; based on the image recognition algorithm, finding the fault pictures that match the sampling pictures from the fault database includes: finding the fault pictures that match the target equipment from the fault database The fault picture corresponding to the parameter is used as a candidate picture, and the fault picture matching the sampling picture is found from the candidate picture.
其中,目标设备的参数可以包括设备型号、转速等等。为了保证图像识别的准确性,一般需要采集的时域波形至少包含一个故障周期,可选地也可以包含多个故障周期。而在故障数据库中的故障图片可以是至少包含一个故障周期的,这样如果采样图片中的时域波形的至少一部分与一张故障图片中的时域波形相似,则二者就视为匹配。Wherein, the parameters of the target device may include device model, rotation speed and so on. In order to ensure the accuracy of image recognition, it is generally required that the collected time-domain waveforms contain at least one fault cycle, and may optionally contain multiple fault cycles. The fault pictures in the fault database may contain at least one fault cycle, so if at least a part of the time-domain waveform in the sampled picture is similar to the time-domain waveform in a fault picture, the two are considered to match.
由于不同设备的参数可能不同,因此故障时采集到的时域波形也不同,将不同设备的时域波形进行比较是意义不大的,因此在本实施例中还先根据目标设备的参数选取出与参数对应的故障图片,减小了匹配的范围,提高了图像识别的准确度,减少了误匹配率。Since the parameters of different devices may be different, the time-domain waveforms collected during the failure are also different. It is meaningless to compare the time-domain waveforms of different devices. Therefore, in this embodiment, the parameters of the target device are selected first. The fault picture corresponding to the parameters reduces the matching range, improves the accuracy of image recognition, and reduces the false matching rate.
在本发明的一个实施例中,上述方法中,获取包含目标设备振动的时域波形的采样图片包括:由对目标设备进行检测的检测设备采集目标设备振动时的时域波形,通过拍摄和/或截屏方式生成包含时域波形的采样图片。In an embodiment of the present invention, in the above method, acquiring the sampled picture containing the time-domain waveform of the vibration of the target device includes: collecting the time-domain waveform of the vibration of the target device by the detection device that detects the target device, by photographing and/or Or generate a sample picture including a time domain waveform by taking a screenshot.
有的时候我们检测设备并没有提供较好的数据处理接口,不能够直接获取到时域波形生成图片,但是这些检测设备可以在显示屏上输出时域波形,因此本实施例中,可以采用对输出时域波形的显示设备进行拍摄或是截屏,不通过接口的方式获取到时域波形。可以看出,本发明实施例虽然本质上是识别时域波形是否相似,但是并非是通过直接识别时域波形而实现的,而是通过识别图片是否相似来实现的。Sometimes our detection equipment does not provide a good data processing interface, and cannot directly obtain time-domain waveforms to generate pictures, but these detection equipment can output time-domain waveforms on the display screen, so in this embodiment, we can use the The display device that outputs the time-domain waveform takes pictures or screenshots, and the time-domain waveform is not obtained through the interface. It can be seen that although the embodiment of the present invention essentially identifies whether the time-domain waveforms are similar, it is not realized by directly identifying the time-domain waveforms, but by identifying whether the pictures are similar.
图2示出了根据本发明一个实施例的一种基于图像识别的设备故障诊断装置的结构示意图。如图2所示,基于图像识别的设备故障诊断装置200包括:Fig. 2 shows a schematic structural diagram of an apparatus for fault diagnosis of equipment based on image recognition according to an embodiment of the present invention. As shown in Figure 2, the device fault diagnosis device 200 based on image recognition includes:
采样图片获取单元210,用于获取包含目标设备运行时振动的时域波形的采样图片。例如,这里的目标设备可以是机械设备,在运行时会产生振动,因此可以通过检测设备如各类传感器等采集到相应的时域波形。由于设备在发生故障时的振动不同于正常工况下的振动,因此产生的时域波形也是不同的。The sampling picture acquiring unit 210 is configured to acquire a sampling picture including a time-domain waveform of vibration of the target device during operation. For example, the target device here may be a mechanical device that generates vibration during operation, so the corresponding time-domain waveform can be collected through detection devices such as various sensors. Since the vibration of the equipment when it fails is different from the vibration under normal working conditions, the generated time domain waveforms are also different.
这里需要说明的是,采样图片可以是单独采集的一幅或几幅图片,也可以是一段采样视频中的各个帧。也就是说,实际采集的可以是图片或是视频。It should be noted here that the sampled picture may be one or several pictures collected separately, or each frame in a sampled video. That is to say, what is actually collected can be a picture or a video.
识别单元220,用于基于图像识别算法从故障数据库中查找出与采样图片相匹配的故障图片。The recognition unit 220 is configured to find fault pictures that match the sampled pictures from the fault database based on an image recognition algorithm.
这里的图像识别算法可以利用现有技术实现,实际上是识别采样图片中的时域波形是否与故障图片中的时域波形相似,如果相似度(这里的相似度也可以是基于图像识别模型中的置信度得到的)达到一定阈值则认为是匹配的。例如,采样图片与故障数据库中的故障图片A的相似度达到95%,超过了预设的阈值90%,则认为采样图片与故障图片A匹配。这里的预设阈值是可以根据需求进行设定的,并且可以与设备的参数相关,例如针对大轴承设定85%的阈值,针对小轴承设定95%的阈值。The image recognition algorithm here can be implemented using existing technologies. In fact, it is to identify whether the time-domain waveform in the sampling picture is similar to the time-domain waveform in the fault picture. If the similarity (the similarity here can also be based on the image recognition model) The confidence obtained) reaches a certain threshold and is considered a match. For example, if the similarity between the sampled picture and the faulty picture A in the fault database reaches 95%, and exceeds the preset threshold of 90%, then the sampled picture is considered to match the faulty picture A. The preset threshold here can be set according to requirements, and can be related to the parameters of the equipment, for example, a threshold of 85% is set for a large bearing, and a threshold of 95% is set for a small bearing.
故障诊断单元230,用于根据故障图片对应的故障描述信息确定目标设备的故障。The fault diagnosis unit 230 is configured to determine the fault of the target device according to the fault description information corresponding to the fault picture.
一个故障图片可以对应一个故障,即目标设备可能是轴承的滚动体损坏;也可以对应于多个故障,即相对应的时域波形是目标设备在同时发生了多处故障时振动所产生的,例如不仅是滚动体损坏,内环或外环也可能损坏。在故障数据库中可以保存有与各类故障对应的故障图片,并附有相应的故障描述信息,使得在匹配到相应的故障图片后,可以根据故障描述信息直接确定故障的类型。A fault picture can correspond to one fault, that is, the target equipment may be damaged rolling elements of the bearing; it can also correspond to multiple faults, that is, the corresponding time domain waveform is generated by the vibration of the target equipment when multiple faults occur at the same time, For example, not only the rolling elements are damaged, but also the inner or outer ring. The fault pictures corresponding to various faults can be stored in the fault database, and the corresponding fault description information is attached, so that after matching the corresponding fault pictures, the fault type can be directly determined according to the fault description information.
可见,图2所示的装置,通过各单元的相互配合,预先在故障数据库中保存故障描述信息和对应的故障图片,在获取到包含目标设备运行时振动的时域波形的采样图片后,基于图像识别算法从故障数据库中查找出与采样图片相匹配的故障图片,根据故障图片对应的故障描述信息确定目标设备的故障。该技术方案能够大大减少故障诊断的操作和消耗的资源,并显著提升诊断效率,节约诊断时间,同时能够保证一定的准确度,适于工业实用,应用场景广泛。It can be seen that the device shown in Figure 2 saves the fault description information and corresponding fault pictures in the fault database in advance through the mutual cooperation of each unit. The image recognition algorithm finds the fault pictures that match the sampling pictures from the fault database, and determines the fault of the target device according to the fault description information corresponding to the fault pictures. This technical solution can greatly reduce the operation and resource consumption of fault diagnosis, significantly improve diagnosis efficiency, save diagnosis time, and at the same time ensure a certain degree of accuracy. It is suitable for industrial practicality and has a wide range of application scenarios.
在本发明的一个实施例中,上述装置中,故障诊断单元230,还用于当故障数据库中不存在与采样图片相匹配的故障图片时,根据采样图片中的时域波形进行分析,确定目标设备的故障,生成相应的故障描述信息;根据采样图片生成与确定的故障对应的故障图片,在故障数据库中将生成的故障图片与生成的故障描述信息对应保存。In one embodiment of the present invention, in the above-mentioned device, the fault diagnosis unit 230 is also used to analyze the time-domain waveform in the sampled picture and determine the target when there is no fault picture matching the sampled picture in the fault database. For equipment faults, generate corresponding fault description information; generate fault pictures corresponding to the determined faults according to the sampled pictures, and store the generated fault pictures and the generated fault description information in the fault database correspondingly.
一般而言,需要进行故障诊断的设备是确实存在一定故障的,但是也可能存在操作人员误判断的情况。因此采用图片中的时域波形可能实际对应于某种或某几种故障,也可能对应于正常工况。在正常工况的情况下,显然是不会从故障数据库中查找出相匹配的故障图片的;另外,也可能存在的情况是,设备的故障并没有被收录在故障数据库中。因此当数据库中不存在与采样图片相匹配的故障图片时,需要采用将时域波形转换为频域波形、经过傅里叶变换等一系列方式进行故障分析,具体可以采用现有技术中的方式实现;分析得到的结果可能是目标设备没有故障,此时可以不进行其他的后续处理;另一种结果可能是目标设备确实存在故障,而且这个故障没有被收录在故障数据库中。这时我们需要生成与这个新故障对应的故障图片,例如直接将采样图片作为故障图片;也可以是由于采样图片中包含的时域波形包含的故障周期过多,仅选取与一个故障周期对应的时域波形生成故障图片。Generally speaking, the equipment that requires fault diagnosis does have certain faults, but there may also be cases where operators misjudge. Therefore, the time-domain waveforms in the picture may actually correspond to one or several kinds of faults, or may correspond to normal working conditions. Under normal working conditions, it is obviously impossible to find a matching fault picture from the fault database; in addition, there may also be situations where the fault of the equipment has not been included in the fault database. Therefore, when there is no fault picture matching the sampling picture in the database, it is necessary to use a series of methods such as converting the time-domain waveform into a frequency-domain waveform and undergoing Fourier transform for fault analysis. Specifically, the methods in the prior art can be used Realization; the result of the analysis may be that the target device is not faulty, and other follow-up processing may not be performed at this time; another result may be that the target device does have a fault, and this fault is not included in the fault database. At this time, we need to generate a fault picture corresponding to this new fault, for example, directly use the sampling picture as the fault picture; it may also be because the time domain waveform contained in the sampling picture contains too many fault cycles, and only select the one corresponding to one fault cycle The time-domain waveform generates a picture of the fault.
这样,就实现了故障数据库的不断完善,能够迭代更新,满足实际需求。In this way, the continuous improvement of the fault database is realized, which can be iteratively updated to meet actual needs.
在本发明的一个实施例中,上述装置中,采样图片获取单元210,用于根据目标设备的故障周期确定与采样图片对应的采样时间,以使采样图片中至少包含若干个故障周期的时域波形;故障周期是根据目标设备的参数确定的;识别单元220,用于从故障数据库中查找出与目标设备的参数对应的故障图片作为备选图片,从备选图片中查找出与采样图片相匹配的故障图片。In one embodiment of the present invention, in the above-mentioned device, the sampling picture acquisition unit 210 is configured to determine the sampling time corresponding to the sampling picture according to the failure period of the target device, so that the sampling picture at least includes the time domain of several failure periods Waveform; the fault period is determined according to the parameters of the target device; the identification unit 220 is used to find out the fault picture corresponding to the parameter of the target device from the fault database as an alternative picture, and find out the fault picture corresponding to the sampling picture from the alternative picture. Matching fault pictures.
其中,目标设备的参数可以包括设备型号、转速等等。为了保证图像识别的准确性,一般需要采集的时域波形至少包含一个故障周期,可选地也可以包含多个故障周期。而在故障数据库中的故障图片可以是至少包含一个故障周期的,这样如果采样图片中的时域波形的至少一部分与一张故障图片中的时域波形相似,则二者就视为匹配。Wherein, the parameters of the target device may include device model, rotation speed and so on. In order to ensure the accuracy of image recognition, it is generally required that the collected time-domain waveforms contain at least one fault cycle, and may optionally contain multiple fault cycles. The fault pictures in the fault database may contain at least one fault cycle, so if at least a part of the time-domain waveform in the sampled picture is similar to the time-domain waveform in a fault picture, the two are considered to match.
由于不同设备的参数可能不同,因此故障时采集到的时域波形也不同,将不同设备的时域波形进行比较是意义不大的,因此在本实施例中还先根据目标设备的参数选取出与参数对应的故障图片,减小了匹配的范围,提高了图像识别的准确度,减少了误匹配率。Since the parameters of different devices may be different, the time-domain waveforms collected during the failure are also different. It is meaningless to compare the time-domain waveforms of different devices. Therefore, in this embodiment, the parameters of the target device are selected first. The fault picture corresponding to the parameters reduces the matching range, improves the accuracy of image recognition, and reduces the false matching rate.
在本发明的一个实施例中,上述装置中,采样图片获取单元210,用于由对目标设备进行检测的检测设备采集目标设备振动时的时域波形,通过拍摄和/或截屏方式生成包含时域波形的采样图片。In one embodiment of the present invention, in the above-mentioned device, the sampling picture acquisition unit 210 is used to collect the time-domain waveform of the target device by the detection device that detects the target device, and generate the A sample picture of the domain waveform.
有的时候我们检测设备并没有提供较好的数据处理接口,不能够直接获取到时域波形生成图片,但是这些检测设备可以在显示屏上输出时域波形,因此本实施例中,可以采用对输出时域波形的显示设备进行拍摄或是截屏,不通过接口的方式获取到时域波形。可以看出,本发明实施例虽然本质上是识别时域波形是否相似,但是并非是通过直接识别时域波形而实现的,而是通过识别图片是否相似来实现的。Sometimes our detection equipment does not provide a good data processing interface, and cannot directly obtain time-domain waveforms to generate pictures, but these detection equipment can output time-domain waveforms on the display screen, so in this embodiment, we can use the The display device that outputs the time-domain waveform takes pictures or screenshots, and the time-domain waveform is not obtained through the interface. It can be seen that although the embodiment of the present invention essentially identifies whether the time-domain waveforms are similar, it is not realized by directly identifying the time-domain waveforms, but by identifying whether the pictures are similar.
综上所述,本发明的技术方案,通过预先在故障数据库中保存故障描述信息和对应的故障图片,在获取到包含目标设备运行时振动的时域波形的采样图片后,基于图像识别算法从故障数据库中查找出与采样图片相匹配的故障图片,根据故障图片对应的故障描述信息确定目标设备的故障。该技术方案能够大大减少故障诊断的操作和消耗的资源,并显著提升诊断效率,节约诊断时间,同时能够保证一定的准确度,适于工业实用,应用场景广泛。In summary, the technical solution of the present invention saves the fault description information and the corresponding fault pictures in the fault database in advance, after obtaining the sampled pictures containing the time-domain waveform of the vibration of the target device during operation, based on the image recognition algorithm, from The fault picture matching the sampling picture is found in the fault database, and the fault of the target device is determined according to the fault description information corresponding to the fault picture. This technical solution can greatly reduce the operation and resource consumption of fault diagnosis, significantly improve diagnosis efficiency, save diagnosis time, and at the same time ensure a certain degree of accuracy. It is suitable for industrial practicality and has a wide range of application scenarios.
需要说明的是:It should be noted:
在此提供的算法和显示不与任何特定计算机、虚拟装置或者其它设备固有相关。各种通用装置也可以与基于在此的示教一起使用。根据上面的描述,构造这类装置所要求的结构是显而易见的。此外,本发明也不针对任何特定编程语言。应当明白,可以利用各种编程语言实现在此描述的本发明的内容,并且上面对特定语言所做的描述是为了披露本发明的最佳实施方式。The algorithms and displays presented herein are not inherently related to any particular computer, virtual appliance, or other device. Various general purpose devices can also be used with the teachings based on this. The structure required to construct such an apparatus will be apparent from the foregoing description. Furthermore, the present invention is not specific to any particular programming language. It should be understood that various programming languages can be used to implement the content of the present invention described herein, and the above description of specific languages is for disclosing the best mode of the present invention.
在此处所提供的说明书中,说明了大量具体细节。然而,能够理解,本发明的实施例可以在没有这些具体细节的情况下实践。在一些实例中,并未详细示出公知的方法、结构和技术,以便不模糊对本说明书的理解。In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure the understanding of this description.
类似地,应当理解,为了精简本公开并帮助理解各个发明方面中的一个或多个,在上面对本发明的示例性实施例的描述中,本发明的各个特征有时被一起分组到单个实施例、图、或者对其的描述中。然而,并不应将该公开的方法解释成反映如下意图:即所要求保护的本发明要求比在每个权利要求中所明确记载的特征更多的特征。更确切地说,如下面的权利要求书所反映的那样,发明方面在于少于前面公开的单个实施例的所有特征。因此,遵循具体实施方式的权利要求书由此明确地并入该具体实施方式,其中每个权利要求本身都作为本发明的单独实施例。Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, in order to streamline this disclosure and to facilitate an understanding of one or more of the various inventive aspects, various features of the invention are sometimes grouped together in a single embodiment, figure, or its description. This method of disclosure, however, is not to be interpreted as reflecting an intention that the claimed invention requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the Detailed Description are hereby expressly incorporated into this Detailed Description, with each claim standing on its own as a separate embodiment of this invention.
本领域那些技术人员可以理解,可以对实施例中的设备中的模块进行自适应性地改变并且把它们设置在与该实施例不同的一个或多个设备中。可以把实施例中的模块或单元或组件组合成一个模块或单元或组件,以及此外可以把它们分成多个子模块或子单元或子组件。除了这样的特征和/或过程或者单元中的至少一些是相互排斥之外,可以采用任何组合对本说明书(包括伴随的权利要求、摘要和附图)中公开的所有特征以及如此公开的任何方法或者设备的所有过程或单元进行组合。除非另外明确陈述,本说明书(包括伴随的权利要求、摘要和附图)中公开的每个特征可以由提供相同、等同或相似目的的替代特征来代替。Those skilled in the art can understand that the modules in the device in the embodiment can be adaptively changed and arranged in one or more devices different from the embodiment. Modules or units or components in the embodiments may be combined into one module or unit or component, and furthermore may be divided into a plurality of sub-modules or sub-units or sub-assemblies. All features disclosed in this specification (including accompanying claims, abstract and drawings) and any method or method so disclosed may be used in any combination, except that at least some of such features and/or processes or units are mutually exclusive. All processes or units of equipment are combined. Each feature disclosed in this specification (including accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
此外,本领域的技术人员能够理解,尽管在此所述的一些实施例包括其它实施例中所包括的某些特征而不是其它特征,但是不同实施例的特征的组合意味着处于本发明的范围之内并且形成不同的实施例。例如,在下面的权利要求书中,所要求保护的实施例的任意之一都可以以任意的组合方式来使用。Furthermore, those skilled in the art will understand that although some embodiments described herein include some features included in other embodiments but not others, combinations of features from different embodiments are meant to be within the scope of the invention. and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.
本发明的各个部件实施例可以以硬件实现,或者以在一个或者多个处理器上运行的软件模块实现,或者以它们的组合实现。本领域的技术人员应当理解,可以在实践中使用微处理器或者数字信号处理器(DSP)来实现根据本发明实施例的基于图像识别的设备故障诊断装置中的一些或者全部部件的一些或者全部功能。本发明还可以实现为用于执行这里所描述的方法的一部分或者全部的设备或者装置程序(例如,计算机程序和计算机程序产品)。这样的实现本发明的程序可以存储在计算机可读介质上,或者可以具有一个或者多个信号的形式。这样的信号可以从因特网网站上下载得到,或者在载体信号上提供,或者以任何其他形式提供。The various component embodiments of the present invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art should understand that a microprocessor or a digital signal processor (DSP) can be used in practice to implement some or all of some or all of the components in the device fault diagnosis device based on image recognition according to the embodiment of the present invention Function. The present invention can also be implemented as an apparatus or an apparatus program (for example, a computer program and a computer program product) for performing a part or all of the methods described herein. Such a program for realizing the present invention may be stored on a computer-readable medium, or may be in the form of one or more signals. Such a signal may be downloaded from an Internet site, or provided on a carrier signal, or provided in any other form.
例如,图3示出了根据本发明一个实施例的电子设备的结构示意图。该电子设备包括处理器310和被安排成存储计算机可执行指令(计算机可读程序代码)的存储器320。存储器320可以是诸如闪存、EEPROM(电可擦除可编程只读存储器)、EPROM、硬盘或者ROM之类的电子存储器。存储器320具有存储用于执行上述方法中的任何方法步骤的计算机可读程序代码331的存储空间330。例如,用于存储计算机可读程序代码的存储空间330可以包括分别用于实现上面的方法中的各种步骤的各个计算机可读程序代码331。计算机可读程序代码331可以从一个或者多个计算机程序产品中读出或者写入到这一个或者多个计算机程序产品中。这些计算机程序产品包括诸如硬盘,紧致盘(CD)、存储卡或者软盘之类的程序代码载体。这样的计算机程序产品通常为例如图4所述的计算机可读存储介质。图4示出了根据本发明一个实施例的一种计算机可读存储介质的结构示意图。该计算机可读存储介质400存储有用于执行根据本发明的方法步骤的计算机可读程序代码331,可以被电子设备300的处理器310读取,当计算机可读程序代码331由电子设备300运行时,导致该电子设备300执行上面所描述的方法中的各个步骤,具体来说,该计算机可读存储介质存储的计算机可读程序代码331可以执行上述任一实施例中示出的方法。计算机可读程序代码331可以以适当形式进行压缩。For example, FIG. 3 shows a schematic structural diagram of an electronic device according to an embodiment of the present invention. The electronic device comprises a processor 310 and a memory 320 arranged to store computer executable instructions (computer readable program code). Memory 320 may be electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read Only Memory), EPROM, hard disk, or ROM. The memory 320 has a storage space 330 storing computer readable program code 331 for performing any method step in the method described above. For example, the storage space 330 for storing computer-readable program codes may include respective computer-readable program codes 331 for respectively implementing various steps in the above methods. The computer readable program code 331 can be read from or written into one or more computer program products. These computer program products comprise program code carriers such as hard disks, compact disks (CDs), memory cards or floppy disks. Such a computer program product is typically, for example, a computer-readable storage medium as described in FIG. 4 . Fig. 4 shows a schematic structural diagram of a computer-readable storage medium according to an embodiment of the present invention. The computer-readable storage medium 400 stores computer-readable program code 331 for executing the method steps according to the present invention, which can be read by the processor 310 of the electronic device 300, when the computer-readable program code 331 is run by the electronic device 300 , causing the electronic device 300 to execute each step in the method described above, specifically, the computer-readable program code 331 stored in the computer-readable storage medium may execute the method shown in any of the foregoing embodiments. The computer readable program code 331 can be compressed in a suitable form.
应该注意的是上述实施例对本发明进行说明而不是对本发明进行限制,并且本领域技术人员在不脱离所附权利要求的范围的情况下可设计出替换实施例。在权利要求中,不应将位于括号之间的任何参考符号构造成对权利要求的限制。单词“包含”不排除存在未列在权利要求中的元件或步骤。位于元件之前的单词“一”或“一个”不排除存在多个这样的元件。本发明可以借助于包括有若干不同元件的硬件以及借助于适当编程的计算机来实现。在列举了若干装置的单元权利要求中,这些装置中的若干个可以是通过同一个硬件项来具体体现。单词第一、第二、以及第三等的使用不表示任何顺序。可将这些单词解释为名称。It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means can be embodied by one and the same item of hardware. The use of the words first, second, and third, etc. does not indicate any order. These words can be interpreted as names.
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810804705.7A CN108830261B (en) | 2018-07-20 | 2018-07-20 | Equipment fault diagnosis method and device based on image recognition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810804705.7A CN108830261B (en) | 2018-07-20 | 2018-07-20 | Equipment fault diagnosis method and device based on image recognition |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108830261A true CN108830261A (en) | 2018-11-16 |
| CN108830261B CN108830261B (en) | 2021-11-30 |
Family
ID=64141188
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810804705.7A Active CN108830261B (en) | 2018-07-20 | 2018-07-20 | Equipment fault diagnosis method and device based on image recognition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108830261B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109584232A (en) * | 2018-11-28 | 2019-04-05 | 成都天衡智造科技有限公司 | Equipment use state online monitoring method, system and terminal based on image recognition |
| CN110443316A (en) * | 2019-08-07 | 2019-11-12 | 上海金智晟东电力科技有限公司 | Board turning recognition methods, device and the distribution network failure of fault detector monitor system |
| CN111160420A (en) * | 2019-12-13 | 2020-05-15 | 北京三快在线科技有限公司 | Map-based fault diagnosis method and device, electronic equipment and storage medium |
| CN111324637A (en) * | 2020-02-05 | 2020-06-23 | 北京工业大数据创新中心有限公司 | Fault symptom searching method and system for industrial time sequence data |
| CN114638973A (en) * | 2022-03-30 | 2022-06-17 | 苏州科达科技股份有限公司 | Target image detection method and image detection model training method |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102902958A (en) * | 2012-09-19 | 2013-01-30 | 四川大学 | Digital nuclear signal processing and multi-parameter nuclear information acquisition method based on image recognition |
| CN103018330A (en) * | 2011-09-22 | 2013-04-03 | 北京理工大学 | Full time domain waveform acquisition and analysis technique applied to ultrasonic microscope |
| CN104634592A (en) * | 2014-12-18 | 2015-05-20 | 成都铁安科技有限责任公司 | Train running gear fault diagnosis method and train running gear fault diagnosis device |
| CN106168539A (en) * | 2016-10-21 | 2016-11-30 | 常州信息职业技术学院 | Fault Diagnosis of Roller Bearings based on convolutional neural networks and system |
| US20180172675A1 (en) * | 2016-10-12 | 2018-06-21 | Viasphere, Llc | Compositions and methods for disease diagnosis using single cell analysis |
| CN108256556A (en) * | 2017-12-22 | 2018-07-06 | 上海电机学院 | Wind-driven generator group wheel box method for diagnosing faults based on depth belief network |
-
2018
- 2018-07-20 CN CN201810804705.7A patent/CN108830261B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103018330A (en) * | 2011-09-22 | 2013-04-03 | 北京理工大学 | Full time domain waveform acquisition and analysis technique applied to ultrasonic microscope |
| CN102902958A (en) * | 2012-09-19 | 2013-01-30 | 四川大学 | Digital nuclear signal processing and multi-parameter nuclear information acquisition method based on image recognition |
| CN104634592A (en) * | 2014-12-18 | 2015-05-20 | 成都铁安科技有限责任公司 | Train running gear fault diagnosis method and train running gear fault diagnosis device |
| US20180172675A1 (en) * | 2016-10-12 | 2018-06-21 | Viasphere, Llc | Compositions and methods for disease diagnosis using single cell analysis |
| CN106168539A (en) * | 2016-10-21 | 2016-11-30 | 常州信息职业技术学院 | Fault Diagnosis of Roller Bearings based on convolutional neural networks and system |
| CN108256556A (en) * | 2017-12-22 | 2018-07-06 | 上海电机学院 | Wind-driven generator group wheel box method for diagnosing faults based on depth belief network |
Non-Patent Citations (1)
| Title |
|---|
| 张铧予 等.: "日本艾普斯龙火箭的发射场测发控技术分析", 《中国航天》 * |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109584232A (en) * | 2018-11-28 | 2019-04-05 | 成都天衡智造科技有限公司 | Equipment use state online monitoring method, system and terminal based on image recognition |
| CN113034431A (en) * | 2018-11-28 | 2021-06-25 | 成都天衡智造科技有限公司 | Equipment use state online monitoring method, system, storage medium and terminal |
| CN113034431B (en) * | 2018-11-28 | 2022-06-17 | 成都天衡智造科技有限公司 | Equipment use state online monitoring method, system, storage medium and terminal |
| CN110443316A (en) * | 2019-08-07 | 2019-11-12 | 上海金智晟东电力科技有限公司 | Board turning recognition methods, device and the distribution network failure of fault detector monitor system |
| CN111160420A (en) * | 2019-12-13 | 2020-05-15 | 北京三快在线科技有限公司 | Map-based fault diagnosis method and device, electronic equipment and storage medium |
| CN111160420B (en) * | 2019-12-13 | 2023-10-10 | 北京三快在线科技有限公司 | Map-based fault diagnosis method, map-based fault diagnosis device, electronic equipment and storage medium |
| CN111324637A (en) * | 2020-02-05 | 2020-06-23 | 北京工业大数据创新中心有限公司 | Fault symptom searching method and system for industrial time sequence data |
| CN114638973A (en) * | 2022-03-30 | 2022-06-17 | 苏州科达科技股份有限公司 | Target image detection method and image detection model training method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108830261B (en) | 2021-11-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108830261A (en) | Equipment fault diagnosis method and device based on image recognition | |
| CN113743607B (en) | Training method of anomaly detection model, anomaly detection method and device | |
| JP6751806B2 (en) | Entity recognition that uses multiple data streams to supplement missing information related to an entity | |
| WO2021027213A1 (en) | Detection method and apparatus, electronic device and computer-readable medium | |
| WO2018086513A1 (en) | Target detection method and device | |
| CN108063698A (en) | Unit exception detection method and device, program product and storage medium | |
| WO2017107843A1 (en) | Periodic task processing method and apparatus, computer program, and readable medium | |
| CN110987404B (en) | Rotating speed identification method and computing equipment | |
| CN109168052B (en) | Method and device for determining service satisfaction degree and computing equipment | |
| CN105630566A (en) | Application page loading duration determining method and application page loading duration determining device | |
| JP2015197436A (en) | Method for detecting events in a signal subject to periodic stationary background noise | |
| CN106803083A (en) | The method and device of pedestrian detection | |
| CN110245074B (en) | Log record generation method and device, storage medium and server | |
| CN108378835A (en) | Blood pressure prediction technique and device | |
| CN109711545A (en) | Creation method, device, system and the computer-readable medium of network model | |
| CN109960648A (en) | Application testing method and device | |
| CN111290905A (en) | Test method and device for IoT cloud platform | |
| CN111358460A (en) | Arrhythmia identification method and device and electronic equipment | |
| CN108052927B (en) | Video data-based gesture processing method and device, and computing device | |
| JP2020187412A (en) | Information processing device and information processing method | |
| Verma et al. | Android app for intelligent CBM | |
| US20240168855A1 (en) | Machine learning pipeline automation | |
| US11798675B2 (en) | Generating and searching data structures that facilitate measurement-informed treatment recommendation | |
| CN110985425A (en) | Information detection method, electronic equipment and computer readable storage medium | |
| CN109710521A (en) | Multimedia application performance test methods, device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: Equipment fault diagnosis method and device based on image recognition Granted publication date: 20211130 Pledgee: Zhongguancun Branch of Bank of Beijing Co.,Ltd. Pledgor: BEIJING HAN ENERGY TECHNOLOGY CO.,LTD. Registration number: Y2024980046966 |
|
| PE01 | Entry into force of the registration of the contract for pledge of patent right |