[go: up one dir, main page]

CN117912023A - A method and terminal for automatically identifying electrical drawings of a hydropower plant - Google Patents

A method and terminal for automatically identifying electrical drawings of a hydropower plant Download PDF

Info

Publication number
CN117912023A
CN117912023A CN202311785158.XA CN202311785158A CN117912023A CN 117912023 A CN117912023 A CN 117912023A CN 202311785158 A CN202311785158 A CN 202311785158A CN 117912023 A CN117912023 A CN 117912023A
Authority
CN
China
Prior art keywords
electrical
hydropower plant
model
recognition
drawings
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311785158.XA
Other languages
Chinese (zh)
Inventor
田利亮
鄢旻雯
陈亨思
林晓龙
林晟
刘国宏
陈建楷
谢昌柠
翁雨艳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
State Grid Fujian Electric Power Co Ltd
Fujian Shuikou Power Generation Group Co Ltd
Original Assignee
State Grid Fujian Electric Power Co Ltd
Fujian Shuikou Power Generation Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by State Grid Fujian Electric Power Co Ltd, Fujian Shuikou Power Generation Group Co Ltd filed Critical State Grid Fujian Electric Power Co Ltd
Priority to CN202311785158.XA priority Critical patent/CN117912023A/en
Publication of CN117912023A publication Critical patent/CN117912023A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition
    • G06V30/14Image acquisition
    • G06V30/148Segmentation of character regions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/40Document-oriented image-based pattern recognition
    • G06V30/42Document-oriented image-based pattern recognition based on the type of document
    • G06V30/422Technical drawings; Geographical maps

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Computing Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Software Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Engineering & Computer Science (AREA)
  • Molecular Biology (AREA)
  • Mathematical Physics (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • Biophysics (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Image Analysis (AREA)

Abstract

The invention discloses an automatic identification method and terminal for an electrical drawing of a hydropower plant, which are characterized in that a segmentation and identification model is used for segmenting and identifying the electrical drawing of the hydropower plant to be identified to obtain a primitive, a text and a category of the electrical drawing of the hydropower plant to be identified, the primitive is identified based on the category to obtain primitive information, the text is subjected to semantic identification to obtain text information, the categories of the primitive, the text and the drawing in the electrical drawing of the hydropower plant are automatically identified and separated by the segmentation and identification model, then the primitive identification and the semantic identification are respectively carried out, automatic, comprehensive and accurate electrical drawing identification can be realized, and the output identification result can be used for further analysis and processing, so that informatization and intellectualization of the electrical drawing are effectively realized.

Description

一种水电厂电气图纸自动化识别方法及终端A method and terminal for automatically identifying electrical drawings of a hydropower plant

技术领域Technical Field

本发明涉及图像识别技术领域,尤其涉及一种水电厂电气图纸自动化识别方法及终端。The present invention relates to the technical field of image recognition, and in particular to an automatic recognition method and terminal for electrical drawings of a hydropower plant.

背景技术Background technique

水电企业在数十年的发展中已经积累了大量的图纸,但大量的水电厂电气图纸也造成了数据处理方面的困难,特别是电气图纸数据的一致性、准确性和及时性等问题。因此,实现水电厂电气图纸的数字化和信息化,方便工作人员在使用过程中进行图纸的检索和提取就成为迫切需要攻克的技术难关。Hydropower enterprises have accumulated a large number of drawings in decades of development, but a large number of electrical drawings of hydropower plants have also caused difficulties in data processing, especially the consistency, accuracy and timeliness of electrical drawing data. Therefore, it has become an urgent technical challenge to realize the digitization and informatization of electrical drawings of hydropower plants and facilitate the retrieval and extraction of drawings by staff during use.

目前水电厂电气图纸数字化的主要方法为图纸扫描,虽然完成了图纸从物理形式到数字形式的转移,但这种形式的转变仅仅是载体方面而不是信息方面,虽然有利于存储、查阅以及传输,但并没有实现图纸数据的信息化和智能化,无法实现图纸信息的进一步加工和处理。At present, the main method for digitizing electrical drawings in hydropower plants is drawing scanning. Although the drawings are transferred from physical form to digital form, this form change is only in terms of carrier rather than information. Although it is conducive to storage, reference and transmission, it does not realize the informatization and intelligence of drawing data, and cannot realize further processing and handling of drawing information.

发明内容Summary of the invention

本发明所要解决的技术问题是:提供一种水电厂电气图纸自动化识别方法及终端,能够有效实现电气图纸的信息化和智能化。The technical problem to be solved by the present invention is to provide a method and a terminal for automatically identifying electrical drawings of a hydropower plant, which can effectively realize the informatization and intelligence of the electrical drawings.

为了解决上述技术问题,本发明采用的技术方案为:In order to solve the above technical problems, the technical solution adopted by the present invention is:

一种水电厂电气图纸自动化识别方法,包括步骤:A method for automatically identifying electrical drawings of a hydropower plant, comprising the steps of:

获取待识别水电厂电气图纸;Obtain electrical drawings of the hydropower plant to be identified;

使用分割辨别模型对所述待识别水电厂电气图纸进行分割和辨别,得到所述待识别水电厂电气图纸的图元、文本和类别;Use the segmentation and recognition model to segment and recognize the electrical drawings of the hydropower plant to be recognized, and obtain the graphic elements, texts and categories of the electrical drawings of the hydropower plant to be recognized;

基于所述类别对所述图元进行识别,得到图元信息,并对所述文本进行语义识别,得到文本信息;Identify the graphic element based on the category to obtain graphic element information, and perform semantic recognition on the text to obtain text information;

根据所述图元信息和所述文本信息输出识别结果。The recognition result is output according to the graphic element information and the text information.

为了解决上述技术问题,本发明采用的另一种技术方案为:In order to solve the above technical problems, another technical solution adopted by the present invention is:

一种水电厂电气图纸自动化识别终端,包括存储器、处理器及存储在存储器上并可在所述处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现以下步骤:An automatic identification terminal for electrical drawings of a hydropower plant comprises a memory, a processor and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the following steps are implemented:

获取待识别水电厂电气图纸;Obtain electrical drawings of the hydropower plant to be identified;

使用分割辨别模型对所述待识别水电厂电气图纸进行分割和辨别,得到所述待识别水电厂电气图纸的图元、文本和类别;Use the segmentation and recognition model to segment and recognize the electrical drawings of the hydropower plant to be recognized, and obtain the graphic elements, texts and categories of the electrical drawings of the hydropower plant to be recognized;

基于所述类别对所述图元进行识别,得到图元信息,并对所述文本进行语义识别,得到文本信息;Identify the graphic element based on the category to obtain graphic element information, and perform semantic recognition on the text to obtain text information;

根据所述图元信息和所述文本信息输出识别结果。The recognition result is output according to the graphic element information and the text information.

本发明的有益效果在于:使用分割辨别模型对待识别水电厂电气图纸进行分割和辨别,得到待识别水电厂电气图纸的图元、文本和类别,基于类别对图元进行识别,得到图元信息,并对文本进行语义识别,得到文本信息,以此利用分割辨别模型将水电厂电气图纸中的图元、文本和图纸的类别自动识别分离出来,然后再分别进行图元识别和语义识别,能够实现自动化、全面且准确的电气图纸识别,输出的识别结果可用于进一步的分析处理,从而有效实现电气图纸的信息化和智能化。The beneficial effects of the present invention are as follows: a segmentation and recognition model is used to segment and recognize the electrical drawings of a hydropower plant to be recognized, and the graphics, text and categories of the electrical drawings of the hydropower plant to be recognized are obtained; graphics are recognized based on the categories to obtain graphics information; and text is semantically recognized to obtain text information. In this way, the graphics, text and categories of the electrical drawings of the hydropower plant are automatically recognized and separated by using the segmentation and recognition model, and then graphics and semantic recognition are performed respectively, so that automatic, comprehensive and accurate electrical drawing recognition can be realized, and the output recognition results can be used for further analysis and processing, thereby effectively realizing the informatization and intelligence of electrical drawings.

附图说明BRIEF DESCRIPTION OF THE DRAWINGS

图1为本发明实施例的一种水电厂电气图纸自动化识别方法的步骤流程图;FIG1 is a flowchart of a method for automatically identifying electrical drawings of a hydropower plant according to an embodiment of the present invention;

图2为本发明实施例的一种水电厂电气图纸自动化识别终端的结构示意图;FIG2 is a schematic diagram of the structure of an automatic identification terminal for electrical drawings of a hydropower plant according to an embodiment of the present invention;

图3为本发明实施例的水电厂电气图纸自动化识别方法中的识别流程图。FIG3 is a recognition flow chart of the method for automatic recognition of electrical drawings of a hydropower plant according to an embodiment of the present invention.

具体实施方式Detailed ways

为详细说明本发明的技术内容、所实现目的及效果,以下结合实施方式并配合附图予以说明。In order to explain the technical content, achieved objectives and effects of the present invention in detail, the following is an explanation in conjunction with the implementation modes and the accompanying drawings.

请参照图1,一种水电厂电气图纸自动化识别方法,包括步骤:Referring to FIG. 1 , a method for automatically identifying electrical drawings of a hydropower plant includes the following steps:

获取待识别水电厂电气图纸;Obtain electrical drawings of the hydropower plant to be identified;

使用分割辨别模型对所述待识别水电厂电气图纸进行分割和辨别,得到所述待识别水电厂电气图纸的图元、文本和类别;Use the segmentation and recognition model to segment and recognize the electrical drawings of the hydropower plant to be recognized, and obtain the graphic elements, texts and categories of the electrical drawings of the hydropower plant to be recognized;

基于所述类别对所述图元进行识别,得到图元信息,并对所述文本进行语义识别,得到文本信息;Identify the graphic element based on the category to obtain graphic element information, and perform semantic recognition on the text to obtain text information;

根据所述图元信息和所述文本信息输出识别结果。The recognition result is output according to the graphic element information and the text information.

从上述描述可知,本发明的有益效果在于:使用分割辨别模型对待识别水电厂电气图纸进行分割和辨别,得到待识别水电厂电气图纸的图元、文本和类别,基于类别对图元进行识别,得到图元信息,并对文本进行语义识别,得到文本信息,以此利用分割辨别模型将水电厂电气图纸中的图元、文本和图纸的类别自动识别分离出来,然后再分别进行图元识别和语义识别,能够实现自动化、全面且准确的电气图纸识别,输出的识别结果可用于进一步的分析处理,从而有效实现电气图纸的信息化和智能化。From the above description, it can be seen that the beneficial effects of the present invention are: using a segmentation and recognition model to segment and recognize the electrical drawings of the hydropower plant to be recognized, obtaining the graphics, text and categories of the electrical drawings of the hydropower plant to be recognized, recognizing the graphics based on the categories to obtain the graphics information, and performing semantic recognition on the text to obtain the text information, thereby utilizing the segmentation and recognition model to automatically recognize and separate the graphics, text and categories of the electrical drawings of the hydropower plant, and then performing graphics recognition and semantic recognition respectively, which can realize automatic, comprehensive and accurate electrical drawing recognition, and the output recognition results can be used for further analysis and processing, thereby effectively realizing the informatization and intelligence of electrical drawings.

进一步地,所述获取待识别水电厂电气图纸之前包括:Furthermore, the step of obtaining the electrical drawings of the hydropower plant to be identified includes:

获取不同类别的水电厂电气图纸;Obtain electrical drawings of different types of hydropower plants;

对所述不同类别的水电厂电气图纸进行扩展处理,得到扩展后的水电厂电气图纸,并对所述扩展后的水电厂电气图纸进行划分,得到第一训练集;Performing expansion processing on the electrical drawings of the hydropower plant of different categories to obtain expanded electrical drawings of the hydropower plant, and dividing the expanded electrical drawings of the hydropower plant to obtain a first training set;

使用类别标签对所述第一训练集进行标注,得到分割辨别样本集;Using category labels to label the first training set to obtain a segmentation and discrimination sample set;

构建改进YOLOv5模型和与所述改进YOLOv5模型对应的分割辨别损失函数;Constructing an improved YOLOv5 model and a segmentation discrimination loss function corresponding to the improved YOLOv5 model;

将所述分割辨别样本集输入所述改进YOLOv5模型,并使用所述分割辨别损失函数对所述改进YOLOv5模型的网络参数进行训练,得到分割辨别模型。The segmentation recognition sample set is input into the improved YOLOv5 model, and the network parameters of the improved YOLOv5 model are trained using the segmentation recognition loss function to obtain a segmentation recognition model.

由上述描述可知,利用标注了类别标签的第一训练集对改进YOLOv5模型进行训练,得到分割辨别模型,从而能够准确、快速地识别出水电厂电气图纸中的图元、文本以及图纸类别。From the above description, it can be seen that the improved YOLOv5 model is trained using the first training set marked with category labels to obtain a segmentation recognition model, which can accurately and quickly identify the graphics elements, texts and drawing categories in the electrical drawings of the hydropower plant.

进一步地,所述基于所述类别对所述图元进行识别,得到图元信息包括:Further, the identifying the graphic element based on the category to obtain the graphic element information includes:

判断所述类别是否为电气一次图纸,若是,则采用电气一次图纸识别模型对所述图元进行识别,得到图元信息,若否,则采用电气二次图纸识别模型对所述图元进行识别,得到图元信息。Determine whether the category is an electrical primary drawing. If so, use an electrical primary drawing recognition model to recognize the graphic element to obtain graphic element information. If not, use an electrical secondary drawing recognition model to recognize the graphic element to obtain graphic element information.

由上述描述可知,根据图纸的类别采用不同的识别模型进行图元的识别,提高识别的准确率。From the above description, it can be seen that different recognition models are used to recognize graphic elements according to the types of drawings to improve the recognition accuracy.

进一步地,所述采用电气一次图纸识别模型对所述图元进行识别,得到图元信息包括:Furthermore, the electrical primary drawing recognition model is used to recognize the graphic element, and the graphic element information obtained includes:

采用电气一次图纸识别模型根据所述待识别水电厂图纸对所述图元进行识别,得到所述图元所在的位置相对于其他图元的电气连接关系以及所述图元的实际物理名称。The electrical primary drawing recognition model is used to identify the graphic element according to the hydropower plant drawing to be identified, and the electrical connection relationship of the position of the graphic element relative to other graphic elements and the actual physical name of the graphic element are obtained.

由上述描述可知,识别得到的图元信息包括图元所在的位置相对于其他图元的电气连接关系以及图元的实际物理名称,使得用户能够直接、快速地了解图元信息。As can be seen from the above description, the identified primitive information includes the electrical connection relationship of the primitive's location relative to other primitives and the actual physical name of the primitive, so that the user can directly and quickly understand the primitive information.

进一步地,所述获取待识别水电厂电气图纸之前包括:Furthermore, the step of obtaining the electrical drawings of the hydropower plant to be identified includes:

获取水电厂电气一次图纸集;Obtain the primary electrical drawing set of the hydropower plant;

对所述水电厂电气一次图纸集进行扩展处理,得到扩展后的水电厂电气一次图纸集;Expanding the primary electrical drawing set of the hydropower plant to obtain an expanded primary electrical drawing set of the hydropower plant;

对所述扩展后的水电厂电气一次图纸集中的每一水电厂电气一次图纸的图元信息进行标注,得到标注后的水电厂电气一次图纸集;Annotate the graphic element information of each hydropower plant electrical primary drawing in the expanded hydropower plant electrical primary drawing set to obtain an annotated hydropower plant electrical primary drawing set;

对所述标注后的水电厂电气一次图纸集进行划分,得到第二训练集;Dividing the annotated primary electrical drawing set of the hydropower plant to obtain a second training set;

构建改进YOLOv5模型以及与所述改进YOLOv5模型对应的电气一次损失函数;Constructing an improved YOLOv5 model and an electrical primary loss function corresponding to the improved YOLOv5 model;

将所述第二训练集输入所述改进YOLOv5模型,并根据所述电气一次损失函数对所述改进YOLOv5模型的网络参数进行训练,得到电气一次图纸识别模型。The second training set is input into the improved YOLOv5 model, and the network parameters of the improved YOLOv5 model are trained according to the electrical primary loss function to obtain an electrical primary drawing recognition model.

由上述描述可知,第二训练集为标注了图元信息的水电厂电气一次图纸集,利用此训练集对改进YOLOv5模型进行训练,能够得到高识别准确率的电气一次图纸识别模型。From the above description, it can be seen that the second training set is a set of electrical primary drawings of hydropower plants with annotated graphic element information. By using this training set to train the improved YOLOv5 model, an electrical primary drawing recognition model with high recognition accuracy can be obtained.

进一步地,所述对所述文本进行语义识别,得到文本信息包括:Furthermore, the performing semantic recognition on the text to obtain text information includes:

使用文本识别模型对所述文本进行语义识别,得到文本信息。A text recognition model is used to perform semantic recognition on the text to obtain text information.

由上述描述可知,使用文本识别模型进行语义识别,提高了电气图纸识别的自动化水平和准确度。From the above description, it can be seen that the use of text recognition models for semantic recognition improves the automation level and accuracy of electrical drawing recognition.

进一步地,所述获取待识别水电厂电气图纸之前包括:Furthermore, the step of obtaining the electrical drawings of the hydropower plant to be identified includes:

获取电气术语的文本框区域图片集;Get the text box area image set of electrical terms;

对所述文本框区域图片集进行文本区域分割,得到分割后的文本框区域图片集,并对所述分割后的文本框区域图片集进行划分,得到第三训练集;Performing text area segmentation on the text box area picture set to obtain a segmented text box area picture set, and dividing the segmented text box area picture set to obtain a third training set;

构建优化后的FCOS模型以及与所述优化后的FCOS模型对应的电气术语损失函数;Constructing an optimized FCOS model and an electrical term loss function corresponding to the optimized FCOS model;

将所述第三训练集输入所述优化后的FCOS模型,并根据所述电气术语损失函数对所述优化后的FCOS模型的网络参数进行训练,得到文本识别模型。The third training set is input into the optimized FCOS model, and the network parameters of the optimized FCOS model are trained according to the electrical terminology loss function to obtain a text recognition model.

由上述描述可知,文本识别模型是对优化后的FCOS模型训练得到的,FCOS模型是一种全卷积单阶段的目标检测器,其基于anchor-free和proposal free来设计,能够在小运算成本的条件下解决文本识别问题。From the above description, we can see that the text recognition model is trained by the optimized FCOS model. The FCOS model is a fully convolutional single-stage target detector, which is designed based on anchor-free and proposal free, and can solve the text recognition problem at a low computational cost.

进一步地,所述获取待识别水电厂电气图纸之前包括:Furthermore, the step of obtaining the electrical drawings of the hydropower plant to be identified includes:

将原始YOLOv5模型中的Backbone特征提取部分修改为综合使用分组卷积和Channel Shuffle操作的ShuffleNet模块,并在所述原始YOLOv5模型中的Neck特征聚合模块增加CBAM机制,得到改进YOLOv5模型。The Backbone feature extraction part in the original YOLOv5 model is modified into a ShuffleNet module that comprehensively uses grouped convolution and Channel Shuffle operations, and a CBAM mechanism is added to the Neck feature aggregation module in the original YOLOv5 model to obtain an improved YOLOv5 model.

由上述描述可知,将原始YOLOv5模型中的Backbone特征提取部分修改为综合使用分组卷积和Channel Shuffle操作的ShuffleNet模块,并在原始YOLOv5模型中的Neck特征聚合模块增加CBAM机制,得到改进YOLOv5模型,加强了算法的图纸特征提取能力,且提高了算法运算效率,确保准确的识别结果。From the above description, it can be seen that the Backbone feature extraction part in the original YOLOv5 model is modified to the ShuffleNet module that comprehensively uses group convolution and Channel Shuffle operations, and the CBAM mechanism is added to the Neck feature aggregation module in the original YOLOv5 model to obtain the improved YOLOv5 model, which strengthens the algorithm's drawing feature extraction capability and improves the algorithm's operation efficiency to ensure accurate recognition results.

进一步地,所述电气术语损失函数为交叉熵损失函数。Furthermore, the electrical term loss function is a cross entropy loss function.

由上述描述可知,使用交叉熵损失函数作为电气术语损失函数可以避免梯度消失问题,加速优化过程,且也能够避免模型过拟合,确保最佳的模型训练效果。From the above description, it can be seen that using the cross entropy loss function as the electrical term loss function can avoid the gradient vanishing problem, accelerate the optimization process, and also avoid model overfitting, ensuring the best model training effect.

请参照图2,本发明另一实施例提供了一种水电厂电气图纸自动化识别终端,包括存储器、处理器及存储在存储器上并可在所述处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现上述水电厂电气图纸自动化识别方法中的各个步骤。Please refer to Figure 2. Another embodiment of the present invention provides a hydropower plant electrical drawing automatic recognition terminal, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, each step in the above-mentioned hydropower plant electrical drawing automatic recognition method is implemented.

本发明上述的水电厂电气图纸自动化识别方法及终端能够适用于水电厂电气图纸识别场景,以下通过具体实施方式进行说明:The above-mentioned hydropower plant electrical drawing automatic recognition method and terminal of the present invention can be applied to the hydropower plant electrical drawing recognition scenario, which is described below through specific implementation methods:

请参照图1和图3,本发明的实施例一为:Please refer to Figures 1 and 3, the first embodiment of the present invention is:

一种水电厂电气图纸自动化识别方法,包括步骤:A method for automatically identifying electrical drawings of a hydropower plant, comprising the steps of:

S1、获取待识别水电厂电气图纸。S1. Obtain the electrical drawings of the hydropower plant to be identified.

具体的,用户端将待识别水电厂电气图纸从DWG、DXF或PDF格式转化为PNG格式,并将PNG格式的待识别水电厂电气图纸上传至服务器端,服务器端获取待识别水电厂电气图纸。Specifically, the user end converts the electrical drawings of the hydropower plant to be identified from DWG, DXF or PDF format into PNG format, and uploads the electrical drawings of the hydropower plant to be identified in PNG format to the server end, and the server end obtains the electrical drawings of the hydropower plant to be identified.

S2、使用分割辨别模型对所述待识别水电厂电气图纸进行分割和辨别,得到所述待识别水电厂电气图纸的图元、文本和类别,如图3所示;S2. Segment and identify the electrical drawings of the hydropower plant to be identified using a segmentation and identification model to obtain the graphic elements, texts and categories of the electrical drawings of the hydropower plant to be identified, as shown in FIG3 ;

其中,所述类别包括电气一次图纸和电气二次图纸。Among them, the categories include electrical primary drawings and electrical secondary drawings.

在一种可选的实施方式中,S1之前包括:In an optional implementation, before S1, the steps include:

获取不同类别的水电厂电气图纸;Obtain electrical drawings of different types of hydropower plants;

对所述不同类别的水电厂电气图纸进行扩展处理,得到扩展后的水电厂电气图纸,并对所述扩展后的水电厂电气图纸进行划分,得到第一训练集;Performing expansion processing on the electrical drawings of the hydropower plant of different categories to obtain expanded electrical drawings of the hydropower plant, and dividing the expanded electrical drawings of the hydropower plant to obtain a first training set;

使用类别标签对所述第一训练集进行标注,得到分割辨别样本集;以使得在训练网络后输出的类别可以与该类别标签进行对比,计算损失值,进而调整网络模型的参数;The first training set is labeled with a category label to obtain a segmentation and discrimination sample set, so that the category output after the network is trained can be compared with the category label, the loss value is calculated, and the parameters of the network model are adjusted;

构建改进YOLOv5模型和与所述改进YOLOv5模型对应的分割辨别损失函数;Constructing an improved YOLOv5 model and a segmentation discrimination loss function corresponding to the improved YOLOv5 model;

将所述分割辨别样本集输入所述改进YOLOv5模型,并使用所述分割辨别损失函数对所述改进YOLOv5模型的网络参数进行训练,得到分割辨别模型。The segmentation recognition sample set is input into the improved YOLOv5 model, and the network parameters of the improved YOLOv5 model are trained using the segmentation recognition loss function to obtain a segmentation recognition model.

其中,所述扩展处理包括图片剪裁、旋转以及数据增强等。对所述扩展后的水电厂电气图纸进行划分时,还得到第一测试集,在一种可选的实施方式中,所述第一训练集和所述第一测试集的比例为8:2。The expansion process includes image cropping, rotation, data enhancement, etc. When the expanded electrical drawings of the hydropower plant are divided, a first test set is also obtained. In an optional implementation, the ratio of the first training set to the first test set is 8:2.

即首先使用带有类别标签的第一训练集作为分割辨别本集训练改进YOLOv5模型,且标签是类别,训练好分割辨别模型之后,输入一个第一测试集内的电气图纸就可以输出对应的类别;分割辨别损失函数的原理是计算预测类别标签和真实的类别标签的均方误差,并根据该均方误差调整模型的网络参数,直到均方误差达到一定的阈值,就可以停止训练,阈值可根据实际情况进行设置,本实施例中,阈值设置为0.001。That is, first use the first training set with category labels as the segmentation and discrimination set to train the improved YOLOv5 model, and the label is the category. After the segmentation and discrimination model is trained, an electrical drawing in the first test set is input to output the corresponding category; the principle of the segmentation and discrimination loss function is to calculate the mean square error between the predicted category label and the true category label, and adjust the network parameters of the model according to the mean square error until the mean square error reaches a certain threshold, then the training can be stopped. The threshold can be set according to the actual situation. In this embodiment, the threshold is set to 0.001.

S3、基于所述类别对所述图元进行识别,得到图元信息,并对所述文本进行语义识别,得到文本信息,如图3所示,具体包括S31-S32:S3, identifying the graphic element based on the category to obtain graphic element information, and performing semantic recognition on the text to obtain text information, as shown in FIG3, specifically including S31-S32:

S31、判断所述类别是否为电气一次图纸,若是,则执行S311,若否,则执行S312。S31. Determine whether the category is an electrical primary drawing. If so, execute S311; if not, execute S312.

S311、采用电气一次图纸识别模型对所述图元进行识别,得到图元信息。S311, using an electrical primary drawing recognition model to recognize the graphic element to obtain graphic element information.

具体的,采用电气一次图纸识别模型根据所述待识别水电厂图纸对所述图元进行识别,得到所述图元所在的位置相对于其他图元的电气连接关系以及所述图元的实际物理名称。Specifically, the electrical primary drawing recognition model is used to identify the graphic element according to the hydropower plant drawing to be identified, and the electrical connection relationship of the position of the graphic element relative to other graphic elements and the actual physical name of the graphic element are obtained.

S312、采用电气二次图纸识别模型对所述图元进行识别,得到图元信息。S312: Use an electrical secondary drawing recognition model to recognize the graphic element to obtain graphic element information.

具体的,采用电气二次图纸识别模型根据所述待识别水电厂图纸对所述图元进行识别,得到所述图元所在的位置相对于其他图元的电气连接关系以及所述图元的实际物理名称。Specifically, the electrical secondary drawing recognition model is used to identify the graphic element according to the hydropower plant drawing to be identified, and the electrical connection relationship of the position of the graphic element relative to other graphic elements and the actual physical name of the graphic element are obtained.

其中,所述图元包括变压器、电流互感器等物理设备图元。The graphic elements include physical equipment graphic elements such as transformers and current transformers.

S32、使用文本识别模型对所述文本进行语义识别,得到文本信息。S32: Use a text recognition model to perform semantic recognition on the text to obtain text information.

在一种可选的实施方式中,S1之前包括:In an optional implementation, before S1, the steps include:

获取水电厂电气一次图纸集;Obtain the primary electrical drawing set of the hydropower plant;

对所述水电厂电气一次图纸集进行扩展处理,得到扩展后的水电厂电气一次图纸集;Expanding the primary electrical drawing set of the hydropower plant to obtain an expanded primary electrical drawing set of the hydropower plant;

对所述扩展后的水电厂电气一次图纸集中的每一水电厂电气一次图纸的图元信息进行标注,得到标注后的水电厂电气一次图纸集;Annotate the graphic element information of each hydropower plant electrical primary drawing in the expanded hydropower plant electrical primary drawing set to obtain an annotated hydropower plant electrical primary drawing set;

对所述标注后的水电厂电气一次图纸集进行划分,得到第二训练集;Dividing the annotated primary electrical drawing set of the hydropower plant to obtain a second training set;

构建改进YOLOv5模型以及与所述改进YOLOv5模型对应的电气一次损失函数;Constructing an improved YOLOv5 model and an electrical primary loss function corresponding to the improved YOLOv5 model;

将所述第二训练集输入所述改进YOLOv5模型,并根据所述电气一次损失函数对所述改进YOLOv5模型的网络参数进行训练,得到电气一次图纸识别模型。The second training set is input into the improved YOLOv5 model, and the network parameters of the improved YOLOv5 model are trained according to the electrical primary loss function to obtain an electrical primary drawing recognition model.

其中,标注的内容包括画布、厂站基本信息、图元以及连接线;画布包括画布宽度和高度,厂站基本信息包括名称和类型,图元包括图元类别、属性、旋转角度和关联图元信息,连接线包括所有连接图元ID的列表以及首末端的坐标。所述电气一次损失函数为均方误差函数。在一种可选的实施方式中,使用深度学习标注工具labelimg对所述扩展后的水电厂电气一次图纸集中的每一水电厂电气一次图纸的图元信息进行标注,得到标注后的水电厂电气一次图纸集,从而能在标注过程中自动计算文本框区域的长度与宽度、中心点坐标以及倾斜角度;将所述标注后的水电厂电气一次图纸集转换为XML格式,方便模型训练;对所述标注后的水电厂电气一次图纸集进行划分时,还得到第二测试集,训练好电气一次图纸识别模型之后,输入一个第二测试集内的水电厂电气一次图纸就可以输出对应的图元信息。Among them, the annotated content includes canvas, basic plant information, primitives and connecting lines; the canvas includes canvas width and height, the basic plant information includes name and type, the primitives include primitive category, attribute, rotation angle and related primitive information, and the connecting lines include a list of all connected primitive IDs and the coordinates of the beginning and end. The electrical primary loss function is a mean square error function. In an optional embodiment, the deep learning annotation tool labelimg is used to annotate the primitive information of each hydropower plant electrical primary drawing in the expanded hydropower plant electrical primary drawing set to obtain the annotated hydropower plant electrical primary drawing set, so that the length and width of the text box area, the center point coordinates and the tilt angle can be automatically calculated during the annotation process; the annotated hydropower plant electrical primary drawing set is converted into XML format to facilitate model training; when the annotated hydropower plant electrical primary drawing set is divided, a second test set is also obtained. After the electrical primary drawing recognition model is trained, the corresponding primitive information can be output by inputting a hydropower plant electrical primary drawing in the second test set.

电气二次图纸识别模型的训练过程与上述类似,只是将上述的水电厂电气一次图纸集替换为水电厂电气二次图纸集,在此不再赘述。The training process of the electrical secondary drawing recognition model is similar to the above, except that the above-mentioned hydropower plant electrical primary drawing set is replaced by the hydropower plant electrical secondary drawing set, which will not be repeated here.

在一种可选的实施方式中,S1之前包括:In an optional implementation, before S1, the steps include:

将原始YOLOv5模型中的Backbone特征提取部分修改为综合使用分组卷积和Channel Shuffle操作的ShuffleNet模块,并在所述原始YOLOv5模型中的Neck特征聚合模块增加CBAM机制,得到改进YOLOv5模型;其将目标检测问题转化为回归预测问题,通过从图像特征中直接获取边界框和类别信息,该算法利用CNN网络提取图像特征,并进行特征融合,然后根据这些特征进行分类和回归,从而得出目标的边界框和类别置信度;在算法的执行过程中,将待检测的图像划分为s×s个窗格,每个窗格都可以检测到对象的中心点是否位于其中;通过这种方式,可以同时对图像中的多个位置进行目标检测,每个窗格会有多个边界框和目标类别置信度,提高了算法的检测速度和准确性。The Backbone feature extraction part in the original YOLOv5 model is modified into a ShuffleNet module that comprehensively uses grouped convolution and Channel Shuffle operations, and a CBAM mechanism is added to the Neck feature aggregation module in the original YOLOv5 model to obtain an improved YOLOv5 model; the target detection problem is converted into a regression prediction problem, and the algorithm uses a CNN network to extract image features and perform feature fusion by directly obtaining bounding boxes and category information from image features, and then classifies and regresses based on these features to obtain the bounding box and category confidence of the target; during the execution of the algorithm, the image to be detected is divided into s×s panes, and each pane can detect whether the center point of the object is located therein; in this way, target detection can be performed on multiple locations in the image at the same time, and each pane will have multiple bounding boxes and target category confidences, thereby improving the detection speed and accuracy of the algorithm.

在一种可选的实施方式中,S1之前包括:In an optional implementation, before S1, the steps include:

获取电气术语的文本框区域图片集;Get the text box area image set of electrical terms;

对所述文本框区域图片集进行文本区域分割,得到分割后的文本框区域图片集,并对所述分割后的文本框区域图片集进行划分,得到第三训练集;Performing text area segmentation on the text box area picture set to obtain a segmented text box area picture set, and dividing the segmented text box area picture set to obtain a third training set;

构建优化后的FCOS模型以及与所述优化后的FCOS模型对应的电气术语损失函数;Constructing an optimized FCOS model and an electrical term loss function corresponding to the optimized FCOS model;

将所述第三训练集输入所述优化后的FCOS模型,并根据所述电气术语损失函数对所述优化后的FCOS模型的网络参数进行训练,得到文本识别模型。The third training set is input into the optimized FCOS model, and the network parameters of the optimized FCOS model are trained according to the electrical terminology loss function to obtain a text recognition model.

其中,所述电气术语损失函数为交叉熵损失函数,其原理是计算预测的字符标签和真实的字符标签的交叉熵损失函数学习率,并根据该学习率调整上述FCOS模型的网络参数,直到学习率达到一定的阈值,就可以停止训练,阈值可根据实际情况进行灵活设置,本实施例中,阈值设置为0.0001。所述优化后的FCOS模型的卷积层为50层,每层采用深度残差网络,最后一层网络设定相关的训练评估指标:测试集准确率,待测试集准确率达到预期值则停止训练,最终得到文本识别模型。Among them, the electrical term loss function is a cross entropy loss function, the principle of which is to calculate the learning rate of the cross entropy loss function of the predicted character label and the real character label, and adjust the network parameters of the above FCOS model according to the learning rate, until the learning rate reaches a certain threshold, the training can be stopped, the threshold can be flexibly set according to the actual situation, in this embodiment, the threshold is set to 0.0001. The optimized FCOS model has 50 convolutional layers, each layer uses a deep residual network, and the last layer of the network sets the relevant training evaluation index: the test set accuracy, and the training is stopped when the test set accuracy reaches the expected value, and finally the text recognition model is obtained.

FCOS与传统神经网络目标检测算法相比具有一些独特的优点:传统神经网络目标检测算法都是基于锚点,即在训练网络模型前,对图像生成多个矩形锚框,并对每个锚框标记预测类别以及偏移量作为训练样本,训练模型时将得到多个预测锚框位置,然后计算预测边界框与真实矩形框的最大交并比,通过非极大抑制方法输出最佳预测边界框及其类别概率。而FCOS不依赖事先通过大数据分析得到的锚框或者提议区域,通过使用anchor-free模式,FCOS完全去除了关于锚框部分的运算,而且训练过程中的内存占用也大大减少,更加方便算法的训练和部署,与现有技术相比,它在文本场景即字符识别上获得更好或更具竞争力的表现。FCOS has some unique advantages over traditional neural network target detection algorithms: Traditional neural network target detection algorithms are based on anchor points, that is, before training the network model, multiple rectangular anchor boxes are generated for the image, and the predicted category and offset are marked for each anchor box as a training sample. When training the model, multiple predicted anchor box positions will be obtained, and then the maximum intersection-over-union ratio between the predicted bounding box and the true rectangular box will be calculated, and the best predicted bounding box and its category probability will be output through the non-maximum suppression method. FCOS does not rely on anchor boxes or proposed areas obtained in advance through big data analysis. By using the anchor-free mode, FCOS completely removes the operations on the anchor box part, and the memory usage during the training process is also greatly reduced, which makes it more convenient to train and deploy the algorithm. Compared with existing technologies, it achieves better or more competitive performance in text scenarios, namely character recognition.

S4、根据所述图元信息和所述文本信息输出识别结果。S4. Output a recognition result according to the graphic element information and the text information.

请参照图2,本发明的实施例二为:Please refer to FIG. 2 , the second embodiment of the present invention is:

一种水电厂电气图纸自动化识别终端,包括存储器、处理器及存储在存储器上并可在所述处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现实施例一中的水电厂电缆信息智能整理方法中的各个步骤。An automatic identification terminal for electrical drawings of a hydropower plant comprises a memory, a processor and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, each step of the method for intelligently organizing cable information of a hydropower plant in the first embodiment is implemented.

综上所述,本发明提供的一种水电厂电气图纸自动化识别方法及终端,使用分割辨别模型对待识别水电厂电气图纸进行分割和辨别,得到待识别水电厂电气图纸的图元、文本和类别,基于类别对图元进行识别,得到图元信息,并对文本进行语义识别,得到文本信息,以此利用分割辨别模型将水电厂电气图纸中的图元、文本和图纸的类别自动识别分离出来,然后再分别进行图元识别和语义识别,能够实现自动化、全面且准确的电气图纸识别,输出的识别结果可用于进一步的分析处理,从而有效实现电气图纸的信息化和智能化;并且,利用标注了类别标签的第一训练集对改进YOLOv5模型进行训练,得到分割辨别模型,从而能够准确、快速地识别出水电厂电气图纸中的图元、文本以及图纸类别;另外,将原始YOLOv5模型中的Backbone特征提取部分修改为综合使用分组卷积和Channel Shuffle操作的ShuffleNet模块,并在原始YOLOv5模型中的Neck特征聚合模块增加CBAM机制,得到改进YOLOv5模型,加强了算法的图纸特征提取能力,且提高了算法运算效率,确保准确的识别结果。In summary, the present invention provides an automatic recognition method and terminal for electrical drawings of hydropower plants, which use a segmentation and recognition model to segment and recognize the electrical drawings of hydropower plants to be recognized, obtain the graphics, text and categories of the electrical drawings of hydropower plants to be recognized, recognize the graphics based on the categories to obtain graphics information, and perform semantic recognition on the text to obtain text information, thereby using the segmentation and recognition model to automatically recognize and separate the graphics, text and categories of the electrical drawings of hydropower plants, and then perform graphics and semantic recognition respectively, which can realize automatic, comprehensive and accurate electrical drawing recognition, and the output recognition results can be used for further analysis and processing, thereby effectively realizing the informatization and intelligence of electrical drawings; and, using the first training set marked with category labels to train the improved YOLOv5 model, a segmentation and recognition model is obtained, so that the graphics, text and drawing categories in the electrical drawings of hydropower plants can be accurately and quickly recognized; in addition, the Backbone feature extraction part in the original YOLOv5 model is modified to comprehensively use grouped convolution and Channel The ShuffleNet module of the Shuffle operation is used, and the CBAM mechanism is added to the Neck feature aggregation module in the original YOLOv5 model to obtain the improved YOLOv5 model, which strengthens the algorithm's drawing feature extraction capability and improves the algorithm's operation efficiency to ensure accurate recognition results.

以上所述仅为本发明的实施例,并非因此限制本发明的专利范围,凡是利用本发明说明书及附图内容所作的等同变换,或直接或间接运用在相关的技术领域,均同理包括在本发明的专利保护范围内。The above descriptions are merely embodiments of the present invention and are not intended to limit the patent scope of the present invention. Any equivalent transformations made using the contents of the present invention's specification and drawings, or directly or indirectly applied in related technical fields, are also included in the patent protection scope of the present invention.

Claims (10)

1.一种水电厂电气图纸自动化识别方法,其特征在于,包括步骤:1. A method for automatic identification of electrical drawings of a hydropower plant, characterized by comprising the steps of: 获取待识别水电厂电气图纸;Obtain electrical drawings of the hydropower plant to be identified; 使用分割辨别模型对所述待识别水电厂电气图纸进行分割和辨别,得到所述待识别水电厂电气图纸的图元、文本和类别;Use the segmentation and recognition model to segment and recognize the electrical drawings of the hydropower plant to be recognized, and obtain the graphic elements, texts and categories of the electrical drawings of the hydropower plant to be recognized; 基于所述类别对所述图元进行识别,得到图元信息,并对所述文本进行语义识别,得到文本信息;Identify the graphic element based on the category to obtain graphic element information, and perform semantic recognition on the text to obtain text information; 根据所述图元信息和所述文本信息输出识别结果。The recognition result is output according to the graphic element information and the text information. 2.根据权利要求1所述的一种水电厂电气图纸自动化识别方法,其特征在于,所述获取待识别水电厂电气图纸之前包括:2. The method for automatic identification of electrical drawings of a hydropower plant according to claim 1, characterized in that before obtaining the electrical drawings of the hydropower plant to be identified, the method comprises: 获取不同类别的水电厂电气图纸;Obtain electrical drawings of different types of hydropower plants; 对所述不同类别的水电厂电气图纸进行扩展处理,得到扩展后的水电厂电气图纸,并对所述扩展后的水电厂电气图纸进行划分,得到第一训练集;Performing expansion processing on the electrical drawings of the hydropower plant of different categories to obtain expanded electrical drawings of the hydropower plant, and dividing the expanded electrical drawings of the hydropower plant to obtain a first training set; 使用类别标签对所述第一训练集进行标注,得到分割辨别样本集;Using category labels to label the first training set to obtain a segmentation and discrimination sample set; 构建改进YOLOv5模型和与所述改进YOLOv5模型对应的分割辨别损失函数;Constructing an improved YOLOv5 model and a segmentation discrimination loss function corresponding to the improved YOLOv5 model; 将所述分割辨别样本集输入所述改进YOLOv5模型,并使用所述分割辨别损失函数对所述改进YOLOv5模型的网络参数进行训练,得到分割辨别模型。The segmentation recognition sample set is input into the improved YOLOv5 model, and the network parameters of the improved YOLOv5 model are trained using the segmentation recognition loss function to obtain a segmentation recognition model. 3.根据权利要求1所述的一种水电厂电气图纸自动化识别方法,其特征在于,所述基于所述类别对所述图元进行识别,得到图元信息包括:3. The method for automatic recognition of electrical drawings of a hydropower plant according to claim 1, characterized in that the step of identifying the graphic element based on the category to obtain the graphic element information comprises: 判断所述类别是否为电气一次图纸,若是,则采用电气一次图纸识别模型对所述图元进行识别,得到图元信息,若否,则采用电气二次图纸识别模型对所述图元进行识别,得到图元信息。Determine whether the category is an electrical primary drawing. If so, use an electrical primary drawing recognition model to recognize the graphic element to obtain graphic element information. If not, use an electrical secondary drawing recognition model to recognize the graphic element to obtain graphic element information. 4.根据权利要求3所述的一种水电厂电气图纸自动化识别方法,其特征在于,所述采用电气一次图纸识别模型对所述图元进行识别,得到图元信息包括:4. A method for automatic recognition of electrical drawings of a hydropower plant according to claim 3, characterized in that the step of using an electrical primary drawing recognition model to recognize the graphic element to obtain graphic element information includes: 采用电气一次图纸识别模型根据所述待识别水电厂图纸对所述图元进行识别,得到所述图元所在的位置相对于其他图元的电气连接关系以及所述图元的实际物理名称。The electrical primary drawing recognition model is used to identify the graphic element according to the hydropower plant drawing to be identified, and the electrical connection relationship of the position of the graphic element relative to other graphic elements and the actual physical name of the graphic element are obtained. 5.根据权利要求1所述的一种水电厂电气图纸自动化识别方法,其特征在于,所述获取待识别水电厂电气图纸之前包括:5. The method for automatic identification of electrical drawings of a hydropower plant according to claim 1, characterized in that before obtaining the electrical drawings of the hydropower plant to be identified, the method comprises: 获取水电厂电气一次图纸集;Obtain the primary electrical drawing set of the hydropower plant; 对所述水电厂电气一次图纸集进行扩展处理,得到扩展后的水电厂电气一次图纸集;Expanding the primary electrical drawing set of the hydropower plant to obtain an expanded primary electrical drawing set of the hydropower plant; 对所述扩展后的水电厂电气一次图纸集中的每一水电厂电气一次图纸的图元信息进行标注,得到标注后的水电厂电气一次图纸集;Annotate the graphic element information of each hydropower plant electrical primary drawing in the expanded hydropower plant electrical primary drawing set to obtain an annotated hydropower plant electrical primary drawing set; 对所述标注后的水电厂电气一次图纸集进行划分,得到第二训练集;Dividing the annotated primary electrical drawing set of the hydropower plant to obtain a second training set; 构建改进YOLOv5模型以及与所述改进YOLOv5模型对应的电气一次损失函数;Constructing an improved YOLOv5 model and an electrical primary loss function corresponding to the improved YOLOv5 model; 将所述第二训练集输入所述改进YOLOv5模型,并根据所述电气一次损失函数对所述改进YOLOv5模型的网络参数进行训练,得到电气一次图纸识别模型。The second training set is input into the improved YOLOv5 model, and the network parameters of the improved YOLOv5 model are trained according to the electrical primary loss function to obtain an electrical primary drawing recognition model. 6.根据权利要求1所述的一种水电厂电气图纸自动化识别方法,其特征在于,所述对所述文本进行语义识别,得到文本信息包括:6. The method for automatic recognition of electrical drawings of a hydropower plant according to claim 1, characterized in that the semantic recognition of the text to obtain text information comprises: 使用文本识别模型对所述文本进行语义识别,得到文本信息。A text recognition model is used to perform semantic recognition on the text to obtain text information. 7.根据权利要求6所述的一种水电厂电气图纸自动化识别方法,其特征在于,所述获取待识别水电厂电气图纸之前包括:7. The method for automatic identification of electrical drawings of a hydropower plant according to claim 6, characterized in that before obtaining the electrical drawings of the hydropower plant to be identified, the method comprises: 获取电气术语的文本框区域图片集;Get the text box area image set of electrical terms; 对所述文本框区域图片集进行文本区域分割,得到分割后的文本框区域图片集,并对所述分割后的文本框区域图片集进行划分,得到第三训练集;Performing text area segmentation on the text box area picture set to obtain a segmented text box area picture set, and dividing the segmented text box area picture set to obtain a third training set; 构建优化后的FCOS模型以及与所述优化后的FCOS模型对应的电气术语损失函数;Constructing an optimized FCOS model and an electrical term loss function corresponding to the optimized FCOS model; 将所述第三训练集输入所述优化后的FCOS模型,并根据所述电气术语损失函数对所述优化后的FCOS模型的网络参数进行训练,得到文本识别模型。The third training set is input into the optimized FCOS model, and the network parameters of the optimized FCOS model are trained according to the electrical terminology loss function to obtain a text recognition model. 8.根据权利要求2或5所述的一种水电厂电气图纸自动化识别方法,其特征在于,所述获取待识别水电厂电气图纸之前包括:8. A method for automatic identification of electrical drawings of a hydropower plant according to claim 2 or 5, characterized in that before obtaining the electrical drawings of the hydropower plant to be identified, the method comprises: 将原始YOLOv5模型中的Backbone特征提取部分修改为综合使用分组卷积和ChannelShuffle操作的ShuffleNet模块,并在所述原始YOLOv5模型中的Neck特征聚合模块增加CBAM机制,得到改进YOLOv5模型。The Backbone feature extraction part in the original YOLOv5 model is modified into a ShuffleNet module that comprehensively uses grouped convolution and ChannelShuffle operations, and a CBAM mechanism is added to the Neck feature aggregation module in the original YOLOv5 model to obtain an improved YOLOv5 model. 9.根据权利要求7所述的一种水电厂电气图纸自动化识别方法,其特征在于,所述电气术语损失函数为交叉熵损失函数。9. A method for automatic recognition of electrical drawings of a hydropower plant according to claim 7, characterized in that the electrical terminology loss function is a cross entropy loss function. 10.一种水电厂电气图纸自动化识别终端,包括存储器、处理器及存储在存储器上并可在所述处理器上运行的计算机程序,其特征在于,所述处理器执行所述计算机程序时实现权利要求1至9中任一项所述的一种水电厂电气图纸自动化识别方法中的各个步骤。10. An automatic identification terminal for electrical drawings of a hydropower plant, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements each step of an automatic identification method for electrical drawings of a hydropower plant as described in any one of claims 1 to 9 when executing the computer program.
CN202311785158.XA 2023-12-22 2023-12-22 A method and terminal for automatically identifying electrical drawings of a hydropower plant Pending CN117912023A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311785158.XA CN117912023A (en) 2023-12-22 2023-12-22 A method and terminal for automatically identifying electrical drawings of a hydropower plant

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311785158.XA CN117912023A (en) 2023-12-22 2023-12-22 A method and terminal for automatically identifying electrical drawings of a hydropower plant

Publications (1)

Publication Number Publication Date
CN117912023A true CN117912023A (en) 2024-04-19

Family

ID=90692935

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311785158.XA Pending CN117912023A (en) 2023-12-22 2023-12-22 A method and terminal for automatically identifying electrical drawings of a hydropower plant

Country Status (1)

Country Link
CN (1) CN117912023A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118506393A (en) * 2024-07-12 2024-08-16 维飒科技(西安)有限公司 Method and system for realizing intelligent recognition of engineering drawing based on OCR technology

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118506393A (en) * 2024-07-12 2024-08-16 维飒科技(西安)有限公司 Method and system for realizing intelligent recognition of engineering drawing based on OCR technology
CN118506393B (en) * 2024-07-12 2024-10-08 维飒科技(西安)有限公司 Method and system for realizing intelligent recognition of engineering drawing based on OCR technology

Similar Documents

Publication Publication Date Title
CN111860348A (en) OCR recognition method of weakly supervised power drawings based on deep learning
CN112861575A (en) Pedestrian structuring method, device, equipment and storage medium
CN114049356B (en) Method, device and system for detecting structure apparent crack
CN110610166A (en) Text region detection model training method and device, electronic equipment and storage medium
CN111460927A (en) Method for extracting structured information of house property certificate image
CN111311475A (en) Detection model training method and device, storage medium and computer equipment
CN102508923A (en) Automatic video annotation method based on automatic classification and keyword marking
CN114387499A (en) Island coastal wetland waterfowl identification method, distribution query system and medium
CN115273112A (en) Table identification method and device, electronic equipment and readable storage medium
CN111881803B (en) An animal face recognition method based on improved YOLOv3
CN114419428A (en) A target detection method, target detection device and computer readable storage medium
CN113673534B (en) RGB-D image fruit detection method based on FASTER RCNN
CN116665054A (en) Remote sensing image small target detection method based on improved YOLOv3
Jamieson et al. A review of deep learning methods for digitisation of complex documents and engineering diagrams
CN118711038A (en) Automatic quality inspection method and system for inverter assembly based on improved YOLOv8 detection algorithm
CN117912023A (en) A method and terminal for automatically identifying electrical drawings of a hydropower plant
CN119292953B (en) Software automatic testing method and system based on visual attention mechanism
CN106503706A (en) The method of discrimination of Chinese character pattern cutting result correctness
CN113159049A (en) Training method and device of weak supervision semantic segmentation model, storage medium and terminal
CN118762369A (en) A marking recognition method, device and electronic equipment for engineering drawings
CN115546824B (en) Taboo picture identification methods, equipment and storage media
CN117454987A (en) Mine event knowledge graph construction method and device based on event automatic extraction
CN117373050A (en) Method for identifying drawing pipeline with high precision
CN117351505A (en) Information code identification method, device, equipment and storage medium
CN116758571A (en) Method and device for extracting and analyzing structured information from table images based on text detection

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination