[go: up one dir, main page]

CN109977891A - A kind of object detection and recognition method neural network based - Google Patents

A kind of object detection and recognition method neural network based Download PDF

Info

Publication number
CN109977891A
CN109977891A CN201910254154.6A CN201910254154A CN109977891A CN 109977891 A CN109977891 A CN 109977891A CN 201910254154 A CN201910254154 A CN 201910254154A CN 109977891 A CN109977891 A CN 109977891A
Authority
CN
China
Prior art keywords
image
neural network
detection
object detection
result
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910254154.6A
Other languages
Chinese (zh)
Inventor
马静
邢佳雪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Harbin University of Science and Technology
Original Assignee
Harbin University of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Harbin University of Science and Technology filed Critical Harbin University of Science and Technology
Priority to CN201910254154.6A priority Critical patent/CN109977891A/en
Publication of CN109977891A publication Critical patent/CN109977891A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Biomedical Technology (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Biophysics (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Computational Linguistics (AREA)
  • Artificial Intelligence (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Image Analysis (AREA)

Abstract

The invention discloses a kind of object detection and recognition methods neural network based comprising the steps of: A, uses the image information in image acquisition device detection zone;B, identifying processing is carried out to acquired image, neural network model C, is established by computer;D, the main modular of convolutional neural networks is defined;E, collected image information is detected using neural network model calculating, and completes numerical result output;F, it makes mark on the image according to testing result, position and the classification of the mark in each target is marked with rectangle frame;The result of judgement detection and identification;G, the result of identification and detection is verified;The present invention is based on the object detection and recognition methods of neural network to carry out recognition of face using object detection and recognition, and arithmetic speed is fast, and judging result is accurate, effectively increases the precision of detection and the efficiency of identification.

Description

一种基于神经网络的目标检测与识别方法A method of target detection and recognition based on neural network

技术领域technical field

本发明涉及一种神经网络技术领域,具体是一种基于神经网络的目标检测与识别方法。The invention relates to the technical field of neural networks, in particular to a target detection and identification method based on neural networks.

背景技术Background technique

现如今,随着计算机视觉的相关理论与应用研究的快速发展,计算机视觉技术在日常生活中应用的优越性也日益突显出来。用计算机对图像进行识别是计算机从相关的视频或图像序列中提取出相应的特征,从而让计算机“理解”图像的内容,并能正确分类的技术。安防意识的提升也让人们对于公共以及个人的安全需求不断攀升,使得计算机神经网络技术在目标检测与识别等方面有了很高的应用价值。Nowadays, with the rapid development of related theory and application research of computer vision, the advantages of computer vision technology in daily life are increasingly prominent. Recognition of images by computer is a technology in which the computer extracts the corresponding features from the related video or image sequence, so that the computer "understands" the content of the image and can classify it correctly. The improvement of security awareness has also made people's demand for public and personal security continue to rise, which makes computer neural network technology have a high application value in target detection and recognition.

目标检测是计算机视觉领域中的一个重要的研究课题。已经被广泛的使用在多个真实场景的应用中,如人脸识别,交通安全,人群监控和图像检索。基于深度学习的实时目标检测是指在一副自然场景图片或者视频中标记出目标物体的位置以及类别。面对海量的图像视频数据,人工标记费时、低效,自动化和快速的目标检测方法是迫切需要的。Object detection is an important research topic in the field of computer vision. It has been widely used in many real-world applications, such as face recognition, traffic safety, crowd monitoring and image retrieval. Real-time target detection based on deep learning refers to marking the location and category of target objects in a natural scene picture or video. In the face of massive image and video data, manual labeling is time-consuming and inefficient, and automated and fast object detection methods are urgently needed.

由于目标检测与识别效果易受多种因素的影响,而神经网络对于数据的要求没有那么严苛,并且识别率较高。所以卷积神经网络对于人脸识别领域的研究具有重要的理论意义和现实意义。Since the effect of target detection and recognition is easily affected by many factors, the neural network has less stringent requirements for data and has a higher recognition rate. Therefore, the convolutional neural network has important theoretical and practical significance for the research in the field of face recognition.

发明内容SUMMARY OF THE INVENTION

本发明的目的在于提供一种基于神经网络的目标检测与识别方法,以解决所述背景技术中提出的问题。The purpose of the present invention is to provide a target detection and recognition method based on a neural network to solve the problems raised in the background art.

为实现所述目的,本发明提供如下技术方案:To achieve the purpose, the present invention provides the following technical solutions:

一种基于神经网络的目标检测与识别方法,包含以下步骤:A method for target detection and recognition based on neural network, comprising the following steps:

A、使用图像采集装置采集检测区域内的画面信息;A. Use the image acquisition device to collect the picture information in the detection area;

B、对采集到的图像进行识别处理,B. Recognize and process the collected images,

C、通过计算机建立神经网络模型;C. Establish a neural network model through a computer;

D、定义卷积神经网络的主要模块;D. Define the main modules of the convolutional neural network;

E、利用神经网络模型计算对采集到的画面信息进行检测,并完成数值结果输出;E. Use the neural network model calculation to detect the collected picture information, and complete the numerical result output;

F、根据检测结果在图像上作出标注,用矩形框标出每个目标中的标注的位置和类别;判断检测与识别的结果;F. Mark the image according to the detection result, mark the position and category of the mark in each target with a rectangular frame; judge the results of detection and recognition;

G、对识别和检测的结果进行验证。G. Verify the results of identification and detection.

作为本发明的进一步技术方案:所述步骤A通过摄像头实现。As a further technical solution of the present invention: the step A is implemented by a camera.

作为本发明的进一步技术方案:所述步骤B具体是:将采集到的一定时间内的图像进行综合比对,如果比对结果一致,则判断为该段时间内的画面静止,没有动态物体出现,自动删除该段时间采集到的图像信息,因此判定该段时间图像为无效图像,当比对结果不一致,则将出现差异的图像提取出来,判定该段时间的图像为待识别图像。As a further technical solution of the present invention: the step B is specifically: comprehensively comparing the collected images within a certain period of time, and if the comparison results are consistent, it is determined that the pictures within this period of time are static and no dynamic objects appear. , automatically delete the image information collected in this period of time, so it is determined that the image in this period of time is invalid.

作为本发明的进一步技术方案:所述步骤E具体是将每张图像的标签信息格式化并写入一个txt文件中,同时还将该图像中与原始画面不同的图像点提取出来,作为区别图像。As a further technical solution of the present invention: the step E specifically formats the label information of each image and writes it into a txt file, and also extracts image points different from the original image in the image as the difference image .

作为本发明的进一步技术方案:还包括步骤F:进行算法仿真,并为改进后的识别算法搭建实验平台进行验证,其中,算法仿真通过MATLAB软件实现。As a further technical solution of the present invention, it also includes step F: performing algorithm simulation, and building an experimental platform for the improved identification algorithm for verification, wherein the algorithm simulation is realized by MATLAB software.

与现有技术相比,本发明的有益效果是:本发明基于神经网络的目标检测与识别方法采用目标检测与识别进行人脸识别,其运算速度快,判断结果准确,有效提高了检测的精度和识别的效率。Compared with the prior art, the beneficial effects of the present invention are as follows: the target detection and recognition method based on the neural network of the present invention adopts target detection and recognition to perform face recognition, the operation speed is fast, the judgment result is accurate, and the detection accuracy is effectively improved. and recognition efficiency.

具体实施方式Detailed ways

下面将对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention will be described clearly and completely below. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

实施例1:一种基于神经网络的目标检测与识别方法,包含以下步骤:Embodiment 1: a neural network-based target detection and recognition method, comprising the following steps:

A、使用图像采集装置采集检测区域内的画面信息;A. Use the image acquisition device to collect the picture information in the detection area;

B、对采集到的图像进行识别处理,将采集到的一定时间内的图像进行综合比对,如果比对结果一致,则判断为该段时间内的画面静止,没有动态物体出现,自动删除该段时间采集到的图像信息,因此判定该段时间图像为无效图像,当比对结果不一致,则将出现差异的图像提取出来,判定该段时间的图像为待识别图像。B. Perform identification processing on the collected images, and comprehensively compare the collected images within a certain period of time. If the comparison results are consistent, it is judged that the picture within this period of time is still and no dynamic objects appear, and the image is automatically deleted. The image information collected over a period of time is therefore determined to be an invalid image. When the comparison results are inconsistent, the image with the difference is extracted, and the image in this period of time is determined to be the image to be recognized.

C、通过计算机建立神经网络模型;C. Establish a neural network model through a computer;

D、定义卷积神经网络的主要模块;D. Define the main modules of the convolutional neural network;

E、利用神经网络模型计算对采集到的画面信息进行检测,并完成数值结果输出;将每张图像的标签信息格式化并写入一个txt文件中,同时还将该图像中与原始画面不同的图像点提取出来,作为区别图像;E. Use the neural network model calculation to detect the collected picture information, and complete the output of the numerical results; format and write the label information of each image into a txt file, and at the same time also change the image in the image different from the original picture. The image points are extracted as the difference image;

F、根据检测结果在图像上作出标注,用矩形框标出每个目标中的标注的位置和类别;判断检测与识别的结果;F. Mark the image according to the detection result, mark the position and category of the mark in each target with a rectangular frame; judge the results of detection and recognition;

G、对识别和检测的结果进行验证。G. Verify the results of identification and detection.

H、进行算法仿真,并为改进后的识别算法搭建实验平台进行验证,其中,算法仿真通过MATLAB软件实现。H. Carry out algorithm simulation, and build an experimental platform for the improved identification algorithm to verify, wherein the algorithm simulation is realized by MATLAB software.

其中,步骤A通过摄像头实现。也可以先用手机、数码相机等设备实现。Wherein, step A is implemented by a camera. You can also use mobile phones, digital cameras and other devices to achieve.

对于本领域技术人员而言,显然本发明不限于上述示范性实施例的细节,而且在不背离本发明的精神或基本特征的情况下,能够以其他的具体形式实现本发明。因此,无论从哪一点来看,均应将实施例看作是示范性的,而且是非限制性的,本发明的范围由所附权利要求而不是上述说明限定,因此旨在将落在权利要求的等同要件的含义和范围内的所有变化囊括在本发明内。It will be apparent to those skilled in the art that the present invention is not limited to the details of the above-described exemplary embodiments, but that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics of the invention. Therefore, the embodiments are to be regarded in all respects as illustrative and not restrictive, and the scope of the invention is to be defined by the appended claims rather than the foregoing description, which are therefore intended to fall within the scope of the claims. All changes within the meaning and scope of the equivalents of , are included in the present invention.

此外,应当理解,虽然本说明书按照实施方式加以描述,但并非每个实施方式仅包含一个独立的技术方案,说明书的这种叙述方式仅仅是为清楚起见,本领域技术人员应当将说明书作为一个整体,各实施例中的技术方案也可以经适当组合,形成本领域技术人员可以理解的其他实施方式。In addition, it should be understood that although this specification is described in terms of embodiments, not each embodiment only includes an independent technical solution, and this description in the specification is only for the sake of clarity, and those skilled in the art should take the specification as a whole , the technical solutions in each embodiment can also be appropriately combined to form other implementations that can be understood by those skilled in the art.

Claims (5)

1. a kind of object detection and recognition method neural network based, which is characterized in that comprise the steps of:
Use the image information in image acquisition device detection zone;
Identifying processing is carried out to acquired image,
Neural network model is established by computer;
Define the main modular of convolutional neural networks;
Collected image information is detected using neural network model calculating, and completes numerical result output;
It makes mark on the image according to testing result, position and the classification of the mark in each target is marked with rectangle frame;Sentence The result of disconnected detection and identification;
The result of identification and detection is verified.
2. a kind of object detection and recognition method neural network based according to claim 1, which is characterized in that described Step A is realized by camera.
3. a kind of object detection and recognition method neural network based according to claim 2, which is characterized in that described Step B is specifically: the image in collected certain time being carried out global alignment, if the comparison results are consistent, then is judged as Picture still in this time occurs without dynamic object, is automatically deleted this section of time acquired image information, therefore sentence Fixed this section of temporal image is invalid image, when comparison result is inconsistent, then comes out the image zooming-out for difference occur, determines the section The image of time is images to be recognized.
4. a kind of object detection and recognition method neural network based according to claim 3, which is characterized in that described Step E be specifically the label information of every image is formatted and is written in a txt file, while also by the image with original The different picture point of beginning picture extracts, as difference image.
5. a kind of object detection and recognition method neural network based according to claim 4, which is characterized in that also wrap It includes step H: carrying out algorithm simulating, and build experiment porch for improved recognizer and verified, wherein algorithm simulating is logical Cross MATLAB software realization.
CN201910254154.6A 2019-03-30 2019-03-30 A kind of object detection and recognition method neural network based Pending CN109977891A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910254154.6A CN109977891A (en) 2019-03-30 2019-03-30 A kind of object detection and recognition method neural network based

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910254154.6A CN109977891A (en) 2019-03-30 2019-03-30 A kind of object detection and recognition method neural network based

Publications (1)

Publication Number Publication Date
CN109977891A true CN109977891A (en) 2019-07-05

Family

ID=67081943

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910254154.6A Pending CN109977891A (en) 2019-03-30 2019-03-30 A kind of object detection and recognition method neural network based

Country Status (1)

Country Link
CN (1) CN109977891A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111076659A (en) * 2019-12-02 2020-04-28 深圳市太赫兹科技创新研究院有限公司 Signal processing method, device, terminal and computer readable storage medium
CN112364844A (en) * 2021-01-12 2021-02-12 北京三维天地科技股份有限公司 Data acquisition method and system based on computer vision technology

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104408470A (en) * 2014-12-01 2015-03-11 中科创达软件股份有限公司 Gender detection method based on average face preliminary learning
CN107563341A (en) * 2017-09-15 2018-01-09 赵立峰 A kind of face identification device and a kind of face identification system
US20180114056A1 (en) * 2016-10-25 2018-04-26 Vmaxx, Inc. Vision Based Target Tracking that Distinguishes Facial Feature Targets
CN108647742A (en) * 2018-05-19 2018-10-12 南京理工大学 Fast target detection method based on lightweight neural network
CN108960230A (en) * 2018-05-31 2018-12-07 中国科学院自动化研究所 Lightweight target identification method and device based on rotation rectangle frame
CN109002766A (en) * 2018-06-22 2018-12-14 北京邮电大学 A kind of expression recognition method and device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104408470A (en) * 2014-12-01 2015-03-11 中科创达软件股份有限公司 Gender detection method based on average face preliminary learning
US20180114056A1 (en) * 2016-10-25 2018-04-26 Vmaxx, Inc. Vision Based Target Tracking that Distinguishes Facial Feature Targets
CN107563341A (en) * 2017-09-15 2018-01-09 赵立峰 A kind of face identification device and a kind of face identification system
CN108647742A (en) * 2018-05-19 2018-10-12 南京理工大学 Fast target detection method based on lightweight neural network
CN108960230A (en) * 2018-05-31 2018-12-07 中国科学院自动化研究所 Lightweight target identification method and device based on rotation rectangle frame
CN109002766A (en) * 2018-06-22 2018-12-14 北京邮电大学 A kind of expression recognition method and device

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111076659A (en) * 2019-12-02 2020-04-28 深圳市太赫兹科技创新研究院有限公司 Signal processing method, device, terminal and computer readable storage medium
CN112364844A (en) * 2021-01-12 2021-02-12 北京三维天地科技股份有限公司 Data acquisition method and system based on computer vision technology
CN112364844B (en) * 2021-01-12 2021-05-18 北京三维天地科技股份有限公司 Data acquisition method and system based on computer vision technology

Similar Documents

Publication Publication Date Title
Kumar et al. Automatic face mask detection using deep learning-based mobile-net architecture
CN111563557B (en) A method for object detection in a power cable tunnel
CN111445459B (en) A method and system for image defect detection based on deep twin network
JP2022133378A (en) Face biological detection method, device, electronic apparatus, and storage medium
CN108229390A (en) Rapid pedestrian detection method based on deep learning
CN107862300A (en) A kind of descending humanized recognition methods of monitoring scene based on convolutional neural networks
CN107977656A (en) A kind of pedestrian recognition methods and system again
CN107301376B (en) A Pedestrian Detection Method Based on Deep Learning Multi-layer Stimulation
CN111353399A (en) Tampered video detection method
CN110942456B (en) Tamper image detection method, device, equipment and storage medium
CN111738054A (en) A behavioral anomaly detection method based on spatiotemporal autoencoder network and spatiotemporal CNN
CN111311708A (en) A Visual SLAM Method Based on Semantic Optical Flow and Inverse Depth Filtering
WO2021190663A1 (en) Annotated face image acquisition method and apparatus, electronic device, and storage medium
CN116778241A (en) Logo recognition method based on multi-mode fusion and metric learning
CN110930384A (en) Crowd counting method, device, device and medium based on density information
CN109977891A (en) A kind of object detection and recognition method neural network based
CN111444803B (en) Image processing method, device, electronic equipment and storage medium
CN114821486B (en) A method of personnel identification in electric work scenarios
CN104268563A (en) Video abstraction method based on abnormal behavior detection
CN103391441B (en) A kind of monitor video object based on difference energy is deleted and is distorted detection algorithm
CN115424185A (en) Target identification method based on multi-dimensional sequence features
CN108596121A (en) A kind of face critical point detection method based on context and structural modeling
CN111160262A (en) Portrait segmentation method fusing human body key point detection
CN117765609A (en) System for detecting factory man-object interaction violation
CN108664902B (en) End-to-end video copy detection method and device based on deep learning

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20190705