CN111382697B - Image data processing method and first electronic equipment - Google Patents
Image data processing method and first electronic equipment Download PDFInfo
- Publication number
- CN111382697B CN111382697B CN202010155907.0A CN202010155907A CN111382697B CN 111382697 B CN111382697 B CN 111382697B CN 202010155907 A CN202010155907 A CN 202010155907A CN 111382697 B CN111382697 B CN 111382697B
- Authority
- CN
- China
- Prior art keywords
- image data
- candidate image
- orientation information
- electronic device
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 18
- 238000013480 data collection Methods 0.000 claims abstract description 97
- 238000003384 imaging method Methods 0.000 claims abstract description 30
- 238000000034 method Methods 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 6
- 238000009434 installation Methods 0.000 abstract description 9
- 238000012544 monitoring process Methods 0.000 description 22
- 238000007667 floating Methods 0.000 description 10
- 238000012545 processing Methods 0.000 description 10
- 238000013473 artificial intelligence Methods 0.000 description 7
- 238000004458 analytical method Methods 0.000 description 6
- 230000006399 behavior Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 238000004140 cleaning Methods 0.000 description 3
- 238000007405 data analysis Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 230000002411 adverse Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000003032 molecular docking Methods 0.000 description 1
- 239000000779 smoke Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/23—Clustering techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
Landscapes
- Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Life Sciences & Earth Sciences (AREA)
- Artificial Intelligence (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- General Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Alarm Systems (AREA)
Abstract
本发明实施例提供了一种影像数据处理方法及第一电子设备,所述影像数据处理方法,应用于第一电子设备,包括:从影像设备获取P个数据采集方位信息,以及所述P个数据采集方位信息对应的N个候选影像数据,所述P个数据采集方位信息关联至少两个第二电子设备,P与N均为大于1的整数;从所述N个候选影像数据中确定目标影像数据,所述目标影像数据为具有告警内容的候选影像数据;将所述目标影像数据发送至目标电子设备,所述目标电子设备为所述至少两个第二电子设备中与所述目标影像数据对应的数据采集方位信息关联的第二电子设备。本发明实施例能够有效降低各应用场合下对影像设备的数量需求,节省影像设备的购置安装成本。
An embodiment of the present invention provides an image data processing method and a first electronic device. The image data processing method is applied to the first electronic device and includes: acquiring P pieces of data collection orientation information from the image equipment, and N candidate image data corresponding to the P pieces of data collection orientation information, the P pieces of data collection orientation information are associated with at least two second electronic devices, and both P and N are integers greater than 1; determining target image data from the N candidate image data, and the target image data is candidate image data with alarm content; sending the target image data to the target electronic device, the target image data The electronic device is the second electronic device associated with the data collection orientation information corresponding to the target image data among the at least two second electronic devices. The embodiments of the present invention can effectively reduce the demand for the quantity of imaging equipment in various application occasions, and save the purchase and installation costs of imaging equipment.
Description
技术领域technical field
本发明涉及电子技术领域,尤其涉及一种影像数据处理方法及第一电子设备。The present invention relates to the field of electronic technology, in particular to an image data processing method and a first electronic device.
背景技术Background technique
摄像头作为一种信息采集设备,已经被广泛地运用于监控中。当前,同一个摄像头通常仅用于实现一种功能,例如,仅用于进行交通违章监控,或者仅用于火灾监控等。对于同一场景有不同监控需求的不同用户,往往需要分别设置摄像头来获取监控信息,导致所需安装的摄像头的数量较多,购置安装成本较高。As an information collection device, the camera has been widely used in monitoring. Currently, the same camera is usually only used for one function, for example, only for traffic violation monitoring, or only for fire monitoring, etc. For different users with different monitoring needs in the same scene, it is often necessary to set up cameras separately to obtain monitoring information, resulting in a large number of cameras to be installed and high purchase and installation costs.
发明内容Contents of the invention
本发明实施例提供一种影像数据处理方法及第一电子设备,以解决现有技术中同一场景下有不同监控需求的不同用户,需要分别设置摄像头来获取监控信息,导致所需安装的摄像头的数量较多,购置安装成本较高的问题。Embodiments of the present invention provide an image data processing method and a first electronic device to solve the problem in the prior art that different users with different monitoring needs in the same scene need to install cameras to obtain monitoring information, resulting in a large number of cameras to be installed and high purchase and installation costs.
为了解决上述技术问题,本发明是这样实现的:In order to solve the problems of the technologies described above, the present invention is achieved in that:
本发明实施例提供了一种影像数据处理方法,应用于第一电子设备,包括:An embodiment of the present invention provides an image data processing method applied to a first electronic device, including:
从影像设备获取P个数据采集方位信息,以及所述P个数据采集方位信息对应的N个候选影像数据,所述P个数据采集方位信息关联至少两个第二电子设备,P与N均为大于1的整数;Acquire P pieces of data collection orientation information from the imaging device, and N pieces of candidate image data corresponding to the P pieces of data collection orientation information, the P pieces of data collection orientation information are associated with at least two second electronic devices, and both P and N are integers greater than 1;
从所述N个候选影像数据中确定目标影像数据,所述目标影像数据为具有告警内容的候选影像数据;determining target image data from the N candidate image data, where the target image data is candidate image data with warning content;
将所述目标影像数据发送至目标电子设备,所述目标电子设备为所述至少两个第二电子设备中与所述目标影像数据对应的数据采集方位信息关联的第二电子设备。The target image data is sent to a target electronic device, and the target electronic device is a second electronic device among the at least two second electronic devices that is associated with the data collection orientation information corresponding to the target image data.
本发明实施例还提供了一种第一电子设备,包括:The embodiment of the present invention also provides a first electronic device, including:
第一获取模块,用于从影像设备获取P个数据采集方位信息,以及所述P个数据采集方位信息对应的N个候选影像数据,所述P个数据采集方位信息关联至少两个第二电子设备,P与N均为大于1的整数;The first acquiring module is configured to acquire P pieces of data collection orientation information from the image device, and N candidate image data corresponding to the P pieces of data collection orientation information, the P pieces of data collection orientation information are associated with at least two second electronic devices, and both P and N are integers greater than 1;
确定模块,用于从所述N个候选影像数据中确定目标影像数据,所述目标影像数据为具有告警内容的候选影像数据;A determining module, configured to determine target image data from the N candidate image data, where the target image data is candidate image data with warning content;
发送模块,用于将所述目标影像数据发送至目标电子设备,所述目标电子设备为所述至少两个第二电子设备中与所述目标影像数据对应的数据采集方位信息关联的第二电子设备。A sending module, configured to send the target image data to a target electronic device, and the target electronic device is a second electronic device among the at least two second electronic devices that is associated with the data collection orientation information corresponding to the target image data.
本发明实施例还提供了一种计算机可读存储介质,所述计算机可读存储介质上存储计算机程序,所述计算机程序被处理器执行时实现上述的影像数据处理方法的步骤。An embodiment of the present invention also provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the above image data processing method are realized.
本发明实施例中,通过将影像设备采集方位信息及其对应的候选影像数据关联至少两个第二电子设备,在候选影像数据中具有告警内容的情况下,能够基于关联关系将具有告警内容的候选影像数据,即目标影像数据发送至对应的第二电子设备;本发明实施例通过建立的第二电子设备与数据采集方位信息的关联关系,可以同时满足不同用户对不同影像设备数据采集方位的需求,较好地实现了影像设备对至少两个第二电子设备的共享,进而能够有效降低各应用场合下对影像设备的数量需求,节省影像设备的购置安装成本。In the embodiment of the present invention, by associating the orientation information collected by the imaging device and its corresponding candidate image data with at least two second electronic devices, if the candidate image data has alarm content, the candidate image data with alarm content, that is, the target image data, can be sent to the corresponding second electronic device based on the association relationship; the embodiment of the present invention can meet the needs of different users for the data collection orientation of different imaging devices by establishing the association relationship between the second electronic device and the data collection orientation information, and better realize the sharing of the image device with at least two second electronic devices, thereby effectively reducing the The demand for the quantity of imaging equipment in the application occasion saves the purchase and installation cost of imaging equipment.
附图说明Description of drawings
图1为本发明实施例提供的影像数据处理方法的流程图;FIG. 1 is a flowchart of an image data processing method provided by an embodiment of the present invention;
图2为本发明实施例提供的影像数据处理方法在一个具体应用场景中的实施流程图;Fig. 2 is a flow chart of the implementation of the image data processing method provided in the embodiment of the present invention in a specific application scenario;
图3为本发明实施例提供的第一电子设备的结构示意图;FIG. 3 is a schematic structural diagram of a first electronic device provided by an embodiment of the present invention;
图4为应用到本发明实施例提供的第一电子设备的一种影像数据处理系统的架构图。FIG. 4 is a structural diagram of an image data processing system applied to a first electronic device provided by an embodiment of the present invention.
具体实施方式Detailed ways
为使本发明要解决的技术问题、技术方案和优点更加清楚,下面将结合附图及具体实施例进行详细描述。在下面的描述中,提供诸如具体的配置和组件的特定细节仅仅是为了帮助全面理解本发明的实施例。因此,本领域技术人员应该清楚,可以对这里描述的实施例进行各种改变和修改而不脱离本发明的范围和精神。另外,为了清楚和简洁,省略了对已知功能和构造的描述。In order to make the technical problems, technical solutions and advantages to be solved by the present invention clearer, the following will describe in detail with reference to the drawings and specific embodiments. In the following description, specific details, such as specific configurations and components, are provided only to assist in a comprehensive understanding of the embodiments of the present invention. Accordingly, those of ordinary skill in the art should recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted for clarity and conciseness.
如图1所示,本发明实施例提供的影像数据处理方法,应用于第一电子设备,包括:As shown in Figure 1, the image data processing method provided by the embodiment of the present invention is applied to the first electronic device, including:
步骤101,从影像设备获取P个数据采集方位信息,以及所述P个数据采集方位信息对应的N个候选影像数据,所述P个数据采集方位信息关联至少两个第二电子设备,P与N均为大于1的整数;Step 101, acquiring P pieces of data collection orientation information from the imaging device, and N pieces of candidate image data corresponding to the P pieces of data collection orientation information, the P pieces of data collection orientation information are associated with at least two second electronic devices, and both P and N are integers greater than 1;
步骤102,从所述N个候选影像数据中确定目标影像数据,所述目标影像数据为具有告警内容的候选影像数据;Step 102, determining target image data from the N candidate image data, where the target image data is candidate image data with warning content;
步骤103,将所述目标影像数据发送至目标电子设备,所述目标电子设备为所述至少两个第二电子设备中与所述目标影像数据对应的数据采集方位信息关联的第二电子设备。Step 103, sending the target image data to a target electronic device, where the target electronic device is the second electronic device associated with the data collection orientation information corresponding to the target image data among the at least two second electronic devices.
影像设备可以是例如摄像头等能够获取候选影像数据的设备。第二电子设备可以对应的是例如电脑端(即PC端)或者移动终端等设备,能够接收第一电子设备发送的目标影像数据等数据。The image device may be a device capable of acquiring candidate image data, such as a camera. The second electronic device may correspond to devices such as a computer terminal (ie, a PC terminal) or a mobile terminal, capable of receiving data such as target image data sent by the first electronic device.
可以理解的是,至少两个第二电子设备可以对应不同的用户,实际应用中,不同的用户可能具有不同的监控与告警需求,对摄像头的工作方位的要求也可能不同。例如,在某一应用场景下,摄像头安装位置的一侧为河流,而另一侧为道路,用户A可能需要使用该摄像头对河流漂浮物进行监控,而用户B可能需要对道路违章情况进行监控;在该应用场景下,用户A对应的第二电子设备所关联的数据采集方位信息,可以对应的是摄像头朝向河流的第一数据采集方位;而用户B对应的第二电子设备所关联的数据采集方位信息,可以对应的是摄像头朝向道路的第二数据采集方位。It can be understood that the at least two second electronic devices may correspond to different users. In practical applications, different users may have different monitoring and alarm requirements, and may also have different requirements for the working orientation of the camera. For example, in a certain application scenario, one side of the installation position of the camera is a river, and the other side is a road. User A may need to use the camera to monitor floating objects in the river, while user B may need to monitor road violations;
影像设备可以在多个数据采集方位中的每一个数据采集方位下,分别采集一个或多个影像数据。在一个示例中,将影像设备采集的影像数据定义为原始影像数据,一个原始影像数据可以是在影像设备停留在某一固定预置方位(以下简称预置位)的期间,录制的一段视频或者是拍摄的一张或多张照片。当原始影像数据为一段视频时,候选影像数据可以是该段视频中的其中一帧或多帧照片,当原始影像数据为一张或多张照片时,候选影像数据可以是其中的全部或部分照片。The imaging device can respectively collect one or more image data in each of the multiple data collection orientations. In an example, the image data collected by the imaging device is defined as raw image data, and a piece of raw image data may be a segment of video recorded or one or more photos taken while the imaging device stays at a certain fixed preset position (hereinafter referred to as the preset position). When the original image data is a video, the candidate image data may be one or more frames of photos in the video; when the original image data is one or more photos, the candidate image data may be all or part of the photos.
当然,原始影像数据也可以是影像设备在某一角度范围内转动期间,通过录制或者拍摄获取的,对应的数据采集方位信息可以对应的是影像设备转动的角度范围。Of course, the original image data can also be obtained by recording or shooting while the imaging device is rotating within a certain angle range, and the corresponding data acquisition orientation information can correspond to the angle range of the imaging device rotation.
告警内容可以根据用户的需要进行设定,例如可以是例如河流漂浮物、火情、人员或者车辆等。基于对候选影像数据的分析与识别可以判断该候选影像数据中是否具有告警内容。当候选影像数据中具有告警内容时,可以将该候选影像数据中确定为目标影像数据。由于目标影像数据对应有数据采集方位信息,而数据采集方位信息又关联有第二电子设备,基于以上关联关系,可以得到目标影像数据对应的第二电子设备,即目标电子设备,并将该目标影像数据发送至目标电子设备。The alarm content can be set according to the needs of the user, for example, it can be, for example, river floating objects, fire conditions, personnel or vehicles, and the like. Based on the analysis and identification of the candidate image data, it can be determined whether the candidate image data has warning content. When the candidate image data has warning content, the candidate image data may be determined as the target image data. Since the target image data corresponds to data collection orientation information, and the data collection orientation information is associated with the second electronic device, based on the above association relationship, the second electronic device corresponding to the target image data, that is, the target electronic device, can be obtained, and the target image data can be sent to the target electronic device.
同样以摄像头分别在第一采集方位与第二采集方位下对河流和道路的监控为例,在经过分析识别得到某一候选影像数据中具有河流漂浮物的情况下,可以将该候选影像数据作为目标影像数据发送至用户A所对应的第二电子设备。Similarly, taking the monitoring of rivers and roads by the camera at the first collection orientation and the second collection orientation respectively as an example, if it is identified through analysis that there are floating objects in the river in a certain candidate image data, the candidate image data can be sent as the target image data to the second electronic device corresponding to user A.
本发明实施例中,通过将影像设备采集方位信息及其对应的候选影像数据关联至少两个第二电子设备,在候选影像数据中具有告警内容的情况下,能够基于关联关系将具有告警内容的候选影像数据,即目标影像数据发送至对应的第二电子设备;本发明实施例通过建立的第二电子设备与数据采集方位信息的关联关系,可以同时满足不同用户对不同影像设备数据采集方位的需求,较好地实现了影像设备对至少两个第二电子设备的共享,进而能够有效降低各应用场合下对影像设备的数量需求,节省影像设备的购置安装成本。此外,本发明实施例中,第一电子设备向目标电子设备发送具有告警内容的目标影像数据,相较于直接将全部候选影像数据发送至相应的第二电子设备,可以有效省略各个第二电子设备对告警内容进行识别的过程,从而提高影像数据处理效率。In the embodiment of the present invention, by associating the orientation information collected by the imaging device and its corresponding candidate image data with at least two second electronic devices, if the candidate image data has alarm content, the candidate image data with alarm content, that is, the target image data, can be sent to the corresponding second electronic device based on the association relationship; the embodiment of the present invention can meet the needs of different users for the data collection orientation of different imaging devices by establishing the association relationship between the second electronic device and the data collection orientation information, and better realize the sharing of the image device with at least two second electronic devices, thereby effectively reducing the The demand for the quantity of imaging equipment in the application occasion saves the purchase and installation cost of imaging equipment. In addition, in the embodiment of the present invention, the first electronic device sends the target image data with warning content to the target electronic device. Compared with directly sending all candidate image data to the corresponding second electronic device, the process of identifying the warning content by each second electronic device can be effectively omitted, thereby improving the image data processing efficiency.
在一个示例中,在一些应用场合下,例如摄像头安装位置比较合适以致于可以在同一数据采集方位下同时对道路与河流进行监控,此时,不同第二电子设备所分别关联的数据方位信息,可以对应摄像头的同一数据采集方位。此时影像设备可以在一个数据采集方位下采集多个影像数据,从而满足不同用户的不同监控需求。In one example, in some applications, for example, the installation position of the camera is so appropriate that roads and rivers can be monitored simultaneously in the same data collection orientation. At this time, the data orientation information associated with different second electronic devices can correspond to the same data collection orientation of the camera. At this time, the imaging device can collect multiple image data in one data collection position, so as to meet the different monitoring needs of different users.
可选地,所述影像数据处理方法还包括:Optionally, the image data processing method further includes:
分别获取所述N个候选影像数据中每一候选影像数据的数据采集时间;Respectively acquire the data collection time of each candidate image data in the N candidate image data;
分别将所述P个数据采集方位信息中每一数据采集方位信息对应的L个候选影像数据以及所述L个候选影像数据中每一候选影像数据的数据采集时间,存储在与所述每一数据采集方位信息对应的存储路径,L为小于或等于N的正整数。The L candidate image data corresponding to each data acquisition orientation information in the P pieces of data collection orientation information and the data acquisition time of each candidate image data in the L candidate image data are respectively stored in the storage path corresponding to each of the data collection orientation information, where L is a positive integer less than or equal to N.
以某一数据采集方位信息对应的L个候选影像数据为例,由于影像设备需要在不同的数据采集方位下采集影像数据,其可能在工作期间在不同的预置位之间切换,因此,上述L个候选影像数据在采集时间上可能并非是连续的。本示例中,一方面,将这L个候选影像数据存储在与该数据采集方位信息对应存储路径;另一方面,将这L个候选影像数据分别对应的数据采集时间也相应地进行存储,进而有利于后续针对同一预置位下的候选影像数据按采集时间先后进行数据比对。Taking the L candidate image data corresponding to a certain data collection orientation information as an example, since the imaging device needs to collect image data in different data collection orientations, it may switch between different preset positions during operation. Therefore, the above L candidate image data may not be continuous in terms of acquisition time. In this example, on the one hand, the L candidate image data is stored in a storage path corresponding to the data acquisition orientation information; on the other hand, the data acquisition time corresponding to the L candidate image data is also stored correspondingly, which is conducive to subsequent data comparison of the candidate image data in the same preset position according to the acquisition time.
结合一具体应用场景,影像设备同时用于道路违停监控(对应第一预置位)与河流漂浮物监控(对应第二预置位),若道路违停判断的条件是同一车辆在预置位置区域停留超过5分钟。现有技术中,通常仅针对第一预置位对应一个连续时间段内的影像数据进行数据分析,如此,必须设定影像设备每次在第一预置位处停留超过5分钟,才能对是否存在道路违停进行判断。而本示例中,将影像设备在第一预置位下获取的影像数据存储在设定的同一存储路径,假设影像设备每隔30秒在两个预置位之间切换一次,在分析是否存在道路违停时,可以判断第一预置位对应存储路径下是否存在5张以上均具有相应告警内容的候选影像数据,或者判断是否存在任两张数据采集时间间隔超过5分钟的具有相应告警内容的候选影像数据。可见,本示例中的影像数据处理方法可以有效解决因仅能对一个预置位的一段连续停留时间内的影像数据分析,而导致的影像设备在一个预置位停留时间过长影响,影响对其他预置位或关键区域的实时监控的问题。Combined with a specific application scenario, the imaging device is used for monitoring illegal parking on the road (corresponding to the first preset position) and monitoring floating objects in the river (corresponding to the second preset position). If the condition for judging illegal parking on the road is that the same vehicle stays in the preset position area for more than 5 minutes. In the prior art, data analysis is usually only performed on the image data corresponding to a continuous period of time corresponding to the first preset position. In this way, it is necessary to set the imaging device to stay at the first preset position for more than 5 minutes each time to determine whether there is a road violation. In this example, the image data acquired by the imaging device at the first preset position is stored in the same set storage path. Assume that the imaging device switches between the two preset positions every 30 seconds. When analyzing whether there is a road violation, it can be judged whether there are more than 5 candidate image data with corresponding warning content in the storage path corresponding to the first preset position, or whether there are any two pieces of candidate image data with corresponding warning content whose data collection time interval exceeds 5 minutes. It can be seen that the image data processing method in this example can effectively solve the problem that the imaging equipment stays in a preset position for too long and affects real-time monitoring of other preset positions or key areas because it can only analyze the image data of a preset position for a period of continuous residence time.
在一个示例中,候选影像数据的存储位置还可以进一步结合数据采集时间来确定。例如,可以将某一数据采集方位信息对应的L个候选影像数据,按采集日期、车辆高低峰或者天气等分不同存储路径进行存储,具体的存储规则可根据实际需要进行设定。In an example, the storage location of the candidate image data may further be determined in conjunction with the data collection time. For example, L candidate image data corresponding to a certain data collection orientation information can be stored in different storage paths according to the collection date, vehicle peak and low peak or weather, and the specific storage rules can be set according to actual needs.
可选地,数据采集方位信息可以同时包括了影像设备所在的地理位置信息,以及影像设备采集影像数据时对应的采集方向信息(例如俯仰角度信息)。以便于在多个地理位置分别设置有上述影像设备的情况下,能够准备地把握获取到的候选影像数据所对应的地理位置。Optionally, the data collection azimuth information may also include geographic location information where the imaging device is located, and corresponding collection direction information (such as pitch angle information) when the imaging device collects image data. In order to prepare for grasping the geographic locations corresponding to the acquired candidate image data when the above-mentioned imaging devices are respectively installed in a plurality of geographic locations.
可选地,所述步骤102,从所述N个候选影像数据中确定目标影像数据,包括:Optionally, the step 102, determining the target image data from the N candidate image data includes:
从所述N个候选影像数据中获取第一数据采集方位信息对应的M个候选影像数据,所述第一数据采集方位信息为所述P个数据采集方位信息中任一数据采集方位信息,M为小于或等于N的正整数;Acquire M candidate image data corresponding to the first data collection orientation information from the N candidate image data, the first data collection orientation information is any data collection orientation information in the P data collection orientation information, and M is a positive integer less than or equal to N;
在第一候选影像数据的数量大于数量阈值的情况下,将所述第一候选影像数据确定为所述目标影像数据,所述第一候选影像数据为所述M个候选影像数据中具有所述告警内容的候选影像数据。If the quantity of the first candidate image data is greater than a quantity threshold, the first candidate image data is determined as the target image data, and the first candidate image data is the candidate image data having the warning content among the M candidate image data.
本实施例中,每一个数据采集方位信息可以对应一个或多个候选影像数据,并且可以在某一个数据采集方位信息对应的M个候选影像数据中,具有告警内容的候选影像数据的数量超过一定数量阈值时,将这部分具有告警内容的候选影像数据作为目标影像数据。In this embodiment, each piece of data collection orientation information may correspond to one or more candidate image data, and among the M candidate image data corresponding to a certain data collection orientation information, when the number of candidate image data with warning content exceeds a certain number threshold, this part of candidate image data with warning content may be used as target image data.
上述数量阈值可以是根据实际需要进行选择。例如,在对某一段河流的河流漂浮物进行监控时,当存在一个候选影像数据中具有告警内容(即对应河流漂浮物)的情况,即可将该候选影像数据作为目标影像数据,此时,数量阈值可以为小于1的数字。再例如,在进行某一交通路口的道路违章监控时,关于违章停车,或者是闯红灯违章等应用,可能需要在具有告警内容的候选影像数据的数量不低于2个的情况下,才会将具有告警内容的候选影像数据作为目标影像数据。The aforementioned quantity threshold may be selected according to actual needs. For example, when monitoring floating objects in a certain section of the river, if there is a situation in which a candidate image data has warning content (that is, corresponding to floating objects in the river), the candidate image data can be used as the target image data. At this time, the quantity threshold can be a number less than 1. For another example, when monitoring road violations at a certain traffic intersection, for applications such as parking violations or red light violations, it may be necessary to use the candidate image data with warning content as the target image data only when the number of candidate image data with warning content is not less than 2.
本实施例中,可以根据实际需要确定数量阈值,并在某一数据采集方位信息对应的M个候选影像数据中,具有告警内容的候选影像数据的数量超过该数量阈值时,确定相应的目标影像数据,进而能够满足多种应用场景下的监控需求。In this embodiment, the number threshold can be determined according to actual needs, and when the number of candidate image data with warning content exceeds the number threshold among the M candidate image data corresponding to a certain data collection orientation information, the corresponding target image data can be determined, thereby meeting the monitoring requirements in various application scenarios.
可选地,所述从所述N个候选影像数据中获取第一数据采集方位信息对应的M个候选影像数据之后,所述方法包括:Optionally, after acquiring M candidate image data corresponding to the first data collection orientation information from the N candidate image data, the method includes:
依据所述第一数据采集方位信息,分别确定所述M个候选影像数据中每一候选影像数据的告警区域,所述告警区域为所述每一候选影像数据中用于判断是否存在告警内容的像素区域;According to the first data acquisition orientation information, respectively determine the alarm area of each candidate image data in the M candidate image data, the alarm area is the pixel area used to determine whether there is an alarm content in each candidate image data;
将所述M个候选影像数据中,对应的所述告警区域内存在告警内容的候选影像数据确定为所述第一候选影像数据。Determining, among the M candidate image data, candidate image data that has warning content in the corresponding warning area as the first candidate image data.
本实施例中,可以针对每一个数据采集方位信息对应的M个候选影像数据,预先确定相应的告警区域。例如,影像设备在一个预置位上用于监控河流漂浮物,则该预置位(即对应一个数据采集方位信息)对应的候选影像数据中的告警区域可以是河流所在的像素区域;再例如,影像设备在另一个预置位上用于监控道路违章情况,则该预置位对应的告警区域可以是道路所在的像素区域。In this embodiment, for each of the M candidate image data corresponding to the data collection orientation information, the corresponding warning area may be determined in advance. For example, if the imaging device is used to monitor floating objects in a river at a preset position, the warning area in the candidate image data corresponding to the preset position (that is, corresponding to a piece of data collection orientation information) may be the pixel area where the river is located; for another example, if the imaging device is used to monitor road violations at another preset position, then the warning area corresponding to the preset position may be the pixel area where the road is located.
通过在候选影像数据中确定相应的告警区域,在进行候选影像数据中是否存在告警内容的判断时,只需对告警区域进行分析与识别,有利于提高对告警内容的识别效率。By determining the corresponding alarm area in the candidate image data, when judging whether there is an alarm content in the candidate image data, only the alarm area needs to be analyzed and identified, which is beneficial to improve the identification efficiency of the alarm content.
可选地,所述步骤103,将所述目标影像数据发送至目标电子设备,包括:Optionally, the step 103, sending the target image data to the target electronic device, includes:
确定所述目标影像数据中的告警内容所归属的告警类别;Determine the alarm category to which the alarm content in the target image data belongs;
依据所述告警类别与所述目标影像数据对应的数据采集方位信息,从所述至少两个第二电子设备中确定目标电子设备,所述目标电子设备与所述告警类别之间满足预设的告警类别与第二电子设备之间的对应关系;Determining a target electronic device from the at least two second electronic devices according to the data collection orientation information corresponding to the alarm category and the target image data, and the target electronic device and the alarm category satisfy a preset correspondence between the alarm category and the second electronic device;
将所述目标影像数据发送至所述目标电子设备。sending the target image data to the target electronic device.
如上文所述,基于对候选影像数据的分析与识别可以判断该候选影像数据中是否具有告警内容;而通过对告警内容进行聚类,即按照一定的要求和规律对告警内容进行区分和分类,可以获得不同告警内容所归属的告警类别。上述聚类的过程可以通过机器学习来实现,例如基于样本图像数据库中的样本图像,提取图像特征并在对图像特征研究的基础上通过学习产生出类别。As mentioned above, based on the analysis and identification of the candidate image data, it can be judged whether the candidate image data has alarm content; and by clustering the alarm content, that is, distinguishing and classifying the alarm content according to certain requirements and rules, the alarm category to which different alarm content belongs can be obtained. The above clustering process can be realized by machine learning, for example, based on sample images in the sample image database, image features are extracted and categories are generated through learning based on the study of image features.
告警类别与第二电子设备之间存在预设的对应关系,例如,对于对道路违章有监控需求的用户(可对应一个第二电子设备),对应的告警类别可以是道路违章告警;实际应用中,通过对候选影像数据的分析识别,可能存在关于车辆违章的告警内容,也可能存在行人违章的告警内容;可以将两种告警内容归入到道路违章告警一类。当存在目标影像数据时,一方面可以根据其数据采集方位信息与第二电子设备的对应关系,初步确定出可能需要接收目标影像数据的一个或多个第二电子设备;另一方面,可以根据告警内容所述的告警类别,比较精准地将目标影像数据发送至对其有需求的目标电子设备。There is a preset corresponding relationship between the warning category and the second electronic device. For example, for a user who needs to monitor road violations (which may correspond to a second electronic device), the corresponding warning category may be a road violation warning; in practical applications, through the analysis and identification of candidate image data, there may be warning content about vehicle violations, and there may also be warning content about pedestrian violations; the two kinds of warning contents can be classified into the road violation warning category. When the target image data exists, on the one hand, one or more second electronic devices that may need to receive the target image data can be preliminarily determined according to the corresponding relationship between the data collection orientation information and the second electronic device;
在一个示例中,在确定目标影像数据后,还可以针对目标影像数据进行告警,例如,可以对目标影像数据、数据采集方位信息以及告警类别等内容中的至少一项进行显示,还可以触发声光报警。在向目标电子设备发送目标影像数据时,也可以将上述数据采集方位信息等内容同时发送给目标电子设备。In an example, after the target image data is determined, an alarm may be given for the target image data, for example, at least one of the target image data, data collection orientation information, and alarm category may be displayed, and an audible and visual alarm may also be triggered. When sending the target image data to the target electronic device, the aforementioned data collection orientation information and other content may also be sent to the target electronic device at the same time.
参见图2,以下对本发明实施例提供的影像数据处理方法在一个具体应用场景中的实施过程进行说明:Referring to Fig. 2, the implementation process of the image data processing method provided by the embodiment of the present invention in a specific application scenario is described below:
步骤201,设置摄像头采集方位交替工作模式;Step 201, setting the alternate working mode of camera acquisition azimuth;
对摄像头进行设置,将已有的区域巡航工作模式下的摄像头,设置为在区域巡航与预置位巡航两种工作模式下交替循环,具体循环的方式可以进行时间的个性化控制。Set up the camera, and set the existing camera in the area cruise mode to cycle alternately in the area cruise and preset cruise modes. The specific cycle method can be personalized for time control.
区域巡航可以是指摄像头螺旋式旋转拍摄,例如,摄像头可以通过螺旋式旋转拍摄在其周边区域进行火情的监控,此时摄像头获得的影像数据并未具体方位信息,采用抽帧的方式获得的候选影像数据通常比较模糊;预置位巡航可以是指摄像头在一个或多个预设的固定方位进行交替循环拍摄(例如摄影或者拍照),获得的影像数据比较清晰,且可以对应比较具体的数据采集方位信息。Regional cruising can refer to the spiral rotation shooting of the camera. For example, the camera can monitor the fire situation in its surrounding area through spiral rotation shooting. At this time, the image data obtained by the camera does not have specific orientation information, and the candidate image data obtained by frame extraction is usually relatively blurred.
步骤202,软件开发工具包(Software Development Kit,SDK)接口对接;Step 202, software development kit (Software Development Kit, SDK) interface docking;
可以通过单独调用海康播放库PlayCtrl.dll来解码视频流,对摄像头返回的影像数据和数据采集方位信息(对应了预置位,包括数据采集角度信息与摄像头定位信息)进行采集处理。The video stream can be decoded by separately calling the Hikvision playback library PlayCtrl.dll, and the image data returned by the camera and the data collection orientation information (corresponding to the preset position, including the data collection angle information and the camera positioning information) can be collected and processed.
预置位可以与用户进行关联,而每个视频数据又会分别与各自预置位相关联,可以为后续视频数据分权分域的共享(可以理解为具体将一个视频数据的哪些内容发送给哪些用户)奠定基础。The preset position can be associated with the user, and each video data will be associated with its respective preset position, which can lay the foundation for the subsequent sharing of video data in terms of rights and domains (it can be understood as which content of a video data is sent to which users).
步骤203,对每个预置位的影像数据分路径存放,且进行数据保存;Step 203, store the image data of each preset position in different paths, and save the data;
需通过SDK接口信息,对同一个预置位的影像数据进行分路径存放;如涉及时间段不同的规则要求,则需对路径进行更细化处理。摄像头(或者称作图像和/或视频传感器信息采集模块)可以使用消息队列遥测传输协议(Message Queuing Telemetry Transport,MQTT)或者实时流传输协议(Real Time Streaming Protocol,RTSP),通过MQTT或RTSP实现对摄像头与用于运行影像数据处理方法的第一电子设备之间的实时数据流传输。The image data of the same preset location needs to be stored in different paths through the SDK interface information; if different time periods are involved in the rule requirements, the paths need to be processed in more detail. The camera (or image and/or video sensor information collection module) can use Message Queuing Telemetry Transport (MQTT) or Real Time Streaming Protocol (RTSP) to implement real-time data stream transmission between the camera and the first electronic device for running the image data processing method through MQTT or RTSP.
如此,可便于同一预置位下的时间标签先后的影像数据的比对;解决了目前摄像头厂家只能对预置位停留时间内的数据分析,导致一个预置位停留时间过长而对其他预置位或关键区域的实时监管带来不利影响的问题。In this way, it is convenient to compare the image data of the time stamps in the same preset position; it solves the problem that the current camera manufacturers can only analyze the data within the dwell time of the preset position, resulting in a preset position staying for too long and adversely affecting the real-time supervision of other preset positions or key areas.
步骤204,影像数据人工智能(Artificial Intelligence,AI)识别;Step 204, artificial intelligence (AI) recognition of image data;
可以利用影像数据AI识别影像数据中的告警内容。智能监控中的场景分析技术是指提取场景的特征信息后,根据场景的特征信息将场景进行分析和归类,将具有相同性质的同种物体归为一类,识别场景中具体包含哪些物体,进而得到识别结果。充分发挥机器视觉的主动性,使得在无人监控的情况下,机器能够自动的分析和抽取影像数据中特征信息,达到对告警内容进行识别的目的。The image data AI can be used to identify the alarm content in the image data. The scene analysis technology in intelligent monitoring refers to extracting the characteristic information of the scene, analyzing and classifying the scene according to the characteristic information of the scene, classifying the same kind of objects with the same nature into one category, identifying which objects are included in the scene, and then obtaining the recognition result. Give full play to the initiative of machine vision, so that the machine can automatically analyze and extract the feature information in the image data without unmanned monitoring, so as to achieve the purpose of identifying the alarm content.
通过AI识别,首先可以实现对影像数据的特征信息提取,然后根据预设的告警阈值,可以识别影像数据中各用户可能关注的“火情”、“人员”、“车辆”或“河道漂浮物”等告警内容。Through AI recognition, it is possible to firstly extract feature information from image data, and then, according to the preset alarm threshold, it can identify the alarm content such as "fire", "personnel", "vehicle" or "floating objects in the river" in the image data that users may be concerned about.
步骤205,识别结果进行分行业或场景的分类;Step 205, the recognition results are classified by industry or scene;
对识别结果进行聚类,即按照一定的要求和规律对事物进行区分和分类的过程,可以预先在图像数据库中,对大量样本图像的特征信息研究的基础上,通过学习产生出类别,然后按次此类别对识别结果进行分类。其优势就是可以动态地进行告警内容分类,而且可以有效地降低影像数据处理维度和目标用户的查询范围,提高数据处理效率。Clustering the recognition results, that is, the process of distinguishing and classifying things according to certain requirements and rules, can be in the image database in advance, on the basis of studying the characteristic information of a large number of sample images, and then generate categories through learning, and then classify the recognition results according to this category. Its advantage is that it can dynamically classify alarm content, and can effectively reduce the dimension of image data processing and the query scope of target users, and improve the efficiency of data processing.
实际应用中,本步骤可作为一头多用技术(即一个摄像头实现多个用户的不同用途)的关键,根据AI识别出来每个预置位对应影像数据的告警内容,以及不同用户(例如不同行业、不同部门或者不同的权限人员),对识别结果进行归类。In practical applications, this step can be used as the key to a multi-purpose technology (that is, one camera can be used for different purposes by multiple users), and the recognition results can be classified according to the alarm content of the image data corresponding to each preset position identified by AI, and different users (such as different industries, different departments or different authority personnel).
步骤206,将告警信息推送对应用户;Step 206, push the alarm information to the corresponding user;
根据对识别结果的类别生成告警信息,并通过分权分域的方式推送给不同的第二电子设备。告警信息可以通过Kafka消息总线传送到第一电子设备,第一电子设备可依据每个预置位的影像数据覆盖范围情况,在每个预置位的影像数据中设定报警区域。通过摄像头反馈的数据采集方位信息,结合二次违法判读(可以认为是同一告警内容同时在于获取时间不同的两个影像数据中,例如上文中提到的交通路口的道路违章监控场景)提供的告警内容像素坐标信息,第二电子设备可对告警区域进行精确定位,并可在主控界面上显示违法图片信息、地理坐标信息、违法类别等,同时触发声光报警,可查看报警消息详情。The alarm information is generated according to the category of the recognition result, and is pushed to different second electronic devices in a manner of dividing rights and domains. The alarm information can be transmitted to the first electronic device through the Kafka message bus, and the first electronic device can set an alarm area in the image data of each preset position according to the coverage of the image data of each preset position. Through the data collection orientation information fed back by the camera, combined with the secondary illegal interpretation (it can be considered that the same alarm content is in two image data with different acquisition times at the same time, such as the road violation monitoring scene at the traffic intersection mentioned above), the second electronic device can accurately locate the alarm area, and display illegal picture information, geographic coordinate information, and illegal categories on the main control interface, and trigger sound and light alarms at the same time, and you can view the details of the alarm message.
第一电子设备可以通过告警推送,将相应的影像数据等发送给匹配的第二电子设备,实现一头多用的影像数据的多层智能分析功能,以及影像数据的共享,降低用户对摄像头等影像设备的购置、安装以及维护成本。The first electronic device can send the corresponding image data to the matching second electronic device through the alarm push, so as to realize the multi-layer intelligent analysis function of the multi-purpose image data and the sharing of image data, and reduce the purchase, installation and maintenance costs of the camera and other image devices for users.
如图3所示,本发明实施例还提供了一种第一电子设备,包括:As shown in Figure 3, the embodiment of the present invention also provides a first electronic device, including:
第一获取模块301,用于从影像设备获取P个数据采集方位信息,以及所述P个数据采集方位信息对应的N个候选影像数据,所述P个数据采集方位信息关联至少两个第二电子设备,P与N均为大于1的整数;The first acquiring module 301 is configured to acquire P pieces of data collection orientation information from the image device, and N pieces of candidate image data corresponding to the P pieces of data collection orientation information, the P pieces of data collection orientation information are associated with at least two second electronic devices, and both P and N are integers greater than 1;
确定模块302,用于从所述N个候选影像数据中确定目标影像数据,所述目标影像数据为具有告警内容的候选影像数据;A determination module 302, configured to determine target image data from the N candidate image data, where the target image data is candidate image data with warning content;
发送模块303,用于将所述目标影像数据发送至目标电子设备,所述目标电子设备为所述至少两个第二电子设备中与所述目标影像数据对应的数据采集方位信息关联的第二电子设备。The sending module 303 is configured to send the target image data to a target electronic device, and the target electronic device is the second electronic device associated with the data collection orientation information corresponding to the target image data among the at least two second electronic devices.
可选地,所述确定模块302,包括:Optionally, the determining module 302 includes:
获取单元,用于从所述N个候选影像数据中获取第一数据采集方位信息对应的M个候选影像数据,所述第一数据采集方位信息为所述P个数据采集方位信息中任一数据采集方位信息,M为小于或等于N的正整数;An acquiring unit, configured to acquire M pieces of candidate image data corresponding to the first data collection orientation information from the N pieces of candidate image data, the first data collection orientation information being any data collection orientation information among the P pieces of data collection orientation information, and M is a positive integer less than or equal to N;
第一确定单元,用于在第一候选影像数据的数量大于数量阈值的情况下,将所述第一候选影像数据确定为所述目标影像数据,所述第一候选影像数据为所述M个候选影像数据中具有所述告警内容的候选影像数据。A first determining unit, configured to determine the first candidate image data as the target image data when the quantity of the first candidate image data is greater than a quantity threshold, and the first candidate image data is the candidate image data having the warning content among the M candidate image data.
可选地,所述确定模块302还包括:Optionally, the determining module 302 also includes:
第二确定单元,用于依据所述第一数据采集方位信息,分别确定所述M个候选影像数据中每一候选影像数据的告警区域,所述告警区域为所述每一候选影像数据中用于判断是否存在告警内容的像素区域;The second determination unit is configured to respectively determine the warning area of each candidate image data in the M candidate image data according to the first data collection orientation information, and the warning area is a pixel area used for judging whether there is an alarm content in each candidate image data;
第三确定单元,用于将所述M个候选影像数据中,对应的所述告警区域内存在告警内容的候选影像数据确定为所述第一候选影像数据。A third determining unit, configured to determine, among the M candidate image data, candidate image data that has warning content in the corresponding warning area as the first candidate image data.
可选地,所述发送模块303,包括:Optionally, the sending module 303 includes:
第四确定单元,用于确定所述目标影像数据中的告警内容所归属的告警类别;A fourth determining unit, configured to determine the alarm category to which the alarm content in the target image data belongs;
第五确定单元,用于依据所述告警类别与所述目标影像数据对应的数据采集方位信息,从所述至少两个第二电子设备中确定目标电子设备,所述目标电子设备与所述告警类别之间满足预设的告警类别与第二电子设备之间的对应关系;The fifth determination unit is configured to determine a target electronic device from the at least two second electronic devices according to the data collection orientation information corresponding to the alarm category and the target image data, and the target electronic device and the alarm category satisfy a preset correspondence between the alarm category and the second electronic device;
发送单元,用于将所述目标影像数据发送至所述目标电子设备。A sending unit, configured to send the target image data to the target electronic device.
可选地,第一电子设备还包括:Optionally, the first electronic device further includes:
第二获取模块,用于分别获取所述N个候选影像数据中每一候选影像数据的数据采集时间;A second acquiring module, configured to respectively acquire the data acquisition time of each candidate image data in the N candidate image data;
存储模块,用于分别将所述P个数据采集方位信息中每一数据采集方位信息对应的L个候选影像数据以及所述L个候选影像数据中每一候选影像数据的数据采集时间,存储在与所述每一数据采集方位信息对应的存储路径,L为小于或等于N的正整数。A storage module, configured to respectively store L candidate image data corresponding to each data acquisition orientation information in the P pieces of data acquisition orientation information and the data acquisition time of each candidate image data in the L candidate image data in a storage path corresponding to each of the data acquisition orientation information, where L is a positive integer less than or equal to N.
需要说明的是,该第一电子设备是与上述应用于第一电子设备的影像数据处理方法对应的电子设备,上述方法实施例中所有实现方式均适用于该第一电子设备的实施例中,也能达到相同的技术效果。It should be noted that the first electronic device is an electronic device corresponding to the above-mentioned image data processing method applied to the first electronic device, and all the implementation methods in the above method embodiments are applicable to the embodiments of the first electronic device, and can also achieve the same technical effect.
参见图4,图4示出了在一具体应用实施方式中,应用到本发明实施例提供的第一电子设备的一种影像数据处理系统的架构图,第一电子设备主要用于业务服务和数据处理。Referring to FIG. 4 , FIG. 4 shows an architecture diagram of an image data processing system applied to a first electronic device provided by an embodiment of the present invention in a specific application implementation manner. The first electronic device is mainly used for business services and data processing.
通过对上一实施例中第一电子设备各个虚拟模块的重新组合,可使得第一电子设备主要包括服务通信模块、大数据模块、人工智能模块以及服务管理模块。服务通信模块可通过MQTT、RTSP及表述性状态传递(Representational State Transfer,REST)中至少一种传输协议实现与摄像头之间的数据传输。大数据模块包括数据采集单元、数据清洗单元以及数据分析单元,每个单元均配设有支持应用程序接口(Application ProgrammingInterface,API)服务的通信接口,其中,数据采集单元可以用于获取来自摄像头的数据,例如影像数据、数据采集方位信息以及数据采集时间等;数据清洗单元可以将冗余的影像数据或者质量较差的影像数据进行清除,数据分析单元可以用于对来自摄像头的数据进行分析,例如分析影像数据中是否存在告警内容等。人工智能模块包括行为识别单元、物体识别单元以及目标检测单元,每个单元配设有相应的通信接口,其中,行为识别模块可以对影像数据中物体的行为进行识别,例如在不同数据采集时间内,影像数据中人物的行为进行识别,判断其是否处于静止、徘徊或其他状态;物体识别单元可以用于识别影像数据中的物体,例如人、车辆、漂浮物或者烟雾等;目标检测单元可以用于针对某一目标物体持续检测,例如对运动的车辆的检测等。服务管理模块包括配置管理单元、监控报警单元、日志管理单元以及基础维护单元等,各个单元能够实现的功能与其名称相匹配,此处不再赘述。除此以外,第一电子设备还包括存储模块,存储模块可以是缓存、文件存储设备以及数据库中的至少一样。By recombining the virtual modules of the first electronic device in the previous embodiment, the first electronic device mainly includes a service communication module, a big data module, an artificial intelligence module and a service management module. The service communication module can realize data transmission with the camera through at least one transmission protocol among MQTT, RTSP and representational state transfer (Representational State Transfer, REST). The big data module includes a data acquisition unit, a data cleaning unit, and a data analysis unit. Each unit is equipped with a communication interface that supports Application Programming Interface (API) services. The data acquisition unit can be used to obtain data from the camera, such as image data, data acquisition orientation information, and data acquisition time. The data cleaning unit can clear redundant image data or poor-quality image data. The artificial intelligence module includes a behavior recognition unit, an object recognition unit, and a target detection unit. Each unit is equipped with a corresponding communication interface. The behavior recognition module can recognize the behavior of objects in the image data, such as identifying the behavior of people in the image data at different data collection times, and judging whether they are in a static, wandering, or other state. The object recognition unit can be used to identify objects in the image data, such as people, vehicles, floating objects, or smoke. The service management module includes a configuration management unit, a monitoring and alarm unit, a log management unit, and a basic maintenance unit. The functions that each unit can achieve match its name, and will not be described here. In addition, the first electronic device further includes a storage module, and the storage module may be at least one of a cache, a file storage device, and a database.
影像数据处理系统还包括中间件模块以及搭载业务系统的访问终端。中间件模块可用于影像数据的共享,包括消息中间件与缓存中间件。访问终端可以是PC端或者是移动设备(即移动终端),业务系统可以对应的是各类行业智慧监控平台、微信程序以及其他可用于接收影像数据的应用程序。The image data processing system also includes a middleware module and an access terminal equipped with a business system. The middleware module can be used for image data sharing, including message middleware and cache middleware. The access terminal can be a PC or a mobile device (that is, a mobile terminal), and the business system can correspond to various industry smart monitoring platforms, WeChat programs, and other applications that can be used to receive image data.
上述影像数据处理系统中,第一电子设备可以通过数据采集单元从影像设备中获取原始数据,原始数据中可以包括原始影像数据、数据采集方位信息以及数据采集时间等。其中,数据采集方位信息可以是对应多个数据采集方位(即上述的预置位),而预置位可以根据不同用户的监控需求进行确定。In the above image data processing system, the first electronic device can obtain raw data from the image device through the data acquisition unit, and the original data can include original image data, data collection orientation information, and data collection time. Wherein, the data collection orientation information may correspond to multiple data collection orientations (that is, the aforementioned preset positions), and the preset positions may be determined according to the monitoring requirements of different users.
对于原始影像数据包括冗余影像数据,例如,影像设备在一个数据采集方位下连续拍摄了三张图片,而最终只需将其中的一张作为候选影像数据,则可以通过数据清洗单元清洗掉其中的两张图片,而数据分析单元可以对剩下的一张图片进行分析识别,判断其中是否存在告警内容,例如河流漂浮物、车辆、人员或者火情等。通过人工智能模块可以对告警内容进行进一步分析,将符合设定条件的候选影像数据作为目标影像数据,并确定告警内容对应的类别,以及该类别对应的第二电子设备(即目标电子设备),并将目标影像数据发送至目标电子设备;例如,若判断告警内容属于道路违章,可以将目标影像数据发送至对道路违章有监控需求的用户。The original image data includes redundant image data. For example, the image equipment takes three pictures continuously in one data collection position, and finally only needs to use one of them as the candidate image data, then the data cleaning unit can clean two of the pictures, and the data analysis unit can analyze and identify the remaining picture to determine whether there is any warning content, such as river floating objects, vehicles, people or fire. The artificial intelligence module can further analyze the alarm content, use the candidate image data that meets the set conditions as the target image data, and determine the category corresponding to the alarm content, and the second electronic device corresponding to the category (ie, the target electronic device), and send the target image data to the target electronic device;
第一电子设备可以将相关的影像数据分享给多个第二电子设备,因此采用了中间件模块进行数据分享,而第二电子设备可以是PC端或者是移动终端,并可以通过业务系统对第一电子设备分享的数据进行接收。The first electronic device can share relevant image data to multiple second electronic devices, so a middleware module is used for data sharing, and the second electronic device can be a PC or a mobile terminal, and can receive the data shared by the first electronic device through the business system.
该影像数据处理系统可以通过第一电子设备接收来自影像设备的原始数据,并且通过第一电子设备对原始影像数据进行分析、识别以及归类,将得到的具有告警内容的目标影像数据发送给与告警内容的类别相匹配的第二电子设备;进而能够有效实现影像数据的共享,减少在同一应用场景下所需影像设备的数量,节省购置安装成本;同时,通过第一电子设备统一对原始影像数据进行处理,各个第二电子设备可以直接获取带有告警内容的目标影像数据,提高了数据处理效率。The image data processing system can receive the original data from the image device through the first electronic device, analyze, identify and classify the original image data through the first electronic device, and send the obtained target image data with alarm content to the second electronic device that matches the category of the alarm content; furthermore, it can effectively realize the sharing of image data, reduce the number of image devices required in the same application scene, and save purchase and installation costs; at the same time, the original image data is uniformly processed by the first electronic device, and each second electronic device can directly obtain target image data with alarm content, which improves data processing. efficiency.
本发明实施例还提供了一种计算机可读存储介质,所述计算机可读存储介质上存储计算机程序,所述计算机程序被处理器执行时实现上述的影像数据处理方法的步骤。An embodiment of the present invention also provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the above image data processing method are realized.
以上所述的是本发明的优选实施方式,应当指出对于本技术领域的普通人员来说,在不脱离本发明所述的原理前提下还可以作出若干改进和润饰,这些改进和润饰也在本发明的保护范围内。What has been described above is a preferred embodiment of the present invention. It should be pointed out that those skilled in the art can make some improvements and modifications without departing from the principles described in the present invention. These improvements and modifications are also within the protection scope of the present invention.
Claims (11)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010155907.0A CN111382697B (en) | 2020-03-09 | 2020-03-09 | Image data processing method and first electronic equipment |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010155907.0A CN111382697B (en) | 2020-03-09 | 2020-03-09 | Image data processing method and first electronic equipment |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111382697A CN111382697A (en) | 2020-07-07 |
CN111382697B true CN111382697B (en) | 2023-07-25 |
Family
ID=71215288
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010155907.0A Active CN111382697B (en) | 2020-03-09 | 2020-03-09 | Image data processing method and first electronic equipment |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111382697B (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115904168A (en) * | 2022-11-18 | 2023-04-04 | Oppo广东移动通信有限公司 | Image material processing method and related device based on multi-device |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101764998A (en) * | 2008-12-23 | 2010-06-30 | 北京中星微电子有限公司 | Alarm interlocking method in network video monitoring system and network video monitoring system |
CN103747217A (en) * | 2014-01-26 | 2014-04-23 | 国家电网公司 | Video monitoring method and device |
CN104378582A (en) * | 2013-08-16 | 2015-02-25 | 北京博思廷科技有限公司 | Intelligent video analysis system and method based on PTZ video camera cruising |
CN105096596A (en) * | 2015-07-03 | 2015-11-25 | 北京润光泰力科技发展有限公司 | Traffic violation detecting method and system |
CN107590834A (en) * | 2017-08-10 | 2018-01-16 | 北京博思廷科技有限公司 | A kind of road traffic accident video detecting method and system |
CN107705569A (en) * | 2016-11-29 | 2018-02-16 | 西安艾润物联网技术服务有限责任公司 | The method and device that remote monitoring parking lot parks cars |
CN108540756A (en) * | 2017-03-01 | 2018-09-14 | 中国电信股份有限公司 | Recognition methods, apparatus and system based on video and electronic device identification |
-
2020
- 2020-03-09 CN CN202010155907.0A patent/CN111382697B/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101764998A (en) * | 2008-12-23 | 2010-06-30 | 北京中星微电子有限公司 | Alarm interlocking method in network video monitoring system and network video monitoring system |
CN104378582A (en) * | 2013-08-16 | 2015-02-25 | 北京博思廷科技有限公司 | Intelligent video analysis system and method based on PTZ video camera cruising |
CN103747217A (en) * | 2014-01-26 | 2014-04-23 | 国家电网公司 | Video monitoring method and device |
CN105096596A (en) * | 2015-07-03 | 2015-11-25 | 北京润光泰力科技发展有限公司 | Traffic violation detecting method and system |
CN107705569A (en) * | 2016-11-29 | 2018-02-16 | 西安艾润物联网技术服务有限责任公司 | The method and device that remote monitoring parking lot parks cars |
CN108540756A (en) * | 2017-03-01 | 2018-09-14 | 中国电信股份有限公司 | Recognition methods, apparatus and system based on video and electronic device identification |
CN107590834A (en) * | 2017-08-10 | 2018-01-16 | 北京博思廷科技有限公司 | A kind of road traffic accident video detecting method and system |
Also Published As
Publication number | Publication date |
---|---|
CN111382697A (en) | 2020-07-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2022105243A1 (en) | Event detection method, apparatus, electronic device, and storage medium | |
CN108509912B (en) | License plate recognition method and system for multi-channel network video stream | |
CN110660222B (en) | Intelligent environment-friendly electronic snapshot system for black-smoke road vehicle | |
US9704393B2 (en) | Integrated intelligent server based system and method/systems adapted to facilitate fail-safe integration and/or optimized utilization of various sensory inputs | |
CA2824330C (en) | An integrated intelligent server based system and method/systems adapted to facilitate fail-safe integration and/or optimized utilization of various sensory inputs | |
WO2018223955A1 (en) | Target monitoring method, target monitoring device, camera and computer readable medium | |
WO2021135879A1 (en) | Vehicle data monitoring method and apparatus, computer device, and storage medium | |
CN103186982B (en) | Intelligent access system for public security | |
CN102799935B (en) | Human flow counting method based on video analysis technology | |
Zabłocki et al. | Intelligent video surveillance systems for public spaces–a survey | |
RU2632473C1 (en) | Method of data exchange between ip video camera and server (versions) | |
CN118075427A (en) | Intelligent monitoring management method and system | |
CN101778260A (en) | Method and system for monitoring and managing videos on basis of structured description | |
CN109214300A (en) | A kind of suspect's method for early warning and its system based on recognition of face | |
WO2021114985A1 (en) | Companionship object identification method and apparatus, server and system | |
CN114067270B (en) | Vehicle tracking method and device, computer equipment and storage medium | |
CN113705502B (en) | Ship target behavior understanding system integrating target detection and target tracking | |
CN112581769A (en) | Non-motor vehicle illegal video analysis system based on artificial intelligence recognition technology | |
CN113963310B (en) | A method, device and electronic equipment for detecting passenger flow at a bus stop | |
CN101430827A (en) | Taxi wireless video monitoring system and method based on GPS | |
CN117998039A (en) | Video data processing method, device, equipment and storage medium | |
CN110473428A (en) | A kind of intelligent parking method, apparatus and system | |
CN112580470A (en) | City visual perception method and device, electronic equipment and storage medium | |
CN111382697B (en) | Image data processing method and first electronic equipment | |
CN116311166A (en) | Traffic obstacle recognition method and device and electronic equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
CB02 | Change of applicant information |
Address after: Room 101, floors 1-3, building 14, North District, yard 9, dongran North Street, Haidian District, Beijing 100029 Applicant after: CHINA TOWER Co.,Ltd. Address before: 100142 19th floor, 73 Fucheng Road, Haidian District, Beijing Applicant before: CHINA TOWER Co.,Ltd. |
|
CB02 | Change of applicant information | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right |
Effective date of registration: 20250321 Address after: 101, Floors 1-3, Building 14, North Campus, No. 9 Dongran North Street, Haidian District, Beijing 100089 Patentee after: CHINA TOWER Co.,Ltd. Country or region after: China Patentee after: Tower Zhilian Technology Co.,Ltd. Address before: 100195 101, floors 1 to 3, building 14, North District, yard 9, dongran North Street, Haidian District, Beijing Patentee before: CHINA TOWER Co.,Ltd. Country or region before: China |
|
TR01 | Transfer of patent right |