[go: up one dir, main page]

CN102929903A - Rapid video retrieval method based on layered structuralized description of video information - Google Patents

Rapid video retrieval method based on layered structuralized description of video information Download PDF

Info

Publication number
CN102929903A
CN102929903A CN2012102305397A CN201210230539A CN102929903A CN 102929903 A CN102929903 A CN 102929903A CN 2012102305397 A CN2012102305397 A CN 2012102305397A CN 201210230539 A CN201210230539 A CN 201210230539A CN 102929903 A CN102929903 A CN 102929903A
Authority
CN
China
Prior art keywords
video
information
metadata
database
engine
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2012102305397A
Other languages
Chinese (zh)
Other versions
CN102929903B (en
Inventor
陈朝武
赵炫
李鹏飞
高磊
王列
孟永新
陈�峰
费宝顶
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vimicro Corp
First Research Institute of Ministry of Public Security
Original Assignee
Vimicro Corp
First Research Institute of Ministry of Public Security
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vimicro Corp, First Research Institute of Ministry of Public Security filed Critical Vimicro Corp
Priority to CN201210230539.7A priority Critical patent/CN102929903B/en
Publication of CN102929903A publication Critical patent/CN102929903A/en
Application granted granted Critical
Publication of CN102929903B publication Critical patent/CN102929903B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Alarm Systems (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

本发明提供了一种基于视频信息分层结构化描述的快速视频检索方法,其特征在于:基于分级三个数据库和三个引擎的视频内容分层结构化描述综合应用架构及研判流程,所述综合应用架构为:在视频监控网络系统中,根据各子网络实际情况,分级部署多个节点,每一节点以视频分层结构化描述服务器为核心,并包含有完备的三个数据库和三个引擎,本发明的优点是通过多级别、多节点的三库三引擎协同工作,对监控视频内容进行全自动分层结构化描述,并基于节点间拓扑关系进行逻辑推理判断,实现了智能化研判视频监控信息,实现了自动报警及快速检索。

Figure 201210230539

The present invention provides a fast video retrieval method based on the hierarchical and structured description of video information, which is characterized in that: the comprehensive application framework and the research and judgment process of the hierarchical and structured description of video content based on three hierarchical databases and three engines, said The comprehensive application architecture is: In the video surveillance network system, according to the actual situation of each sub-network, multiple nodes are deployed hierarchically, each node takes the video layered structured description server as the core, and includes three complete databases and three Engine, the advantage of the present invention is that through the multi-level, multi-node three-database three-engine collaborative work, the surveillance video content is fully automatic hierarchically structured description, and logical reasoning and judgment are performed based on the topological relationship between nodes, realizing intelligent research and judgment Video surveillance information realizes automatic alarm and quick retrieval.

Figure 201210230539

Description

一种基于视频信息分层结构化描述的快速视频检索方法A Fast Video Retrieval Method Based on Hierarchical and Structured Description of Video Information

技术领域 technical field

本发明涉及一种基于视频信息分层结构化描述的快速视频检索方法,属于安全防范视频监控领域。The invention relates to a fast video retrieval method based on the layered and structured description of video information, which belongs to the field of security video monitoring.

背景技术 Background technique

随着经济和社会的发展,以及人们对安全防范需求的不断提高,视频监控系统在过去的几十年中得到了迅速的发展和普及,由原来单一的安防重点行业如政府机关、道路交通、金融机构等,慢慢应用到越来越多的公共设施如写字楼、商场、居民小区等。With the development of the economy and society, and the continuous improvement of people's demand for security, video surveillance systems have been rapidly developed and popularized in the past few decades. From the original single key security industries such as government agencies, road traffic, Financial institutions, etc., are gradually applied to more and more public facilities such as office buildings, shopping malls, residential quarters, etc.

社会治安监控产生了大量的视频信息,然而在这些视频信息中绝大部分的视频信息都与破案无关,有用信息混杂在大量无用信息中,使得查找周期拖长,延误破案时机。单凭人力无法在海量的视频监控信息中区分嫌犯或普通群众行动、尽早预警嫌犯行为,由此,需要有专用的视频信息分析和查询系统,从这些视频中提取警用关注信息并进行视频分层结构化描述,为公安部门在日常监控中锁定目标、早期预警,或在侦查过程中检索目标、固定证据、发现线索来提供视频排查服务。Social security monitoring produces a large amount of video information. However, most of the video information has nothing to do with solving the case. Useful information is mixed with a large amount of useless information, which prolongs the search cycle and delays the time to solve the case. Manpower alone cannot distinguish between the actions of suspects or ordinary people in the mass video surveillance information, and give early warning of suspect behavior. Therefore, a dedicated video information analysis and query system is required to extract police attention information from these videos and perform video analysis. Layer-by-layer structured description, providing video screening services for public security departments to lock targets and provide early warnings in daily monitoring, or to retrieve targets, fix evidence, and discover clues during investigations.

实现这样的视频信息分析和查询系统通常需要满足一些基本条件:首先,系统要布设多个摄像机组成监控网络;其次,系统要对监控视频的内容进行自动分析,提取有用信息并存储,必要时能够自动报警;第三,系统能够提供对这些有用信息进行快速查询并深入分析的功能。The realization of such a video information analysis and query system usually needs to meet some basic conditions: first, the system must deploy multiple cameras to form a monitoring network; second, the system must automatically analyze the content of the monitoring video, extract and store useful information, and be able to Automatic alarm; Third, the system can provide the function of quick query and in-depth analysis of these useful information.

现有技术通过以太网或者无线网来布设监控网络。在现有技术中,为实现自动化视频描述和分析系统,以便从这些视频中提取警用关注信息并实现视频监控快速检索及自动报警,可以在摄像头终端对已存储的和实时获取的视频监控信息进行处理,也可以把数据传送到监控中心进行集中处理。视频分析中用到的技术包括目标检测、目标跟踪、场景分析等。分析得到的结果可以用于自动报警,也可以存储起来供以后查询。In the prior art, a monitoring network is deployed through an Ethernet or a wireless network. In the existing technology, in order to realize the automatic video description and analysis system, in order to extract the police attention information from these videos and realize the video monitoring fast retrieval and automatic alarm, the video monitoring information stored and obtained in real time can be analyzed at the camera terminal For processing, the data can also be transmitted to the monitoring center for centralized processing. Techniques used in video analysis include object detection, object tracking, scene analysis, etc. The results obtained from the analysis can be used for automatic alarm, and can also be stored for later query.

例如,在专利公告CN101783881A中公开了一种具有视频结构化描述功能的智能网络摄像机,其针对摄像机中的物体颜色、纹理、形状、运动、定位和轮廓特征等图像视觉特征对其属性和内容进行推理和判断,并通过可扩展标记语言(XML)、二进制可扩展标记语言(Binary XML)编写描述语言。此发明主要通过一种视频结构化描述装置,针对一台摄像机中的物体进行特征、属性的推理、判断。For example, patent announcement CN101783881A discloses a kind of intelligent network camera with video structure description function, which is aimed at the image visual features such as object color, texture, shape, motion, positioning and contour features in the camera to perform its attribute and content analysis. Reasoning and judgment, and writing description language through Extensible Markup Language (XML), Binary Extensible Markup Language (Binary XML). This invention mainly uses a video structured description device to reason and judge the characteristics and attributes of objects in a camera.

在专利公告CN101790064A中公开了一种具有视频结构化描述功能的硬盘录像设备。此发明通过一个特征提取单元,对多路监控视频图像信息进行结构化描述,产生关于其属性和内容的描述信息数据,实现智能监控和报警功能。In the patent announcement CN101790064A, a hard disk video recording device with a video structured description function is disclosed. The invention uses a feature extraction unit to structurally describe multi-channel monitoring video image information, generate description information data about its attributes and contents, and realize intelligent monitoring and alarm functions.

在专利公告CN101827266A中公开了一种网络视频服务器,其包括视频采集、分析和编码输出模块,可利用视频特征的属性和内容等进行判断和推理,并实现小数据量的编码,以便于网络传输和视频快速检索。此发明主要通过一个视频分析描述模块,对本网络中的多路视频信号进行特定分析,实现对监控视频的结构化描述。In the patent announcement CN101827266A, a network video server is disclosed, which includes video acquisition, analysis and encoding output modules, which can use the attributes and contents of video features to judge and reason, and realize the encoding of small data volumes, so as to facilitate network transmission and video quick retrieval. This invention mainly uses a video analysis and description module to perform specific analysis on multi-channel video signals in the network to realize the structured description of the monitoring video.

但是,在上述现有技术中,即使是实现了部分自动分析或自动报警功能,也仅限于单独分析每个摄像机终端采集到的数据形成结构化描述信息以供查询;或对同一局域网内多个摄像机终端的数据进行综合分析,未考虑在多个视频监控子网络、海量视频信息情况下的视频内容快速查询及交叉检索。在面对警用超大规模联网视频监控系统或跨省跨地域级联网视频监控系统的需求时,现有技术无力满足此类超大规模系统的性能要求。However, in the above-mentioned prior art, even if part of the automatic analysis or automatic alarm function is realized, it is limited to separately analyzing the data collected by each camera terminal to form structured description information for query; The data of the camera terminal is comprehensively analyzed, and the quick query and cross-retrieval of video content in the case of multiple video surveillance sub-networks and massive video information are not considered. In the face of the needs of police ultra-large-scale networked video surveillance systems or inter-provincial and cross-regional networked video surveillance systems, the existing technology is unable to meet the performance requirements of such ultra-large-scale systems.

另外,根据现有技术的视频监控功能模块或网络服务器,主要面对简单监控环境或简单视频监控网络,对视频信息的分析和检索都仅限于对单一视频源/少数几部视频源中的物体进行推理、判断、分析和存储,都未曾提及在多个视频监控子网络之间通过子网络节点间的信息交互、通过子网络节点拓扑关系进行逻辑推理来实现跨网络智能视频监控的方法,也未提及跨多个子网络的视频内容分层结构化描述及视频内容分布式快速查询方法。在面对复杂的多个子网络集成系统时,上述现有技术既要不影响所在单位各自的视频监控报警功能,且同时满足集中式视频监控智能化判别报警功能,权限设置会十分困难,且系统效率不高,在能够灵活地扩展或断开某一节点这一要求上也会有所局限。所以上述专利仍然不能满足警用大型跨地域级别视频监控智能分析系统的需求。In addition, according to the video monitoring function module or network server of the prior art, it mainly faces a simple monitoring environment or a simple video monitoring network, and the analysis and retrieval of video information are limited to objects in a single video source/a few video sources For reasoning, judging, analyzing and storing, there is no mention of the method of realizing cross-network intelligent video monitoring through information interaction between sub-network nodes and logical reasoning through sub-network node topology between multiple video surveillance sub-networks. There is also no mention of a hierarchical and structured description of video content across multiple sub-networks and a distributed fast query method for video content. In the face of complex multiple sub-network integration systems, the above-mentioned prior art should not affect the respective video surveillance and alarm functions of the units, and at the same time satisfy the centralized video surveillance intelligent discrimination and alarm function, the permission setting will be very difficult, and the system The efficiency is not high, and there will be limitations on the requirement of being able to flexibly expand or disconnect a certain node. Therefore, the above-mentioned patents still cannot meet the needs of police large-scale cross-regional level video surveillance intelligent analysis system.

发明内容 Contents of the invention

为了解决上述技术问题,满足警用大型跨地域级别视频联网监控系统深度应用的需求,满足在海量视频信息中快速检索目标、在不同地域甚至跨市跨地区根据目标特征进行智能化地对嫌疑人/车进行联网追踪、在重点监控地段智能布防并自动报警联动的需求,本发明提供一种基于视频信息分层结构化描述的快速视频检索方法。In order to solve the above technical problems, meet the needs of in-depth application of large-scale cross-regional video network monitoring system for police, quickly search for targets in massive video information, and intelligently detect suspects according to target characteristics in different regions or even across cities and regions The present invention provides a fast video retrieval method based on the layered and structured description of video information to meet the needs of networked tracking, intelligent arming and automatic alarm linkage in key monitoring areas.

本发明的一种基于视频信息分层结构化描述的快速视频检索方法是基于分级三个数据库和三个引擎的视频内容分层结构化描述综合应用架构及研判流程,所述综合应用架构为:在视频监控网络系统中,根据各子网络实际情况,分级部署多个节点,每一节点以视频分层结构化描述服务器(即Metadata服务器)为核心,并包含有完备的三个数据库和三个引擎,所述三个数据库为视频基础资源数据库、视频分层结构化描述数据库(即Metadata数据库)及监控黑名单数据库;所述三个引擎是视频分层结构化描述抽取引擎(即Metadata抽取引擎)、报警研判引擎及视频内容检索引擎;所述研判流程为:通过多级别、多节点的三个数据库和三个引擎协同工作,对监控视频内容进行全自动分层结构化描述,并基于节点间拓扑关系进行逻辑推理判断,实现智能化研判视频监控信息,最终实现自动报警及快速检索。A fast video retrieval method based on the layered structured description of video information of the present invention is based on the comprehensive application framework and the research and judgment process of the hierarchically structured description of video content based on three hierarchical databases and three engines. The comprehensive application framework is: In the video surveillance network system, according to the actual situation of each sub-network, multiple nodes are deployed hierarchically. Each node takes the video layered structured description server (Metadata server) as the core, and contains three complete databases and three engine, the three databases are video basic resource database, video layered structured description database (i.e. Metadata database) and monitoring blacklist database; the three engines are video layered structured description extraction engine (i.e. Metadata extraction engine ), an alarm research and judgment engine, and a video content retrieval engine; the research and judgment process is: through the multi-level, multi-node three databases and the three engines working together, a fully automatic hierarchical and structured description of the monitoring video content is carried out, and based on the node Logical reasoning and judgment of the topological relationship between them, realizing intelligent research and judgment of video surveillance information, and finally realizing automatic alarm and fast retrieval.

在所述视频监控网络系统的每一节点上都设置Metadata服务器及三个数据库和三个引擎,使其具备独立的视频监控、自动报警、用户检索等功能。所述三个数据库,既可以为集中式数据库,也可以为分布式数据库。Metadata servers, three databases and three engines are set on each node of the video monitoring network system, so that it has functions such as independent video monitoring, automatic alarm, and user retrieval. The three databases may be centralized databases or distributed databases.

在所述视频监控网络系统的每一节点都包含专用的视频分层结构化描述服务器(即Metadata服务器),用于节点间互联、同步逻辑分析结果,实现精简且完备的警用关注信息Metadata数据的订阅、推送、存储、查询功能。Each node of the video surveillance network system includes a dedicated video layered structured description server (i.e. Metadata server), which is used for inter-node interconnection and synchronous logic analysis results to realize simplified and complete police attention information Metadata data Subscription, push, storage, and query functions.

本发明所述的快速视频检索方法在进行查询时,借助于不同终端之间的信息相互关联,充分利用视频基础资源数据库中的摄像机拓扑关系等信息,采用基于逻辑推理的搜索方法实现快速查询。The fast video retrieval method of the present invention utilizes information such as the topological relationship of cameras in the basic video resource database to realize fast query by means of information correlation among different terminals when querying.

本发明所述的快速视频检索方法在对视频内容进行分层结构化描述时,需遵循视频内容分层结构化描述的标准化格式。The fast video retrieval method of the present invention needs to follow the standardized format of the hierarchically structured description of the video content when performing hierarchically structured description of the video content.

本发明所述的快速视频检索方法的具体步骤是:建立视频基础资源数据库,将各地各类报警与监控系统的建设、更新、变动情况以及相关基础信息及时采集入库;来自不同设备的监控视频通过Metadata抽取引擎来进行视频抽取工作,抽取出视频基本特征和警用关注信息;这些层次化内容描述信息被以标准化形式保存在存储介质中,并统一建立索引;所述视频基础资源被存储在视频基础资源数据库中,所述层次化描述内容被存储在Metadata数据库中;同时,报警研判引擎将上述生成的视频内容层次化描述信息与重点人员、重点车辆、可疑物品图像库中的数据进行比对,或与基于各级公安系统破案经验制定的各种嫌犯行为判读原则及报警界限进行比对,当发现可疑目标时,自动输出报警信息;在用户检索时,用户通过客户端输入时间、地点、嫌疑人特征、可疑车辆特征、可疑物品特征等检索条件,视频内容检索引擎首先从查询条件中抽取特征,然后结合视频基础资源信息,通过分布式访问的方式经过Metadata服务器对各级子节点的Metadata数据库进行并行查找,获得检索结果并将相关视频返回给用户。The specific steps of the fast video retrieval method described in the present invention are as follows: establish a video basic resource database, collect and store in time the construction, update, changes and related basic information of various alarm and monitoring systems in various places; monitor video from different devices The video extraction work is carried out through the Metadata extraction engine, and the basic features of the video and the police attention information are extracted; these hierarchical content description information are stored in the storage medium in a standardized form, and are indexed uniformly; the basic video resources are stored in In the video basic resource database, the hierarchical description content is stored in the Metadata database; at the same time, the alarm research and judgment engine compares the generated video content hierarchical description information with the data in the key personnel, key vehicles, and suspicious object image databases. Yes, or compared with various suspect behavior interpretation principles and alarm limits based on the experience of public security systems at all levels, when a suspicious target is found, the alarm information is automatically output; when the user retrieves, the user enters the time and place through the client , Suspect features, suspicious vehicle features, suspicious item features and other retrieval conditions, the video content retrieval engine first extracts the features from the query conditions, and then combines the video basic resource information, through the Metadata server through distributed access to the sub-nodes at all levels The Metadata database performs parallel search, obtains the retrieval results and returns relevant videos to the user.

本发明的一种基于视频信息分层结构化描述的快速视频检索系统,其特征在于:基于分级三库三引擎的视频内容分层结构化描述综合应用架构及研判流程,所述综合应用架构为:在视频监控网络系统中,根据各子网络实际情况,分级部署多个节点,每一节点以视频分层结构化描述服务器(即Metadata服务器)为核心,并包含有完备的三个数据库和三个引擎,所述三个数据库为视频基础资源数据库、视频分层结构化描述数据库(即Metadata数据库)及监控黑名单数据库;所述三个引擎是视频分层结构化描述抽取引擎(即Metadata抽取引擎)、报警研判引擎及视频内容检索引擎;所述研判流程为:通过多级别、多节点的三个数据库和三个引擎协同工作,对监控视频内容进行全自动分层结构化描述,并基于节点间拓扑关系进行逻辑推理判断,实现智能化研判视频监控信息,最终实现自动报警及快速检索;在所述视频监控网络系统的每一节点都包含专用的用于节点间互联、同步逻辑分析结果的、视频分层结构化描述服务器(即Metadata服务器),以实现精简且完备的警用关注信息Metadata数据的订阅、推送、存储、查询功能。A fast video retrieval system based on the hierarchical and structured description of video information according to the present invention is characterized in that: a comprehensive application framework and a research and judgment process based on hierarchical and structured description of video content with three databases and three engines, the comprehensive application framework is : In the video surveillance network system, according to the actual situation of each sub-network, multiple nodes are deployed hierarchically, each node takes the video layered structured description server (ie Metadata server) as the core, and contains three complete databases and three three engines, the three databases are video basic resource database, video hierarchical structured description database (i.e. Metadata database) and monitoring blacklist database; the three engines are video hierarchical structured description extraction engine (i.e. Metadata extraction engine), an alarm research and judgment engine, and a video content retrieval engine; the research and judgment process is: through the multi-level, multi-node three databases and the three engines working together, a fully automatic hierarchical and structured description of the monitoring video content is carried out, and based on Perform logical reasoning and judgment on the topological relationship between nodes, realize intelligent research and judgment of video surveillance information, and finally realize automatic alarm and fast retrieval; each node in the video surveillance network system contains a dedicated network for inter-node interconnection and synchronous logic analysis results A video layered and structured description server (metadata server) to realize simplified and complete subscription, push, storage, and query functions of police attention information Metadata data.

本发明的一种基于视频信息分层结构化描述的快速视频检索系统在进行查询时,借助于不同终端之间的信息相互关联,充分利用视频基础资源数据库中的摄像机拓扑关系等信息,采用基于逻辑推理的搜索方法实现快速查询。A fast video retrieval system based on the layered and structured description of video information of the present invention, when querying, relies on the mutual correlation of information between different terminals, fully utilizes information such as the camera topology in the video basic resource database, and adopts a method based on The search method of logical reasoning realizes fast query.

本发明的优点是结合公安一线需求,对面向安全防范和刑侦破案的视频内容分层结构化描述内容和格式进行了设计和定义,从视频基本特征和警用关注特征两个层次对视频进行了描述,并利用所述两个层次对视频信号进行自动化警用关注信息检索和研判,利用自身的三个数据库和三个引擎技术实现了警用关注信息的提取、传输、存储、检索等功能,从而实现跨省、跨地域的大规模警用视频自动检索及自动报警系统,而且在理论上可以无限量地扩充,不断接入新的终端及新的存储系统,并由于接入新的终端和新的存储系统继续扩大逻辑推理能力及自动报警范围,通过多级别、多节点的三库三引擎协同工作,对监控视频内容进行全自动分层结构化描述,并基于节点间拓扑关系进行逻辑推理判断,实现了智能化研判视频监控信息以及自动报警和快速检索。The advantage of the present invention is that it designs and defines the layered and structured description content and format of the video content oriented to security prevention and criminal investigation and solving cases in combination with the needs of the front line of public security, and the video is analyzed from the two levels of basic video features and police attention features. Describe, and use the two levels to automatically retrieve and judge the video signal for police attention information, use its own three databases and three engine technologies to realize the functions of police attention information extraction, transmission, storage, retrieval, etc. In this way, a large-scale cross-provincial and cross-regional police video automatic retrieval and automatic alarm system can be realized, and theoretically it can be expanded indefinitely, and new terminals and new storage systems can be continuously connected. The new storage system continues to expand the logical reasoning ability and the scope of automatic alarms. Through the multi-level, multi-node three-database and three-engine collaborative work, it can fully automatically describe the surveillance video content in a hierarchical structure, and perform logical reasoning based on the topological relationship between nodes. Judgment, realizing intelligent research and judgment of video surveillance information, automatic alarm and quick retrieval.

附图说明 Description of drawings

图1示出了本发明的多级别的三个数据库和三个引擎的网络结构示意图;Fig. 1 shows the network structure diagram of three multi-level databases and three engines of the present invention;

图2示出了本发明在单一节点中的三个数据库和三个引擎的网络结构示意图。Fig. 2 shows a schematic diagram of the network structure of three databases and three engines in a single node of the present invention.

具体实施方式 Detailed ways

下面结合附图对本发明所述的一种基于视频信息分层结构化描述的快速视频检索方法进行详细描述;本发明所述的多级别的三个数据库和三个引擎网络,其原理如图1所示。A kind of fast video retrieval method based on video information layered structured description of the present invention is described in detail below in conjunction with accompanying drawing; Multilevel three databases and three engine networks of the present invention, its principle is shown in Figure 1 shown.

在本发明的基于多级别的三个数据库和三个引擎的视频内容分层结构化描述综合应用架构中,所述多级别的三个数据库和三个引擎是指,在包含多个节点的网络中,部署有相对于其子节点更高级别的三个数据库和三个引擎节点。通过所述更高级别节点中的三个数据库和三个引擎,可以调度其所有子节点三个数据库和三个引擎中的资源。例如,在每个派出所可部署一个三级三个数据库和三个引擎节点,在分局可整合这些子节点资源形成一个二级三个数据库和三个引擎节点,在市局可整合子节点资源形成一个一级三个数据库和三个引擎节点。每一级的子节点,既包含有独立的Metadata服务器、数据库和引擎以供独立实现检索功能,也通过Metadata服务器调用各子节点的资源以及对上级提供服务。每个级别的子节点都有可独立工作的全部控制系统,并对上下级提供统一的接口。In the multi-level three databases and three engines based video content hierarchically structured description comprehensive application architecture of the present invention, the multi-level three databases and three engines refer to the network including multiple nodes In , there are three database and three engine nodes deployed at a higher level relative to their child nodes. Through the three databases and three engines in the higher-level node, the resources in the three databases and three engines of all its child nodes can be scheduled. For example, a third-level three databases and three engine nodes can be deployed in each police station, these sub-node resources can be integrated in the sub-bureau to form a second-level three databases and three engine nodes, and the sub-node resources can be integrated in the city bureau to form A first-level three databases and three engine nodes. The sub-nodes at each level not only include independent Metadata servers, databases and engines for independent retrieval functions, but also call the resources of each sub-node and provide services to the upper level through the Metadata server. Sub-nodes at each level have all control systems that can work independently, and provide a unified interface to the upper and lower levels.

在所述视频监控网络系统的每一节点上都设置Metadata服务器及三个数据库和三个引擎,使其具备独立的视频监控、自动报警、用户检索等功能;所述三个数据库,既可以为集中式数据库,也可以为分布式数据库。Metadata server and three databases and three engines are all set on each node of described video surveillance network system, make it have functions such as independent video surveillance, automatic alarm, user retrieval; Described three databases, both can be A centralized database can also be a distributed database.

为了满足大规模跨地域联网式视频监控系统的性能需求及灵活扩展需求,本发明在每一节点包含专用的视频分层结构化描述服务器(Metadata服务器1),用于节点间互联、同步逻辑分析结果,实现精简且完备的警用关注信息Metadata数据的订阅、推送、存储、查询功能。In order to meet the performance requirements and flexible expansion requirements of a large-scale cross-regional networked video surveillance system, the present invention includes a dedicated video layered structured description server (Metadata server 1) in each node for inter-node interconnection and synchronous logic analysis As a result, streamlined and complete police attention information Metadata data subscription, push, storage, and query functions are realized.

优选地,在本发明提供的方法中,通过采用分布式数据库,可以利用迅速发展的网络处理能力,传输较为小量的Metadata数据以供检索,并通过逻辑推理的方式定位相关的监控视频,使得检索大量监控视频资源信息的时间由几天缩短到几小时。而且,由于分布式数据库的自身优势,其并非是如现有技术中某一设计方案就必须采用某一特定的视频监控系统,而可以便利地与不同视频监控系统进行集成,或是与现有视频监控系统集成,只需要它们补充装备标准化、模块化的Metadata服务器及三个数据库和三个引擎即可。且由于分布式数据库中的网格本质上是动态的,网格中的资源可以是动态出现,允许用户根据需要将资源加到网格中,或从网格中删除。在某一节点自联网式视频监控系统中删除之后,该节点具备Metadata服务器及三个数据库和三个引擎,所以仍旧具备独立的视频监控、自动报警、用户检索等功能,只是不具备与临近节点的关联研判功能和逻辑推理功能,且删除掉此节点后的联网系统仍具备全部的关联研判功能和逻辑推理功能。另外,分布式数据库提供了增强的可扩展性,通过传输精简且完备的逻辑相关视频信息,使系统不受限于物理邻近或网络延时,避免了集中式数据库的缺陷,而且通过这种方式,可以很灵活地实现节点间简便地互联、简便地分离、方便地权限划分和快捷地跨地域信息传输及视频信息查询。Preferably, in the method provided by the present invention, by adopting a distributed database, the rapidly developing network processing capability can be utilized to transmit relatively small amounts of Metadata data for retrieval, and to locate relevant surveillance videos by means of logical reasoning, so that The time to retrieve information from a large number of surveillance video assets is reduced from days to hours. Moreover, due to the self-advantages of the distributed database, it is not necessary to adopt a specific video surveillance system for a certain design scheme in the prior art, but can be easily integrated with different video surveillance systems, or integrated with existing The integration of video surveillance systems only requires them to be supplemented with standardized and modularized Metadata servers, three databases and three engines. And because the grid in the distributed database is dynamic in nature, the resources in the grid can appear dynamically, allowing users to add resources to the grid or delete them from the grid as needed. After a node is deleted from the networked video surveillance system, the node has a Metadata server, three databases and three engines, so it still has independent video surveillance, automatic alarm, user retrieval and other functions, but it does not have the same functions as adjacent nodes. The associated research and judgment function and logical reasoning function, and the networked system after deleting this node still has all the related research and judgment functions and logical reasoning functions. In addition, the distributed database provides enhanced scalability. By transmitting streamlined and complete logically related video information, the system is not limited by physical proximity or network delay, avoiding the defects of centralized databases, and in this way , can flexibly realize easy interconnection between nodes, easy separation, convenient authority division, and fast cross-regional information transmission and video information query.

本发明所述的单一节点中的专用Metadata服务器及三个数据库和三个引擎三个数据库和三个引擎示意图,其原理如图2所示。A schematic diagram of a dedicated Metadata server, three databases and three engines, three databases and three engines in a single node according to the present invention, and its principle is shown in FIG. 2 .

图2亦示出了基于本发明所述的快速视频检索方法的警用关注信息检索综合应用架构。所述综合应用架构为,每一节点都是以视频分层结构化描述服务器(Metadata服务器1)为核心,并包含有完备的三个数据库和三个引擎,所述三个数据库为视频基础资源数据库4、视频分层结构化描述数据库(Metadata数据库2)及监控黑名单数据库3;所述三个引擎是视频分层结构化描述抽取引擎(Metadata抽取引擎5)、报警研判引擎6及视频内容检索引擎7。FIG. 2 also shows a comprehensive application architecture for police attention information retrieval based on the fast video retrieval method of the present invention. The comprehensive application architecture is that each node is based on the video layered structured description server (Metadata server 1) as the core, and contains three complete databases and three engines, and the three databases are basic video resources Database 4, video hierarchical structured description database (Metadata database 2) and monitoring blacklist database 3; the three engines are video hierarchical structured description extraction engine (Metadata extraction engine 5), alarm research and judgment engine 6 and video content search engine7.

本发明所述的快速视频检索方法在进行查询时,借助于不同终端之间的信息相互关联,充分利用所述视频基础资源数据库4中的摄像机拓扑关系等信息,采用基于逻辑推理的搜索方法实现快速查询。The fast video retrieval method described in the present invention, when querying, relies on the mutual correlation of information between different terminals, makes full use of information such as the camera topological relationship in the video basic resource database 4, and adopts a logical reasoning-based search method to achieve Quick Search.

所述视频信息分层结构化描述是指通过视频智能分析技术,将无结构性的视频数据,通过对其内容不同层次的抽象和理解,生成文本形式的结构和注释,即视频分层结构化描述数据(即下文所述的元数据或Metadata数据)。这些Metadata数据所需的传输和存储设备资源远远小于经过压缩编码后的视频数据,却包含了视频中主要的警用关注信息。对这些Metadata数据进行编索,就可以实现高级视频检索和数据挖掘应用。在本发明提供的方法中,为了实现各个视频监控子网络之间的数据交互和跨子网数据综合推理应用,需首先建立视频内容分层结构化描述的标准化格式。The hierarchical structured description of video information refers to the use of video intelligent analysis technology to generate textual structures and annotations from unstructured video data through different levels of abstraction and understanding of its content, that is, video hierarchical structure Descriptive data (i.e. metadata or Metadata data described below). The transmission and storage equipment resources required by these Metadata data are far less than the video data after compression and encoding, but it contains the main police attention information in the video. By indexing these Metadata data, advanced video retrieval and data mining applications can be realized. In the method provided by the present invention, in order to realize the data interaction between each video surveillance sub-network and the cross-subnet comprehensive reasoning application, it is first necessary to establish a standardized format for the hierarchical and structured description of the video content.

所述基于逻辑推理的搜索方法,是指借助于视频内容分层结构化描述数据,通过对事件发生时间、地点、嫌犯交通工具及移动速度进行综合逻辑推理,生成逻辑推理评判结果,即逻辑数据。对这些逻辑数据进行编索,并与基于各级公安系统破案经验制定的各种嫌犯行为判读原则及报警界限进行比对,就可以实现智能化研判视频监控信息,并最终实现自动报警及快速检索。The search method based on logical reasoning refers to the use of hierarchically structured description data of video content to generate a logical reasoning evaluation result, i.e. logical data . Compile and index these logical data and compare them with various suspect behavior interpretation principles and alarm limits formulated based on the experience of public security systems at all levels to realize intelligent research and judgment of video surveillance information, and finally realize automatic alarm and fast retrieval .

所述视频分层结构化描述服务器,即Metadata服务器1,为每一子节点的核心,用于节点间互联、同步逻辑分析结果,实现精简且完备的警用关注信息Metadata数据的订阅、推送、存储、查询功能。The video layered structured description server, i.e. Metadata server 1, is the core of each sub-node, used for inter-node interconnection and synchronous logical analysis results, and realizes the subscription, push, and Storage and query functions.

所述Metadata数据库2,用于存储子节点中各摄像机拍摄视频对应的视频分层结构化描述数据(即所述Metadata数据)。The Metadata database 2 is used to store the hierarchically structured video description data corresponding to the video captured by each camera in the sub-node (that is, the Metadata data).

所述监控黑名单数据库3,存储需布防的人员黑名单、人脸特征、衣着特征、步态特征、车辆外形特征、车辆颜色特征、车牌特征、群体性事件、人员徘徊、车辆逆行等各种警用关注事件描述等。The monitoring blacklist database 3 stores a blacklist of personnel to be armed, facial features, clothing features, gait features, vehicle shape features, vehicle color features, license plate features, mass incidents, personnel wandering, vehicle retrograde, etc. Police attention event description, etc.

所述视频基础资源数据库4,用于存储监控子节点中各摄像机的设备型号、安装地点、工作状态以及摄像机拓扑关系图等基础信息。所述摄像机拓扑关系图,描述每个摄像机的临近摄像机以及嫌疑人/车从一个摄像机移动到另一个摄像机拍摄范围所需的必经路线和最短时间。该最短时间由摄像机安装位置、安装角度、交通方式、道路情况等决定。The video basic resource database 4 is used to store basic information such as the device model, installation location, working status, and camera topology diagram of each camera in the monitoring sub-node. The camera topology diagram describes the adjacent cameras of each camera and the necessary route and minimum time required for the suspect/vehicle to move from one camera to another camera's shooting range. The shortest time is determined by the camera installation location, installation angle, traffic mode, road conditions, etc.

所述Metadata抽取引擎5,其功能是对多路监控视频进行实时数据分析,抽取出标准的视频分层结构化描述信息,并保存到所述Metadata数据库2中。所述Metadata抽取引擎是所有能从视频中抽取分层结构化描述的设备或模块的总称:可以是一个设备,也可以是多个设备;可以是前段嵌入式设备,也可以是中心服务器甚至是集群计算资源;可以是独立设备,也可以嵌入到摄像机、DVR中;可接入模拟视频,也可接入经过压缩的数字视频。所述Metadata抽取引擎既可对拍摄的视频流进行实时抽取,也可对已存储的录像文件进行抽取。The Metadata extraction engine 5 has a function of performing real-time data analysis on multi-channel surveillance video, extracting standard video layered structured description information, and storing it in the Metadata database 2 . The Metadata extraction engine is a general term for all devices or modules that can extract hierarchical and structured descriptions from videos: it can be one device or multiple devices; it can be a front-end embedded device, a central server or even a Cluster computing resources; it can be a stand-alone device or embedded in a camera or DVR; it can be connected to analog video or compressed digital video. The Metadata extraction engine can not only extract the captured video stream in real time, but also extract the stored video files.

所述报警研判引擎6,通过对Metadata数据流进行实时分析,针对所述监控黑名单数据库3中的信息进行布防,当检测到符合黑名单数据库和嫌疑人/车或事件发生后,立即发出报警。The alarm research and judgment engine 6, by analyzing the Metadata data stream in real time, deploys defenses against the information in the monitoring blacklist database 3, and sends an alarm immediately when it detects that it meets the blacklist database and the suspect/car or event occurs .

所述视频内容检索引擎7,根据用户的智能视频检索或追踪请求,生成Metadata检索计算机指令,对所述Metadata数据库2进行检索,向用户返回包含吻合检索条件的目标的视频片段。The video content retrieval engine 7, according to the user's intelligent video retrieval or tracking request, generates Metadata retrieval computer instructions, searches the Metadata database 2, and returns to the user video clips containing objects matching the retrieval conditions.

所述摄像机网络指的是相邻摄像机终端有逻辑关联并且信息互通的多路摄像机。The camera network refers to multiple cameras in which adjacent camera terminals are logically associated and communicate with each other.

在本发明提供的方法中,为实现节点间基于逻辑推理的视频信息检索,首先,需要将监控网络中的摄像机型号、安装地点、工作状态记录到视频基础资源数据库4,并且,通过对现场的实地考察和实验,记录每个摄像机的临近摄像机,以及嫌疑人/车从一个摄像机移动到另一个摄像机拍摄范围所需的必经路线和最短时间,最终形成摄像机拓扑关系图并记录到视频基础资源数据库4。In the method provided by the present invention, in order to realize video information retrieval based on logical reasoning between nodes, first, it is necessary to record the camera model, installation location, and working status in the monitoring network to the video basic resource database 4, and, through on-site On-the-spot investigation and experiment, record the neighboring cameras of each camera, as well as the necessary route and the shortest time required for the suspect/vehicle to move from one camera to another camera’s shooting range, and finally form a camera topology map and record it to the basic video resource database4.

其次,部署各种视频智能分析设备,形成Metadata抽取引擎5。所述Metadata抽取引擎5可自动化地从所属节点摄像机/视频采集设备8拍摄的视频内容中提取常规性的目标及其特征(如目标的形状、颜色、纹理、轮廓等),和警用关注信息(如嫌疑人、可疑车辆、可疑物品、异常事件等),经过索引存储到Metadata数据库2中。对于存储在视频存储设备9中、未被实时分析并抽取Metadata数据的视频,可在需要检索时临时指令Metadata抽取引擎5进行视频录像抽取,其结果也存入Metadata数据库2。Second, deploy various video intelligent analysis devices to form a Metadata extraction engine5. The Metadata extraction engine 5 can automatically extract conventional targets and their features (such as target shape, color, texture, outline, etc.) and police attention information from the video content captured by the associated node camera/video capture device 8 (such as suspects, suspicious vehicles, suspicious objects, abnormal events, etc.), and store them in the Metadata database 2 after being indexed. For videos stored in the video storage device 9 that have not been analyzed in real time and extracted Metadata data, the Metadata extraction engine 5 can be temporarily instructed to extract video recordings when retrieval is required, and the results are also stored in the Metadata database 2 .

在用户进行智能布控时,根据用户通过软件界面输入的黑名单及布防策略,以及上级节点指派的监控黑名单和布防策略,形成监控黑名单数据库3并动态更新。同时,在所述报警研判引擎6,通过对Metadata数据流进行实时分析,针对所述监控黑名单数据库3中的信息进行布防,或与基于各级公安系统破案经验制定的各种嫌犯行为判读原则及报警界限进行比对,当检测到符合黑名单的嫌疑人/车、以及超越警方预设报警界限的行迹可疑嫌疑人/车或突发事件后,则立即发出报警。当存在下级节点时,本节点报警研判引擎还可将监控黑名单和布防策略指派给相应下级节点进行布防。When the user performs intelligent deployment and control, according to the blacklist and deployment strategy input by the user through the software interface, as well as the monitoring blacklist and deployment strategy assigned by the superior node, the monitoring blacklist database 3 is formed and dynamically updated. At the same time, in the alarm research and judgment engine 6, through the real-time analysis of the Metadata data stream, the information in the monitoring blacklist database 3 is deployed, or it is combined with various suspect behavior interpretation principles based on the experience of public security systems at all levels. When a suspect/vehicle that meets the blacklist, a suspicious suspect/vehicle or an emergency that exceeds the police preset alarm limit is detected, an alarm will be issued immediately. When there are lower-level nodes, the alarm research and judgment engine of this node can also assign the monitoring blacklist and arming strategy to the corresponding lower-level nodes for arming.

在用户进行智能视频检索时,由用户在所述视频内容检索引擎7中指定检索时间范围、区域范围、目标特征、行为规则、事件类型等限定,由所述视频内容检索引擎7生成Metadata检索计算机指令,对所述Metadata数据库2进行检索,向用户返回包含吻合检索条件的目标的视频片段。当存在下级节点时,本节点视频内容检索引擎7还可将检索任务指派给相应区域的下级节点。When the user performs intelligent video retrieval, the user specifies the retrieval time range, area range, target feature, behavior rules, event type, etc. in the video content retrieval engine 7, and the Metadata retrieval computer is generated by the video content retrieval engine 7. Instructions are used to search the Metadata database 2, and return to the user video clips containing objects matching the search conditions. When there are subordinate nodes, the video content retrieval engine 7 of this node can also assign the retrieval task to the subordinate nodes in the corresponding area.

在用户对嫌疑人/车进行智能联网追踪时,借助于不同摄像机之间的信息相互关联,结合摄像机网络节点拓扑关系图,采用基于逻辑推理的搜索方法,实现对嫌疑人/车去向的综合推理,得出最为吻合的视频相关信息,或得出最可能再次发现嫌疑人/车的时间地点,帮助警方自动获取相关视频。When the user conducts intelligent network tracking of the suspect/car, with the help of the information correlation between different cameras, combined with the camera network node topology diagram, the search method based on logical reasoning is adopted to realize the comprehensive reasoning of the whereabouts of the suspect/car , get the most matching video-related information, or get the time and place where the suspect/car is most likely to be found again, and help the police automatically obtain relevant videos.

通过每一节点上与临近的系统节点之间的地理相关信息,以及警方实地考察勘测得出大量的由此节点前往临近系统节点的路程、所需时间的关系信息,可以由逻辑推理出某一可疑车辆或某一嫌疑人通过某种交通方式前往临近系统节点所需时间,并由此推断出可能需要调取临近节点视频信息的优先级。可疑车辆或某一嫌疑人不可能到达的远方系统节点,其视频信息检索的优先级降低为零,则在网络上就不需要再做进一步检索或调取视频信息,由此而节省警方检索及调取视频的时间,保障实现大规模联网视频监控系统及自动报警系统不至于受到系统性能或网络性能的制约。Through the geographically related information between each node and the adjacent system nodes, as well as the police field investigation and survey, a large amount of relationship information about the distance and time required for this node to the adjacent system nodes can be derived logically. The time required for a suspicious vehicle or a certain suspect to go to an adjacent system node through a certain mode of transportation, and from this it can be deduced that it may be necessary to call the priority of the adjacent node video information. For a suspicious vehicle or a remote system node that cannot be reached by a certain suspect, the priority of video information retrieval is reduced to zero, so there is no need for further retrieval or retrieval of video information on the network, thus saving police retrieval and The time to call the video ensures that the large-scale networked video surveillance system and automatic alarm system will not be restricted by system performance or network performance.

优选地,为了满足大规模跨地域联网式视频监控系统互联互通及邻近节点综合逻辑推理的要求,各个节点中的Metadata数据库2中储存的Metadata数据都需按照相同的格式、相同的索引方式进行存储,保障在邻近节点中的视频基础数据能够被同一逻辑的检索指令检索出来。Preferably, in order to meet the requirements of large-scale cross-regional networked video surveillance system interconnection and comprehensive logical reasoning of adjacent nodes, the Metadata data stored in the Metadata database 2 in each node must be stored in the same format and the same indexing method , to ensure that the basic video data in adjacent nodes can be retrieved by the same logical retrieval command.

优选地,本发明所述的Metadata数据,由以下两部分数据组成:Preferably, the Metadata data described in the present invention consists of the following two parts of data:

1.视频基本特征1. Basic features of video

视频基本特征是用于描述视频中目标的低层信息。包括以下信息:Video basic features are low-level information used to describe objects in a video. Include the following information:

1)运动目标检测信息:包括时间、目标编号、目标位置、目标大小、速度;1) Moving target detection information: including time, target number, target position, target size, speed;

2)运动目标跟踪信息(轨迹);2) Moving target tracking information (trajectory);

3)目标颜色直方图:颜色直方图描述了物体上不同颜色的分布。主颜色特征描述了构成目标的主要颜色。如一辆绿色的车,其主要颜色就是绿色;3) Object color histogram: The color histogram describes the distribution of different colors on the object. The dominant color feature describes the main colors that make up the object. Such as a green car, its main color is green;

4)离散余弦变换(DCT)系数:目标图像进行频域变换所得的系数,该特征有效描述了目标的纹理特性;4) Discrete cosine transform (DCT) coefficient: the coefficient obtained by performing frequency domain transformation on the target image, this feature effectively describes the texture characteristics of the target;

5)边缘方向特征:对目标边缘按照方向进行直方图统计所得到的向量,用于有效区分形状不同的目标。5) Edge direction feature: the vector obtained by performing histogram statistics on the object edge according to the direction, which is used to effectively distinguish objects with different shapes.

2.警用关注信息2. Police attention information

1)目标类别信息;1) Target category information;

2)人脸、车牌识别信息;2) Face and license plate recognition information;

3)遗留物检测、物品移除检测、奔跑检测、入侵检测、逆行检测、徘徊检测等事件检测类输出信息,具体信息中包括:当前时间、事件编号、事件类型、事件级别、事件状态;3) Event detection output information such as leftover detection, item removal detection, running detection, intrusion detection, retrograde detection, loitering detection, etc. The specific information includes: current time, event number, event type, event level, event status;

4)人流量统计输出信息包括:当前时间、切面通过人数;4) The output information of people flow statistics includes: the current time, the number of people passing through the section;

5)人群密度估计输出信息包括:当前时间、当前人群密度等级;5) The output information of crowd density estimation includes: current time, current crowd density level;

6)视频质量检测信息。6) Video quality inspection information.

上述两部分信息共同构成Metadata数据,通过Metadata抽取引擎即时提取出来,存储到Metadata数据库中。The above two parts of information together constitute Metadata data, which is immediately extracted by the Metadata extraction engine and stored in the Metadata database.

在本发明所述视频信息层次化描述过程中,优选地,监控视频源可以是如图2中所示的视频采集设备8,也可以是存储在视频存储设备9中的录像文件。In the hierarchical description process of video information in the present invention, preferably, the surveillance video source may be the video acquisition device 8 as shown in FIG. 2 , or a video file stored in the video storage device 9 .

综上所述,根据本发明所述的实施方案,其具体流程是:建立视频基础资源数据库4,将各地各类报警与监控系统的建设、更新、变动情况以及相关基础信息及时采集入库;来自不同设备的监控视频通过Metadata抽取引擎5,抽取出视频基本特征和警用关注信息;这些层次化内容描述信息被以标准化形式保存在存储介质中,并统一建立索引;所述视频基础资源被存储在视频基础资源数据库4中,所述层次化描述内容被存储在Metadata数据库2中;同时,报警研判引擎6将上述生成的视频内容层次化描述信息与重点人员、重点车辆、可疑物品图像库中的数据进行比对,或与基于各级公安系统破案经验制定的各种嫌犯行为判读原则及报警界限进行比对,当发现可疑目标时,自动输出报警信息;在用户检索时,用户通过客户端输入时间、地点、嫌疑人特征、可疑车辆特征、可疑物品特征等检索条件,视频内容检索引擎7首先从查询条件中抽取特征,然后结合视频基础资源信息,通过分布式访问的方式经过Metadata服务器1对各级子节点的Metadata数据库2进行并行查找,获得检索结果并将相关视频返回给用户。In summary, according to the embodiment of the present invention, its specific process is: establish a video basic resource database 4, and collect and store in time the construction, update, changes and related basic information of various alarm and monitoring systems in various places; Surveillance videos from different devices use the Metadata extraction engine 5 to extract the basic features of the video and police attention information; these hierarchical content description information are stored in the storage medium in a standardized form and indexed uniformly; the basic video resources are Stored in the video basic resource database 4, the hierarchical description content is stored in the Metadata database 2; meanwhile, the alarm research engine 6 combines the above-mentioned generated video content hierarchical description information with key personnel, key vehicles, and suspicious object image libraries Compare the data in the database, or compare with various suspect behavior interpretation principles and alarm limits based on the experience of public security systems at all levels, and when suspicious targets are found, the alarm information will be automatically output; Input time, location, suspect features, suspicious vehicle features, suspicious item features and other retrieval conditions at the terminal, the video content retrieval engine 7 first extracts the features from the query conditions, and then combines the video basic resource information, through the Metadata server through distributed access 1 Parallel search is performed on the Metadata database 2 of sub-nodes at all levels, the retrieval results are obtained and relevant videos are returned to the user.

以上所述,仅为本发明的具体实施方式,但本发明的保护范围并不局限于此,在不脱离本发明的精神和实质的情况下,在本发明基础上增加更多的引擎或更多的数据库,由此而实现更完备的快速视频检索,这些变型和改进也视为本发明的保护范围,以及任何熟悉本技术领域的技术人员在本发明公开的范围内,能够轻易想到的变化或替换,都应涵盖在本发明权利要求的保护范围内。The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Without departing from the spirit and essence of the present invention, more engines or more engines can be added on the basis of the present invention. More databases, thereby realizing more complete and fast video retrieval, these modifications and improvements are also considered as the protection scope of the present invention, and any changes that can be easily imagined by those skilled in the art within the scope of the disclosure of the present invention Or replacement, all should be covered in the scope of protection of the claims of the present invention.

Claims (6)

1. fast video search method of describing based on the video information hierarchical structured, it is characterized in that: describe the integrated application framework and study and judge flow process based on the video content hierarchical structured of three databases of classification and three engines, described integrated application framework is: in video monitoring network system, according to each sub-network actual conditions, a plurality of nodes are disposed in classification, each node is take video segmentation structural description server as core, and include complete three databases and three engines, described video segmentation structural description server is the Metadata server, described three databases are the video elementary resource database, video segmentation structural description database and monitoring blacklist database, described video segmentation structural description database is the Metadata database; Described three engines are that engine and video content search engine are studied and judged in video segmentation structural description extraction engine, warning, and described video segmentation structural description extraction engine is the Metadata extraction engine; The described flow process of studying and judging is: by three databases and three engine collaborative works multi-level, multinode, the monitor video content is carried out full-automatic hierarchical structured to be described, and carry out reasoning from logic based on topological relation between node and judge, video monitoring information is studied and judged in the realization intellectuality, finally realizes automatic alarm and quick-searching.
2. a kind of fast video search method of describing based on the video information hierarchical structured according to claim 1, it is characterized in that: Metadata server and three databases and three engines all are set on each node of described video monitoring network system, make it possess independently video monitoring, automatic alarm, user search function, described three databases are one of centralized data base or distributed data base.
3. a kind of fast video search method of describing based on the video information hierarchical structured according to claim 1, it is characterized in that: each node at described video monitoring network system all comprises special-purpose video segmentation structural description server, it is the Metadata server, be used for interconnected, synchronous logic analysis result between node, realize simplifying and subscription, propelling movement, storage, the query function of complete police concern information Metadata data.
4. a kind of fast video search method of describing based on the video information hierarchical structured according to claim 1, it is characterized in that: described fast video search method is when inquiring about, interrelated by means of the information between the different terminals, take full advantage of the information such as video camera topological relation in the video elementary resource database, adopt the searching method of logic-based reasoning to realize fast query.
5. a kind of fast video search method of describing based on the video information hierarchical structured according to claim 1, it is characterized in that: described fast video search method is being carried out hierarchical structured when describing to video content, need follow the standardized format that the video content hierarchical structured is described.
6. a kind of fast video search method of describing based on the video information hierarchical structured according to claim 1, it is characterized in that: the concrete steps of described fast video search method are: set up the video elementary resource database, construction, renewal, change conditions and the relevant rudimentary information of all kinds of warnings in various places and supervisory system is in time gathered warehouse-in; Monitor video from distinct device carries out video extraction work by the Metadata extraction engine, extracts video essential characteristic and police concern information; These stratification content description informations are kept in the storage medium with normalized form, and the unified index of setting up; Described video elementary resource is stored in the video elementary resource database, and described stratification is described content and is stored in the Metadata database; Simultaneously, warning is studied and judged engine the data in the video content stratification descriptor of above-mentioned generation and emphasis personnel, emphasis vehicle, the suspicious object image library is compared, or compare with various suspect's behavior interpretation principles and alarm threshold that the experience of solving a case based on public security systems at different levels is formulated, when finding suspicious object, automatic output alarm information; When user search, the user is by search conditions such as client input time, place, suspect's feature, suspect vehicle feature, suspicious object features, the video content search engine at first extracts feature from querying condition, then in conjunction with the video elementary resource information, mode by distributed access is carried out parallel search through the Metadata server to the Metadata database of child nodes at different levels, obtains result for retrieval and associated video is returned to the user.
CN201210230539.7A 2012-07-04 2012-07-04 Rapid video retrieval method based on layered structuralized description of video information Active CN102929903B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210230539.7A CN102929903B (en) 2012-07-04 2012-07-04 Rapid video retrieval method based on layered structuralized description of video information

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210230539.7A CN102929903B (en) 2012-07-04 2012-07-04 Rapid video retrieval method based on layered structuralized description of video information

Publications (2)

Publication Number Publication Date
CN102929903A true CN102929903A (en) 2013-02-13
CN102929903B CN102929903B (en) 2017-02-08

Family

ID=47644701

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210230539.7A Active CN102929903B (en) 2012-07-04 2012-07-04 Rapid video retrieval method based on layered structuralized description of video information

Country Status (1)

Country Link
CN (1) CN102929903B (en)

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103347167A (en) * 2013-06-20 2013-10-09 上海交通大学 Surveillance video content description method based on fragments
CN104052780A (en) * 2013-03-15 2014-09-17 南京理工大学常熟研究院有限公司 Social public security video information retrieval and service system based on convergence of three networks
CN104281598A (en) * 2013-07-05 2015-01-14 上海众恒信息产业股份有限公司 Population database system based on cloud computing
CN105138525A (en) * 2014-05-30 2015-12-09 株式会社日立制作所 Traffic video processing device and method, and retrieval device and method
CN105959621A (en) * 2016-04-28 2016-09-21 泰华智慧产业集团股份有限公司 Quasi-real time control distribution system and method based on multi-source video structural data
CN106034217A (en) * 2014-12-12 2016-10-19 由田新技股份有限公司 Remote face monitoring system and method thereof
CN106330928A (en) * 2016-08-29 2017-01-11 上海航盛实业有限公司 Monitoring information management system
CN106339973A (en) * 2016-08-31 2017-01-18 安徽四创电子股份有限公司 Guard security system based on data platform and and guard security method thereof
CN106339428A (en) * 2016-08-16 2017-01-18 东方网力科技股份有限公司 Identity identification method and device for suspects based on large video data
CN106709424A (en) * 2016-11-19 2017-05-24 北京中科天云科技有限公司 Optimized surveillance video storage system and equipment
CN107277470A (en) * 2017-08-10 2017-10-20 四川天翼网络服务有限公司 A kind of network-linked management method and digitlization police service linkage management method
CN107832475A (en) * 2017-12-01 2018-03-23 浪潮软件集团有限公司 Deployment control method, deployment control engine and deployment control system
CN108153799A (en) * 2016-12-06 2018-06-12 阿里巴巴集团控股有限公司 Access and control strategy of database method, apparatus and Database Systems
CN108364438A (en) * 2017-12-28 2018-08-03 武汉烽火众智数字技术有限责任公司 Method for early warning based on front end perception data and device
CN108399261A (en) * 2018-03-13 2018-08-14 成都蓉兴伟业科技有限公司 A kind of case and video analysis method based on integration method
CN109523797A (en) * 2018-12-12 2019-03-26 武汉中科天宇科技有限公司 A kind of wisdom traffic police service linkage system and corresponding method
CN110519204A (en) * 2018-05-21 2019-11-29 北京仁光科技有限公司 Device, method and system for being interacted to the computer in a subnet
CN110602461A (en) * 2019-09-26 2019-12-20 广脉科技股份有限公司 Future community regional perception information processing feedback system
CN110825893A (en) * 2019-09-18 2020-02-21 北京旷视科技有限公司 Target searching method, device, system and storage medium
CN110933291A (en) * 2019-06-06 2020-03-27 北京仁光科技有限公司 Cross-network interaction system and cross-network interaction method
CN112651992A (en) * 2020-06-29 2021-04-13 浙江宇视科技有限公司 A trajectory tracking method and system
CN113448622A (en) * 2021-01-20 2021-09-28 北京仁光科技有限公司 Multi-signal-source interface interaction system
CN113569096A (en) * 2021-07-23 2021-10-29 北京百度网讯科技有限公司 Structured information extraction method, device, equipment and storage medium
CN115080094A (en) * 2022-08-16 2022-09-20 张家港金典软件有限公司 Security system updating method and system based on hierarchical interaction

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6463433B1 (en) * 1998-07-24 2002-10-08 Jarg Corporation Distributed computer database system and method for performing object search
CN1691591A (en) * 2004-04-16 2005-11-02 Ut斯达康公司 Method and device for loosely coupled scalable distributed multimedia streaming transmission system
CN101917553A (en) * 2009-11-27 2010-12-15 新奥特(北京)视频技术有限公司 System for collectively processing multimedia data

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6463433B1 (en) * 1998-07-24 2002-10-08 Jarg Corporation Distributed computer database system and method for performing object search
CN1691591A (en) * 2004-04-16 2005-11-02 Ut斯达康公司 Method and device for loosely coupled scalable distributed multimedia streaming transmission system
CN101917553A (en) * 2009-11-27 2010-12-15 新奥特(北京)视频技术有限公司 System for collectively processing multimedia data

Cited By (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104052780A (en) * 2013-03-15 2014-09-17 南京理工大学常熟研究院有限公司 Social public security video information retrieval and service system based on convergence of three networks
CN103347167A (en) * 2013-06-20 2013-10-09 上海交通大学 Surveillance video content description method based on fragments
CN104281598A (en) * 2013-07-05 2015-01-14 上海众恒信息产业股份有限公司 Population database system based on cloud computing
CN105138525A (en) * 2014-05-30 2015-12-09 株式会社日立制作所 Traffic video processing device and method, and retrieval device and method
CN105138525B (en) * 2014-05-30 2019-10-01 株式会社日立制作所 Traffic video processing unit and method and retrieval device and method
CN106034217A (en) * 2014-12-12 2016-10-19 由田新技股份有限公司 Remote face monitoring system and method thereof
CN105959621A (en) * 2016-04-28 2016-09-21 泰华智慧产业集团股份有限公司 Quasi-real time control distribution system and method based on multi-source video structural data
CN106339428B (en) * 2016-08-16 2019-08-23 东方网力科技股份有限公司 Suspect's personal identification method and device based on video big data
CN106339428A (en) * 2016-08-16 2017-01-18 东方网力科技股份有限公司 Identity identification method and device for suspects based on large video data
CN106330928B (en) * 2016-08-29 2019-12-31 上海航盛实业有限公司 Management system for monitoring information
CN106330928A (en) * 2016-08-29 2017-01-11 上海航盛实业有限公司 Monitoring information management system
CN106339973A (en) * 2016-08-31 2017-01-18 安徽四创电子股份有限公司 Guard security system based on data platform and and guard security method thereof
CN106709424A (en) * 2016-11-19 2017-05-24 北京中科天云科技有限公司 Optimized surveillance video storage system and equipment
CN108153799A (en) * 2016-12-06 2018-06-12 阿里巴巴集团控股有限公司 Access and control strategy of database method, apparatus and Database Systems
CN108153799B (en) * 2016-12-06 2022-03-25 阿里云计算有限公司 Database access control method and device and database system
CN107277470A (en) * 2017-08-10 2017-10-20 四川天翼网络服务有限公司 A kind of network-linked management method and digitlization police service linkage management method
CN107832475A (en) * 2017-12-01 2018-03-23 浪潮软件集团有限公司 Deployment control method, deployment control engine and deployment control system
CN108364438A (en) * 2017-12-28 2018-08-03 武汉烽火众智数字技术有限责任公司 Method for early warning based on front end perception data and device
CN108399261A (en) * 2018-03-13 2018-08-14 成都蓉兴伟业科技有限公司 A kind of case and video analysis method based on integration method
CN110519204A (en) * 2018-05-21 2019-11-29 北京仁光科技有限公司 Device, method and system for being interacted to the computer in a subnet
CN110519204B (en) * 2018-05-21 2020-07-24 北京仁光科技有限公司 Apparatus, method and system for interacting with computers within a subnet
CN109523797A (en) * 2018-12-12 2019-03-26 武汉中科天宇科技有限公司 A kind of wisdom traffic police service linkage system and corresponding method
CN110933291A (en) * 2019-06-06 2020-03-27 北京仁光科技有限公司 Cross-network interaction system and cross-network interaction method
CN110825893A (en) * 2019-09-18 2020-02-21 北京旷视科技有限公司 Target searching method, device, system and storage medium
CN110602461A (en) * 2019-09-26 2019-12-20 广脉科技股份有限公司 Future community regional perception information processing feedback system
CN112651992A (en) * 2020-06-29 2021-04-13 浙江宇视科技有限公司 A trajectory tracking method and system
CN112651992B (en) * 2020-06-29 2024-04-05 浙江宇视科技有限公司 Trajectory tracking method and system
CN113448622A (en) * 2021-01-20 2021-09-28 北京仁光科技有限公司 Multi-signal-source interface interaction system
CN113569096B (en) * 2021-07-23 2024-03-29 北京百度网讯科技有限公司 Structured information extraction method, device, equipment and storage medium
CN113569096A (en) * 2021-07-23 2021-10-29 北京百度网讯科技有限公司 Structured information extraction method, device, equipment and storage medium
CN115080094A (en) * 2022-08-16 2022-09-20 张家港金典软件有限公司 Security system updating method and system based on hierarchical interaction
CN115080094B (en) * 2022-08-16 2022-11-29 张家港金典软件有限公司 Security system updating method and system based on hierarchical interaction

Also Published As

Publication number Publication date
CN102929903B (en) 2017-02-08

Similar Documents

Publication Publication Date Title
CN102929903B (en) Rapid video retrieval method based on layered structuralized description of video information
Valera et al. Intelligent distributed surveillance systems: a review
CN104700434B (en) A kind of crowd movement track method for detecting abnormality for labyrinth scene
CN100487739C (en) Multi-layer real time forewarning system based on the intelligent video monitoring
CN101873414B (en) Event video detection system based on hierarchical structure
CN118075427A (en) Intelligent monitoring management method and system
CN115002414A (en) Monitoring method, monitoring device, server and computer readable storage medium
CN100514379C (en) Intelligent monitoring dynamic alarm system of anti-technical net
TWI450207B (en) Method, system, computer program product and computer-readable recording medium for object tracking
CN105138525B (en) Traffic video processing unit and method and retrieval device and method
CN106649801A (en) Time-space relationship analysis system based on multi-source internet-of-things position awareness
KR20180118979A (en) Method and apparatus for risk detection, prediction, and its correspondence for public safety based on multiple complex information
Ali Big data-driven smart policing: Big data-based patrol car dispatching
Benrazek Internet of Things: Analysis of suspicious behaviour in a surveillance camera network
Choi et al. Activity recognition in wide aerial video surveillance using entity relationship models
CN105208326A (en) Video-cloud-based early warning method and system of public security threat of urban region
Valera et al. A review of the state-of-the-art in distributed surveillance systems
CN114265952B (en) Target retrieval method and device
Mishra et al. Monitoring a large surveillance space through distributed face matching
Celik et al. Discovering and ranking urban social clusters out of streaming social media datasets
CN104966264A (en) Security big data based on text serving as transformation basic state of heterogeneous data for fusion processing
Skopal et al. Videolytics: system for data analytics of video streams
CN119848951B (en) Video monitoring data safe storage method based on block chain technology
US12368822B2 (en) Scalable visual computing system
Portugal et al. Spatial-Temporal Cluster Relations--A Foundation for Trajectory Cluster Lifetime Analysis

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant