[go: up one dir, main page]

CN109784254B - A method, device and electronic device for vehicle violation event detection - Google Patents

A method, device and electronic device for vehicle violation event detection Download PDF

Info

Publication number
CN109784254B
CN109784254B CN201910011455.6A CN201910011455A CN109784254B CN 109784254 B CN109784254 B CN 109784254B CN 201910011455 A CN201910011455 A CN 201910011455A CN 109784254 B CN109784254 B CN 109784254B
Authority
CN
China
Prior art keywords
vehicle
motion trajectory
traffic event
traffic
determination model
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910011455.6A
Other languages
Chinese (zh)
Other versions
CN109784254A (en
Inventor
郭昌野
王文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yi Tai Fei Liu Information Technology LLC
Original Assignee
Yi Tai Fei Liu Information Technology LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yi Tai Fei Liu Information Technology LLC filed Critical Yi Tai Fei Liu Information Technology LLC
Priority to CN201910011455.6A priority Critical patent/CN109784254B/en
Publication of CN109784254A publication Critical patent/CN109784254A/en
Application granted granted Critical
Publication of CN109784254B publication Critical patent/CN109784254B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Traffic Control Systems (AREA)
  • Image Analysis (AREA)

Abstract

本发明实施例涉及网络技术领域,公开了一种车辆违规事件检测的方法、装置和电子设备。本发明中车辆违规事件检测的方法,包括:实时采集预设区域内所有车辆的图像数据,所述图像数据包含至少2帧区域内的图像;根据图像数据,确定在预设区域内每辆车的运动轨迹;根据每辆车的运动轨迹以及交通事件确定模型,确定每辆车当前所属的交通事件,其中,交通事件确定模型为车辆运动轨迹与车辆所属交通事件之间的对应关系;根据每辆车所属的交通事件,输出指示车辆属于违规交通事件的告警信息。本实施方式,使得可以准确地对各种场景中的车辆进行违规事件的检测,减少车辆违规事件的发生次数。

Figure 201910011455

Embodiments of the present invention relate to the technical field of networks, and disclose a method, a device and an electronic device for detecting a vehicle violation event. The method for vehicle violation event detection in the present invention includes: collecting image data of all vehicles in a preset area in real time, the image data including images in at least two frames of area; determining each vehicle in the preset area according to the image data According to the motion trajectory of each vehicle and the traffic event determination model, determine the traffic event to which each vehicle currently belongs, wherein the traffic event determination model is the correspondence between the vehicle motion trajectory and the traffic event to which the vehicle belongs; The traffic event to which the vehicle belongs, and output warning information indicating that the vehicle belongs to the violation traffic event. This embodiment makes it possible to accurately detect violation events for vehicles in various scenarios, thereby reducing the number of vehicle violation events.

Figure 201910011455

Description

Vehicle violation event detection method and device and electronic equipment
Technical Field
The embodiment of the invention relates to the technical field of networks, in particular to a method and a device for detecting a vehicle violation event and electronic equipment.
Background
With the continuous development of social economy and science and technology, the living standard of materials is continuously improved, the number of urban motor vehicles is rapidly increased, the urban traffic environment is gradually worsened, and the problem of road safety is more and more concerned by people. In road safety, behaviors such as vehicle road parking, vehicle back running and the like belong to high-frequency traffic violation behaviors. Once the vehicle stops on the road, runs backwards and the like, road congestion and even traffic accidents are easily caused. Therefore, the real-time automatic detection and judgment of behaviors such as vehicle road parking, retrograde motion and the like are realized by utilizing the conventional road video monitoring system, and the real-time automatic detection and judgment system has very important significance in actual production life.
The inventor finds that at least the following problems exist in the prior art: at present, different detection modes are required to be adopted for judging different violation events of a vehicle, for example, the detection of vehicle road parking can adopt an optical flow detection mode to determine the movement speed and direction of the vehicle, the movement speed of the vehicle is compared with the movement speed of a vehicle running normally, and whether the vehicle has the violation event of road parking is judged according to the comparison result; and the detection of the reverse running of the vehicle is to determine the violation detection result of the vehicle according to the detection result of whether the moving direction of the vehicle is consistent with the direction of the normally moving vehicle. Therefore, different methods are needed for detecting different violation events of the vehicle, so that the method is inconvenient to apply and is not beneficial to detecting the violation events of the vehicle; simultaneously; the detection method is low in accuracy, cannot detect vehicles running on the road, and loses detection significance.
Disclosure of Invention
The invention aims to provide a method, a device and electronic equipment for detecting vehicle violation events, which can accurately detect the violation events of vehicles in various scenes and reduce the occurrence frequency of the vehicle violation events.
In order to solve the technical problem, an embodiment of the present invention provides a method for detecting a vehicle violation event, including: acquiring image data of all vehicles in a preset area in real time, wherein the image data comprises at least 2 frames of images in the area; determining the motion track of each vehicle in a preset area according to the image data; determining a traffic incident to which each vehicle belongs currently according to the motion trail of each vehicle and a traffic incident determination model, wherein the traffic incident determination model is a corresponding relation between the motion trail of the vehicle and the traffic incident to which the vehicle belongs; and outputting alarm information indicating that the vehicles belong to the illegal traffic events according to the traffic events to which each vehicle belongs.
The embodiment of the invention also provides a device for detecting the vehicle violation event, which comprises the following steps: the device comprises an acquisition module, a first determination module, a second determination module and an information output module; the acquisition module is used for acquiring image data of all vehicles in a preset area in real time, wherein the image data comprises images in at least 2 frame areas; the first determining module is used for determining the motion track of each vehicle in a preset area according to the image data; the second determining module is used for determining a traffic incident to which each vehicle belongs at present according to the motion trail of each vehicle and a traffic incident determining model, wherein the traffic incident determining model is a corresponding relation between the motion trail of the vehicle and the traffic incident to which the vehicle belongs; the information output module is used for outputting alarm information indicating that the vehicles belong to the illegal traffic incident according to the traffic incident to which each vehicle belongs.
An embodiment of the present invention also provides an electronic device, including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method for vehicle violation event detection described above.
Compared with the prior art, the method and the device have the advantages that the motion trail of each vehicle in the preset area is determined by acquiring the image data of all vehicles in the preset area and according to the frame images in the image data; the traffic incident to which the current vehicle belongs can be determined according to the movement track of each vehicle and the traffic incident determination model, different detection methods are not required to be set for the vehicles according to different detection requirements, the range of applicable scenes for detecting violation incidents of the vehicles is widened, the traffic incident to which the current vehicle belongs can be accurately determined only by detecting once, and the detection speed of the vehicles is accelerated; because the traffic events of the vehicles are related to the motion states of the vehicles, the acquired motion tracks of each vehicle and the traffic event determination model jointly determine the traffic events of the vehicles, so that the accuracy of detecting the traffic events can be improved, and the occurrence of road violation events can be effectively reduced.
In addition, prior to determining the traffic events to which each vehicle currently belongs, the method of vehicle violation event detection further comprises: acquiring historical image data of vehicles in a first preset time period in a preset area, and acquiring a traffic incident to which each vehicle belongs in the first preset time period; determining the historical motion track of each vehicle in a preset area within a first preset time period according to historical image data; and constructing a traffic incident determination model according to the historical motion trail and the traffic incident to which each vehicle belongs within the first preset time period. A large amount of historical data is used as a basis for constructing a traffic incident determination model, so that the determined traffic incident determination model is more accurate.
In addition, the traffic incident determination model is constructed in a deep neural network mode, wherein an input layer of the traffic incident determination model comprises n nodes, each node corresponds to one sampling point of the motion trail of each vehicle, an output layer comprises m output nodes, each output node corresponds to one traffic incident, and n and m are integers larger than 1. A traffic incident determination model is constructed in a deep neural network mode, so that the traffic incident determination model is more practical and has high accuracy; the number of sampling points of the motion trail corresponds to the number of nodes, so that the deep neural network model can be accurately constructed.
In addition, determining the current traffic incident of each vehicle according to the motion trail of each vehicle and the traffic incident determination model specifically comprises: acquiring the number of nodes of a traffic incident determination model input layer; respectively preprocessing the motion trail of each vehicle according to the number of nodes of the input layer; and taking the preprocessed motion trail of each vehicle as the input of a traffic incident determination model to determine the current traffic incident of each vehicle. And preprocessing the motion trail of each vehicle according to the number of nodes of the input layer of the traffic determination model so that the motion trail of each vehicle conforms to the input of the traffic incident determination model.
In addition, according to the number of nodes of the input layer, the motion trail of each vehicle is preprocessed, and the method specifically comprises the following steps: the following preprocessing is carried out on the motion track of each vehicle: judging whether the number of sampling points contained in the motion trail is equal to the number of nodes or not, if the number of the sampling points contained in the motion trail is determined to be not equal to the number of the nodes, adjusting the number of the sampling points in the motion trail so that the number of the sampling points in the adjusted motion trail is equal to the number of the nodes. Through adjusting the number of sampling points to ensure that no matter how many actual sampling points are few, can all determine corresponding traffic incident according to the sampling point in the motion trail.
In addition, after obtaining the number of nodes of the traffic event determination model input layer, the method for vehicle violation event detection further comprises: and carrying out normalization processing on the motion track of each vehicle. Through normalization operation, the subsequent rapid processing of the motion trail is facilitated, and meanwhile, due to the fact that the motion trail is mapped between 0 and 1, large errors caused by large distance difference of two sampling points in the motion trail are reduced.
In addition, according to the image data, determining a motion track of each vehicle in a preset area specifically comprises: detecting the position of each vehicle in each frame of image in a preset area; the following processing is performed for each vehicle in the image: identifying vehicles in the images of the continuous frames, and taking the positions of the vehicles in each frame of image as sampling points in the motion trail of the vehicles; and determining the motion trail of the vehicle according to the sampling points of the motion trail of the vehicle in the area. The method can accurately identify the vehicles in each frame of image, and can accurately track the position of each vehicle in the image due to the continuity of the image, so that the corresponding motion track of each vehicle in the preset area image can be quickly and accurately determined, and the time for determining the motion track is shortened.
In addition, the method for determining the traffic incident of each vehicle by taking the preprocessed motion trail of each vehicle as the input of a traffic incident determination model specifically comprises the following steps: each vehicle is processed as follows: obtaining the confidence coefficient of each traffic event corresponding to the current vehicle; and determining the current traffic event of the vehicle according to the confidence coefficient. And the traffic incident to which the vehicle belongs can be objectively determined according to the confidence coefficient.
Drawings
One or more embodiments are illustrated by way of example in the accompanying drawings, which correspond to the figures in which like reference numerals refer to similar elements and which are not to scale unless otherwise specified.
FIG. 1 is a detailed flow chart of a method for vehicle violation event detection according to a first embodiment of the present disclosure;
FIG. 2 is a schematic diagram of sampling points in a motion trajectory of a vehicle according to a first embodiment of the present invention;
FIG. 3 is a detailed flow chart illustrating the determination of the traffic events to which each vehicle currently belongs according to a second embodiment of the present invention;
fig. 4 is a specific structural view of a vehicle violation event detection apparatus provided in a third embodiment of the present invention;
fig. 5 is a specific structural diagram of an electronic device according to a fourth embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention more apparent, embodiments of the present invention will be described in detail below with reference to the accompanying drawings. However, it will be appreciated by those of ordinary skill in the art that numerous technical details are set forth in order to provide a better understanding of the present application in various embodiments of the present invention. However, the technical solution claimed in the present application can be implemented without these technical details and various changes and modifications based on the following embodiments.
A first embodiment of the invention relates to a method of vehicle violation event detection. The method for detecting the vehicle violation event is applied to a terminal or electronic equipment, and the terminal or the electronic equipment is installed at the positions of a road, a parking lot and the like needing to detect the vehicle violation event so as to detect vehicles in a preset area in real time. The specific flow of the vehicle violation event detection method is shown in fig. 1.
Step 101: and acquiring image data of all vehicles in a preset area in real time, wherein the image data comprises images in at least 2 frame areas.
Specifically, the image data of all vehicles in the preset area can be collected in real time by using equipment for collecting image data, such as a camera and infrared monitoring equipment. The preset area can be determined according to a scene of vehicle violation event detection, and the detected scene can be a parking lot, a highway intersection or a road and the like. The preset area may be set as a maximum acquisition range of the acquisition device for acquiring the current scene, for example, if the acquisition device is a camera and the detection scene is an intersection position, a range of an image shot by the camera at the current intersection may be used as the preset area. Since the acquisition device is usually fixedly arranged in the detection scene, the preset area is fixed.
The image data includes at least 2 frames of images in the preset area, for example, if a camera is used to collect images in the preset area in real time, the collected images are consecutive frames of images.
It should be noted that, before determining the current traffic event of each vehicle, a traffic event determination model of the current preset area needs to be constructed in advance. The manner in which the traffic event determination model is determined may be as follows.
In a specific implementation, historical image data of vehicles in a first preset time period in a preset area is obtained, and a traffic incident to each vehicle in the first preset time period is obtained; determining the historical motion track of each vehicle in a preset area within a first preset time period according to historical image data; and constructing a traffic incident determination model according to the historical motion trail and the traffic incident to which each vehicle belongs within the first preset time period.
Specifically, there are various scenes in which it is necessary to detect whether a vehicle violates a rule, and the preset areas are different, so that the traffic event determination model corresponding to each preset area can be determined. The traffic event determination model may be constructed in a neural network learning manner. The traffic event determination model may be constructed by learning from a large amount of historical data. The first preset time period may be selected from historical time periods, and a time period adjacent to the current time may be selected for learning accuracy. For example, if it is currently 1/2018, the first preset time period may be a time period between 1/2017 and 31/2017/12/2017. The method comprises the steps of obtaining historical image data of vehicles in a preset area within a first preset time period, identifying the vehicles in each frame of image, determining the motion track of each vehicle in the preset area image according to continuous frame images, taking the historical motion track of each vehicle as input data of a traffic event model, taking the acquired traffic event to which each vehicle belongs as an output result of the traffic event model, and constructing the traffic event model in the preset area by utilizing a machine learning algorithm or a neural network algorithm. It will be appreciated that the present embodiment is not limited to the algorithm for constructing the traffic event determination model.
Step 102: and determining the motion track of each vehicle in the preset area according to the image data.
In one specific implementation, the position of each vehicle in a preset area in each frame of image is detected; the following processing is performed for each vehicle in the image: identifying vehicles in the images of the continuous frames, and taking the positions of the vehicles in each frame of image as sampling points in the motion trail of the vehicles; and determining the motion trail of the vehicle according to the sampling points of the motion trail of the vehicle in the area.
Specifically, the vehicles in each frame of image included in the image data are identified, the position of each vehicle in the image is detected, the preset area is fixed, and the acquisition device is also fixed, so that the background (a fixed building) in each frame of image is the same, and the movement track of each vehicle in the image of the preset area can be determined through the position information of each vehicle in different frame of images, wherein the position of each vehicle in each frame of image can be used as a sampling point in the movement track.
For example, as shown in fig. 2, a frame a, a frame B and a frame C respectively represent the areas where the vehicle y is located in 3 continuous images, a center point s1 of the frame a, a center point s2 of the frame B and a center point s3 of the frame C are obtained, and a connection line of three points s1, s2 and s3 can be determined as the motion trajectory of the vehicle y.
The recognition of the vehicles can also be realized through a yolo (young Only Look one, abbreviated as "yolo") real-time target detection method or an object detection algorithm ssd (single shot multi-box detector, abbreviated as "ssd"), and then the positions of the vehicles belonging to the same area in the preset area image can be tracked through the hungarian algorithm, so that the movement locus of each vehicle can be obtained, wherein the specific calculation processes of yolo or ssd and the hungarian algorithm are not repeated in the embodiment.
Step 103: and determining the traffic incident to which each vehicle belongs currently according to the motion trail of each vehicle and a traffic incident determination model, wherein the traffic incident determination model is the corresponding relation between the motion trail of the vehicle and the traffic incident to which the vehicle belongs.
In a specific implementation, the following processing is performed on the motion track of each vehicle: taking the motion trail of the vehicle as the input of a traffic incident determination model to obtain the confidence coefficient of each traffic incident corresponding to the vehicle; and determining the current traffic event of the vehicle according to the confidence coefficient.
Specifically, according to the input parameter requirements of the traffic incident determination model, the motion trail of each vehicle is input into the traffic incident determination model, the traffic incident model calculates the confidence degree of each traffic incident corresponding to the vehicle according to the input motion trail, and the traffic incident to which the current vehicle belongs can be determined according to the confidence degree of each traffic incident. For example: if the corresponding output results in the traffic event determination model include three traffic events, namely, illegal parking, vehicle reverse running and normal running of the vehicle, after the running track of the vehicle A is input into the traffic event determination model, the confidence degrees corresponding to the three traffic events are obtained, namely, the parking confidence degree is 0.1, the confidence degree of the vehicle reverse running is 0.8, and the confidence degree of the normal running of the vehicle is 0.1, so that the traffic event to which the vehicle A belongs can be determined to be the reverse running according to the confidence degree of the vehicle. Of course, it is understood that the type of the corresponding belonging traffic event in the traffic event determination model may be set according to actual needs, and is not limited to the three traffic events listed in the embodiment.
Step 104: and outputting alarm information indicating that the vehicles belong to the illegal traffic events according to the traffic events to which each vehicle belongs.
Specifically, when it is determined that the traffic event to which the vehicle belongs is a traffic event in violation, the warning information indicating that the vehicle belongs to the traffic event in violation can be output, and the output mode can be a voice report or uploading to a related network platform (such as a traffic network platform).
Compared with the prior art, the method and the device have the advantages that the motion trail of each vehicle in the preset area is determined by acquiring the image data of all vehicles in the preset area and according to the frame images in the image data; the traffic incident to which the current vehicle belongs can be determined according to the movement track of each vehicle and the traffic incident determination model, different detection methods are not required to be set for the vehicles according to different detection requirements, the range of applicable scenes for detecting violation incidents of the vehicles is widened, the traffic incident to which the current vehicle belongs can be accurately determined only by detecting once, and the detection speed of the vehicles is accelerated; because the traffic events of the vehicles are related to the motion states of the vehicles, the acquired motion tracks of each vehicle and the traffic event determination model jointly determine the traffic events of the vehicles, so that the accuracy of detecting the traffic events can be improved, and the occurrence of road violation events can be effectively reduced.
A second embodiment of the invention relates to a method of vehicle violation event detection. The second embodiment is the step 103 of the first embodiment: and determining the concrete refinement of the current traffic incident of each vehicle according to the motion trail of each vehicle and the traffic incident determination model. The specific process of determining the traffic event to which each vehicle belongs currently is shown in fig. 3.
Step 2031: and acquiring the number of nodes of the input layer of the traffic event determination model.
In a specific implementation, the traffic incident determination model is constructed in a deep neural network manner, wherein an input layer of the traffic incident determination model comprises n nodes, each node corresponds to one sampling point of a motion track of each vehicle, an output layer comprises m output nodes, each output node corresponds to one traffic incident, and n and m are integers greater than 1.
Specifically, a Deep Neural Network (DNN) model includes three parts, namely an input layer, a hidden layer and an output layer. Each node of the input layer corresponds to one sampling point of a vehicle motion trajectory, for example, if the input layer includes 4 nodes, the 4 nodes correspond to 4 sampling points of the motion trajectory of the vehicle a. The hidden layer can be a single layer or multiple layers, each layer can also be provided with a plurality of nodes, the more the hidden layers are, the more the calculation is complex, and the number of the hidden layers and the number of the nodes in each layer can be set according to actual needs. The output layer comprises m output nodes, and each output node corresponds to a traffic event, such as normal driving, roadside parking, reverse driving and the like.
Because the traffic incident determination model is constructed in advance, the number of nodes of the input layer of the traffic incident determination model can be directly acquired.
Step 2032: and respectively preprocessing the motion trail of each vehicle according to the number of the nodes of the input layer.
In one specific implementation, the following preprocessing is performed on the motion trajectory of each vehicle: judging whether the number of sampling points contained in the motion trail is equal to the number of nodes or not, if the number of the sampling points contained in the motion trail is determined to be not equal to the number of the nodes, adjusting the number of the sampling points in the motion trail so that the number of the sampling points in the adjusted motion trail is equal to the number of the nodes.
The following description will take the motion trajectory of one of the vehicles as an example.
Specifically, the number of sampling points included in the movement track of the vehicle is firstly obtained, whether the number of the sampling points is equal to the number of nodes in an input layer or not is judged, if yes, each sampling point in the movement track of the vehicle is directly used as the input of a traffic event determination model, and if not, the number of the sampling points in the movement track of the vehicle is adjusted, so that the number of the sampling points is equal to the number of the nodes in the input layer. And when the number of the sampling points in the motion trail is greater than the number of the nodes of the input layer, randomly deleting any coordinate data between the maximum value and the minimum value of the coordinate data of the sampling points of the motion trail until the number of the coordinate data of the motion trail of the vehicle is equal to n. And when the number of the sampling points in the motion trail is less than the number of the nodes of the input layer, randomly simulating and generating new sampling points between the maximum value and the minimum value of the coordinate data of the sampling points of the motion trail of the vehicle until the number of the coordinate data of the motion trail of the vehicle is equal to n.
It should be noted that after the number of nodes of the input layer of the traffic event determination model is obtained and before the motion trajectory of each vehicle is preprocessed, the motion trajectory of each vehicle may be normalized. Through normalization operation, the subsequent rapid processing of the motion trail is facilitated, and meanwhile, due to the fact that the motion trail is mapped between 0 and 1, large errors caused by large distance difference of two sampling points in the motion trail are reduced.
Step 2033: and taking the preprocessed motion trail of each vehicle as the input of a traffic incident determination model to determine the current traffic incident of each vehicle.
In a specific embodiment, the confidence of each traffic event corresponding to the current vehicle is obtained; and determining the current traffic event of the vehicle according to the confidence coefficient. This process is substantially the same as the process of determining a traffic event according to the confidence in the first embodiment, and will not be described here.
According to the method for detecting the vehicle violation event, the traffic event determination model is constructed in a deep neural network mode, so that the traffic event determination model is more practical and has high accuracy; the number of sampling points of the motion trail corresponds to the number of nodes, so that the deep neural network model can be constructed; and through adjusting the number of sampling points to ensure that no matter how many actual sampling points are few, can all determine corresponding traffic incident according to the sampling point in the motion trail.
The steps of the above methods are divided for clarity, and the implementation may be combined into one step or split some steps, and the steps are divided into multiple steps, so long as the same logical relationship is included, which are all within the protection scope of the present patent; it is within the scope of the patent to add insignificant modifications to the algorithms or processes or to introduce insignificant design changes to the core design without changing the algorithms or processes.
A third embodiment of the present invention relates to a vehicle violation event detection device 30, including: the specific structure of the acquisition module 301, the first determination module 302, the second determination module 303 and the information output module 304 is shown in fig. 4.
The acquisition module 301 is configured to acquire image data of all vehicles in a preset area in real time, where the image data includes images in at least 2 frame areas; the first determining module 302 is configured to determine a motion trajectory of each vehicle in a preset area according to the image data; the second determining module 303 is configured to determine a traffic event to which each vehicle belongs currently according to the motion trajectory of each vehicle and a traffic event determination model, where the traffic event determination model is a correspondence between the motion trajectory of the vehicle and the traffic event to which the vehicle belongs; the information output module 304 is configured to output warning information indicating that the vehicle belongs to an illegal traffic event according to the traffic event to which each vehicle belongs.
It should be understood that this embodiment is an example of the apparatus corresponding to the first embodiment, and may be implemented in cooperation with the first embodiment. The related technical details mentioned in the first embodiment are still valid in this embodiment, and are not described herein again in order to reduce repetition. Accordingly, the related-art details mentioned in the present embodiment can also be applied to the first embodiment.
It should be noted that each module referred to in this embodiment is a logical module, and in practical applications, one logical unit may be one physical unit, may be a part of one physical unit, and may be implemented by a combination of multiple physical units. In addition, in order to highlight the innovative part of the present invention, elements that are not so closely related to solving the technical problems proposed by the present invention are not introduced in the present embodiment, but this does not indicate that other elements are not present in the present embodiment.
A fourth embodiment of the present invention relates to an electronic apparatus 40 including: at least one processor 401; and a memory 402 communicatively coupled to the at least one processor 401; the memory 402 stores instructions executable by the at least one processor 401, and the instructions are executed by the at least one processor 401 to enable the at least one processor 401 to perform the method for detecting vehicle violation events in the first embodiment or the second embodiment. The specific structure of the electronic device is shown in fig. 5.
The memory 402 and the processor 401 are connected by a bus, which may include any number of interconnected buses and bridges that link one or more of the various circuits of the processor 401 and the memory 402. The bus may also link various other circuits such as peripherals, voltage regulators, power management circuits, and the like, which are well known in the art, and therefore, will not be described any further herein. A bus interface provides an interface between the bus and the transceiver. The transceiver may be one element or a plurality of elements, such as a plurality of receivers and transmitters, providing a means for communicating with various other apparatus over a transmission medium. The data processed by the processor is transmitted over a wireless medium via an antenna, which further receives the data and transmits the data to the processor.
The processor 401 is responsible for managing the bus and general processing and may provide various functions including timing, peripheral interfaces, voltage regulation, power management, and other control functions. And the memory may be used to store data used by the processor in performing operations.
Those skilled in the art can understand that all or part of the steps in the method of the foregoing embodiments may be implemented by a program to instruct related hardware, where the program is stored in a storage medium and includes several instructions to enable a device (which may be a single chip, a chip, etc.) or a processor (processor) to execute all or part of the steps of the method described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
It will be understood by those of ordinary skill in the art that the foregoing embodiments are specific examples for carrying out the invention, and that various changes in form and details may be made therein without departing from the spirit and scope of the invention in practice.

Claims (7)

1.一种车辆违规事件检测的方法,其特征在于,包括:1. A method for vehicle violation event detection, characterized in that, comprising: 实时采集预设区域内所有车辆的图像数据,所述图像数据包含至少2帧所述区域内的图像;Collect real-time image data of all vehicles in the preset area, and the image data includes at least 2 frames of images in the area; 根据所述图像数据,确定在所述预设区域内每辆车的运动轨迹;According to the image data, determine the motion trajectory of each vehicle in the preset area; 根据每辆车的运动轨迹以及交通事件确定模型,确定每辆车当前所属的交通事件,其中,所述交通事件确定模型为车辆运动轨迹与车辆所属交通事件之间的对应关系,所述车辆所属交通事件包括:违规停车、车辆逆行以及车辆正常行驶;The traffic event to which each vehicle currently belongs is determined according to the motion trajectory of each vehicle and the traffic event determination model, wherein the traffic event determination model is the correspondence between the vehicle motion trajectory and the traffic event to which the vehicle belongs, and the traffic event to which the vehicle belongs is determined. Traffic incidents include: illegal parking, wrong-way vehicles, and normal vehicles; 根据每辆车所属的交通事件,输出指示车辆属于违规交通事件的告警信息;According to the traffic event to which each vehicle belongs, output the warning information indicating that the vehicle belongs to the illegal traffic event; 其中,所述交通事件确定模型采用深度神经网络方式构建,其中,所述交通事件确定模型的输入层包含n个节点,每个节点对应每辆车运动轨迹的一个采样点,输出层包含m个输出节点,每个所述输出节点对应一种交通事件,n和m为大于1的整数;Wherein, the traffic event determination model is constructed using a deep neural network, wherein the input layer of the traffic event determination model includes n nodes, each node corresponds to a sampling point of the motion trajectory of each vehicle, and the output layer includes m nodes output nodes, each of the output nodes corresponds to a traffic event, and n and m are integers greater than 1; 根据每辆车的运动轨迹以及交通事件确定模型,确定每辆车当前所属的交通事件,具体包括:According to the motion trajectory of each vehicle and the traffic event determination model, determine the traffic event that each vehicle currently belongs to, including: 获取所述交通事件确定模型输入层的节点数目;obtaining the number of nodes in the input layer of the traffic event determination model; 根据所述输入层的节点数目,分别对每辆车的运动轨迹进行预处理,包括:若所述运动轨迹中的采样点数目大于所述输入层的节点数目,则随机删除所述运动轨迹中采样点坐标数据的最大值和最小值之间中任一的坐标数据,直至所述运动轨迹中采样点的数量等于n个;若所述运动轨迹中的采样点数目小于所述输入层的节点数目,则在所述运动轨迹中采样点坐标数据的最大值和最小值之间随机模拟生成新的采样点,直至所述运动轨迹中采样点的数量等于n个;Preprocessing the motion trajectory of each vehicle according to the number of nodes in the input layer, including: if the number of sampling points in the motion trajectory is greater than the number of nodes in the input layer, randomly deleting the motion trajectory in the motion trajectory Any coordinate data between the maximum value and the minimum value of the coordinate data of the sampling point, until the number of sampling points in the motion trajectory is equal to n; if the number of sampling points in the motion trajectory is less than the nodes of the input layer number, then randomly simulate and generate new sampling points between the maximum value and the minimum value of the coordinate data of the sampling points in the motion trajectory, until the number of sampling points in the motion trajectory is equal to n; 将预处理后的每辆车的运动轨迹作为所述交通事件确定模型的输入,确定每辆车当前所属的交通事件。The preprocessed motion trajectory of each vehicle is used as the input of the traffic event determination model, and the traffic event to which each vehicle currently belongs is determined. 2.根据权利要求1所述的车辆违规事件检测的方法,其特征在于,在确定每辆车当前所属的交通事件之前,所述车辆违规事件检测的方法还包括:2. The method for vehicle violation event detection according to claim 1, wherein before determining the traffic event to which each vehicle currently belongs, the vehicle violation event detection method further comprises: 获取所述预设区域在第一预设时间段内车辆的历史图像数据,以及获取所述第一预设时间段内每辆车所属的交通事件;Acquiring historical image data of vehicles in the preset area in a first preset time period, and acquiring the traffic events to which each vehicle belongs in the first preset time period; 根据所述历史图像数据,确定第一预设时间段内每辆车在预设区域内的历史运动轨迹;According to the historical image data, determine the historical motion trajectory of each vehicle in the preset area within the first preset time period; 根据所述历史运动轨迹以及所述第一预设时间段内每辆车所属的交通事件,构建所述交通事件确定模型。The traffic event determination model is constructed according to the historical motion trajectory and the traffic event to which each vehicle belongs within the first preset time period. 3.根据权利要求1所述的车辆违规事件检测的方法,其特征在于,在获取所述交通事件确定模型输入层的节点数目之后,且在分别对每辆车的运动轨迹进行预处理之前,所述车辆违规事件检测的方法还包括:3. The method for vehicle violation event detection according to claim 1, characterized in that, after acquiring the number of nodes in the input layer of the traffic event determination model, and before preprocessing the motion trajectory of each vehicle respectively, The method for detecting a vehicle violation event further includes: 对每辆车的所述运动轨迹进行归一化处理。The motion trajectory of each vehicle is normalized. 4.根据权利要求1所述的车辆违规事件检测的方法,其特征在于,根据所述图像数据,确定在所述预设区域内每辆车的运动轨迹,具体包括:4 . The method for vehicle violation event detection according to claim 1 , wherein determining the motion trajectory of each vehicle in the preset area according to the image data, specifically comprising: 5 . 检测每帧图像中每辆车在所述预设区域内的位置;Detecting the position of each vehicle in the preset area in each frame of image; 针对图像中每辆车进行如下处理:Do the following for each vehicle in the image: 在连续帧的图像中识别所述车辆,并将每帧图像中所述车辆的位置作为所述车辆运动轨迹中的采样点;Identify the vehicle in images of consecutive frames, and use the position of the vehicle in each frame of images as a sampling point in the vehicle motion trajectory; 根据所述区域内所述车辆的运动轨迹的采样点,确定所述车辆的运动轨迹。The motion trajectory of the vehicle is determined according to the sampling points of the motion trajectory of the vehicle in the area. 5.根据权利要求1所述的车辆违规事件检测的方法,其特征在于,将预处理后的每辆车的运动轨迹作为所述交通事件确定模型的输入,确定每辆车当前所属的交通事件,具体包括:5 . The method for vehicle violation event detection according to claim 1 , wherein the preprocessed motion trajectory of each vehicle is used as the input of the traffic event determination model, and the traffic event to which each vehicle currently belongs is determined. 6 . , including: 对每辆车进行如下处理:Do the following for each vehicle: 获取当前车辆对应的每种交通事件的置信度;Obtain the confidence level of each traffic event corresponding to the current vehicle; 根据所述置信度,确定所述车辆当前所属交通事件。According to the confidence level, the traffic event to which the vehicle currently belongs is determined. 6.一种车辆违规事件检测的装置,其特征在于,包括:采集模块、第一确定模块、第二确定模块和信息输出模块;6. A device for vehicle violation event detection, comprising: a collection module, a first determination module, a second determination module and an information output module; 所述采集模块用于实时采集预设区域内所有车辆的图像数据,所述图像数据包含至少2帧所述区域内的图像;The acquisition module is used for real-time acquisition of image data of all vehicles in the preset area, and the image data includes at least 2 frames of images in the area; 所述第一确定模块用于根据所述图像数据,确定在所述预设区域内每辆车的运动轨迹;The first determining module is configured to determine, according to the image data, the motion trajectory of each vehicle in the preset area; 所述第二确定模块用于根据每辆车的运动轨迹以及交通事件确定模型,确定每辆车当前所属的交通事件,其中,所述交通事件确定模型为车辆运动轨迹与车辆所属交通事件之间的对应关系,所述车辆所属交通事件包括:违规停车、车辆逆行以及车辆正常行驶;The second determination module is used to determine the model according to the motion trajectory of each vehicle and the traffic event, and determine the traffic event to which each vehicle currently belongs, wherein the traffic event determination model is between the vehicle motion trajectory and the traffic event to which the vehicle belongs. The corresponding relationship of the vehicle, the traffic incident to which the vehicle belongs includes: illegal parking, the vehicle is in the wrong direction, and the vehicle is running normally; 所述信息输出模块用于根据每辆车所属的交通事件,输出指示车辆属于违规交通事件的告警信息;The information output module is used for outputting warning information indicating that the vehicle belongs to a traffic violation event according to the traffic event to which each vehicle belongs; 其中,所述交通事件确定模型采用深度神经网络方式构建,其中,所述交通事件确定模型的输入层包含n个节点,每个节点对应每辆车运动轨迹的一个采样点,输出层包含m个输出节点,每个所述输出节点对应一种交通事件,n和m为大于1的整数;Wherein, the traffic event determination model is constructed using a deep neural network, wherein the input layer of the traffic event determination model includes n nodes, each node corresponds to a sampling point of the motion trajectory of each vehicle, and the output layer includes m nodes output nodes, each of which corresponds to a traffic event, and n and m are integers greater than 1; 根据每辆车的运动轨迹以及交通事件确定模型,确定每辆车当前所属的交通事件,具体包括:According to the motion trajectory of each vehicle and the traffic event determination model, determine the traffic event to which each vehicle currently belongs, including: 获取所述交通事件确定模型输入层的节点数目;obtaining the number of nodes in the input layer of the traffic event determination model; 根据所述输入层的节点数目,分别对每辆车的运动轨迹进行预处理,包括:若所述运动轨迹中的采样点数目大于所述输入层的节点数目,则随机删除所述运动轨迹中采样点坐标数据的最大值和最小值之间中任一的坐标数据,直至所述运动轨迹中采样点的数量等于n个;若所述运动轨迹中的采样点数目小于所述输入层的节点数目,则在所述运动轨迹中采样点坐标数据的最大值和最小值之间随机模拟生成新的采样点,直至所述运动轨迹中采样点的数量等于n个;Preprocessing the motion trajectory of each vehicle according to the number of nodes in the input layer, including: if the number of sampling points in the motion trajectory is greater than the number of nodes in the input layer, randomly deleting the motion trajectory in the motion trajectory Any coordinate data between the maximum value and the minimum value of the coordinate data of the sampling point, until the number of sampling points in the motion trajectory is equal to n; if the number of sampling points in the motion trajectory is less than the nodes of the input layer number, then randomly simulate and generate new sampling points between the maximum value and the minimum value of the coordinate data of the sampling points in the motion trajectory, until the number of sampling points in the motion trajectory is equal to n; 将预处理后的每辆车的运动轨迹作为所述交通事件确定模型的输入,确定每辆车当前所属的交通事件。The preprocessed motion trajectory of each vehicle is used as the input of the traffic event determination model, and the traffic event to which each vehicle currently belongs is determined. 7.一种电子设备,其特征在于,包括:7. An electronic device, characterized in that, comprising: 至少一个处理器;以及,at least one processor; and, 与所述至少一个处理器通信连接的存储器;其中,a memory communicatively coupled to the at least one processor; wherein, 所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够执行如权利要求1-5任一所述的车辆违规事件检测的方法。The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform any one of claims 1-5 Methods for vehicle violation event detection.
CN201910011455.6A 2019-01-07 2019-01-07 A method, device and electronic device for vehicle violation event detection Active CN109784254B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910011455.6A CN109784254B (en) 2019-01-07 2019-01-07 A method, device and electronic device for vehicle violation event detection

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910011455.6A CN109784254B (en) 2019-01-07 2019-01-07 A method, device and electronic device for vehicle violation event detection

Publications (2)

Publication Number Publication Date
CN109784254A CN109784254A (en) 2019-05-21
CN109784254B true CN109784254B (en) 2021-06-25

Family

ID=66500060

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910011455.6A Active CN109784254B (en) 2019-01-07 2019-01-07 A method, device and electronic device for vehicle violation event detection

Country Status (1)

Country Link
CN (1) CN109784254B (en)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110634302A (en) * 2019-11-14 2019-12-31 广东优世联合控股集团股份有限公司 Parking lot retrograde vehicle detection system based on BIM
CN111091098B (en) * 2019-12-20 2023-08-15 浙江大华技术股份有限公司 Training method of detection model, detection method and related device
CN111209880A (en) * 2020-01-13 2020-05-29 南京新一代人工智能研究院有限公司 Vehicle behavior identification method and device
CN114019947B (en) * 2020-07-15 2024-03-12 广州汽车集团股份有限公司 Method and system for controlling vehicle to travel at intersection and computer readable storage medium
CN112435470A (en) * 2020-11-11 2021-03-02 宁波职业技术学院 Traffic incident video detection system
CN112419722B (en) * 2020-11-18 2022-08-30 百度(中国)有限公司 Traffic abnormal event detection method, traffic control method, device and medium
CN112507813A (en) * 2020-11-23 2021-03-16 北京旷视科技有限公司 Event detection method and device, electronic equipment and storage medium
CN112712696A (en) * 2020-12-30 2021-04-27 北京嘀嘀无限科技发展有限公司 Method and device for determining road section with illegal parking
CN118411853A (en) * 2024-04-23 2024-07-30 北京嘀嘀无限科技发展有限公司 Vehicle warning determination method, system, vehicle warning method and electronic equipment
CN118334604B (en) * 2024-06-12 2024-10-01 海信集团控股股份有限公司 Accident detection and data set construction method and equipment based on multi-mode large model
CN119028144A (en) * 2024-07-29 2024-11-26 石家庄学院 Electric vehicle violation behavior identification method, device, equipment and storage medium

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103593430A (en) * 2013-11-11 2014-02-19 胡宝清 Clustering method based on mobile object spatiotemporal information trajectory subsections

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8855361B2 (en) * 2010-12-30 2014-10-07 Pelco, Inc. Scene activity analysis using statistical and semantic features learnt from object trajectory data
CN102289660B (en) * 2011-07-26 2013-07-03 华南理工大学 Method for detecting illegal driving behavior based on hand gesture tracking
CN104809470B (en) * 2015-04-23 2019-02-15 杭州中威电子股份有限公司 A kind of vehicle based on SVM drives in the wrong direction detection device and detection method
CN108345894B (en) * 2017-01-22 2019-10-11 北京同方软件有限公司 A kind of traffic incidents detection method based on deep learning and entropy model
CN106846803B (en) * 2017-02-08 2023-06-23 广西交通科学研究院有限公司 Traffic event detection device and method based on audio frequency

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103593430A (en) * 2013-11-11 2014-02-19 胡宝清 Clustering method based on mobile object spatiotemporal information trajectory subsections

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
traffic peccancy processing system based on image recognition;dongdong zhang et al;《proceedings of the 2003 IEEE international conference on intelligent transportation systems》;20031219;第1200-1205页 *

Also Published As

Publication number Publication date
CN109784254A (en) 2019-05-21

Similar Documents

Publication Publication Date Title
CN109784254B (en) A method, device and electronic device for vehicle violation event detection
CN109887281B (en) Method and system for monitoring traffic incident
KR102350711B1 (en) Method and device for training trajectory classification model, and electronic apparatus
CN110991289B (en) Abnormal event monitoring method and device, electronic equipment and storage medium
CN111680377B (en) Traffic situation simulation method, system and electronic equipment
US12148219B2 (en) Method, apparatus, and computing device for lane recognition
CN110009903B (en) Traffic accident scene restoration method
CN106297281A (en) The method and apparatus of vehicle peccancy detection
CN110322687B (en) Method and device for determining running state information of target intersection
CN116778292B (en) Method, device, equipment and storage medium for fusing space-time trajectories of multi-mode vehicles
CN117649767A (en) Traffic road condition analysis system based on digital twin technology
CN114332707A (en) Method and device for determining equipment effectiveness, storage medium and electronic device
CN117808113A (en) Training method and device of track planning model, terminal equipment and storage medium
CN117727148A (en) Multi-sensing technology fused high-speed railway perimeter intrusion alarm front-end optimization method and system
CN106033643B (en) A kind of data processing method and device
CN119380309B (en) Road network generation method, intelligent device and computer readable storage medium
CN119694162A (en) Collision warning method, device, electronic device, readable storage medium and program product
CN118708489A (en) Automatic driving simulation evaluation method, device, electronic device and storage medium
JP7294323B2 (en) Moving body management device, moving body management system, moving body management method, and computer program
CN112464749A (en) Traffic scene abnormal target detection method based on rules and learning
CN114475653B (en) Vehicle emergency steering simulation scene configuration method and device
CN114495505B (en) Method, device, medium and server for predicting passing duration of congestion road section
CN117150433A (en) Target association matching method, device, equipment and computer readable medium
CN117238166A (en) Parking space searching system and method
CN116628433A (en) A driving state evaluation method and system for an intelligent driving vehicle

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
PE01 Entry into force of the registration of the contract for pledge of patent right

Denomination of invention: A method, device, and electronic device for detecting vehicle violation incidents

Granted publication date: 20210625

Pledgee: Bank of China Limited by Share Ltd. Nanjing Jiangning branch

Pledgor: YI TAI FEI LIU INFORMATION TECHNOLOGY LLC

Registration number: Y2024980058493

PE01 Entry into force of the registration of the contract for pledge of patent right