KR102485416B1 - Automotive Accident Record Analysis System, Analysis Method and Analysis Program - Google Patents

Abstract

It includes a user interface, an image processing unit, a video recording storage unit and an output unit,
Data from the event data recorder (EDR), data from the data storage system for automated driving (DSSAD), car black box images, and road CCTV images at the time of the car accident. Vehicle accident record analysis system that analyzes video and data, analysis method and analysis program

Description

Automotive Accident Record Analysis System, Analysis Method and Analysis Program {Automotive Accident Record Analysis System, Analysis Method and Analysis Program}

The present invention relates to an analysis system for vehicle accident records.

More specifically, a technique for synchronizing various data such as data recorded inside a car, a car black box, and CCTVs around an accident site is developed, a technique for analyzing video and audio in video data in detail, editing a file, It is to provide a system that can output and build a DB for accident analysis cases and provide the basis for accident analysis of data on autonomous vehicles.

In general, in order to analyze a car accident record, various information such as traffic conditions and accident situations related to a car accident are collected, and each analysis is performed based on the various image information collected in this way, and based on each analysis information The results of the analysis of the cause of the accident must be synthesized.

However, various types of data exist in the various types of information, such as data recorded inside a car, a car black box, and CCTVs around an accident site. For analysis, it is not easy to identify and collect accident situations from various types of data. However, there are limitations and difficulties in determining the cause of the accident from different types of image information and outputting accurate analysis results.

Efforts have been made to develop a system that records accident situations using image information.

In this regard, in the prior patent of the Republic of Korea (KR 10-2001-0110912 A, published on December 15, 2001), in the event of a vehicle accident, for a limited time before and after the accident, the image of the CD camera and the vehicle speed signal provided by the vehicle , A system capable of replaying an accident situation and analyzing an accident by storing a brake operation signal and a steering angle signal of a steering wheel is disclosed.

In addition, in the Republic of Korea prior patent (KR 10-2010-0081706 A, published on July 15, 2010), based on accident-related information such as vehicle location, vehicle speed before and after the accident, direction before the accident, and direction of the vehicle after the accident There is disclosed an accident recording system for a vehicle including an accident reconstruction image generation unit for generating an image in which an accident is reconstructed.

(0001) Korean Patent Publication No. 10-2001-0110912 A, published on December 15, 2001 (0002) Korean Patent Publication No. 10-2010-0081706 A, published on July 15, 2010

As shown in FIG. 1, the conventional vehicle accident recording system analyzes information input from a camera, acceleration sensor, temperature sensor, vibration sensor, etc. to analyze the cause of the accident and generate an accident reconstruction image.

However, the analysis framework for analyzing the cause of the accident is not specifically presented, and only a simple analysis that compares past accident cases and images stored in the database is presented.

In addition, since the generation tool for generating accident reconstruction images is not specifically presented, there is a problem in that the cause of the car accident cannot be accurately analyzed and recorded.

Therefore, the present invention effectively records the data of an event data recorder (EDR) and a data storage system for automated driving (DSSAD) of a self-driving car together with a car black box and CCTV images on the road. We provide analysis systems and programs.

According to the present invention, by providing a system and program that can effectively analyze car accident records, the cause of the accident can be analyzed in detail and efficiently, and the result can be conveniently output, breaking away from the existing simple comparative analysis method with past data. effect can be expected.

1 is a diagram of a conventional vehicle accident record system.
2 to 17 are examples of a vehicle accident record analysis system according to the present invention.

Since the present invention can make various changes and have various embodiments, specific embodiments will be illustrated in the drawings and described in detail.

However, this is not intended to limit the present invention to specific embodiments, and should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention. Like reference numerals have been used for like elements throughout the description of each figure.

Terms used in this application are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, the terms "include" or "have" are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other features It should be understood that the presence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded.

The present invention effectively analyzes the data of an event data recorder (EDR) and a data storage system for automated driving (DSSAD) of an autonomous vehicle along with a car black box and CCTV images on the road. It is to provide systems and programs that do.

An automobile accident record analysis system according to the present invention is disclosed in FIG. 2 . The system according to the present invention is composed of a user interface 100, an image processing unit 200, a video recording and storage unit 300 and an image conversion unit 400.

3 is a user interface 100 of a vehicle accident record analysis system. The user interface 100 includes a toolbar 110, a page list 120, a window property 130, a window control panel 140, a video window 150, and a graphic window 160.

The toolbar 110 includes a plurality of buttons providing command input functions for image processing, such as creating a new project, opening an existing project, saving an image processed project, and searching for a project.

In the present invention, the minimum unit for analyzing, recording, and storing accident images is referred to as a project.

In the present invention, a menu screen for searching for a project may be provided.

A function for easily searching for a storage location and directory where project files are stored, outputting search results, and selecting and importing project files from the search results may be provided.

Projects can be conveniently searched using tags or search words stored along with project files that provide convenience in project search.

The page list 120 includes buttons for adding a page included in a project, copying a page, deleting a page, changing a page name, changing a page layout, opening a page, and closing a page.

Pages can be moved using buttons or a tree structure, a specific window currently working within a page is displayed as an active window, and the active window display can be moved between windows.

The window property 130 outputs all information of the video and graphic files output to the video window 150 and the graphic window 160 to be easily recognized at a glance, and can display the video stream and the audio stream separately.

Preferably, the present invention can output information such as the length, frame width, frame height, frame rate (frame/sec), and bit rate of the video.

Sound sources can be separated from images of various formats, such as accident-related black box images and CCTV images, and preferably, the separated sound sources can be synchronized with other images and data.

For effective audio analysis, an audio filtering function that separates voice from noise may be provided, and playback speed may be adjusted using a play bar during audio playback.

The window control panel 140 is a means for inputting commands providing essential functions for video analysis.

The video window 150 is a means for fetching and outputting a black box image of an accident vehicle, a CCTV image of a road, and the like.

Black box video and CCTV video can be played in various formats such as AVI, WMV, and MP4.

Various functions may be provided in relation to image reproduction. Function to arbitrarily adjust the start and end points (time, frame) of video playback, play a fixed section repeatedly, output time (frame), adjust playback speed using the play bar during playback, or directly input playback speed value Thus, a function for adjusting the playback speed may be provided.

It is possible to output an image that is clearer than the input image by adjusting the sharpness of the video image, and a plurality of videos can be played simultaneously, and a plurality of videos can be synchronized and reproduced at the same time.

In addition, lines, figures, memos, etc. added on the image by the marker function can be output.

The graphic window 160 is a means for reading EDR record information of an accident vehicle, self-driving vehicle information DSSAD, and the like, and outputting graphic data.

Excel and text import functions can be included to input data into the graph, and data can be entered directly in the window.

Input data can be converted into various types of graphs, and the type, thickness, and color of graph lines can be changed.

In addition, it is possible to adjust the offset and scale for each graph, and it is possible to output as an image or PowerPoint.

The embodiment of the user interface is divided into four windows, and a video is output in three windows and a graph is output in one window.

In addition to the embodiment in which the user interface is divided into four windows as described above, a plurality of frequently used layouts may be additionally provided. As shown in FIG. 4, the present invention may include a function of suggesting a selection to a user by outputting a menu divided into six windows to an arbitrary position of the user interface.

5 is an image processing unit 200 of a vehicle accident record analysis system. The image processing unit 200 includes image processing functions such as a control unit, an extraction unit, a capture unit, an enlargement unit, a filter unit, a sink unit, a marker unit, waveform, spectrum, and screen recording.

6 is an embodiment of a control unit. The control part controls audio volume (Volume), video brightness control function (Brightness, Contrast, Saturation), video playback, stop, change of playback speed, designation of start and end frames, movement back and forth between frames, and movement to designated frames. , section repeat play function, etc. may be included.

7 is an embodiment of an extraction unit. The extraction unit can store video frames by specifying start and end frames, output frame numbers and times, and output video frames as a power point.

8 is an embodiment of a capture unit. The capture unit may capture and store the active window, capture and store the entire window, or capture and store the active window by enlarging the entire screen. In addition, you can capture and save multiple frames by specifying the start and end frames, and you can output the captured screen to PowerPoint.

9 is an embodiment of an enlargement unit. In the present invention, when checking a specific window in detail in a divided window, it can be enlarged to the entire screen and can be returned to its original state. The embodiment is a state in which the active window on the left is enlarged to the entire screen as shown on the right.

10 is an Emboss embodiment of the filter unit. The image on the left can be output after processing the Emboss filter as shown on the right.

The filter unit may include Bigedge, Defocus, EdgeDetect, Emboss, EmbossColor, GaussianBlur, Highlight, Negative, Sharpen, SharpenEvenMore, and SharpenMore functions.

11 is an embodiment of a sink unit. It provides a function to synchronize each video file and EDR graph data loaded in the divided window based on the time of the accident. Scaling and offset functions for each image frame of the divided window are provided for synchronization.

12 is an embodiment of a marker unit. The marker unit provides an advantage of analyzing movements in the reproduced image in detail by marking lines, figures (circular squares, etc.), memos, etc. on each image frame reproduced in the window.

13 is a waveform, and FIG. 14 is an example of a spectrum. In the audio waveform of the playback file, it is inferred that an accident occurred at the time when the amplitude increases or the spectrum changes, and it is possible to quickly move to the accident frame.

15 is an example of screen recording. Screen recording refers to a function of recording each image frame reproduced in a divided window as a whole. It is recorded as a continuous frame video from the start point to the end point, and it can also be output as a PowerPoint with each frame as one slide. Screen recording can record a page area with sound while keeping it visible on the entire screen.

16 is a video record storage unit 300 of an automobile accident record analysis system. The video record storage unit 300 records and stores black box images of the accident vehicle, CCTV images, EDR data of the vehicle accident recorder, DSSAD data of the autonomous driving vehicle information system, and the like. In addition, analysis result video files such as animations are also saved as videos.

17 is an image conversion unit 400 of a vehicle accident record analysis system. The image conversion unit 400 includes an image flip function, an image rotation function, a fixed frame conversion function, and a high frequency/low frequency filter function.

The image flip function can be divided into a flip vertical for flipping an image vertically and a flip horizontal for flipping an image horizontally.

The image rotation function can be divided into Rotate 90 Clockwise and Rotate 90 Count Clockwise.

The variable frame rate to constant frame rate conversion function specifies the frame rate for video compressed and recorded in the variable frame method (eg 40 frames per second) (eg 60 frames per second). This function converts to a fixed frame. In addition, a filter function is provided to remove high-frequency and low-frequency noise of the image.

Claims (16)

It includes a user interface, an image processing unit, a video recording storage unit and an image conversion unit,
Data from the event data recorder (EDR), data from the data storage system for automated driving (DSSAD), car black box images, and road CCTV images at the time of the car accident. Analyze video and data,
The user interface includes a toolbar, a page list, a window property, a window control panel, a video window, and a graphic window;
The image processing unit includes a control unit, an extraction unit, a capture unit, an enlargement unit, a filter unit, a sink unit, a marker unit, a waveform, a spectrum, and a screen recording unit,
The screen recording records each image frame reproduced in the divided window as a whole,
The video window retrieves and outputs the black box image of the accident vehicle and the CCTV image of the road, and can reproduce the image in a plurality of formats including AVI, WMV, and MP4,
By adjusting the sharpness of the video image, a clearer image than the input image can be output, multiple videos can be played simultaneously, and multiple videos can be synchronized and played at the same time. You can add notes and print them out,
The graphic window is a means of fetching EDR record information and autonomous driving vehicle information of an accident vehicle and outputting graphic data, and includes an Excel and text import function so that data can be input into a graph, and data can be directly input in the window. Vehicle accident record analysis system characterized in that it can
delete delete The method of claim 1,
The video record storage unit records and stores black box images of the accident vehicle, CCTV images, EDR data of the vehicle accident recorder, DSSAD data of the autonomous driving vehicle information system, and analysis result image files.
The method of claim 1,
The vehicle accident record analysis system, characterized in that the image conversion unit has an image flip function, an image rotation function, a fixed frame conversion function, and a high-frequency / low-frequency filter function
The method of claim 1,
The control unit controls audio volume (Volume), adjusts video brightness (Brightness, Contrast, Saturation), plays/stops video, changes playback speed, designates start and end frames, moves back and forth between frames, and repeats sections. Vehicle accident record analysis system comprising a function
The method of claim 1,
The extraction unit includes a frame storage function, a function to output a frame number and time, and a function to output an image frame to a power point.
The method of claim 1,
The capture unit includes a function of capturing and storing the active window, capturing and storing the entire window, capturing and storing the active window by enlarging the entire screen, capturing and storing multiple frames, and outputting the captured screen to a power point. record analysis system
The method of claim 1,
The enlargement unit can enlarge a specific window window from the divided window window to the entire screen, and can return to the original state. Vehicle accident record analysis system, characterized in that
The method of claim 1,
The filter unit includes a Bigedge, Defocus, EdgeDetect, Emboss, EmbossColor, GaussianBlur, Highlight, Negative, Sharpen, SharpenEvenMore, and SharpenMore functions.
The method of claim 1,
The car accident record analysis system, characterized in that the sink unit provides a scaling and offset function for each image frame of the divided window
The method of claim 1,
The car accident record analysis system, characterized in that the marker unit can mark a line, figure, memo on the video frame played in the window
The method of claim 1,
The waveform and spectrum can quickly move to the point where the amplitude increases and the spectrum changes in the audio waveform of the playback file, characterized in that the car accident record analysis system
delete Data of the event data recorder (EDR) and data storage system for automated driving (DSSAD) ) data, car black box video, and car accident record analysis method that analyzes video and data at the time of car accident from CCTV video of the road
Data of an event data recorder (EDR), data storage system for automated driving (DSSAD) of an autonomous vehicle, ), a computer-readable recording medium recording a car accident record analysis program that analyzes the video and data at the time of the car accident from the car black box video and CCTV video of the road

Images