CN114202751A

CN114202751A - Leave over article detecting system in car

Info

Publication number: CN114202751A
Application number: CN202111298991.2A
Authority: CN
Inventors: 张楠; 龚晓琴; 李彦奇; 田鋆; 王星皓; 张云轩; 娄凌宇; 李佳
Original assignee: FAW Bestune Car Co Ltd
Current assignee: FAW Bestune Car Co Ltd
Priority date: 2021-11-04
Filing date: 2021-11-04
Publication date: 2022-03-18

Abstract

The invention belongs to the technical field of detection, and relates to a system for detecting left articles in a vehicle. The system comprises a camera, a millimeter wave radar, a left article detection controller and a BCM; the camera and the millimeter wave radar are respectively connected with the left article detection controller through CAN lines; the left article detection controller is connected with the BCM through a CAN line; the controller analyzes and compares the conditions in the front and rear vehicles and informs the BCM of the left articles in the vehicles; the BCM is used for providing states of vehicles and passengers for the left article detection controller, receiving an article left signal provided by the left article detection controller, and controlling the vehicle machine, the voice system, the lighting system and the APP system to remind the user of article left; the invention can detect whether articles are left in the vehicle, solve the problem that passengers leave articles in the vehicle, prompt drivers and passengers to take back the articles in time, and avoid unnecessary troubles; the invention mainly applies the image analysis technology and the millimeter wave radar detection technology and realizes the object detection and prompt functions through the controller and the communication.

Description

Leave over article detecting system in car

Technical Field

The invention belongs to the technical field of detection, and relates to a system for detecting left articles in a vehicle.

Background

Image contrast analysis techniques: the image analysis mainly focuses on the description method for constructing images, and more particularly, the method uses symbols to represent various images instead of calculating the images themselves, and utilizes various related knowledge to carry out reasoning to obtain the specific structure of the images. The image comparison mainly adopts a two-dimensional and three-dimensional mode to reflect the images of a real object and the characteristics thereof, and an image is obtained through analysis.

Millimeter wave radar: is a radar operating in the millimeter wave band (millimeter wave) detection. Usually, the millimeter wave is in the frequency domain of 30 to 300GHz (with a wavelength of 1 to 10 mm). Millimeter-wave radar has some of the advantages of both microwave and photoelectric radar because the wavelength of millimeter-wave waves is intermediate between microwave and centimeter waves.

CN111914670A this application discloses a method, an apparatus, a system and a storage medium for detecting a left article, which are used to avoid the false detection of the left article due to the change of weather and illumination. The embodiment of the application provides a method for detecting a left-over article, which comprises the following steps: establishing a background model; acquiring a motion area in a detection image, and extracting a first characteristic point in the motion area; acquiring a previous frame image of the detection image, and extracting a second characteristic point from an area which is overlapped with the motion area in the previous frame image; matching the first characteristic points with the second characteristic points, and determining the number of matched characteristic points in the first characteristic points and the second characteristic points; judging whether the ratio of the number of the matched feature points to the number of the first feature points or the second feature points is smaller than a first preset value or not; and when the ratio of the number of the matched feature points to the number of the first feature points or the second feature points is smaller than a first preset value, taking the moving area as a first suspicious area, and judging whether the first suspicious area comprises the left-over article.

Compared with the application, the application scenes are different, the detection time periods are different, and the reminding function is omitted.

CN113128268A the present disclosure provides a method for detecting a left-behind article and a device thereof, the method comprising: receiving an image from an image acquisition module; obtaining a reference image using a principal component analysis method based on a plurality of images received within a first predetermined period of time; and performing principal component analysis on the image received after the first predetermined period of time from the image acquisition module after the first predetermined period of time; and comparing the image received after the first predetermined period of time after the principal component analysis with a reference image to determine whether a carry-over item is present.

CN112036303A the present disclosure relates to a method and apparatus for reminding of a legacy article, an electronic device, and a storage medium. The method comprises the following steps: detecting left-over articles in a cabin of a vehicle; in response to detecting a legacy item, determining identity information of a target occupant to which the legacy item belongs; and generating reminding information according to the identity information.

Compared with the application, the method has no millimeter wave radar identification. There is no reminder function.

Disclosure of Invention

The invention aims to solve the technical problem of overcoming the problems in the prior art and provides a system for detecting articles left in a vehicle.

It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.

A detection system for left-over articles in a vehicle comprises a camera, a millimeter wave radar, a left-over article detection controller and a BCM; the camera and the millimeter wave radar are respectively connected with the left article detection controller through CAN lines; the left article detection controller is connected with the BCM through a CAN line;

the left article detection controller analyzes and compares the conditions in the front and rear vehicles and informs the BCM of article left in the vehicle;

BCM is used for providing vehicle and passenger state to leaving over article detection controller, receives the article that the article detection controller provided and leaves over the signal, and control car machine, voice system, lighting system, APP system remind article to leave over.

Further, the left article detection controller analyzes and compares the conditions in the front and rear vehicles, and the specific method is as follows:

firstly, initializing a detection system for left articles in a vehicle;

and step two, collecting and preprocessing: photographing by a camera and scanning by a millimeter wave radar.

Thirdly, comparing the background model with the foreground: comparing the conditions of the passengers after getting on the bus;

fourthly, detecting a target;

fifthly, post-processing and target segmentation; : and comparing the conditions of the passengers after getting off the vehicle.

Sixthly, comparing results: and comparing whether the passengers leave the articles after getting on or off the bus.

Further, the algorithm logic of the comparative analysis is used for comparatively analyzing the collected images or the collected data, segmenting the data model and identifying the left-over articles.

Furthermore, the camera is used for identifying the left articles in the vehicle and collecting images in the vehicle through the camera.

Collecting for the first time: after the vehicle is started, the rear door is opened.

And (3) second collection: after the rear-row passenger gets off and closes the door, the controller contrasts and analyzes the collected image and judges whether the left-over articles exist.

Furthermore, the millimeter wave radar identifies the left articles in the vehicle, and the data in the vehicle is scanned through the millimeter wave radar.

First scanning: after the vehicle is started, the rear door is opened.

And (3) second scanning: after the rear-row passenger gets off and closes the door, the controller contrasts and analyzes the scanned data and judges whether the left-over articles exist.

Further, after judging that there is the article left over in the car, remind to have the article left over in taking advantage of the passenger train through opening two flashing light, voice prompt, car machine or cell-phone APP modes.

Further, reminding 10s of automatic closing of lamplight, voice prompt, car machine or mobile phone APP.

Furthermore, the cameras are arranged on a front ceiling, a ceiling and a trunk of the vehicle, and three cameras are arranged.

Further, the millimeter wave radar is arranged on a front ceiling, a ceiling and a trunk of the vehicle, and the number of the millimeter wave radars is three.

Compared with the prior art, the invention has the beneficial effects that:

the invention can solve the problem that passengers leave articles in the automobile, and the passengers often leave personal articles in the automobile when getting off, thereby causing time and economic loss. So as not to cause unnecessary trouble. The method is mainly applied to an image analysis technology and a millimeter wave radar detection technology. The article detection and prompt functions are realized through the controller and the communication.

Drawings

The invention is further described with reference to the accompanying drawings in which:

FIG. 1 is a block diagram of an in-vehicle left-over item detection system according to the present invention;

FIG. 2 is a flow chart of a system for detecting an item left in a vehicle according to the present invention;

FIG. 3 is a schematic diagram of a system for detecting a left-behind object in a vehicle according to the present invention:

FIG. 4 is a logic diagram of an algorithm in a system for detecting a left-behind object in a vehicle according to the present invention:

Detailed Description

In order to make the implementation objects, technical solutions and advantages of the present invention clearer, the technical solutions in the embodiments of the present invention will be described in more detail below with reference to the accompanying drawings in the embodiments of the present invention. In the drawings, the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The described embodiments are only some, but not all embodiments of the invention. The embodiments described below with reference to the drawings are illustrative and intended to be illustrative of the invention and are not to be construed as limiting the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention. Embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

In the description of the present invention, it is to be understood that the terms "center", "longitudinal", "lateral", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc., indicate orientations or positional relationships based on those shown in the drawings, and are used merely for convenience in describing the present invention and for simplifying the description, and do not indicate or imply that the device or element being referred to must have a particular orientation, be constructed and operated in a particular orientation, and therefore, should not be taken as limiting the scope of the present invention.

The invention is described in detail below with reference to the attached drawing figures:

The invention mainly detects the left articles in the vehicle and reminds the vehicle owner and passengers of the left articles, monitors the articles in the vehicle through an image collector (a camera) and a millimeter wave radar, and judges whether the left articles are left in the vehicle or not through the change of collected images. And then the sound-light-electricity alarm is used for reminding the car owner or the passenger to take the left-over articles away. The radar mainly comprises a camera, a millimeter wave radar and a controller.

Referring to fig. 1, a system block diagram: the vehicle can realize the path by the function and design related hardware and software.

1, CAN: functional bus, system path.

BCM: the vehicle and passenger states are provided for the controller, the article leaving signal provided by the controller is received, and the related functions in the vehicle are controlled to remind the user of article leaving.

The related functions are functions of the car machine, the voice system, the lighting system and the APP system

3. A camera: the method comprises the steps of collecting pictures in a vehicle before a passenger gets on the vehicle and after the passenger gets off the vehicle.

4. Millimeter wave radar: and recording radar images in the front of the passenger getting on the bus and the rear of the passenger getting off the bus.

5. A legacy article detection controller: and analyzing and comparing the conditions in the front and rear vehicles, and informing the BCM of the fact that articles are left in the vehicles.

Referring to fig. 2, the system flow: the legacy article detection function operates according to this flow.

The camera on the car is in and shoots, the radar is in the scanning state, and the passenger gets on the bus, and the vehicle driving in-process, camera on the car are always in and shoot, the millimeter wave radar is always in the scanning state, and the passenger gets off the bus, and camera on the car still is always in and shoots, the millimeter wave radar is still always in the scanning state, leaves over the interior condition of article detection controller analysis contrast passenger getting on, getting off, carries out data contrastive analysis to it has article to leave over in the suggestion BCM car.

Referring to fig. 3, a schematic diagram: the schematic diagram of the arrangement position and the use scene in the vehicle is shown.

The camera and the millimeter wave radar are arranged on a front ceiling, a ceiling and a trunk of the vehicle, and can shoot and scan the front row of the vehicle, the rear row of seats of the vehicle and the trunk.

The system functions are as follows: the specific functions are described in table 1.

Referring to fig. 4, the algorithm logic: collection and analysis logic.

The algorithm logic is as follows:

firstly, initializing a detection system for left articles in a vehicle;

fourthly, detecting a target;

The main application scenarios of the invention are as follows:

the method is used for detecting the left articles in shared cars, taxies, outgoing cars, private cars, vans and the like. Identify the left-over item and alert the passenger.

The invention discloses a system for detecting left articles in a vehicle, which has the following functions:

TABLE 1

The camera is used for identifying the left articles in the vehicle and collecting images in the vehicle through the camera.

And (3) second collection: after the rear-row passenger gets off and closes the door, the controller (namely the left article detection controller) carries out contrastive analysis on the collected image, and judges whether the left article exists.

And the millimeter wave radar identifies the articles left in the vehicle and scans the data in the vehicle through the millimeter wave radar.

First scanning: after the vehicle is started, the rear door is opened.

Remind the function, after judging that there is the article of leaving over in the car, remind to have the article of leaving over in taking advantage of the passenger train through modes such as opening two flashing lights, voice prompt, car machine, cell-phone APP, remind behind 10s self-closing.

And the algorithm logic of the comparison analysis is used for comparing and analyzing the acquired images or the acquired data, segmenting the data model and identifying the left articles.

The in-vehicle use scene, front row, back row, trunk, passenger and cargo area, take the district, etc. may have the interior space of car that article left over.

The method is mainly used for detecting the left-over articles in shared cars, taxies, outgoing cars, private cars, passenger cars, freight cars and the like. Identify the left-over item and alert the passenger.

The invention identifies the left articles in the vehicle through the camera, identifies the left articles in the vehicle through the millimeter wave radar, and is applied to the use scene in the vehicle through the data comparison analysis algorithm logic.

The above description is only for the purpose of illustrating the present invention and the appended claims are not to be construed as limiting the scope of the invention, which is intended to cover all modifications, equivalents and improvements that are within the spirit and scope of the invention as defined by the appended claims. And those not described in detail in this specification are well within the skill of those in the art.

Claims

1. The utility model provides a leave over article detecting system in car which characterized in that:

the system comprises a camera, a millimeter wave radar, a left article detection controller and a BCM; the camera and the millimeter wave radar are respectively connected with the left article detection controller through CAN lines; the left article detection controller is connected with the BCM through a CAN line;

2. The in-vehicle left article detection system according to claim 1, wherein:

the left article detection controller analyzes and compares the conditions in the front vehicle and the rear vehicle, and the specific method comprises the following steps:

firstly, initializing a detection system for left articles in a vehicle;

fourthly, detecting a target;

3. The in-vehicle left article detection system according to claim 1, wherein:

4. The in-vehicle left article detection system according to claim 1, wherein:

5. The in-vehicle left article detection system according to claim 1, wherein:

First scanning: after the vehicle is started, the rear door is opened.

6. The in-vehicle left article detection system according to claim 1, wherein:

after judging that there is the article left over in the car, remind to have the article left over in the passenger train through opening two flashing light, voice prompt, car machine or cell-phone APP modes.

7. The in-vehicle left article detection system according to claim 6, wherein:

reminding 10s of automatic closing of lamplight, voice prompt, car machine or mobile phone APP.

8. The in-vehicle left article detection system according to claim 1, wherein:

the cameras are arranged on a front ceiling, a ceiling and a trunk of the vehicle, and three cameras are arranged.

9. The in-vehicle left article detection system according to claim 1, wherein:

the millimeter wave radar is arranged on the front ceiling, the ceiling and the trunk of the vehicle, and the number of the millimeter wave radar is three.