JP5251539B2 - Vehicle state recognition device - Google Patents

Description

The present invention relates to a state recognition device for recognizing vehicles both the state of the vehicle interior.

As a state recognition device vehicles both for recognizing a vehicle interior state (so-called vehicle interior state recognition device), for example, Patent Document 1, is irradiated with near infrared rays into the vehicle compartment, imaging the vehicle interior by a CCD camera or the like that Discloses a technique for recognizing the seating position and physique of the occupant. Patent Document 2 discloses a technique for determining the seat belt mounting state by irradiating a vehicle interior with near infrared rays, imaging the vehicle interior, and recognizing a mark attached to a seat belt buckle. ing.

JP 2007-198929 A JP 2005-254949 A

  Here, in order to recognize the mounting state such as the twist of the seat belt, it is necessary to identify the seat and the occupant seated on the seat and the seat belt, and therefore it is necessary to perform highly accurate image processing.

  However, the technique disclosed in Patent Document 2 recognizes whether or not the seat belt is worn by recognizing a mark attached to the seat belt buckle, and recognizes the seat belt torsional state or the like. It is not possible.

  Therefore, an object of the present invention is to more accurately recognize the wearing state of the seat belt.

State recognition apparatus for a vehicle according to the invention comprises a seat row arranged in a plurality of rows along the longitudinal direction of the vehicle in the passenger compartment, the restraining means having a seat belt for restraining a passenger seated on the sheet over bets, the A vehicle state recognition device in which the seat belt includes a shoulder belt portion that restrains a shoulder portion of an occupant seated on the seat, and is disposed in front of the seat in the vehicle front-rear direction and is seated on the seat. An irradiating unit that irradiates a passenger with near infrared rays, an imaging unit that images a vehicle interior irradiated by the irradiating unit, and a recognizing unit that recognizes the seat belt wearing state based on an image captured by the imaging unit. When, wherein the imaging means is provided in a front upper portion of the front row seat, Shitobe the seat column and the seat row in the second column from the front of the seat row in a plurality of rows in the image pickup means Tang capturing bets shoulder belt portion, said recognizing means, said recognizing the mounting state of the shoulder belt portion, wherein the restraining means, which is movable along the seat belt of the second row seat rows And a buckle that is provided on the vehicle body side and engages with the tongue, and detecting means for detecting an engagement state between the tongue and the buckle, and an engagement detected by the detecting means Determination means for determining a seat belt mounting state of the second row of seats based on the state and the mounting state of the shoulder belt portion recognized by the recognition means.

According to the above configuration , since the recognition unit recognizes the mounting state of the shoulder belt portion based on the image captured by the imaging unit, the mounting state of the seat belt can be recognized more accurately.

The restraining means includes a tongue that is movable along a seat belt of the second row of rows, and a buckle that is provided on the vehicle body side and engages with the tongue. The detection means for detecting the engagement state between the tongue and the buckle; the engagement state detected by the detection means; and the mounting state of the shoulder belt portion recognized by the recognition means. Determination means for determining the seat belt wearing state of the row of seat rows, and therefore whether or not the seat belt wearing state is appropriate can be determined.

In this embodiment of the present invention, the also the surface of the shoulder belt portion in which further comprising an identification member provided on at least something Re of the rear surface.
According to this structure, the recognition property of the shoulder belt part can be improved by the identification member.

In one embodiment of the present invention, the identification member includes a first identification pattern formed on the front surface and a second identification pattern formed on the back surface and different from the first identification pattern. cage, said recognition means, by identifying the first and second identification pattern is one that recognizes the mounted state of the shoulder belt portion.
According to this arrangement, Ru can be easily recognize the state in which the shoulder belt portion is twisted.

In one embodiment of the present invention, the seat includes a first seat and a second seat arranged side by side in the vehicle width direction with the first seat, and the restraining means includes the respectively disposed in the first and second sheet, the buckle is respectively disposed between the first sheet and the second sheet, the determination means, the first or the second sheet tongue is, the first or those determines whether it is attached in correspondence with the buckle of the second sheet.
According to this configuration, the determination means, the first or the tongue of the second sheet, the first or is possible to determine whether or not it is properly seated in response to buckle of the second sheet it can.

In one embodiment of the present invention, the restraining means is disposed on the inner side of the vehicle body, and is disposed on the winding portion that winds up the seat belt, and on the inner side of the vehicle body in the vertical direction above the winding portion. has and the anchor, wherein the seat belt, while restraining an occupant seated in the seat, the occupant seated in the and between and the anchor of the anchor and the winding section sheet The identification member extends in between and is provided at a position where the seat belt is not taken up by the take-up portion in a state where the seat belt does not restrain an occupant seated on the seat .
According to this configuration, the recognizability of the shoulder belt portion can be improved by the identification member without increasing the size of the winding portion.

  According to the present invention, the wearing state of the seat belt can be recognized more accurately.

Side view of the vehicles according to an embodiment of the present invention On the face view showing a state of a vehicle interior according to one embodiment Oblique view showing the restraining portion (A) the seatbelts shows an identification pattern formed on the surface of, (b) the seat belts shown to view the identification pattern formed on the back surface of View whether et vehicle longitudinal direction rear imaging unit Positive side view of the sheet Block diagram showing a functional configuration of the status detection equipment It shows to view the state recognition equipment of a processing procedure (A) is a diagram showing a detailed processing procedure of the seat belt warning processing, (b) the headrest height warning detailed processing procedure shown to view the treatment

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. Incidentally, the embodiments described below are examples as implementation means of the present invention, the present invention may also modify the following embodiments within a scope not departing from the spirit can be applied to a modification.

  FIG. 1 is a side view of a vehicle A according to an embodiment of the present invention. FIG. 2 is a top view illustrating a state of the passenger compartment according to the embodiment.

  The vehicle A includes seats S1a and S1b (first seats) arranged side by side in the vehicle width direction in the vehicle interior, and sheets S2a and S2b (second seats) arranged behind the seats S1a and S1b in the vehicle front-rear direction. ), Seats S3a, S3b, and S3c disposed on the rear side in the vehicle front-rear direction of the seats S2a and S2b, and a restraining portion B that is provided for each seat and restrains an occupant seated on each seat.

  The seat S1a is a driver seat and the seat S1b is a passenger seat. The seats S2a and S2b are second row seats having seats for two people. The seats S3a, S3b, and S3c are third row seats having a so-called bench seat having a seat for two persons and a seat for one person. Each seat has a moving mechanism (sliding mechanism) that moves in the vehicle front-rear direction, and a tilting mechanism (reclining mechanism) that tilts in the vehicle front-rear direction around the lower end in the vertical direction of the seat back.

An A pillar Pa, a B pillar Pb, a C pillar Pc, and a D pillar Pd are disposed on the left and right vehicle body side portions in order from the front in the vehicle front-rear direction. A front door FD can be opened and closed in an opening formed between the A pillar Pa and the B pillar Pb, and a rear door RD is opened and closed in the opening formed between the B pillar and the C pillar. It is possible to arrange.

  The restraining part B restrains the restraints B1a and B1b (seat belt devices) of the sheets S1a and S1b respectively disposed on the left and right B pillars Pb and the sheets S2a and S2b respectively disposed on the left and right C pillars Pc. Parts B2a and B2b, and restraint parts B3a and B3c of sheets S3a and S3c respectively disposed on the left and right D pillars Pd.

  FIG. 3 is a perspective view showing the restraining portion B. FIG. 4A is a diagram showing an identification pattern D1 formed on the surface of the seat belt B11, and FIG. 4B is a diagram showing an identification pattern D2 formed on the back surface of the seat belt B11.

The restraining part B2a is disposed on the inner side of the seat belt B11, a tongue B12 provided so as to be movable along the seat belt B11, a buckle B13 provided on the vehicle body side and engaged with the tongue B12, A winding unit B14 that winds up the seat belt B11 and an anchor B15 disposed on the inner side of the vehicle body above the winding unit B14 in the vertical direction are provided. Note that the restraint portion B of the seat S3b, winding portion B14 and anchor B15 is not provided.

  The seat belt B11 includes a shoulder belt portion SB that restrains the shoulder and chest of the occupant seated on the seat S2a, and a lap belt portion LB that restrains the waist and abdomen of the occupant seated on the seat S2a.

Seatbelt B11 are in a state of restraining a passenger seated on the seat S2a, extends between the occupant seated between and anchor B15 and sheet S2a of the winding portion B14 and the anchor B15. The shoulder belt portion SB extends from the vehicle body inner side portion (B pillar P2) toward the occupant seated on the seat S2a with the seat belt B11 attached.

  The tongue B12 defines the lengths of the shoulder belt portion SB and the lap belt portion LB, and is positioned at the end portions of the shoulder belt portion SB and the lap belt portion LB. Buckle B13 is arrange | positioned corresponding to each sheet | seat between the sheets adjacent to a vehicle width direction.

  The winding part B14 is a retractor that constantly urges the seat belt B11 in the winding direction, and is accommodated in the vehicle body side part (B pillar Pb, C pillar Pc, D pillar Pd). The anchor B15 supports the seat belt B11 extending upward in the vertical direction from the winding portion B14 so that the seat belt B11 is pulled out from the desired height to the shoulder of the occupant.

Shoulder belt portion SB has an identification member D provided on both surfaces and rear surface of the shoulder belt portion SB. The identification member D has a first identification pattern D1 formed on the front surface of the shoulder belt portion SB and a second identification pattern D2 formed on the back surface of the shoulder belt portion SB and different from the first identification pattern D1. First identification pattern D1 is, for example, reflective material is adhered along the edges of the surface, or, are woven. Second identification pattern D2 is, for example, attached to the reflection member along the rear surface of the edge portion meanders, or are woven. The identification member D is in a state where the seat belt B11 does not restrain the occupant seated on each seat, that is, most of the seat belt B11 is wound around the winding portion B14, and the belt line (the lower edge of the side window) Winding in the winding part B14 in a state of being substantially straight from the retractor provided at a predetermined position between the floor to the shoulder anchor B15 above the pillar and from the shoulder anchor B15 to the floor anchor Bx near the floor. It is provided at a position where it cannot be taken. Thereby, the identification member D can be provided in the shoulder belt part SB, using the existing winding part B14, without enlarging winding part B14.

The identification member D, in the present embodiment is configured to have a different identification patterns D1, D2 from each other on both the surface and the back surface of the shoulder belt portion SB, or the surface of the shoulder belt portion SB What the back Alternatively, an identification pattern may be formed.

[Configuration of State Recognition Device 100]
FIG. 5 is a view of the rear of the vehicle in the front-rear direction from the imaging unit 20. FIG. 6 is a front view of the sheets S3a, S3b, and S3c. FIG. 7 is a block diagram illustrating a functional configuration of the state recognition device 100.

  The state recognition device 100 is disposed in front of the vehicle in the front-rear direction of the vehicle, and the irradiation unit 10 that irradiates near-infrared rays toward an occupant seated on the seat, and the imaging unit 20 that images the vehicle interior irradiated by the irradiation unit 10. Based on the image captured by the imaging unit 20, the recognition unit 30 that recognizes the state of the passenger compartment, the detection unit 40 that detects the engagement state between the tongue B12 and the buckle B13, and the detection unit 40 And a determination unit 50 that determines a seat belt wearing state based on the engagement state and the shoulder belt portion SB wearing state recognized by the recognition unit 30.

  Here, infrared rays are electromagnetic waves having a longer wavelength than red, which is visible light, and a shorter wavelength than radio waves. Infrared wavelengths are distributed in the range of about 0.7 to 1000 micrometers (1 mm), and generally called three types of near-infrared, mid-infrared, and far-infrared depending on the length of the wavelength. Near-infrared light has a wavelength that is distributed in the range of about 0.7 to 2.5 micrometers and cannot be seen with the naked eye, but can be seen with a CCD or the like. For this reason, the near infrared rays emitted by the irradiating unit 10 are not visible to the occupant and are not obstructive to the occupant. On the other hand, the brightness can be increased when the image is taken with the CCD. Use.

  The irradiation unit 10 is disposed in the upper part of the vehicle interior in front of the vehicle front-rear direction with respect to the seat backs of the seats S1a, S1b, and the first irradiation unit 11 that irradiates near infrared rays toward the rear of the vehicle front-rear direction, and the sheets S1a, S1b. The second irradiation that is disposed behind the seat back of the vehicle in the front-rear direction of the vehicle and in the upper part of the vehicle interior in front of the seat back of the seats S2a and S2b and irradiates near-infrared rays toward the rear of the vehicle front-rear direction Unit 12. In the present invention, the second irradiating unit 12 is not an indispensable configuration, and it is sufficient if the first irradiating unit 11 is provided.

The first irradiation unit 11 and the second irradiation unit 12, in this embodiment, is disposed in the passenger compartment in the vehicle width direction substantially central (on the central line CL in FIG. 2). The first irradiation unit 11 is disposed, for example, in the overhead console 2 provided at the front end portion of the roof in the vehicle front-rear direction, and the second irradiation unit 12 is rearward in the vehicle front-rear direction than the first irradiation unit 11. It is arranged on the vehicle interior side of the roof.

The first irradiation unit 11 and the second irradiation unit 12 is connected to the ECU, to irradiate on the basis of a control signal of ECU. The second irradiation unit 12 irradiates near infrared rays substantially simultaneously with the first irradiation unit 11. That is, the first irradiation unit 11 and the second irradiation unit 12, substantially near infrared radiation signal is simultaneously transmitted.

  In the present embodiment, the irradiating unit 10 is arranged at the approximate center in the vehicle width direction in order to minimize the number of arrangements. However, since the LED is relatively inexpensive, it is not limited to the central position. You may provide in the position.

  The imaging unit 20 is disposed in the upper part of the vehicle interior in the front and rear direction of the vehicle with respect to the seat backs of the seats S1a and S1b, and at the approximate center in the vehicle width direction of the vehicle interior. The imaging unit 20 is disposed on the overhead console 2 in the same manner as the first irradiation unit 11. For the imaging unit 20, for example, a CCD camera can be used. The imaging unit 20 is connected to the ECU, performs imaging based on a control signal from the ECU, and transmits the captured image to the ECU.

The recognition unit 30 recognizes the mounting state of the shoulder belt portion SB of each sheet. In this embodiment, the recognizing unit 30 is in a position C1 close to the vehicle interior side portion (for example, pillar) of the shoulder belt portion SB, that is, between the vehicle interior side portion and the occupant seated in the seats S2a and S2b. The shoulder belt portion SB and the CCD camera may recognize the seat belt C2 that is not hidden by the first row sheet. Position C1 is also sheets S1a a position that does not overlap with the passenger seated in the S 1 b, because the recognition is improved. Further, the recognition unit 30, by identifying the first and second identification patterns D1, D2, located at positions C1, C2 of the seat belt in use, recognizing the mounted state, such as twisting of the shoulder belt portion SB May be. The recognition unit 30 is, for example, a CPU in the ECU, and performs various recognition processes based on the captured image transmitted from the imaging unit 20 and the signal transmitted from the detection unit 40.

  The detection unit 40 is a buckle switch that detects that the tongue B12 is attached to the buckle B13. The detection unit 40 is connected to the ECU. Examples of the detection unit 40 include a travel drive switch other than the buckle switch.

  The determination unit 50 is, for example, a CPU in the ECU, and determines whether or not the tongue B12 corresponding to the seat on which the occupant is seated is normally attached to the buckle B13 corresponding to the seat on which the occupant is seated. That is, when adjacent sheets are close to each other, the tongue may be erroneously attached to the buckle of the adjacent sheet. Therefore, the determination unit 50 makes a determination to prevent such erroneous attachment. To do.

[Processing Procedure of State Recognition Device 100]
FIG. 8 is a diagram illustrating an example of a processing procedure of the state recognition apparatus 100. First, in step S101, it is determined whether or not the travel drive switch is ON. If it is determined in step S101 that it is ON, it is determined in step S102 whether all the doors are closed. If it is determined in step S102 that all doors are closed, it is determined in step S103 whether the gear is in the travel range (D range).

  If it is determined in step S103 that the vehicle is in the travel range, it is determined in step S104 whether or not a predetermined time T1 (for example, 1 to 3 seconds) has elapsed since the gear change to the travel range. When each condition of step S101 to step S104 is not satisfied, each condition is determined until the condition is satisfied.

  If it is determined in step S104 that the predetermined time has elapsed, the irradiation unit 10 irradiates the vehicle interior with near infrared rays in step S105. In step S106, the imaging unit 30 images the vehicle interior irradiated with near infrared rays. Thereafter, in step S107, the image processing unit 40 performs predetermined image processing (for example, filter processing or the like). In step S108, the seated occupant is recognized. For example, as the seated occupant recognition process, the head (including eyes and mouth) of the seated occupant and its position are recognized.

  Then, in step S109, the sheet whose buckle switch is ON is compared with the sheet in which the occupant is recognized by image processing, and in step S110, whether or not these sheets completely match. judge. If it is determined in step S110 that there is a mismatched seat, it is highly possible that the seating of the occupant could not be reliably detected due to the hairstyle of the occupant, the direction the face is facing, or the like. From this position, the routine proceeds to a routine for determining the passenger.

  Next, in step S112, a warning is given when the height of the headrest is not appropriate. In step S113, the seat belt twist state is recognized, and in step S114, it is determined whether the seat belt is twisted based on the recognition result. If it is determined in step S114 that there is a twist, the effect of the seat belt is reduced, and a warning to that effect is given.

  In step S116, it is determined whether or not the travel drive switch is OFF. If it is determined in step S116 that the travel drive switch is ON, it is determined in step S117 whether or not the standby timer has counted a predetermined time T2 (for example, 10 milliseconds to 1 second). If it is determined in step S117 that the predetermined time has been counted, the process returns to step S105. If it is determined in step S117 that the predetermined time has not been counted, the process returns to step S116. If it is determined in step S116 that the travel drive switch is OFF, the series of processing ends.

Next, it will be described in order detailed procedure of step S111 and step S112 described above. 9A is a diagram illustrating a detailed processing procedure of the seat belt wearing warning process (step S111), and FIG. 9B is a diagram illustrating a detailed processing procedure of the headrest height warning process (step S112). is there.

  First, the detailed processing procedure of step S111 will be described. In step S111a, the seat belt wearing state is recognized. The recognition of the wearing state means recognition of the state of whether or not the user is wearing a seat belt.

  In step S111b, the sheet whose buckle switch is ON and the sheet whose seat belt is in use are collated. Thereafter, in step S111c, it is determined whether or not the sheet for which the buckle switch detected by the detection unit 40 is ON and the sheet for which the seat belt is in use are acquired by the image recognition process. If it is determined in step S111c that the parts do not match, there is a high possibility that the tongue is erroneously attached to a buckle that is not appropriate, so a warning to that effect is given and the series of processing in step S111 is terminated. . On the other hand, if it is determined in step S111c that they completely match, the series of processes in step S111 is terminated without warning.

  Next, a detailed processing procedure of step S112 will be described. In step S112a, the height of the lower end portion (chin portion) of the head of the occupant is compared with the height of the lower end portion of the headrest. These heights are acquired by the image recognition process described above. In step S112b, it is determined whether or not these height differences are within a predetermined range (for example, ± 5 cm). If it is determined in step S112b that it is not within the predetermined range, there is a possibility that the safety of the occupant may not be ensured (that is, the impact on the neck at the time of the collision is excessive). A warning is given, and the series of processing in step S112 is terminated. On the other hand, if it is determined in step S112b that it is within the predetermined range, a series of processes in step S112 is terminated without warning.

  As described above, according to the present embodiment, the wearing state of the seat belt can be recognized more accurately.

A Vehicle S1a Seat B1a Restraint part (restraint means)
B11 Seat belt
B12 tongue
B13 buckle SB Shoulder belt part 10 Irradiation part (irradiation means)
20 Imaging unit (imaging means)
30 recognition unit (recognition means)
40 detector (detector)
50 determination unit (determination means)
100 State recognition device
D1 first identification pattern
D2 second identification pattern

Claims (5)

Seat rows arranged in a plurality of rows along the vehicle longitudinal direction in the vehicle interior;
And restraining means having a seat belt for restraining a passenger seated on the sheet over preparative,
With
The vehicle state recognition apparatus, wherein the seat belt includes a shoulder belt portion that restrains a shoulder portion of an occupant seated on the seat,
An irradiating means disposed near the front of the vehicle in the longitudinal direction of the vehicle and irradiating a near infrared ray toward an occupant seated on the seat;
Imaging means for imaging the vehicle interior irradiated by the irradiation means;
Recognizing means for recognizing a wearing state of the seat belt based on an image picked up by the image pickup means;
The imaging means is provided in the upper front part of the front row seat, and the imaging means images the second row from the front of the plurality of sheet rows and the shoulder belt portion of the seat belt for the seat row. And
The recognizing means recognizes the mounting state of the shoulder belt portion ;
The restraining means is
A tongue movably provided along a seat belt of the second row of seats;
A buckle provided on the vehicle body side and engaged with the tongue;
Have
Detecting means for detecting an engagement state between the tongue and the buckle;
A determination unit that determines a mounting state of a seat belt of the second row of rows based on an engagement state detected by the detection unit and a mounting state of the shoulder belt portion recognized by the recognition unit; A vehicle state recognition device. Wherein also the surface of the shoulder belt portion the state recognition device for a vehicle according to claim 1, characterized in that further comprising an identification member provided on at least something Re of the rear surface. The identification member is
A first identification pattern formed on the surface;
A second identification pattern formed on the back surface and different from the first identification pattern;
Have
It said recognition means, by identifying the first and second identification pattern, state recognition equipment for a vehicle according to claim 2, characterized in that to recognize the mounting state of the shoulder belt portion. The sheet is
A first sheet;
A second seat arranged side by side in the vehicle width direction with the first seat;
Have
The restraining means is disposed on each of the first and second sheets,
The buckle is disposed between the first sheet and the second sheet,
2. The vehicle according to claim 1, wherein the determination unit determines whether or not a tongue of the first or second seat is attached corresponding to a buckle of the first or second seat. State recognition device. The restraining means is
A winding part disposed on the inner side of the vehicle body and winding the seat belt;
An anchor disposed on the inner side of the vehicle body in the vertical direction above the winding unit;
Have
The seat belt is in a state of restraining an occupant seated on the seat, and extends between the winding portion and the anchor and between the anchor and an occupant seated on the seat,
3. The vehicle state according to claim 2 , wherein the identification member is provided at a position where the seat belt does not restrain an occupant seated on the seat and is not wound around the winding unit. recognition equipment.

Images