WO2024214162A1 - Fraud prevention device, fraud prevention method, and fraud prevention system - Google Patents

Abstract

In the present invention, a vehicle is provided with: an image acquisition unit (11) that acquires an image captured by an image capture device provided so as to be able to capture an image of an area around the driver's seat, including at least the driver's foot area; a detection unit (12) that detects an occupant captured in a first region of the captured image and an occupant captured in a second region of the captured image; a fraud provisional determination unit (13) that provisionally determines that there is no fraud if one occupant is detected in the first region and no occupant is detected in the second region; and a fraud determination result confirmation unit (14) that confirms that there is no fraud if the fraud provisional determination unit (13) provisionally determines that there is no fraud and furthermore it is presumed that an occupant that takes a test and the occupant detected in the first region are the same person. The detection unit (12) detects an occupant captured in the second region by using a method different from the method used to detect an occupant captured in the first region.

Description

Anti-fraud device, anti-fraud method, and anti-fraud system

This disclosure relates to a fraud prevention device, a fraud prevention method, and a fraud prevention system that prevent fraud in driver breathalyzer tests.

In recent years, there has been a push to make breathalyzer tests mandatory before driving.
In response to this trend, technology has been considered to prevent fraudulent conduct in which a passenger other than the driver poses as the driver to administer a breathalyzer test before the driver drives.
For example, Patent Document 1 discloses a determination device that determines the reliability of an alcohol concentration when breath is detected, the alcohol concentration contained in the breath is measured, and whether or not the measured alcohol concentration is equal to or higher than a predetermined value is determined, and that determines that the reliability of the measured alcohol concentration is low if it is determined that the figure extracted from the captured image of the driver's seat is not a single figure. The determination device disclosed in Patent Document 1 recognizes the contour of a face from the captured image of the driver's seat to extract the figure, and counts the number of extracted figures.

JP 2009-90866 A

One example of fraudulent conduct in which a passenger other than the driver impersonates the driver to conduct a breathalyzer test is when the driver, while sitting in the driver's seat, changes their position so that the passenger other than the driver positions their face where the driver's face should be, and then acts as if they are sitting in the driver's seat to conduct a breathalyzer test by impersonating the driver.
To give a specific example, the driver may lose their posture and move their face downward, and a rear seat passenger may lean forward and bring their face near the headrest where the driver's face is expected to be located, thereby impersonating the driver and conducting a breathalyzer test.
In this case, since the driver is not in good posture, there is a risk that the outline of the driver's face will not be extracted from the captured image.
In the conventional technology, since it is not possible to take into consideration the above-mentioned fraudulent behavior, there is a possibility that the number of people present near the driver's seat is actually multiple and multiple images of people should be extracted from the captured image, but the number of people extracted from the captured image is one, which is a possibility. In other words, the conventional technology has a problem that it is not possible to completely prevent fraudulent behavior in which a passenger other than the driver impersonates the driver and performs a breathalyzer test.

This disclosure has been made to solve the above problems, and aims to provide a fraud prevention device that prevents fraud in breathalyzer tests administered to drivers in vehicles.

The fraud prevention device of the present disclosure includes an image acquisition unit that acquires an image captured by an imaging device installed in a vehicle capable of capturing an image of at least the area around the driver's seat including the foot area, a detection unit that detects an occupant captured in a first area around the headrest of the driver's seat in the captured image and an occupant captured in a second area below the headrest of the driver's seat in the captured image including the area around the driver's seat, based on the image captured by the image acquisition unit, and a fraud provisional determination process that provisionally determines whether or not there is fraud based on the presence or absence of an occupant detected in the first area or the second area, and when one occupant is detected in the first area and one occupant is detected in the second area, The system further includes a fraud provisional determination unit that provisionally determines that there is no fraud if the image is not captured, and a fraud determination result confirmation process that confirms the presence or absence of fraud, and when the fraud provisional determination unit provisionally determines that there is no fraud and detects the face of the test occupant performing the operation of performing the alcohol test based on the captured image acquired by the image acquisition unit and compares the face of the test occupant with the face of the occupant detected in the first area, it is presumed that the test occupant and the occupant detected in the first area are the same person, and the detection unit detects the occupant captured in the second area by a method different from the method of detecting the occupant captured in the first area.

This disclosure makes it possible to prevent fraud in breathalyzer tests administered to drivers in vehicles.

1 is a diagram illustrating a configuration example of an anti-tampering device according to a first embodiment; 4A to 4C are diagrams for explaining a first region and a second region detected by a detection unit in the first embodiment. 4 is a flowchart for explaining an example of the operation of the anti-tamper device according to the first embodiment. 4 is a flowchart for explaining details of step ST20 in FIG. 3. 4 is a flowchart for explaining details of the process of step ST30 in FIG. 3. 4 is a flowchart for explaining details of the process of step ST40-1 in FIG. 3. This is a flowchart showing an example operation of the anti-fraud device in embodiment 1, which starts a provisional fraud judgment process when an occupant imaged in the first area is detected, and if the provisional fraud judgment process determines that there is only one occupant detected in the first area, detects an occupant imaged in the second area. This figure shows an example of an image captured inside a vehicle cabin in which an occupant other than the driver of the vehicle is pretending to be sitting in the driver's seat and taking a breathalyzer test, thereby allowing the driver to evade the breathalyzer test. 9A and 9B are diagrams illustrating an example of a hardware configuration of the anti-tamper device according to the first embodiment. FIG. 11 is a diagram illustrating a configuration example of an anti-tampering device according to a second embodiment. 13 is a flowchart for explaining an example of the operation of the fraud prevention device according to the second embodiment. 12 is a flowchart for explaining details of the process of step ST35 in FIG. 11. 1 is a diagram showing an example of the configuration of an anti-tamper device including a recheck execution unit in the first embodiment;

Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings.
Embodiment 1.
The fraud prevention device according to the first embodiment prevents a passenger other than the driver from impersonating the driver in a breathalyzer test administered to the driver of a vehicle in order to prevent the driver from evading the breathalyzer test. For example, when the driver gets into the vehicle, the breathalyzer test is administered before driving the vehicle.
In the following embodiment 1, when the term "fraud" is used simply, this refers to fraud in which a passenger other than the driver impersonates the driver in order for the driver to evade a breathalyzer test.

FIG. 1 is a diagram showing an example of the configuration of an anti-tamper device 1 according to the first embodiment.
In the first embodiment, it is assumed that the anti-fraud device 1 is mounted on a vehicle (not shown).
The anti-tamper device 1 is connected to an imaging device 2 and an output device 3 .
In the first embodiment, the fraud prevention system 100 is made up of the fraud prevention device 1 and the imaging device 2. Note that this is merely an example, and the fraud prevention system 100 may also be made up of, for example, the fraud prevention device 1, the imaging device 2, and the output device 3.

The imaging device 2 is, for example, a near-infrared camera or a visible light camera, and captures an image of an occupant present in the vehicle cabin. The imaging device 2 may be, for example, a camera shared with a so-called "Driver Monitoring System (DMS)." Note that, for example, when the power supply of the vehicle is turned on, the imaging device 2 constantly captures an image of an occupant present in the vehicle cabin.
The imaging device 2 is installed in the vehicle interior so as to be able to capture an image of the periphery of the driver's seat including at least the foot area. The periphery of the driver's seat including the foot area in the vehicle interior is, for example, a range corresponding to a space near the front of the headrest of the driver's seat, a space near the front of the backrest of the driver's seat, and a space near the front of the driver's seat below the seat surface of the driver's seat.
The imaging device 2 is installed, for example, in the center of the vehicle in the vehicle width direction. Note that in the first embodiment, the "center" in the vehicle width direction is not limited to the strict "center" and also includes "approximately the center".
For example, the image capturing device 2 is installed on an overhead console, a mirror such as a rear-view mirror, a center console of the vehicle, or near the center of the dashboard where a car navigation system, etc. are provided. The image capturing device 2 may be a wide-angle camera that can capture an image of the area around the driver's seat including the foot area, as well as the area where seats other than the driver's seat are located within the vehicle cabin.
In the following embodiment 1, as an example, it is assumed that the imaging device 2 is installed near the vehicle's rearview mirror and captures images of the area around the driver's seat including the foot area, the area around the passenger seat including the foot area, and the space between the driver's seat and the passenger seat from near the vehicle's rearview mirror.
The imaging device 2 outputs the captured image to the anti-tamper device 1 .

Based on the image captured by the imaging device 2, the fraud prevention device 1 determines whether or not there is any fraudulent attempt by the driver to evade the breathalyzer test, for example, by a passenger other than the driver impersonating the driver.
In addition, the anti-fraud device 1 obtains information (hereinafter referred to as "test result information") indicating the alcohol concentration in the breath of the occupant (hereinafter referred to as the "test-performing occupant") who actually performs the alcohol test by blowing his or her breath from a detection device (not shown), and determines whether the test-performing occupant is in a drunk state based on the obtained test result information.
The detection device is, for example, an alcohol checker that measures the alcohol concentration in the breath of a passenger and has a breath inlet through which the passenger blows and a gas measurement sensor that measures the alcohol concentration in the breath of the passenger blown into the breath inlet. The detection device is, for example, attached to the dashboard and disposed adjacent to the steering wheel.

The anti-tampering device 1 releases the interlock of the vehicle when it determines that there is no tampering and that the test-performing occupant is not in a drunk state.The anti-tampering device 1 keeps the interlock of the vehicle on when it determines that there is tampering or that the test-performing occupant is in a drunk state.
In the first embodiment, the vehicle has an interlock function that controls whether the engine of the vehicle can be started or not.
In the first embodiment, for example, a control unit (not shown) of the anti-fraud device 1 puts the vehicle into an interlock state, in other words, a state in which the engine cannot be started, when the power supply of the vehicle is turned on. Note that the control for putting the vehicle into the interlock state when the power supply of the vehicle is turned on may be performed by a device external to the anti-fraud device 1.
In the first embodiment, releasing the vehicle interlock means making the engine startable from an unstartable state. Continuing the vehicle interlock means maintaining the unstartable state of the vehicle engine. Note that in the first embodiment, continuing the vehicle interlock also includes changing the vehicle engine from an unstartable state to a startable state, and then making the vehicle engine unstartable again before the vehicle engine actually starts.
A detailed configuration example of the fraud prevention device 1 will be described later.

The output device 3 is mounted on, for example, a vehicle and is, for example, a display device or an audio output device included in a navigation device (not shown) mounted on the vehicle.
The output device 3 outputs various information based on instructions from the anti-tamper device 1. For example, the output device 3 displays or outputs audio to prompt the driver to blow into the detection device based on instructions from the anti-tamper device 1. The test-carrying occupant blows into the detection device in accordance with the display or audio output from the output device 3 to carry out the alcohol test.

A detailed configuration example of the fraud prevention device 1 will be described.
The anti-fraud device 1 includes an image acquisition unit 11 , a detection unit 12 , a provisional fraud determination unit 13 , a fraud determination result confirmation unit 14 , a test result acquisition unit 15 , a drinking determination unit 16 , and an interlock unit 17 .
The detection unit 12 includes a first detection unit 121 and a second detection unit 122 .

The image acquisition unit 11 acquires a captured image from the imaging device 2 .
The image acquisition unit 11 outputs the acquired captured image to the detection unit 12 and the fraud determination result confirmation unit 14 .

Based on the captured image acquired by the image acquisition unit 11, the detection unit 12 detects occupants who are imaged in the area around the driver's headrest in the captured image (hereinafter referred to as the "first area") and occupants who are imaged in the area below the driver's headrest in the captured image including the area at the driver's feet (hereinafter referred to as the "second area").
In the first embodiment, the process in which the detector 12 detects an occupant whose image is captured in the first area and an occupant whose image is captured in the second area is referred to as a "detection process."

In detail, the first detection section 121 of the detection unit 12 detects a first area in the captured image based on the captured image acquired by the image acquisition unit 11, and detects the occupant whose image is captured in the detected first area.
The second detection section 122 of the detection section 12 detects a second area in the captured image based on the captured image acquired by the image acquisition section 11, and detects the occupant whose image is captured in the detected second area.

FIG. 2 is a diagram for explaining the first region and the second region detected by the detection unit 12 in the first embodiment.
In FIG. 2, the captured image is indicated by "I."
In Fig. 2, the captured image shows the driver and the passenger seat occupant seated correctly in the driver's seat and the passenger seat, respectively. As an example, the vehicle is a right-hand drive vehicle, but in Fig. 2, the steering wheel and other structures in the vehicle cabin other than the seats are omitted for convenience.
In Fig. 2, the first area is indicated by "201" and the second area is indicated by "202." In addition, in Fig. 2, the driver's seat captured in the captured image is indicated by "S1," the driver by "D," the passenger seat by "S2," and the passenger seat occupant by "P."

In embodiment 1, the first area on the captured image is an area set for authenticating an occupant who is assumed to be sitting in the driver's seat and about to take an alcohol test, and is set to suppress erroneous authentication of people located outside the vehicle, people sitting in the rear seat of the vehicle, and people sitting in the passenger seat of the vehicle.
As described above, the first region is set around the headrest of the driver's seat. The first region is, for example, a rectangular region. The position of the first region on the ceiling side of the vehicle interior is set at a position spaced a predetermined distance (e.g., about 15 cm) from the top of the headrest of the driver's seat toward the ceiling side of the vehicle interior. The position of the first region on the exterior side of the vehicle is set at a position spaced a predetermined distance (e.g., about 20 cm) from the side of the backrest of the driver's seat toward the exterior side of the vehicle. The position of the first region on the passenger seat side is set at a position spaced a predetermined distance (e.g., about 10 cm) from the side of the backrest of the driver's seat toward the passenger seat. The position of the first region on the floor side of the vehicle interior is set at the position of the lower part of the headrest of the driver's seat.
The distance from the headrest to the ceiling side of the vehicle interior and the predetermined distance from the seat back are appropriately set so that the faces of people outside the vehicle and people in the back seat do not enter the area.
The first detection unit 121 stores the coordinate values of the first area in a buffer or a memory area (not shown).

When the first detection unit 121 detects the first area, the first detection unit 121 detects the occupant whose image is captured in the first area. Specifically, the first detection unit 121 detects a face in the first area to detect the occupant whose image is captured in the first area.
The first detection unit 121 performs a known image analysis process on the captured image to detect an area in which a human face is captured (hereinafter referred to as a "face area"). At this time, the first detection unit 121 also detects feature information of the captured image of the face area. The first detection unit 121 sets a rectangle that surrounds the face area on the captured image, and acquires the coordinate values of each vertex of the set rectangle. The coordinate values acquired by the first detection unit 121 are coordinate values in the captured image.
The first detection unit 121 outputs, as a first detection result, feature information of the captured image of the acquired face region and the coordinate value of the face region to the provisional fraud determination unit 13. Here, the feature information of the captured image is, for example, the contrast value of the eyes, nose, mouth, and cheeks after normalizing the size of the face.

In the first embodiment, the second region on the captured image is a region set for detecting an occupant (specifically, the driver) who is hiding in the driver's seat in an attempt to commit an illegal act, and is set to detect the face or head of the occupant located around the driver's seat below the headrest where the driver's face is assumed to be located when the driver sits upright. In other words, the second region on the captured image is set to detect the face or head of the occupant located in a position where the face of the driver who is about to blow breath to take a breathalyzer test is assumed not to be present.
As described above, the second area is set as an area below the headrest of the driver's seat and including the area at the driver's feet. The second area is, for example, a rectangular area. The position of the second area on the ceiling side in the vehicle cabin is set below the headrest of the driver's seat. The position of the second area on the exterior side of the vehicle is set at a position spaced a predetermined distance (e.g., about 20 cm) from the side of the backrest of the driver's seat toward the exterior side of the vehicle. The position of the passenger side of the second area is set at a position spaced a predetermined distance (e.g., about 10 cm) from the side of the backrest of the driver's seat toward the passenger side. The position of the second area on the floor side in the vehicle cabin is set on the floor below the seat surface of the driver's seat.
The second detection unit 122 stores the coordinate values of the second area in a buffer or a memory area.

When the second detection unit 122 detects the second region, it detects the occupant whose image is captured in the second region. Specifically, the second detection unit 122 detects the face or head in the second region, thereby detecting the occupant whose image is captured in the second region. Note that in the first embodiment, the "head" includes only the top of the head, excluding facial features such as eyes, nose, and mouth.
Here, an example of a method for detecting an occupant imaged in the second area by the second detection unit 122 will be described in detail.
In the first embodiment, the second detection unit 122 detects an occupant whose image is captured in the second area using a method different from the method used by the first detection unit 121 to detect an occupant whose image is captured in the first area.

Specifically, the second detection unit 122 uses the occupant recognition dictionary to detect an occupant whose image is captured in the second area based on the captured image and the occupant recognition dictionary.
The occupant recognition dictionary was generated by machine learning of a whole-body image of a person sitting in the driver's seat facing forward or backward (hereinafter referred to as a "whole-body image"), a whole-body image of a person sitting in the driver's seat facing sideways, and a whole-body image of a person sitting in the driver's seat with a relaxed posture. Note that a whole-body image of a person sitting in the driver's seat with a relaxed posture includes an image in which a person is sitting in the driver's seat with a relaxed posture, so that the face is not captured in a recognizable manner in the captured image and only the head is captured.
The occupant recognition dictionary has been trained to, for example, take an image as input and output information indicating whether or not a person's face or head has been captured in a second area of the image (hereinafter referred to as "person capture presence/absence information").
The occupant recognition dictionary may be trained to take an image as input and output information indicating the probability that a human face or head is captured in a second region of the image (hereinafter referred to as "human image probability information").
The occupant recognition dictionary is generated in advance, and the second detection unit 122 stores the occupant recognition dictionary in a buffer or a memory area.

For example, the second detection unit 122 detects an occupant imaged in the second region by inputting an imaged image into the occupant recognition dictionary and obtaining human image presence/absence information. In detail, the second detection unit 122 inputs an imaged image into the occupant recognition dictionary, and when human image presence/absence information indicating that a person's face or head is imaged in the second region of the imaged image is obtained, detects that an occupant is imaged in the second region. The second detection unit 122 inputs an imaged image into the occupant recognition dictionary, and when human image presence/absence information indicating that a person's face or head is not imaged in the second region of the imaged image is obtained, detects that no occupant is imaged in the second region.
Also, for example, the second detection unit 122 may detect an occupant imaged in the second area by inputting the captured image to the occupant recognition dictionary and obtaining human imaging probability information. In detail, the second detection unit 122 inputs the captured image to the occupant recognition dictionary, and detects that there is an occupant imaged in the second area if the probability indicated in the obtained human imaging probability information is equal to or greater than a preset threshold (hereinafter referred to as a "probability determination threshold"), and detects that there is no occupant imaged in the second area if the probability indicated in the obtained human imaging probability information is less than the probability determination threshold.

As described above, the first detection unit 121 detects an occupant whose image is captured in the first area by detecting a face in the first area. In contrast, the second detection unit 122 detects an occupant whose image is captured in the second area by using an occupant recognition dictionary. As described above, the occupant recognition dictionary has been trained to be able to detect not only human faces but also heads. By using the occupant recognition dictionary to detect an occupant whose image is captured in the second area, the second detection unit 122 can detect the presence of the occupant even if the occupant's face is not captured in an image in a way that allows the face to be recognized in the second area.

The second detection unit 122 outputs the detection result indicating whether or not an occupant is detected in the second area to the provisional fraud determination unit 13 as the second detection result.

In the first embodiment, the first and second regions are rectangular regions, but the first and second regions that are set are not limited to rectangular regions.
The first and second areas can be applied as appropriate as long as they are set to suppress erroneous recognition of the faces of people outside the vehicle and people in the back seat of the vehicle, and can make it easier to detect occupants who are hiding in the driver's seat in an attempt to commit fraud.

The provisional fraud determination unit 13 provisionally determines whether or not there is fraud based on the first detection result and the second detection result output from the detection unit 12, depending on whether or not there is an occupant detected in the first area or the second area.
In embodiment 1, the process performed by the fraud provisional judgment unit 13 to provisionally judge the presence or absence of fraud based on the presence or absence of an occupant detected in the first area or the second area is referred to as the "fraud provisional judgment process."

The provisional fraud determination unit 13 provisionally determines whether or not fraud has occurred based on whether or not a preset condition for provisionally determining that there is no fraud (hereinafter referred to as a "provisional determination condition") is satisfied.
The provisional determination conditions are set based on the presence or absence of an occupant detected in the first area or the presence or absence of an occupant detected in the second area. For example, an administrator or the like sets the provisional determination conditions in advance and stores them in a location that can be referenced by the anti-fraud device 1.

The provisional determination conditions are set, for example, as in the following condition (1).

Condition (1)
One occupant is detected in the first area and no occupant is detected in the second area

If the condition for provisional judgment is satisfied, the provisional fraud judgment unit 13 provisionally judges that there is no fraud.
On the other hand, if the condition for provisional judgment is not satisfied, the provisional fraud judgment unit 13 provisionally judges that there is fraud.
If the condition for provisional judgment is set to the above condition (1), the provisional fraud judgment unit 13 provisionally judges that there is no fraud when one occupant is detected in the first area and no occupant is detected in the second area. Here, the detection of one occupant in the first area means, in detail, that one and only one occupant is detected in the first area.
On the other hand, the provisional fraud judgment unit 13 provisionally judges that there is fraud if multiple occupants are detected in the first area, if no occupants are detected in the first area, or if an occupant is detected in the second area.

Note that the determination of the presence or absence of fraud made by the provisional fraud determination unit 13 here is a provisional determination of the presence or absence of fraud. The final determination of the presence or absence of fraud is made by the fraud determination result determination unit 14. Details of the fraud determination result determination unit 14 will be described later.

The fraud provisional judgment unit 13 outputs the provisional judgment result of the fraud provisional judgment process, that is, whether or not fraud has occurred (hereinafter referred to as the “fraud provisional judgment result”), to the fraud judgment result finalizing unit 14 .
Furthermore, when the provisional fraud judgment unit 13 provisionally judges that there is no fraud as a result of the provisional fraud judgment process, it outputs information (hereinafter referred to as "output control information") instructing the output device 3 to output a display or sound prompting the action of blowing into the detection device. For example, the provisional fraud judgment unit 13 outputs output control information to the output device 3 for outputting a display or sound saying "Please blow into the detection device."

The fraud determination result finalizing unit 14 performs processing to finalize the result of the determination as to whether or not fraud has occurred.
In the first embodiment, the process performed by the fraud determination result determining unit 14 to determine the result of the determination as to whether or not fraud has occurred is referred to as the "fraud determination result determining process."

The fraud determination result determination process performed by the fraud determination result determination unit 14 will be described.
In the fraud determination result determination process, the fraud determination result determination unit 14 first determines whether or not the provisional fraud determination unit 13 has provisionally determined that there is no fraud.
The fraud determination result finalizing unit 14 may determine that the fraud temporary determination unit 13 has temporarily determined that there is no fraud, based on the fraud temporary determination result output from the fraud temporary determination unit 13 .

When the fraud determination result confirmation unit 14 determines that the fraud provisional determination unit 13 has provisionally determined that there is no fraud, it causes the image acquisition unit 11 to acquire an image and acquires the image from the image acquisition unit 11. As described above, the imaging device 2 constantly captures images of the interior of the vehicle. The fraud determination result confirmation unit 14 acquires the latest image from the image acquisition unit 11 after the fraud provisional determination unit 13 provisionally determines that there is no fraud and outputs output control information to the output device 3 to prompt the detection device to blow in. It is assumed that the image captures the test occupant blowing in.
In FIG. 1, the arrow from the fraud determination result confirmation unit 14 to the image acquisition unit 11 is omitted.

The fraud determination result confirmation unit 14 performs a known image analysis process on the captured image acquired by the image acquisition unit 11, and detects the area in which the face of the test occupant is captured (hereinafter referred to as the "test occupant face area").
The fraud determination result determination unit 14 may detect the test occupant's face area by performing known pattern matching on the captured image, for example. Alternatively, the fraud determination result determination unit 14 may detect the test occupant's face area by inputting the captured image into a trained model (hereinafter referred to as a "machine learning model") that receives the captured image as an input and outputs the test occupant's face area.

When the test occupant face area is detected, the fraud determination result confirmation unit 14 then compares the test occupant face area with the face area of the occupant detected in the first area, and determines whether the test occupant and the occupant detected in the first area can be considered to be the same person, in other words, whether the test occupant and the occupant detected in the first area are presumed to be the same person. The fraud determination result confirmation unit 14 may obtain the first detection result from the first detection unit 121 via the provisional fraud determination unit 13.

The fraud determination result confirmation unit 14 may use, for example, a known image matching technique to determine whether the inspection occupant and the occupant detected in the first area can be considered to be the same person. For example, the fraud determination result confirmation unit 14 calculates, as the degree of matching, the sum of the differences between corresponding pixels, the number of pixels where the number of differences between pixels is equal to or less than a threshold, the correlation coefficient between images, etc., and if the calculated degree of matching is equal to or greater than a preset threshold, it determines that the inspection occupant and the occupant detected in the first area can be considered to be the same person. In this case, it is presumed that the inspection occupant and the occupant detected in the first area are the same person.

For example, the fraud determination result confirmation unit 14 may compare feature information of the captured image of the test occupant's face area with feature information of the captured image of the occupant's face area detected in the first area, and if the degree of match is equal to or greater than a preset threshold, determine that the test occupant and the occupant detected in the first area can be considered to be the same person. In this case, when the fraud determination result confirmation unit 14 detects the test occupant's face area, it also detects feature information of the captured image of the test occupant's face area.

The fraud determination result confirmation unit 14 compares the face of the occupant undergoing the test with the face of the occupant detected in the first area, more specifically, compares the face area of the occupant undergoing the test with the face area of the occupant detected in the first area, and if it is presumed that the occupant undergoing the test and the occupant detected in the first area are the same person, it confirms the result of the fraud determination that there is no fraud.
On the other hand, if the fraud determination result confirmation unit 14 determines that the occupant conducting the test and the occupant detected in the first area cannot be considered to be the same person, in other words, if the occupant conducting the test and the occupant detected in the first area are not presumed to be the same person, it confirms the result of the fraud determination that there is fraud.

If the provisional fraud determination unit 13 provisionally determines that fraud has occurred, the fraud determination result confirmation unit 14 confirms the result of the determination as to whether or not fraud has occurred.

The fraud determination result confirmation unit 14 outputs the confirmation result indicating whether or not fraud has occurred (hereinafter referred to as the "fraud confirmation result") to the interlock unit 17.

The test result acquisition unit 15 acquires test result information from the detection device. That is, the test result acquisition unit 15 acquires the alcohol test result obtained by the alcohol test performed by the test occupant, more specifically, the test result information indicating the alcohol concentration obtained from the breath of the test occupant by blowing the breath of the test occupant.
The test result acquisition unit 15 outputs the acquired test result information to the drinking alcohol determination unit 16 .

The drinking alcohol determination unit 16 determines whether or not the test occupant is drinking alcohol, based on the test result information acquired by the test result acquisition unit 15 .
The drinking alcohol determination unit 16 may have the functions of the test result acquisition unit 15. In this case, the anti-tampering device 1 does not require the test result acquisition unit 15 as an essential component.
The drinking alcohol determination unit 16 determines that the test occupant is in a drunk state if, for example, the alcohol concentration indicated in the test result information is equal to or higher than a preset threshold value (hereinafter referred to as the "drinking alcohol determination threshold value").
On the other hand, if the alcohol concentration indicated in the test result information is less than the alcohol consumption determination threshold, the alcohol consumption determination unit 16 determines that the test occupant is not in a drunk state.
The drinking alcohol determination unit 16 outputs the determination result as to whether or not the test occupant is in a drunk state (hereinafter referred to as the “drinking alcohol determination result”) to the interlock unit 17 .

The interlock unit 17 decides whether or not to release the interlock in the vehicle based on the determination result of the fraud determination result determination unit 14 as to whether or not there is fraud (i.e., the fraud determination result) and the determination result of the drinking alcohol determination unit 16 as to whether or not the occupant conducting the test is in a drunk state (i.e., the drinking alcohol determination result).
The interlock unit 17 releases the interlock when the fraud determination result confirming unit 14 confirms that there is no fraud and the drinking alcohol determining unit 16 determines that the test implementing occupant is not in a drinking state.
The interlock unit 17 continues the interlock when the fraud determination result confirmation unit 14 does not confirm that there is no fraud, or when the drinking alcohol determination unit 16 determines that the test implementing occupant is in a drunk state.

An example of the operation of the fraud prevention device 1 according to the first embodiment will be described.
FIG. 3 is a flowchart for explaining an example of the operation of the fraud prevention device 1 according to the first embodiment.
For example, when the vehicle's power supply is turned on, the anti-fraud device 1 starts the operation as shown in the flowchart of Fig. 3. When the vehicle's power supply is turned on, the control unit of the anti-fraud device 1 causes the image acquisition unit 11, the detection unit 12, the provisional fraud determination unit 13, the fraud determination result confirmation unit 14, the test result acquisition unit 15, the drinking determination unit 16, and the interlock unit 17 to start processing.
The fraud prevention device 1 repeats the operations shown in the flowchart of FIG. 3, for example, until the vehicle interlock is released or instruction information instructing the suspension of the breathalyzer test is input. For example, a vehicle occupant can input instruction information from an input device (not shown) installed in the vehicle. The input device is, for example, a touch panel display provided in a navigation device. When the control unit of the fraud prevention device 1 acquires the instruction information, it causes the image acquisition unit 11, the detection unit 12, the provisional fraud determination unit 13, the fraud determination result confirmation unit 14, the test result acquisition unit 15, the drinking judgment unit 16, and the interlock unit 17 to terminate processing.

The image acquisition unit 11 acquires a captured image from the imaging device 2 (step ST10).
The image acquisition unit 11 outputs the acquired captured image to the detection unit 12 and the fraud determination result confirmation unit 14 .

The detection unit 12 performs a detection process based on the captured image acquired by the image acquisition unit 11 in step ST10 (step ST20).
The detection unit 12 outputs the first detection result and the second detection result to the provisional fraud determination unit 13 .

The provisional fraud determination unit 13 performs a provisional fraud determination process based on the first detection result and the second detection result output from the detection unit 12 in step ST20 (step ST30).
The provisional fraud judgment unit 13 outputs the provisional fraud judgment result to the fraud judgment result confirmation unit 14 .
In addition, if the provisional fraud judgment unit 13 provisionally judges that there is no fraud as a result of performing the provisional fraud judgment process, it outputs output control information to the output device 3 to cause it to display or output audio prompting the user to blow air into the detection device.
When the output control information is output from the anti-tamper device 1, the output device 3 displays or outputs a voice to prompt the test occupant to blow into the detection device. In response to this, the test occupant blows into the detection device and performs the alcohol test.

The fraud determination result confirming section 14 performs a fraud determination result confirming process (step ST40-1).
The fraud determination result finalizing unit 14 outputs a fraud determination result indicating that no fraud has occurred to the interlock unit 17 .

The test result acquisition unit 15 acquires the test result information from the detection device, and the drinking alcohol determination unit 16 determines whether the test participant is in a drunk state based on the test result information acquired by the test result acquisition unit 15 (step ST40-2).
The drinking determination unit 16 outputs the drinking determination result to the interlock unit 17 .

The interlock unit 17 decides whether or not to release the interlock in the vehicle based on the determination result of the fraud determination result determination unit 14 in step ST40-1 as to whether or not there is fraud (i.e., the fraud determination result) and the determination result of the drinking alcohol determination unit 16 in step ST40-2 as to whether or not the occupant conducting the test is in a drunk state (i.e., the drinking alcohol determination result) (step ST50).
The interlock unit 17 releases the interlock when the fraud determination result determining unit 14 determines that there is no fraud and the drinking alcohol determination unit 16 determines that the test-performing occupant is not drinking alcohol. The interlock unit 17 continues the interlock when the fraud determination result determining unit 14 does not determine that there is no fraud or when the drinking alcohol determination unit 16 determines that the test-performing occupant is drinking alcohol.

In the flowchart shown in FIG. 3, the processing of step ST40-1 and the processing of step ST40-2 are performed in parallel, but this is merely an example. For example, the processing of step ST40-2 may be performed after the processing of step ST40-1, or the processing of step ST40-1 may be performed after the processing of step ST40-2. It is sufficient that the processing of step ST40-1 and the processing of step ST40-2 are performed before the processing of step ST50 is performed.

FIG. 4 is a flow chart for explaining the details of step ST20 in FIG.
The first detection unit 121 of the detection unit 12 detects a first area in the captured image based on the captured image acquired by the image acquisition unit 11 in step ST10, and detects an occupant imaged in the detected first area (step ST101).
The first detection unit 121 outputs the feature information of the captured image of the acquired face region and the coordinate value of the face region to the provisional fraud determination unit 13 as a first detection result.
The second detection section 122 of the detection unit 12 detects a second area in the captured image based on the captured image acquired by the image acquisition unit 11 in step ST10 and the occupant recognition dictionary, and detects the occupant imaged in the detected second area (step ST102).
The second detection unit 122 outputs the detection result, whether or not it has detected the presence of an occupant in the second area, to the fraud provisional determination unit 13 as a second detection result.

FIG. 5 is a flowchart for explaining the details of the process of step ST30 in FIG.
In this case, the provisional determination condition is set to be "one occupant is detected in the first area, and no occupant is detected in the second area."

The fraud provisional determination unit 13 determines whether or not the number of occupants detected in the first area is one, based on the first detection result output from the first detection unit 121 (step ST111).
If it is determined in step ST111 that there is only one occupant detected in the first area, i.e., that there is only one occupant detected in the first area (if the result is "YES" in step ST111), the fraud provisional judgment unit 13 determines whether or not there is no occupant detected in the second area based on the second detection result output from the second detection unit 122 (step ST112).

If it is determined in step ST112 that no occupant is detected in the second area (if "YES" in step ST112), the fraud provisional judgment unit 13 determines that the provisional judgment condition is satisfied and provisionally judges that there is no fraud (step ST113).
The provisional fraud judgment unit 13 outputs a provisional fraud judgment result indicating that no fraud has been detected to the fraud judgment result finalizing unit 14 .
Furthermore, the provisional malpractice determination unit 13 outputs output control information for causing the output device 3 to display or output a voice prompting the user to blow into the detection device. For example, the provisional malpractice determination unit 13 outputs output control information for causing the output device 3 to display or output a voice urging the user to blow into the detection device. The test execution occupant blows into the detection device in accordance with the display or voice output from the output device 3 to carry out the alcohol test.

If it is determined in step ST111 that there are two or more occupants detected in the first area or that there are no occupants detected in the first area (if the answer is "NO" in step ST111), and if it is determined in step ST112 that there is an occupant detected in the second area (if the answer is "NO" in step ST112), the fraud provisional judgment unit 13 determines that the provisional judgment conditions are not satisfied and provisionally judges that there is fraud (step ST114).
The provisional fraud determination unit 13 outputs a provisional fraud determination result indicating that there is a provisional determination that fraud has occurred to the fraud determination result confirmation unit 14 .

FIG. 6 is a flowchart explaining the details of the processing of step ST40-1 in FIG. 3.

The fraud determination result determination unit 14 determines whether or not the fraud provisional determination unit 13 has provisionally determined that there is fraud as a result of the fraud provisional determination process performed in step ST30 of FIG. 3 (step ST121).

If the provisional fraud determination unit 13 determines in step ST121 that there is no fraud (if "NO" in step ST121), the fraud determination result confirmation unit 14 causes the image acquisition unit 11 to acquire an image, and performs a known image analysis process on the image acquired by the image acquisition unit 11 to detect the facial area of the occupant undergoing the inspection (step ST122).

The fraud determination result confirmation unit 14 compares the face area of the test occupant detected in step ST122 with the face area of the occupant detected in the first area in step ST20 of FIG. 3, and determines whether the test occupant and the occupant detected in the first area are presumed to be the same person (step ST123).

If it is determined in step ST123 that the occupant conducting the test and the occupant detected in the first area are suspected to be the same person ("YES" in step ST123), the fraud determination result confirmation unit 14 confirms that there is no fraud (step ST124).
The fraud determination result finalizing unit 14 outputs a fraud determination result indicating that no fraud has occurred to the interlock unit 17 .

On the other hand, if the fraud provisional judgment unit 13 judges in step ST121 that there is a provisional judgment that there is fraud (if the answer is "YES" in step ST121), and if it judges in step ST123 that the occupant conducting the test and the occupant detected in the first area cannot be assumed to be the same person (if the answer is "NO" in step ST123), the fraud judgment result confirmation unit 14 confirms that there is fraud (step ST125).
The fraud determination result confirming unit 14 outputs a fraud confirmation result indicating that fraud has occurred to the interlock unit 17 .

In the above example of operation of the anti-fraud device 1 described using the flowchart of Figure 3, the anti-fraud device 1 starts the provisional fraud judgment process after detecting an occupant who is imaged in the first area and an occupant who is imaged in the second area.
However, this is just one example, and the anti-fraud device 1 may, for example, initiate a provisional fraud judgment process when an occupant imaged in the first area is detected, and if the provisional fraud judgment process determines that there is only one occupant detected in the first area, detect an occupant imaged in the second area.

Figure 7 is a flowchart showing an example operation in embodiment 1 in which the anti-fraud device 1 starts a provisional fraud judgment process when it detects an occupant imaged in the first area, and if the provisional fraud judgment process determines that there is only one occupant detected in the first area, it detects an occupant imaged in the second area.
In the flowchart shown in FIG. 7, the same processes as those shown in the flowcharts shown in FIG. 3, FIG. 4, or FIG. 5 are given the same step numbers, and duplicated explanations of the details of the processes will be omitted.

As shown in the flowchart of FIG. 7, in step ST101, the first detection unit 121 of the detection unit 12 detects a first area in the captured image based on the captured image acquired by the image acquisition unit 11 in step ST10, and when it detects an occupant captured in the detected first area, the provisional fraud determination unit 13 determines whether or not there is only one occupant detected in the first area based on the first detection result output from the first detection unit 121 (step ST111).

In step ST111, if the provisional fraud judgment unit 13 determines that there is only one occupant detected in the first area (if the answer is "YES" in step ST111), the second detection unit 122 of the detection unit 12 detects a second area in the captured image based on the captured image acquired by the image acquisition unit 11 in step ST10 and the occupant recognition dictionary, and detects the occupant imaged in the detected second area (step ST102).
Then, the fraud provisional determination unit 13 determines the presence or absence of an occupant detected in the second area based on the second detection result output from the second detection unit 122 (step ST112).
If the fraud provisional judgment unit 13 determines that there are two or more occupants detected in the first area, or that there are no occupants detected in the first area ("NO" in step ST111), the second detection unit 122 does not detect the second area or detect occupants in the second area.

As explained using the flowchart shown in Figure 7, the fraud prevention device 1 detects the second area and detects an occupant in the second area only if the fraud provisional determination unit 13 determines that there is only one occupant detected in the first area, thereby preventing unnecessary processing from being executed and reducing the processing load.

For example, one example of fraudulent behavior aimed at evading a breathalyzer test administered by the driver of a vehicle would be for the driver to change position while seated in the driver's seat, have a passenger other than the driver position their face where the driver's face should be, and act as if they were sitting in the driver's seat to impersonate the driver and administer the breathalyzer test.
FIG. 8 shows an example of an image captured inside a vehicle cabin in which an occupant other than the driver of the vehicle is pretending to be sitting in the driver's seat and impersonating the driver to conduct a breathalyzer test, thereby allowing the driver to evade the breathalyzer test.
In Fig. 8, the captured image is indicated by "I". In Fig. 8, the driver's seat captured in the captured image is indicated by "S1", the driver by "D", the passenger seat by "S2", and the rear seat passenger by "Pb". As an example, the vehicle is a right-hand drive vehicle, but for convenience, Fig. 8 omits illustration of structures inside the vehicle cabin other than the seats, such as the steering wheel.
Figure 8 is an example of an image captured in a vehicle cabin showing a driver (indicated by "D" in Figure 8) leaning back in the driver's seat and moving his or her face downward to hide his or her face, while a rear seat passenger leans forward and brings his or her face near the headrest of the driver's seat, where the driver's face is expected to be located.
It is also conceivable that a rear seat passenger may pose as the driver and carry out a breathalyzer test in a vehicle interior as shown in FIG. 8, that is, the rear seat passenger may blow breath into the detection device.
At this time, as shown in Figure 8, the driver will lose his/her posture and hide his/her face, and although the driver's head will be recognized in the captured image, the driver's face will not be recognized; in other words, it is expected that the outline of the driver's face will not be extracted from the captured image.
If a system were to be used to recognize the contours of a face from an image of a person changing seats, extract a person's image, and count the extracted person's image, a driver who has lost his/her balance would not be counted in an image such as that shown in Figure 8, and it may not be possible to completely prevent impersonation by a rear seat passenger as described above.

In response to this, as described above, the anti-fraud device 1 detects an occupant (more specifically, the occupant's face) who is imaged in a first area around the headrest of the driver's seat in an image captured by the imaging device 2, which is provided in a vehicle and capable of capturing an image of at least the area around the driver's seat including the foot area, and an occupant (more specifically, the occupant's face or head) who is imaged in a second area in the image captured that is below the headrest of the driver's seat and includes the area around the driver's seat. The anti-fraud device 1 detects the occupant who is imaged in the second area by a method that is different from the method of detecting the occupant who is imaged in the first area and that is capable of detecting the presence of the occupant even if the occupant's face is not imaged in a recognizable manner.
The anti-tampering device 1 then performs a provisional tampering determination process, and if one occupant is detected in the first area and no occupant is detected in the second area, it provisionally determines that there is no tampering; if it provisionally determines that there is no tampering and detects the face of the test-performing occupant performing the action of conducting the alcohol test based on the captured image and compares the face of the test-performing occupant with the face of the occupant detected in the first area, and if it is presumed that the test-performing occupant and the occupant detected in the first area are the same person, it confirms that there is no tampering.
In this way, the fraud prevention device 1 can prevent fraud in a breathalyzer test administered to a driver of a vehicle. In detail, the fraud prevention device 1 can prevent fraud in a breathalyzer test administered to a driver of a vehicle, in which a passenger other than the driver impersonates the driver and the driver tries to evade the breathalyzer test.
For example, even if a driver changes their position while sitting in the driver's seat, and a passenger other than the driver positions their face where the driver's face should be, and acts as if they are sitting in the driver's seat, impersonating the driver and conducting a breathalyzer test, making it impossible to extract the outline of the driver who has changed their position in the image captured of the driver's seat, the fraud prevention device 1 can detect the presence of the driver and prevent fraud.

9A and 9B are diagrams showing an example of the hardware configuration of the anti-tamper device 1 according to embodiment 1. FIG.
In the first embodiment, the functions of the image acquisition unit 11, the detection unit 12, the provisional fraud determination unit 13, the fraud determination result confirmation unit 14, the test result acquisition unit 15, the drinking determination unit 16, the interlock unit 17, and a control unit (not shown) are realized by the processing circuit 1001. That is, the fraud prevention device 1 includes the processing circuit 1001 for performing control to prevent fraud in a breathalyzer test administered to a driver of a vehicle.
The processing circuitry 1001 may be dedicated hardware as shown in FIG. 9A, or may be a processor 1004 executing a program stored in a memory as shown in FIG. 9B.

If the processing circuit 1001 is dedicated hardware, the processing circuit 1001 may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a combination of these.

When the processing circuit is the processor 1004, the functions of the image acquisition unit 11, the detection unit 12, the provisional fraud determination unit 13, the fraud determination result confirmation unit 14, the test result acquisition unit 15, the drinking determination unit 16, the interlock unit 17, and the control unit (not shown) are realized by software, firmware, or a combination of software and firmware. The software or firmware is written as a program and stored in the memory 1005. The processor 1004 executes the functions of the image acquisition unit 11, the detection unit 12, the provisional fraud determination unit 13, the fraud determination result confirmation unit 14, the test result acquisition unit 15, the drinking determination unit 16, the interlock unit 17, and the control unit (not shown) by reading and executing the program stored in the memory 1005. In other words, the anti-fraud device 1 includes a memory 1005 for storing a program that, when executed by the processor 1004, results in the execution of steps ST10 to ST50 in FIG. 3 described above or steps ST10 to ST50 in FIG. 7 described above. In addition, the program stored in memory 1005 can also be said to cause the computer to execute the processing procedures or methods of the image acquisition unit 11, the detection unit 12, the provisional fraud judgment unit 13, the fraud judgment result confirmation unit 14, the test result acquisition unit 15, the drinking judgment unit 16, the interlock unit 17, and a control unit not shown. Here, memory 1005 may be, for example, a non-volatile or volatile semiconductor memory such as a RAM, a ROM (Read Only Memory), a flash memory, an EPROM (Erasable Programmable Read Only Memory), or an EEPROM (Electrically Erasable Programmable Read-Only Memory), or a magnetic disk, a flexible disk, an optical disk, a compact disk, a mini disk, or a DVD (Digital Versatile Disc).

The functions of the image acquisition unit 11, the detection unit 12, the provisional fraud determination unit 13, the fraud determination result confirmation unit 14, the test result acquisition unit 15, the drinking determination unit 16, the interlock unit 17, and a control unit (not shown) may be partially realized by dedicated hardware and partially realized by software or firmware. For example, the image acquisition unit 11 may be realized by a processing circuit 1001 as dedicated hardware, and the detection unit 12, the provisional fraud determination unit 13, the fraud determination result confirmation unit 14, the test result acquisition unit 15, the drinking determination unit 16, the interlock unit 17, and a control unit (not shown) may be realized by a processor 1004 reading out and executing a program stored in a memory 1005.
The anti-tamper device 1 also includes an input interface device 1002 and an output interface device 1003 that perform wired or wireless communication with devices such as the imaging device 2 or the output device 3 .

In the above-described first embodiment, the test result acquisition unit 15, the drinking alcohol determination unit 16, and the interlock unit 17 are provided in the anti-tampering device 1.
However, the test result acquisition unit 15, the drinking determination unit 16, and the interlock unit 17 are not essential components of the anti-tampering device 1. The test result acquisition unit 15, the drinking determination unit 16, and the interlock unit 17 may be provided in a device connected to the anti-tampering device 1 outside the anti-tampering device 1, for example.

In addition, in the above embodiment 1, the fraud prevention device 1 is an on-board device mounted on a vehicle, and the image acquisition unit 11, the detection unit 12, the provisional fraud judgment unit 13, the fraud judgment result confirmation unit 14, the test result acquisition unit 15, the drinking judgment unit 16, the interlock unit 17, and a control unit (not shown) are provided in the on-board device.
Without being limited thereto, some of the image acquisition unit 11, detection unit 12, provisional fraud determination unit 13, fraud determination result confirmation unit 14, test result acquisition unit 15, drinking determination unit 16, interlock unit 17, and a control unit (not shown) may be mounted on an in-vehicle device of a vehicle, and the rest may be provided in a server connected to the in-vehicle device via a network, so that the in-vehicle device, server, and imaging device 2 constitute the fraud prevention system 100. Also, the image acquisition unit 11, detection unit 12, provisional fraud determination unit 13, fraud determination result confirmation unit 14, test result acquisition unit 15, drinking determination unit 16, interlock unit 17, and a control unit (not shown) may all be provided in the server.

As described above, according to the first embodiment, the fraud prevention device 1 includes an image acquisition unit 11 that acquires an image captured by an imaging device 2 that is provided in a vehicle so as to be able to capture an image of at least the periphery of the driver's seat including the foot area, a detection unit 12 that detects an occupant captured in a first area around the headrest of the driver's seat in the captured image and an occupant captured in a second area below the headrest of the driver's seat in the captured image including the foot area of the driver's seat based on the captured image acquired by the image acquisition unit 11, and a fraud provisional determination process that provisionally determines whether or not fraud has occurred based on the presence or absence of an occupant detected in the first area or the second area, The system is configured to include a fraud provisional judgment unit 13 that provisionally judges that there is no fraud when one occupant is detected in one area and no occupant is detected in the second area, and a fraud judgment result confirmation unit 14 that performs a fraud judgment result confirmation process to confirm the result of the judgment as to whether or not there is fraud, and that confirms that there is no fraud when the fraud provisional judgment unit 13 provisionally judges that there is no fraud and detects the face of the test performing occupant performing the operation of conducting an alcohol test based on the captured image acquired by the image acquisition unit 11 and compares the face of the test performing occupant with the face of the occupant detected in the first area, and it is presumed that the test performing occupant and the occupant detected in the first area are the same person.
Therefore, the fraud prevention device 1 can prevent fraud in a breathalyzer test administered to a driver of a vehicle. In detail, the fraud prevention device 1 can prevent fraud in a breathalyzer test administered to a driver of a vehicle, in which a passenger other than the driver impersonates the driver and the driver tries to evade the breathalyzer test.

Embodiment 2.
In the second embodiment, an embodiment will be described in which the anti-tampering device has a personal authentication function in addition to the functions described in the first embodiment.

FIG. 10 is a diagram showing an example of the configuration of an anti-tamper device 1a according to the second embodiment.
The fraud prevention device 1 a is connected to an imaging device 2 and an output device 3 .
In the second embodiment, the fraud prevention system 100a is made up of the fraud prevention device 1a and the imaging device 2. Note that this is merely an example, and for example, the fraud prevention system 100a may be made up of the fraud prevention device 1a, the imaging device 2, and the output device 3.
In the second embodiment, the anti-fraud device 1a is mounted on, for example, a vehicle (not shown).

10, the same configuration examples as those of the anti-tamper device 1 described in the first embodiment with reference to FIG. 1 are denoted by the same reference numerals, and duplicated explanations will be omitted.
The anti-fraud device 1 a according to the second embodiment differs from the anti-fraud device 1 according to the first embodiment in that it includes a personal authentication unit 18 .

When the provisional fraud determination unit 13 provisionally determines that there is no fraud, the personal authentication unit 18 performs personal authentication of the occupant detected in the first area by the first detection unit 121 .
In the second embodiment, the process of personal authentication of an occupant detected in the first area, which is performed by the personal authentication unit 18, is referred to as a "personal authentication process."
The personal authentication unit 18 may determine that the fraud temporary judgment unit 13 has provisionally judged that there is no fraud based on the fraud temporary judgment result output from the fraud temporary judgment unit 13. In the second embodiment, the fraud temporary judgment unit 13 outputs the fraud temporary judgment result to the personal authentication unit 18. The personal authentication unit 18 may obtain the first detection result from the first detection unit 121 via the fraud temporary judgment unit 13.

The personal authentication unit 18 performs personal authentication, for example, by comparing a pre-registered facial image of the driver with a captured image of the facial area of the occupant detected in the first area. For example, the driver stores an image of his or her own face in advance in a storage device (not shown) provided in a location accessible to the anti-fraud device 1. Note that this is merely one example, and the personal authentication unit 18 may use known personal authentication technology to perform personal authentication of the occupant detected in the first area.

When the personal authentication unit 18 is able to personally authenticate the occupant detected in the first area, it maintains the provisional determination result of the presence or absence of fraud provisionally determined by the fraud provisional determination unit 13. In other words, the personal authentication unit 18 maintains the provisional determination result of the fraud provisional determination unit 13 that there is no fraud. The personal authentication unit 18 outputs the provisional determination result output from the fraud provisional determination unit 13 to the fraud determination result confirmation unit 14.

On the other hand, if the personal authentication unit 18 is unable to perform personal authentication of the occupant detected in the first area, it determines that there is fraud, regardless of the provisional judgment result of the provisional fraud judgment unit 13 as to whether or not there is fraud, and rewrites the provisional judgment result output from the provisional fraud judgment unit 13 to a provisional judgment result indicating that there is fraud. The personal authentication unit 18 outputs the provisional judgment result indicating that there is fraud to the fraud judgment result confirmation unit 14.

In the second embodiment, the fraud determination result confirmation section 14 performs a fraud determination result confirmation process based on the provisional fraud determination result output from the personal authentication section 18 .
When the personal authentication unit 18 authenticates the occupant detected in the first area, and when the face of the test-performing occupant performing the operation of conducting an alcohol test is detected based on the captured image acquired by the image acquisition unit 11 and the face of the test-performing occupant is compared with the face of the occupant detected in the first area, the fraud determination result confirmation unit 14 determines that there is no fraud when it is inferred that the test-performing occupant and the occupant detected in the first area are the same person.
When the personal authentication unit 18 authenticates the occupant detected in the first area, in other words, when a provisional determination result indicating that no tampering has occurred is output from the personal authentication unit 18.

The fraud determination result confirmation unit 14 determines that fraud has occurred if the personal authentication unit 18 does not authenticate the occupant detected in the first area, in other words, if the personal authentication unit 18 outputs a provisional determination result indicating that fraud has occurred.

An example of the operation of the fraud prevention device 1a according to the second embodiment will be described.
FIG. 11 is a flowchart for explaining an example of the operation of the fraud prevention device 1a according to the second embodiment.
With regard to the specific processing contents of the anti-fraud device 1a shown in the flowchart shown in Figure 11, the same step numbers are used for those that are similar to the specific processing contents of the anti-fraud device 1 described in embodiment 1 using the flowchart shown in Figure 3.
For example, when the vehicle's power supply is turned on, the anti-fraud device 1a starts the operation shown in the flowchart of Fig. 11. When the vehicle's power supply is turned on, the control unit of the anti-fraud device 1a causes the image acquisition unit 11, the detection unit 12, the provisional fraud determination unit 13, the fraud determination result confirmation unit 14, the test result acquisition unit 15, the drinking determination unit 16, the interlock unit 17, and the personal authentication unit 18 to start processing.
The fraud prevention device 1a repeats the operations shown in the flowchart of Fig. 11 until, for example, the vehicle interlock is released or instruction information instructing the suspension of the breathalyzer test is input. When the control unit of the fraud prevention device 1a acquires the instruction information, it causes the image acquisition unit 11, the detection unit 12, the provisional fraud determination unit 13, the fraud determination result confirmation unit 14, the test result acquisition unit 15, the drinking determination unit 16, the interlock unit 17, and the personal authentication unit 18 to terminate processing.

The image acquisition unit 11 acquires a captured image from the imaging device 2 (step ST10).
The image acquisition unit 11 outputs the acquired captured image to the detection unit 12 and the fraud determination result confirmation unit 14 .

The detection unit 12 performs detection processing based on the captured image acquired by the image acquisition unit 11 in step ST10 (step ST20).

The provisional fraud determination unit 13 performs a provisional fraud determination process based on the first detection result and the second detection result output from the detection unit 12 in step ST20 (step ST30).
The provisional fraud determination unit 13 outputs the provisional fraud determination result to the personal authentication unit 18 .
In addition, if the provisional fraud judgment unit 13 provisionally judges that there is no fraud as a result of performing the provisional fraud judgment process, it outputs output control information to the output device 3 to cause it to display or output audio prompting the user to blow air into the detection device.
When the output control information is output from the anti-tamper device 1, the output device 3 displays or outputs a voice to prompt the test occupant to blow into the detection device. In response to this, the test occupant blows into the detection device and performs the alcohol test.

If the provisional fraud determination section 13 provisionally determines that there is no fraud, the personal authentication section 18 performs a personal authentication process (step ST35).
The personal authentication unit 18 outputs the provisional judgment result to the fraud judgment result confirmation unit 14 .

The fraud determination result confirming section 14 performs a fraud determination result confirming process (step ST40-1).
The fraud determination result confirming unit 14 outputs the fraud determination result to the interlock unit 17 .

The test result acquisition unit 15 acquires the test result information from the detection device, and the drinking alcohol determination unit 16 determines whether the test participant is in a drunk state based on the test result information acquired by the test result acquisition unit 15 (step ST40-2).
The drinking determination unit 16 outputs the drinking determination result to the interlock unit 17 .

The interlock unit 17 decides whether or not to release the interlock in the vehicle based on the result of the determination of the presence or absence of fraud by the fraud determination result determination unit 14 in step ST40-1 (i.e., the fraud determination result) and the result of the determination of whether or not the test occupant is in a drunk state by the drinking judgment unit 16 in step ST40-2 (i.e., the drinking judgment result) (step ST50).

FIG. 12 is a flowchart for explaining the details of the process of step ST35 in FIG.
As a result of the fraud provisional judgment process performed by the fraud provisional judgment unit 13 in step ST30 of FIG. 11, it is judged whether or not a provisional judgment has been made that there is fraud (step ST131).

If the provisional fraud determination unit 13 provisionally determines that there is no fraud ("NO" in step ST131), the personal authentication unit 18 performs personal authentication of the occupant detected in the first area (step ST132).
If the personal authentication is successful (YES in step ST132), the personal authentication unit 18 maintains the provisional judgment result that the fraud provisional judgment unit 13 provisionally judged that there was no fraud (step ST133). The personal authentication unit 18 outputs the provisional judgment result output from the fraud provisional judgment unit 13 to the fraud judgment result confirmation unit 14.

If the provisional fraud determination unit 13 determines in step ST30 of FIG. 11 that a provisional determination has been made that there is fraud (if "YES" in step ST131), or if personal authentication is not possible (if "NO" in step ST132), the personal authentication unit 18 provisionally determines that there is fraud (step ST134) and outputs a provisional determination result indicating that there is fraud to the fraud determination result confirmation unit 14.

In addition, in the anti-fraud device 1a of embodiment 2, similar to the anti-fraud device 1 of embodiment 1, for example, when an occupant imaged in the first area is detected, a provisional fraud judgment process may be initiated, and if the provisional fraud judgment process determines that there is only one occupant detected in the first area, an occupant imaged in the second area may be detected.
In this case, the operation example of the anti-fraud device 1a is an operation example in which the processing of step ST35 described in the flowchart shown in FIG. 11 is added after the processing of step ST113 and the processing of step ST114 and before the processing of step ST40-1 and the processing of step ST40-1 in the flowchart shown in FIG. 7 already described in embodiment 1.
The anti-fraud device 1a detects the second area and detects an occupant in the second area only if the fraud provisional judgment unit 13 determines that there is only one occupant detected in the first area, thereby preventing unnecessary processing from being executed and reducing the processing load.

In this way, the anti-fraud device 1a detects an occupant (more specifically, the occupant's face) imaged in a first area around the headrest of the driver's seat in an image captured by the imaging device 2 provided in a vehicle so as to be able to capture at least the area around the driver's seat including the foot area, and an occupant (more specifically, the occupant's face or head) imaged in a second area in the image captured that is below the headrest of the driver's seat and includes the area around the driver's seat. The anti-fraud device 1 detects the occupant imaged in the second area by a method that is different from the method for detecting the occupant imaged in the first area and that is capable of detecting the presence of the occupant even if the occupant's face is not imaged in a recognizable manner.
The anti-fraud device 1a then performs a provisional fraud determination process, and if one occupant is detected in the first area and no occupant is detected in the second area, it provisionally determines that there is no fraud.
Furthermore, if the anti-tampering device 1a provisionally determines that no tampering has occurred, it performs personal authentication of the occupant detected in the first area.
When the anti-fraud device 1a performs personal authentication on the occupant detected in the first area, and detects the face of the test-performing occupant performing the action of conducting an alcohol test based on the captured image and compares the face of the test-performing occupant with the face of the occupant detected in the first area, if it is inferred that the test-performing occupant and the occupant detected in the first area are the same person, it determines that there is no fraud.
In this way, the fraud prevention device 1a can prevent fraud in a breathalyzer test administered to a driver of a vehicle. In detail, the fraud prevention device 1a can prevent a passenger other than the driver from impersonating the driver in a breathalyzer test administered to a driver of a vehicle, thereby preventing the driver from evading the breathalyzer test.
For example, even if a driver changes his/her position while sitting in the driver's seat, and a passenger other than the driver positions his/her face where the driver's face should be, and acts as if the passenger other than the driver is sitting in the driver's seat, impersonating the driver and conducting a breathalyzer test, making it impossible to extract the outline of the driver who has changed his/her position in the image captured of the driver's seat, the fraud prevention device 1a can detect the presence of the driver and prevent fraud.
In addition, when the fraud prevention device 1a performs the fraud provisional judgment process and provisionally judges that there is no fraud, it further performs personal authentication of the occupant detected in the first area, and if the personal authentication is successful and it is presumed that the occupant conducting the test and the occupant detected in the first area are the same person, it determines that there is no fraud.This makes it possible to more reliably prevent fraud in which an occupant other than the driver impersonates the driver in order for the driver to evade the alcohol breathalyzer test administered to the driver of a vehicle compared to when personal authentication is not performed.

For example, in the case where a vehicle is driven by only one person on a daily basis, the anti-fraud device 1a can be equipped with a personal authentication function as described above, which more reliably prevents fraudulent attempts by passengers other than the driver to pose as the driver and evade breathalyzer tests.
On the other hand, for example, when there is not a single person who drives the vehicle on a daily basis, or when there is a single person who drives the vehicle on a daily basis but other people may drive the vehicle, the fraud prevention device 1a has a personal authentication function, and therefore a situation may occur in which fraud is provisionally determined to be present even when there is no fraud, and then the fraud is confirmed to be present, and the interlock is not released. Therefore, when there is not a single person who drives the vehicle on a daily basis, or when there is a single person who drives the vehicle on a daily basis but other people may drive the vehicle, a situation in which a provisional determination of the presence or absence of fraud and a confirmation of the presence or absence of fraud are made without performing personal authentication, as in the fraud prevention device 1 according to embodiment 1, can more flexibly prevent fraud in a breathalyzer test administered to the driver of the vehicle, in which a passenger other than the driver impersonates the driver and the driver tries to slip through the breathalyzer test.

The hardware configuration of the anti-tamper device 1a according to the second embodiment is similar to the hardware configuration of the anti-tamper device 1 described in the first embodiment using Figures 9A and 9B, and therefore is not illustrated.
In the second embodiment, the functions of the image acquisition unit 11, the detection unit 12, the provisional fraud determination unit 13, the fraud determination result confirmation unit 14, the test result acquisition unit 15, the drinking determination unit 16, the interlock unit 17, the personal authentication unit 18, and a control unit (not shown) are realized by the processing circuit 1001. That is, the fraud prevention device 1a includes the processing circuit 1001 for performing control to prevent fraud in a breathalyzer test administered to a driver in a vehicle.
The processing circuitry 1001 may be dedicated hardware as shown in FIG. 9A, or may be a processor 1004 executing a program stored in a memory 1005 as shown in FIG. 9B.

The processing circuit 1001 reads out and executes the programs stored in the memory 1005, thereby executing the functions of the image acquisition unit 11, the detection unit 12, the fraud provisional determination unit 13, the fraud determination result confirmation unit 14, the test result acquisition unit 15, the drinking determination unit 16, the interlock unit 17, the personal authentication unit 18, and a control unit (not shown). That is, the fraud prevention device 1a includes a memory 1005 for storing a program that, when executed by the processing circuit 1001, results in the execution of steps ST10 to ST50 in FIG. 11 described above. It can also be said that the programs stored in the memory 1005 cause a computer to execute the procedures or methods of the image acquisition unit 11, the detection unit 12, the fraud provisional determination unit 13, the fraud determination result confirmation unit 14, the test result acquisition unit 15, the drinking determination unit 16, the interlock unit 17, the personal authentication unit 18, and a control unit (not shown).
The fraud prevention device 1a includes an input interface device 1002 and an output interface device 1003 that perform wired or wireless communication with devices such as an imaging device 2 or an output device 3.

In the above-described second embodiment, if the provisional fraud judgment unit 13 provisionally judges that there is no fraud as a result of performing the provisional fraud judgment process, it outputs output control information to the output device 3 to cause a display or audio output prompting the user to blow air into the detection device.
However, this is merely one example, and in embodiment 2, when the personal authentication unit 18 has completed personal authentication of the occupant imaged in the first area, it may output output control information to the output device 3 to cause a display or audio output prompting the occupant to blow air into the detection device.

In the second embodiment, the test result acquisition unit 15, the drinking alcohol determination unit 16, and the interlock unit 17 are provided in the anti-tampering device 1a.
However, the anti-tampering device 1a does not necessarily include the test result acquisition unit 15, the drinking determination unit 16, and the interlock unit 17. The test result acquisition unit 15, the drinking determination unit 16, and the interlock unit 17 may be provided in a device connected to the anti-tampering device 1a outside the anti-tampering device 1a, for example.

In addition, in the above-mentioned embodiment 2, the fraud prevention device 1a is an on-board device mounted on a vehicle, and the image acquisition unit 11, the detection unit 12, the provisional fraud judgment unit 13, the fraud judgment result confirmation unit 14, the test result acquisition unit 15, the drinking judgment unit 16, the interlock unit 17, the personal authentication unit 18, and a control unit (not shown) are provided in the on-board device.
Without being limited thereto, some of the image acquisition unit 11, detection unit 12, provisional fraud determination unit 13, fraud determination result confirmation unit 14, test result acquisition unit 15, drinking determination unit 16, interlock unit 17, personal authentication unit 18, and a control unit (not shown) may be mounted on an in-vehicle device of a vehicle, and the rest may be provided in a server connected to the in-vehicle device via a network, so that the fraud prevention system 100a is configured by the in-vehicle device, server, and image capture device 2. Also, the image acquisition unit 11, detection unit 12, provisional fraud determination unit 13, fraud determination result confirmation unit 14, test result acquisition unit 15, drinking determination unit 16, interlock unit 17, personal authentication unit 18, and a control unit (not shown) may all be provided in the server.

As described above, according to embodiment 2, the anti-fraud device 1a is equipped with a personal authentication unit 18 that performs personal authentication of the occupant detected in the first area when the provisional fraud judgment unit 13 provisionally judges that there is no fraud, and the fraud judgment result confirmation unit 14 is configured to determine that there is no fraud when the personal authentication unit 18 authenticates the occupant detected in the first area and detects the face of the test-performing occupant performing the operation of conducting an alcohol test based on the captured image acquired by the image acquisition unit 11 and compares the face of the test-performing occupant with the face of the occupant detected in the first area, and when it is presumed that the test-performing occupant and the occupant detected in the first area are the same person.
Therefore, when the fraud prevention device 1a performs a provisional fraud judgment process and provisionally judges that there is no fraud, it further performs personal authentication of the occupant detected in the first area, and if the personal authentication is successful and it is presumed that the occupant conducting the test and the occupant detected in the first area are the same person, it determines that there is no fraud.This makes it possible to more reliably prevent fraud in which an occupant other than the drivers impersonates the drivers and the drivers attempt to evade the alcohol breathalyzer test conducted on both drivers compared to when personal authentication is not performed.

In the fraud prevention device 1 according to the above embodiment 1 and the fraud prevention device 1a according to the above embodiment 2, the above-mentioned condition (1) is set as the provisional judgment condition used by the fraud provisional judgment unit 13 when performing the fraud provisional judgment process.
That is, in the above-mentioned first and second embodiments, the fraud provisional judgment unit 13 performs a fraud provisional judgment process to provisionally judge the presence or absence of fraud based on the presence or absence of an occupant detected in the first area or the second area, and if one occupant is detected in the first area and no occupant is detected in the second area, it provisionally judges that there is no fraud.
However, this is merely an example, and a condition other than the above-mentioned condition (1) may be set as the provisional determination condition.

For example, the provisional determination condition may be set to a condition such as the following condition (2).

Condition (2)
One occupant is detected in the first area, no occupant is detected in the second area, and a seat belt is captured in the second area.

That is, in the above-mentioned embodiment 1 or embodiment 2, the fraud provisional judgment unit 13 performs a fraud provisional judgment process, and if one occupant is detected in the first area, no occupant is detected in the second area, and an image of a seat belt is captured in the second area, it may make a provisional judgment that there is no fraud.
The fraud provisional determination unit 13 may, for example, perform a known image recognition process on the captured image of the second area based on the second detection result acquired from the second detection unit 122 to determine whether or not a seat belt is captured in the second area. In this case, the second detection unit 122 outputs, as the second detection result, for example, a detection result indicating whether or not an occupant is detected in the second area and coordinates indicating the second area in the captured image to the fraud provisional determination unit 13. The coordinates indicating the second area in the captured image are, for example, the coordinates of the four corners of the second area.
The fraud provisional judgment unit 13 may, for example, determine whether or not a seat belt is captured in the second region by performing pattern matching, or by using a machine learning model that takes an image as input and outputs information indicating whether or not a seat belt is captured in the second region of the image.

In this case, in the operation described using the flowchart shown in FIG. 5, for example, after step ST112 becomes "YES", the fraud provisional judgment unit 13 judges whether or not a seat belt has been imaged in the second area. If the fraud provisional judgment unit 13 judges that a seat belt has been imaged in the second area, it provisionally judges that there is no fraud (step ST113), and if it judges that a seat belt has not been imaged in the second area, it provisionally judges that there is fraud (step ST114).

By setting condition (2) in the provisional judgment condition, the fraud prevention device 1 or fraud prevention device 1a can make a stricter provisional judgment, for example, against impersonation of the driver by a passenger other than the driver, than when condition (1) is set in the provisional judgment condition. In other words, the fraud prevention device 1 or fraud prevention device 1a can make a provisional judgment on the presence or absence of fraud with greater accuracy.

In the above-described first or second embodiment, the provisional determination condition may be set to a condition such as the following condition (3).

Condition (3)
One occupant is detected in the first area, no occupant is detected in the second area, and the driver's seat belt is fastened.

That is, in the above-mentioned embodiment 1 or embodiment 2, the fraud provisional judgment unit 13 performs a fraud provisional judgment process, and if one occupant is detected in the first area, no occupant is detected in the second area, and the driver's seat belt is fastened, it may provisionally judge that there is no fraud.
The fraud provisional judgment unit 13, for example, acquires a status indicating the fastening status of the driver's seat belt from a seat belt sensor (not shown) installed in the vehicle, and determines that the driver's seat belt is fastened.

In this case, the fraud provisional judgment unit 13, in the operation described using the flowchart shown in FIG. 5, judges whether or not the driver's seat belt is fastened, for example, after step ST112 becomes "YES". If the fraud provisional judgment unit 13 judges that the driver's seat belt is fastened, it provisionally judges that there is no fraud (step ST113), and if it judges that the seat belt has not been imaged in the second area, it provisionally judges that there is fraud (step ST114).

In general, determining whether the seat belt is fastened based on information detected by a seat belt sensor will provide a more reliable determination result than determining whether the seat belt is fastened based on whether or not the seat belt is imaged based on a captured image.
By setting condition (3) in the condition for provisional judgment, the fraud prevention device 1 or 1a can make a more stringent provisional judgment against impersonation of the driver by a passenger other than the driver than when condition (2) is set in the condition for provisional judgment. In other words, the fraud prevention device 1 or 1a can make a provisional judgment on the presence or absence of fraud with greater accuracy.

Furthermore, in the above-described embodiment 1 or embodiment 2, the fraud prevention device 1 or fraud prevention device 1a may be configured to include a re-test execution unit 19 (see FIG. 13 described below) that, when predetermined requirements (hereinafter referred to as "re-test execution requirements") are satisfied, causes the detection unit 12 to detect an occupant in the first area, the detection unit 12 to detect an occupant in the second area, the fraud provisional judgment process by the fraud provisional judgment unit 13, and the fraud judgment result confirmation process by the fraud judgment result confirmation unit 14 to be performed again.

FIG. 13 is a diagram showing an example of the configuration of the fraud prevention device 1 including the recheck execution unit 19 in the first embodiment.
13 shows an example configuration of the anti-fraud device 1 in the first embodiment that includes the re-test execution unit 19, in other words, the example configuration of the anti-fraud device 1 in which the re-test execution unit 19 is added to the example configuration shown in Fig. 1, but in the second embodiment, the anti-fraud device 1a may also be configured to include the re-test execution unit 19. In this case, the example configuration of the anti-fraud device 1a is the example configuration of the anti-fraud device 1a shown in Fig. 10 to which the re-test execution unit 19 is added.

The retest execution requirement is set, for example, as the following retest execution requirement (1) or retest execution requirement (2). The retest execution requirement may have a plurality of requirements set, such as the following retest execution requirement (1) and retest execution requirement (2). The retest execution requirement is set in advance as appropriate, for example, by an administrator, and is stored in a location that can be referenced by the anti-tampering device 1 or the anti-tampering device 1a.

・Requirements for re-inspection (1)
The vehicle door was opened

・Requirements for re-inspection (2)
The driver's seat belt was unfastened

The re-inspection execution unit 19 may detect whether the vehicle door is opened or closed by acquiring information regarding the opening and closing of the door from a door sensor (not shown) mounted in the vehicle, for example.
In addition, the retest execution unit 19 may obtain information indicating the seat belt fastening state from a seat belt sensor in the driver's seat, for example, and detect that the seat belt in the driver's seat has been released.

In this case, in the fraud prevention device 1 according to embodiment 1, while performing the operation shown in the flowchart of FIG. 3 or the operation shown in the flowchart of FIG. 7, the retest execution unit 19 monitors whether or not a state in which the retest execution requirements are met has been reached, and if it determines that a state in which the retest execution requirements are met has been reached, it causes the detection unit 12 to detect an occupant in the first area, the detection unit 12 to detect an occupant in the second area, the fraud provisional judgment unit 13 to perform a fraud provisional judgment process, and the fraud judgment result confirmation unit 14 to perform a fraud judgment result confirmation process again. The fraud prevention device 1 repeats the operation shown in the flowchart of FIG. 3 or the operation shown in the flowchart of FIG. 7 from step ST10.

In this case, in the fraud prevention device 1a according to embodiment 2, the retest execution unit 19 monitors whether the retest execution requirements are met while performing the operations shown in the flowchart of FIG. 11, and if it determines that the retest execution requirements are met, causes the detection unit 12 to detect an occupant in the first area, the detection unit 12 to detect an occupant in the second area, the fraud temporary judgment process by the fraud temporary judgment unit 13, the personal authentication process by the personal authentication unit 18, and the fraud judgment result confirmation process by the fraud judgment result confirmation unit 14 to be performed again. The fraud prevention device 1a repeats the operations shown in the flowchart of FIG. 11 from step ST10.

In this way, the anti-fraud device 1 may be configured to include a re-examination execution unit 19 that, when the re-examination execution requirements are met, causes the detection of an occupant in the first area by the detection unit 12, the detection of an occupant in the second area by the detection unit 12, the fraud provisional judgment processing by the fraud provisional judgment unit 13, and the fraud judgment result confirmation processing by the fraud judgment result confirmation unit 14 to be performed again. The anti-fraud device 1a may also be configured to include a re-examination execution unit 19 that, when the re-examination execution requirements are met, causes the detection of an occupant in the first area by the detection unit 12, the detection of an occupant in the second area by the detection unit 12, the fraud provisional judgment processing by the fraud provisional judgment unit 13, the personal authentication processing by the personal authentication unit 18, and the fraud judgment result confirmation processing by the fraud judgment result confirmation unit 14 to be performed again.
In this way, the fraud prevention device 1 or the fraud prevention device 1a can detect fraudulent acts such as an occupant other than the driver impersonating the driver during the breathalyzer test, and can cause the breathalyzer test to be retaken. As a result, the fraud prevention device 1 or the fraud prevention device 1a can more accurately prevent fraud in the breathalyzer test administered to the driver in the vehicle. In detail, the fraud prevention device 1 or the fraud prevention device 1a can more accurately prevent fraudulent acts in the breathalyzer test administered to the driver of the vehicle, such as an occupant other than the driver impersonating the driver, so that the driver can evade the breathalyzer test.

The hardware configuration of the anti-tamper device 1 or anti-tamper device 1a including the recheck execution unit 19 is similar to the hardware configuration shown in Figures 9A and 9B, so it is not shown in the figures.
The function of the retest execution unit 19 is realized by the processing circuit 1001 .
The processing circuit 1001 executes the function of the recheck execution unit 19 by reading and executing a program stored in the memory 1005. That is, the fraud prevention device 1 or the fraud prevention device 1a includes a memory 1005 for storing a program that, when executed by the processing circuit 1001, results in the execution of steps ST10 to ST50 in FIG. 3 described above, steps ST10 to ST50 in FIG. 7 described above, or steps ST10 to ST50 in FIG. 11 described above. It can also be said that the program stored in the memory 1005 causes a computer to execute the procedure or method of the processing of the recheck execution unit 19.

Furthermore, it is possible to freely combine the embodiments, modify any of the components in each embodiment, or omit any of the components in each embodiment.

This can prevent fraud during breathalyzer tests administered to drivers in vehicles.

1, 1a: tamper-proof device, 11: image acquisition unit, 12: detection unit, 121: first detection unit, 122: second detection unit, 13: provisional tamper-proof determination unit, 14: tamper-proof determination result confirmation unit, 15: test result acquisition unit, 16: drinking determination unit, 17: interlock unit, 18: personal authentication unit, 19: retest execution unit, 100: tamper-proof system, 2: imaging device, 3: output device, 1001: processing circuit, 1002: input interface device, 1003: output interface device, 1004: processor, 1005: memory.

Claims (12)

an image acquisition unit that acquires an image captured by an imaging device that is provided in a vehicle and is capable of capturing an image of at least the periphery of a driver's seat including a foot area;
a detection unit that detects, based on the captured image acquired by the image acquisition unit, an occupant who is imaged in a first region around a headrest of the driver's seat in the captured image, and an occupant who is imaged in a second region below the headrest of the driver's seat in the captured image and including an area at the feet of the driver's seat;
a fraud provisional determination unit that performs a fraud provisional determination process for provisionally determining the presence or absence of fraud based on the presence or absence of the occupant detected in the first area or the presence or absence of the occupant detected in the second area, and provisionally determines that there is no fraud when one occupant is detected in the first area and no occupant is detected in the second area;
a fraud determination result confirmation unit that performs a fraud determination result confirmation process to confirm the result of the determination of the presence or absence of fraud, and when the fraud provisional determination unit has provisionally determined that there is no fraud and, as a result of detecting a face of a test-performing occupant who is performing an operation to perform an alcohol test based on the captured image acquired by the image acquisition unit and comparing the face of the test-performing occupant with the face of the occupant detected in the first area, determines that there is no fraud when it is presumed that the test-performing occupant and the occupant detected in the first area are the same person,
The anti-fraudulent device, characterized in that the detection unit detects the occupant imaged in the second area by a method different from a method for detecting the occupant imaged in the first area. The anti-tamper device according to claim 1 , wherein the detection unit detects the presence of the occupant when the head of the occupant is detected in the second area. The anti-fraud device according to claim 1 or 2, wherein the detection unit detects the face of the occupant imaged in the first area and the face or head of the occupant imaged in the second area. The fraud prevention device described in any one of claims 1 to 3, characterized in that the fraud provisional judgment unit performs the fraud provisional judgment process and provisionally judges that there is no fraud if one occupant is detected in the first area, no occupant is detected in the second area, and a seat belt is imaged in the second area. The fraud prevention device described in any one of claims 1 to 4, characterized in that the fraud provisional judgment unit performs the fraud provisional judgment process, and provisionally judges that there is no fraud if one occupant is detected in the first area, no occupant is detected in the second area, and the seat belt of the driver's seat is fastened. a drinking judgment unit that judges whether the test-taking occupant is in a drunk state based on test result information indicating an alcohol test result obtained by the alcohol test taken by the test-taking occupant;
An anti-fraud device as described in any one of claims 1 to 5, comprising an interlock unit that determines whether or not to release the interlock in the vehicle based on the determination result of the fraud determination result determination unit as to whether or not there is fraud and the determination result of the drinking alcohol determination unit as to whether the test occupant is in a drunk state. The interlock portion is
release the interlock when the fraud determination result determination unit determines that there is no fraud and the drinking alcohol determination unit determines that the test-carrying occupant is not drinking alcohol;
The fraud prevention device as described in claim 6, characterized in that if the fraud determination result determination unit does not determine that there is no fraud, or if the drinking alcohol determination unit determines that the test-administering occupant is in a drunk state, the interlock is continued. a personal authentication unit that performs personal authentication of the occupant detected in the first area when the fraud provisional determination unit provisionally determines that there is no fraud,
The fraud prevention device described in any one of claims 1 to 7, characterized in that when the personal authentication unit authenticates the occupant detected in the first area, and when the face of the test-performing occupant performing the operation of conducting the alcohol test is detected based on the captured image acquired by the image acquisition unit, and the fraud determination result confirmation unit compares the face of the test-performing occupant with the face of the occupant detected in the first area, it is presumed that the test-performing occupant and the occupant detected in the first area are the same person, and then determines that there is no fraud. An anti-fraud device as described in any one of claims 1 to 8, characterized in that it is equipped with a re-examination execution unit that detects the opening and closing of a door of the vehicle, and when it detects that the door is opened, detects the occupant in the first area by the detection unit, detects the occupant in the second area by the detection unit, performs the fraud provisional judgment processing by the fraud provisional judgment unit, and the fraud judgment result confirmation processing by the fraud judgment result confirmation unit again. The fraud prevention device described in any one of claims 1 to 8, characterized in that it is equipped with a re-examination execution unit that detects the state of the seat belt of the driver's seat, and when it detects that the seat belt of the driver's seat has been released, detects the occupant in the first area by the detection unit, detects the occupant in the second area by the detection unit, performs the fraud provisional judgment processing by the fraud provisional judgment unit, and the fraud judgment result confirmation processing by the fraud judgment result confirmation unit again. An image acquisition unit acquires an image captured by an imaging device provided in a vehicle so as to be able to capture an image of at least the area around a driver's seat including a foot area;
a detection unit detecting, based on the captured image acquired by the image acquisition unit, an occupant who is imaged in a first region around a headrest of the driver's seat in the captured image and an occupant who is imaged in a second region below the headrest of the driver's seat in the captured image and including an area at the feet of the driver's seat;
a fraud provisional determination unit performing a fraud provisional determination process for provisionally determining the presence or absence of fraud based on the presence or absence of the occupant detected in the first area or the presence or absence of the occupant detected in the second area, and provisionally determining that there is no fraud when one occupant is detected in the first area and no occupant is detected in the second area;
a fraud determination result determination unit performing a fraud determination result determination process for determining the result of the determination of the presence or absence of fraud, and when the fraud provisional determination unit provisionally determines that there is no fraud and detects a face of a test-performing occupant performing an action to perform an alcohol test based on the captured image acquired by the image acquisition unit and compares the face of the test-performing occupant with the face of the occupant detected in the first area, when it is estimated that the test-performing occupant and the occupant detected in the first area are the same person, determining that there is no fraud,
The fraud prevention method, characterized in that the detection unit detects the occupant imaged in the second area by a method different from a method for detecting the occupant imaged in the first area. An anti-tamper device according to any one of claims 1 to 10;
and an imaging device provided in the vehicle for imaging an area around the driver's seat in the vehicle, the area including at least the foot area.

Images