JP4666202B2 - Automobile equipment remote control system - Google Patents

Description

  The present invention relates to a vehicle equipment remote control system.

JP 2003-151088 A

  When a parking lot user wants to park his car in any of the multiple parking lots, then go to the destination and return to the parking lot to get on again You may forget whether you parked your car in the parking lot and find it difficult to find your car. In Patent Document 1, a radio transmission device and a radio reception device are lent to a user of an automobile and the transmission device is attached to the automobile side, while the user carries the reception device and a radio signal processing system on the parking lot side There has been proposed a parking management system that restores a moving route of a car at the time of parking by analyzing communication information by transmitting the information to a receiving device on the user side and guides the user to a parking position.

  However, the above-mentioned system has the advantage that the user can be surely guided to the parking position in the parking lot where the infrastructure for analyzing the parking route is established, but the effect is completely expected in the parking lot where the infrastructure is not established. However, there is a drawback that capital investment is expensive.

  In addition, lighting and horns (horns) that are typically installed on the car side can be expected to be effective in assisting the user's physical approach to a parked car, No consideration is given to its utilization. For example, a wireless key entry system that remotely performs key operation of an automobile is widespread. For example, when a lock is released or unlocked, a user is notified of an operation state by a lighting pattern such as a hazard lamp. In addition, a function has been put into practical use in which the interior lighting is turned on at the same time as the key operation, and the ride at night is taken into consideration. However, the operation of the wireless key entry system as described above is controlled by direct and unidirectional radio wave transmission from the radio key side to the automobile side, so the radio wave reach is short (about several meters at most) It is impossible to expect an effect of finding a parked vehicle farther than the reachable range or assisting a user who approaches the parked vehicle from a distance.

  The problem of the present invention is that even when the user is present at a relatively distant position with respect to the parked automobile, the automobile-side equipment including the lighting and the sound wave generator can be remotely operated, and thus the parking position can be notified. An object of the present invention is to provide an automobile equipment remote control system that can effectively utilize the automobile-side equipment for guidance to a user's parking position.

Means for Solving the Problems and Effects of the Invention

In order to solve the above problems, the automobile equipment remote control system of the present invention
A vehicle-side communication means that is provided in the vehicle and communicates with an external terminal device via a wireless communication network;
A user-side terminal device having terminal-side communication means that is carried by a user of an automobile and communicates with the automobile-side communication means via a wireless communication network;
It is provided on the vehicle side , and when operating command information is received from the user side terminal device via the vehicle side communication means, it is configured so that a user installed in the vehicle and existing outside the vehicle can directly recognize the output information. A perceptual output facility control means for operating a perceptual output facility comprising at least one of a lighting device or a sound wave generator,
The perceptual output facility control means is premised on setting the output operation pattern of the perceptual output facility to be changeable for each user.

  In the present invention, the user-side terminal device corresponds to an operation control input unit such as a lighting device and a sound wave generator mounted on a car. Then, the operation command information is transmitted to the vehicle side via the wireless communication network, and the lighting device that generates light or sound waves that can be recognized from outside the vehicle and the sound wave generation device are remotely operated on the vehicle side that has received the operation command information. I made it. Via the communication network, it is possible to operate the lighting device and the sound wave generator even for a vehicle that exists in a position where radio wave entry cannot be expected in the wireless key entry system. The perceptual output facility can be effectively used for guidance to the parking position.

  In addition, when the user's automobile is located far away such that the output (light and sound) of the perceptual output facility cannot be recognized, it is useless to operate the perceptual output facility on the automobile side. Even though there is no sign of approaching, it is annoying to the surroundings that the lighting of the car and horn etc. continue to operate, and it also gives an eerie impression to passers-by etc., and it is mistaken for malfunction and reported The later response is troublesome. Therefore, in the system according to the present invention, the perceptual output facility control means is configured such that the output of the perceptual output facility is visually recognized by the user or the user is in a state where the distance between the user-side terminal device carried by the user and the automobile is below a certain level. It is desirable to be configured to operate in a audible state.

Further, the vehicle equipment remote control system of the present invention includes a vehicle position specifying means for specifying the position of the vehicle and a terminal device for specifying the position of the user-side terminal device, which are installed in the peripheral equipment of the vehicle or the parked vehicle. position and an identification means, sensory output equipment control means based on the position information of the car and the user terminal device for specifying the position specifying means, whether the distance between the user-side terminal and the vehicle approaches the predetermined value or less Can be configured to recognize. By identifying the positions of the automobile side and the user side terminal device side, the distance between the user side terminal device and the automobile can be quantitatively grasped, and the operation control of the perceptual output equipment according to the distance is more accurately performed. Can be done. The position specifying means can be configured by, for example, a well-known GPS (Global Positioning System) device. With GPS, radio waves carrying positioning data (hereinafter referred to as positioning radio waves) are transmitted from the multiple artificial satellites (U.S. military satellites) that orbit the earth in different orbits toward the ground surface. The position of the receiver on the earth can be specified by receiving and analyzing positioning data from three or more of these artificial satellites.

Specifically, the perceptual output facility control means sets the distance between the user-side terminal device and the vehicle to a certain value or less based on the position information of the vehicle and the user-side terminal device and the access area information for the other wireless communication network. It can be configured to recognize whether or not they are approaching . In other words, since both the automobile and the user side terminal device are connected to the communication network by accessing the radio base station by radio waves, if the radio base station can be identified, the automobile and the user are within the access area covered by the radio base station. It can be easily grasped that the terminal device is present. Therefore, the distance between the user-side terminal device and the automobile can be grasped based on the information and the other position information by the position specifying means.

  On the other hand, the perceptual output facility control means recognizes whether or not the distance between the user side terminal device and the vehicle has approached a certain level or less based on the position information of both the vehicle and the user side terminal device (by the position specifying means). It can also be configured as a thing. If it does in this way, if the position of a car and a user side terminal unit is specified individually by the above-mentioned position specifying means, the distance between a user side terminal unit and a car can be grasped more correctly.

  The perceptual output equipment control means is configured to output the perceptual output equipment to notify the user of the parking position of the car when the distance between the user side terminal device and the car approaches a predetermined distance or less. Can be configured. As a result, when the parking position is forgotten in a large-scale parking lot or the like, the user side terminal device sends operation command information to the vehicle, so that the vehicle causes the lighting device to emit light, or the sound generator generates a notification sound. By outputting, it is possible to effectively inform the user of the parking position of the automobile, and the user can easily grasp the position of his / her automobile which is lost due to the output. Moreover, a public communication network can be used as a wireless communication network, and there is an advantage that the communication infrastructure on the parking lot side is not required as in Patent Document 1.

  When using the present invention for grasping the parking position, it is desirable to set the distance within a range of 100 m to 400 m. The above-mentioned distance for determining whether or not to notify the parking position is sufficiently large that the distance to a lost car can exceed 100m in a large parking lot such as a suburban supermarket. There is a possibility that the effect of the present invention relating to position grasping cannot be enjoyed. On the other hand, when the distance exceeds 400 m, even if the perceptual output equipment is operated when the distance is maximized, the illumination light and sound waves are difficult to reach the user, and the operation is wasted. In order to avoid it, it is annoying to the surroundings to emit strong illumination light and sound waves.

  When illumination light is used as the perceptual output facility, the user's car may be behind other cars or obstacles in a parking lot or the like, and the user may not be able to recognize the notification content by illumination. In such a case, sound wave notification by blowing a horn or a buzzer is effective. In this case, if the blowing pattern is output as a pattern that changes regularly, such as an intermittent sound or a combination of a long sound and an intermittent sound, the blowing pattern for parking position notification can be easily identified with respect to other sound waves. . In addition, the perceptual output facility control means is also effective from the viewpoint of facilitating the understanding of the parking position at a distant place, by notifying the user of the parking position of the automobile by combining the outputs of both the lighting device and the sound wave generator. .

  As a sound wave generator, it is particularly advantageous to use a horn provided in an automobile in terms of securing sound volume necessary for parking position notification. In addition, it is advantageous to use at least one of an automobile headlamp, a hazard lamp, and an interior illumination as an illumination device from the viewpoint of securing a light amount necessary for parking position notification.

The perceptual output equipment control means includes user approach direction detecting means for detecting the relative approach direction of the user with respect to the vehicle, and operates the perceptual output equipment capable of output operation in the approach direction. be able to. By appropriately selecting the perceptual output equipment to be operated according to the approaching direction of the user , it becomes easier for the user to grasp the direction of the entrance / exit of the car, etc., and the effect of guiding the user toward the car Is also expensive. When performing such operations, it is particularly advantageous to use a lighting device as the perceptual output facility from the viewpoint of illuminating the approach to the vehicle and guiding the user to the vehicle safely. Specifically, an illuminating device including at least one of a head lamp, a fog lamp, a hazard lamp, a cornering lamp, a side lamp, a tail lamp, a stop lamp, a backup lamp, and an in-vehicle lamp provided in a vehicle. Can be used.

  In addition, when the number of vehicles adopting the system of the present invention increases, another car that uses the same system in the same parking lot may encounter each other, and these simultaneously operate the perceptual output facility for parking position notification. Then, there is a fear that it is impossible to identify which is the notification output of the own car. Therefore, if the perceptual output facility control means is set so that the output operation pattern for informing the parking position of the perceptual output facility can be changed, the output operation pattern unique to the user can also be set. Can be increased.

In multistory parking lots, etc., in addition to flat parking position information, position information in the height direction such as floors is also added, and if you forget the parking position including that, even more difficult Will be forced. Therefore, the height direction information of the parking position of the vehicle is acquired from the height direction information specifying means for specifying the height direction information of the vehicle provided on the vehicle side or the parking facility side of the vehicle. It is effective to provide a height direction information acquisition means for the parking position, and to provide a height direction information output unit for outputting the height direction information received from the vehicle side via the terminal side communication means in the user side terminal device. is there. As a result, it is possible to assist the user in grasping the three-dimensional parking position, and to easily reach the forgotten parking position even in a three-dimensional parking lot or the like. As the height direction information specifying means, for example, a barometer or the like can be adopted, or a floor information receiving device that receives floor information from a transmitting device provided on a building side such as a multilevel parking garage can be used. it can. On the other hand, the above-mentioned GPS can also generate positioning freedom in the height direction by receiving positioning radio waves from four or more satellites, which can also be used as height direction information specifying means. is there.

  In the unlikely event that the user side terminal device is lost or stolen, if the third party outputs the operation command information from the user side terminal device, the user's car will be in the parking position (that is, , If there is a car). This is something that bothers me to say "My car is here, so please steal it" and there are many security issues. In particular, when the user-side terminal device is also used as a lock operation unit of an automobile, the user-side terminal device that has been picked up may open the vehicle without permission and steal an in-vehicle product. Therefore, in order to prevent this, a personal authentication means for personally authenticating the user is provided in the user side terminal device, and the above-described operation command information can be output only when the authentication is accepted. Is desirable.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. FIG. 1 is a conceptual block diagram of an automotive equipment remote control system (hereinafter also simply referred to as “system”) 1000 showing an embodiment of the present invention. The system 1000 includes a wireless communication device 501 that constitutes vehicle-side communication means, and a communication device 323 (terminal-side communication means) that is carried by the user of the vehicle and that communicates with the vehicle-side communication means via the wireless communication network 1170. When the operation command information is received from the user terminal device 1 via the communication devices 501 and 323, the lighting devices 504 to 512 mounted on the vehicle and sound wave generation are provided. It comprises a perceptual output facility control unit (means) 50 for operating a perceptual output facility comprising at least one of the devices 502 and 503.

  The main part of the perceptual output equipment control unit 50 includes a vehicle position determination control unit 1100, a user approach determination control unit 1110, and a function selection control unit 1120, each of which stores a CPU and a ROM that stores a function realization program that will be described in detail. And a microprocessor having a RAM serving as an execution area thereof. A communication device 501, a wireless tuner 531, and a GPS 532 are connected to the vehicle position determination control unit 1100. The content received by the communication device 501 is also input to the user approach determination control unit 1110.

  In this embodiment, the user side terminal device 1 is configured as a mobile phone. As shown in FIG. 1, an information determination unit 310 composed of a microprocessor, an input / output unit 311 connected thereto, a display unit (liquid crystal panel) 542 and a sound generation unit connected to the input / output unit 311 (Although it is a buzzer in the present embodiment, it can be substituted by a ring tone generator of a cellular phone).

  The vehicle position determination control unit 1100 can acquire the position information from the GPS provided on the peripheral equipment (for example, a building such as a home or a garage) 1160 side of the car parking position via the wireless communication network 1170, for example. it can. In addition, the position information of the automobile can be acquired autonomously by the GPS 532 connected to itself. Since the configuration of GPS is well known, detailed description thereof is omitted.

  The position information of the automobile is used to specify the distance between the user-side terminal device 1 and the automobile, and the approaching direction of the user carrying the terminal device 1 with respect to the automobile. Since the user side terminal device 1 configured as a mobile phone is connected to the communication network 1170 via the nearest radio base station 1171, the radio base station 1171 stores the radio base station 1 in the communication information from the user side terminal device 1. The position specifying information of the station 1171 is added and transferred to the vehicle position determination control unit 1100. As a result, the vehicle position determination control unit 1100 uses the GPS 532 (or the GPS on the peripheral equipment 1160 side) and the position of the nearest radio base station 1171 accessed by the user side terminal device 1 based on the user side. The distance between the terminal device 1 and the automobile and the relative orientation of the user terminal device 1 with respect to the automobile can be grasped.

  However, in order to grasp the distance and azimuth relationship between the user side terminal device 1 and the car more accurately, the user side terminal device 1 autonomously obtains its position information by providing the user side terminal device 1 with the GPS 554. It is desirable to adopt a method in which the terminal position information is transmitted to the vehicle position determination control unit 1100 via the wireless communication network 1170. As a result, the vehicle position determination control unit 1100 can acquire both the accurate vehicle position by the GPS 532 connected to the vehicle position and the accurate terminal position by the GPS 554 received from the user side terminal device 1. Since the distance and orientation relationship between the vehicle and the vehicle can be grasped very accurately, and the distance change and the approach direction change between the user terminal device 1 and the vehicle can be grasped in real time, the lighting devices 504 to 512 and The operation control of the sound wave generators 502 and 503 can be performed more finely.

  The positional information between the user-side terminal device 1 and the vehicle specified by the vehicle-side GPS 532 and the terminal-side GPS 554 indicates that the distance and azimuth relationship between the two when the user-side terminal device 1 is relatively far from the vehicle. This is useful for grasping roughly. For example, when the vehicle parking position is lost in a parking lot or the like, when the above distance is reduced to a distance (for example, 100 m or more and 400 m or less), the outputs of the lighting devices 504 to 512 and the sound wave generation devices 502 and 503 It can be effectively utilized for control for notifying the user of the parking position of the automobile. In addition, the vehicle parking position grasped on the vehicle position determination control unit 1100 side is wirelessly transmitted to the user terminal device 1, and the terminal position and the vehicle parking position are displayed on the display unit 542 of the user terminal device 1 as a map. Alternatively, the parking position grasp support information may be displayed such as displaying the parking direction and distance.

  On the other hand, the user approach determination control unit 1110 is connected with various sensors for detecting the positional relationship with the car in more detail when the user carrying the user side terminal device 1 further approaches the car. Yes. The main parts are human sensors 522 to 525 which are arranged at each seat position and detect which seat the user is approaching (in FIG. 1, the driver seat sensor 522, the passenger seat sensor 523, the left rear seat) Sensor 524 and right rear seat sensor 525 are provided, but more may be provided as shown in FIGS. In addition, a camera 521, an infrared sensor 526, a sonar 527, an ingress sensor 528, and the like are similarly connected for in-vehicle security monitoring.

  On the other hand, a horn 502 and a buzzer 503 are connected to the function selection control unit 1120 as the sound wave generator 3. Further, as a lighting device (lamps), a head lamp 504 (beam can be switched between high and low), fog lamp 505, hazard lamp 506, tail lamp 507, cornering lamp 508, backup lamp 509, stop lamp 510, interior lighting 511 and an underfloor lamp 512 are connected. These operations are controlled according to a pattern described by a control program stored in the ROM of the function selection control unit 1120. The operation pattern can be variously set by changing the contents of the control program by the customization unit 1130.

  FIG. 11 is an external perspective view showing an example of a user terminal device 1 (hereinafter also referred to as a mobile phone 1) configured as a mobile phone. The mobile phone 1 is provided with a receiver 303 on the upper side of the main body and a transmitter 304 on the lower side, and a liquid crystal display device (for example, a color liquid crystal display device) between the two. An on-hook / off-hook switch 306 that switches the liquid crystal monitor 308, the input unit 305, and the mobile phone 1 between an on-hook state and an off-hook state is provided. In the present embodiment, the mobile phone 1 can access not only a line telephone communication network but also an information communication network such as the Internet. The input unit includes a call dial key 305a that is also used as an information input keyboard, a cursor movement key 305b, and a mode switching key 305c for switching use modes such as a call mode and an information search mode.

  The transmitter 304 is composed of a microphone that also serves as an air conduction sound detection unit. On the other hand, the handset 303 is constituted by a bone conduction speaker in the present embodiment, and a bone conduction microphone 340 as a bone conduction sound detecting unit is disposed in the vicinity thereof. The basic configuration of the bone conduction speaker is, for example, Japanese Patent No. 2967777 or Japanese Patent Laid-Open No. 2003-340370, and the basic configuration of the bone conduction microphone is, for example, Japanese Utility Model Laid-Open No. 55-146785, Japanese Patent Laid-Open No. 58-18297. Since it is well known in Japanese Patent Publication No. 63-173991 or Japanese Patent No. 34888749, detailed description is omitted. Both are used for the ear or the jawbone under the ear. All of these constitute an authentication feature information acquisition unit.

  In addition, the mobile phone 1 includes a face photographing camera 341, a surface contact sensor 343 that forms a contact-type biometric feature information detection unit, and a fingerprint detection unit 342 as other authentication feature information acquisition units. As shown in FIG. 11, the form of gripping the mobile phone 1 is almost the same as the basic form although there are variations among users. That is, four phones that are bent to the first side of the phone (left-handed for right-handed people, reverse for left-handed) so that the display unit 308 faces the inside of the hand MH While applying finger 14F, place the side part from the base of thumb MS to the lower half of the second side of the telephone (the left side for right-handed people, the opposite for left-handed people), and the thumb at the top half Hit the tip of. In order to avoid inadvertently touching the input unit 305 and to reduce the uncomfortable feeling that the fingertip hits the face, it is unconsciously held in this way. In the present embodiment, utilizing this, the fingerprint detection unit 342 is provided at a position where the tip of the thumb hits, and the surface contact sensors 343 are provided on both side surfaces.

  In the present embodiment, as shown in FIG. 13, as the surface-type contact sensor 343, a sheet in which a plurality of pressure-sensitive contacts SP that have already been described and whose contact resistance (or contact capacity) changes due to the pressing force is dispersedly arranged in the sheet. A pressure sensor module is used. The resistance value (pressure detection value) of each pressure-sensitive contact SP is digitally converted by a multi-bit signal, and pressure distribution information is obtained from the signal value of each pressure-sensitive contact SP. As a result, the pressure sensor distribution area PDP corresponding to the grasping pressing area by the four fingers other than the thumb is detected by the surface contact sensor 343 on the first side (here, left), and is detected on the second side (here, right). The surface contact sensor 343 detects a pressure-sensitive distribution area PDP corresponding to the grasping pressing area of the thumb (and the base of the thumb of the palm) in the pressure distribution. Since the shape (and pressure distribution state) of the pressure-sensitive distribution region PDP varies depending on the individual, it can be used as feature information.

  The face photographing camera 341 includes, for example, a CCD camera, and is displayed on the display unit 308 of the mobile phone 1 so that the face can be photographed when the face of the person to be authenticated and the display unit 308 are facing each other. Proximity is provided. This is because the face image for authentication must have a necessary part of the face within the field of view of the camera 341. Therefore, a finder image for photographing that is captured by the camera 341 is displayed on the display unit 308 and has a posture suitable for authentication. This is so that an image can be taken while confirming whether or not an image can be obtained (for example, as shown in FIG. 13, the face fits within a prescribed frame F in the display unit 308 and the line of sight is aligned with the reference line SL). is there. It is also possible to provide a retina photographing camera instead of the face photographing camera 341 and use the retina image as the authentication feature information. In addition to the retina image, an iris image can be taken and used as authentication feature information. When an iris image is used, collation / authentication is performed using the personality of the pattern and color. In particular, the iris pattern is an acquired component and has a low genetic influence, so there is a significant difference even in identical twins, and there is an advantage that it can be reliably identified. An authentication method using an iris pattern has features that it can quickly recognize and collate and has a low misidentification rate. The iris can be photographed using a normal camera. In this case, a dedicated camera may be provided instead of the face photographing camera 341, or an attachment for iris close-up photography is attached to the face photographing camera 341. It is also possible to attach and perform shooting.

  FIG. 12 is a block diagram showing an example of the electrical configuration of the mobile phone 1. The main parts of the circuit are an input / output unit 311 and a CPU 312 (which constitutes an authentication feature information acquisition control unit, an authentication processing unit, a verification unit, and a composite voice feature information calculation unit), a ROM 314, and a RAM 313 (bones) connected thereto. And a control unit 310 including a conduction voice information storage unit and an air conduction voice information storage unit. The input unit 305 and the on-hook / off-hook switch 306 are connected to the input / output unit 311. The receiver 303 is connected via an amplifier 315 and a D / A converter 316, the transmitter 304 is connected via an amplifier 317 and an A / D converter 318, and the bone conduction microphone 340 is connected to an amplifier 320 and an A / D converter. Each is connected to the input / output unit 311 via the H.321. Further, the GPS 554 and the sound output unit (buzzer or ringing tone output unit) 543 are also connected to the input / output unit 311.

  The input / output unit 311 is connected to the communication device 323 described above. The communication device 323 includes a connection interface 331 for connecting to the control unit 310, a modulator 332, a transmitter 333, a frequency synthesizer 334, a receiver 335, a demodulator 336, a duplexer 337, and the like connected thereto. ing. The data signal from the controller 310 is modulated by the modulator 332 and further transmitted from the antenna 339 via the duplexer 337 by the transmitter 333. On the other hand, the received radio wave is received by the receiver 335 via the antenna 339 and the duplexer 337, demodulated by the demodulator 336, and then input to the I / O port 311 of the control unit 310. When making a call, for example, an audio signal input from the transmitter 304 is amplified by the amplifier 317, further digitally converted by the A / D converter 318, and input to the control unit 310. The signal is processed by the control unit 310 as necessary, and then output from the receiver 303 via the D / A converter 316 and the amplifier 315.

  On the other hand, a control radio wave transmitter 338 that transmits a control radio wave P is connected to the connection interface 331. The control radio wave P is transmitted from the antenna 339 via the duplexer 337. When the mobile phone 1 moves to another communication zone, the network-side radio network controller performs a well-known handover process based on the reception status of the control radio wave P.

  The operation of the automobile facility remote control system (hereinafter also simply referred to as “system”) 1000 will be described below. First, FIG. 2 shows the flow of processing on the user terminal device (mobile phone) 1 side. In S200, an authentication input is performed to authenticate whether the operator is a car user. Details of this authentication process will be described later. In addition, if the user forgets the parking position of the automobile, after receiving the authentication, a parking position notification request is input from the input unit 305 in FIG. This input content is transmitted as operation command information from the communication device 323 to the perceptual output facility control unit 50 via the wireless communication network 1170 of FIG.

  In S210, it is determined whether the parking position information from the perceptual output facility control unit 50 can be received. If it can be received, the parking position information is acquired, the positional relationship (distance and relative direction) between the vehicle and the terminal is specified using the information acquired in S230, and this is displayed on the display unit 542 in S270. To do.

  In the process of FIG. 2, when a plurality of radio sources from the automobile side are utilized and parking position information cannot be obtained with a certain radio source, another radio source is used as an alternative method by S240, S250, S260, and S280. The parking position information can be acquired by using (However, as shown in FIG. 1, when GPS 532 and 554 are provided on both the automobile side and the user side terminal device 1 side, the position information by the respective GPS 532 and 554 is provided. Can be obtained without any problem, so that these steps can be omitted). In this case, if the parking position information from the perceptual output facility control unit 50 cannot be directly received in S210, the process proceeds to S240, and the reception of the output radio wave from the wireless tuner 531 mounted on the vehicle is performed by scanning the radio wave arrival direction. Try. In S250, it is determined whether or not a reference signal radio wave (described later) generated from the vehicle side can be received as a scan result. If it cannot be received, the process proceeds to S280, and it is determined that there is no vehicle capable of communication in the vicinity. A message is displayed on the display unit 542 (FIG. 1). On the other hand, if the reference signal radio wave can be received, the parking direction of the vehicle is recognized from the received intensity of the reference signal radio wave, and the process proceeds to S270 and the result is displayed on the display unit 542.

  Next, FIG. 3 shows the flow of main processing on the perceptual output facility control unit 50 side. In S1, an automobile position specifying process is performed, and it is checked in S2 whether a parking position notification request signal (operation command information) has been received from the terminal device 1. If it is received, the distance between the user (that is, the terminal device 1) and the car is checked, and if it is smaller than a certain distance (for example, a constant value set to 100 m or more and 400 m or less), the process proceeds to S4 and the position notification operation is performed. To do. On the other hand, if not approaching, the process returns to S1 to repeat the position specifying process. At this time, error information notifying that there is no vehicle within the above distance is returned to the terminal device 1 side (S6), and the terminal device 1 displays a message or the like notifying that there is no vehicle nearby based on the received content. You may make it display on 542 (FIG. 1). On the other hand, if the parking position notification request signal from the terminal device 1 is not received in S2, the process returns to S1 and repeats the position specifying process.

  FIG. 4 is a flowchart showing the flow of the position specifying process. In S300, it is confirmed whether or not the positioning information from the GPS 532 can be received. If it can be received, the process proceeds to S310 to receive the positioning information from the GPS, and the absolute position of the vehicle (for example, longitude and latitude display) is specified. . In combination with known map information, it may be converted into a position on the map and specified. On the other hand, if the positioning information from the GPS 532 cannot be received in S300, the process proceeds to S320, and for example, it is determined whether or not the positioning information from another GPS or the like mounted on the peripheral equipment in FIG. If it can be received, this is received in S330, and the process proceeds to S340 to specify the position of the vehicle. On the other hand, if the alternative positioning information cannot be received in S320, the process proceeds to S350 to notify the terminal device 1 that there is no information, and as the last means, the above-described reference signal is transmitted. As described above, the terminal device 1 attempts to specify the positional relationship with the automobile based on the reference signal.

  FIG. 5 shows the flow of the position notification operation. In the present embodiment, the output of both the lighting device and the sound wave generator is combined to notify the user of the parking position of the automobile. In addition, the output operation pattern for informing the parking position of the perceptual output facility can be set to be changeable in order to enhance identification as being unique to the user. First, in S11, a selected one is read out from a plurality of output operation patterns prepared in advance (stored in the ROM of the function selection control unit 1120). In the case of a multilevel parking lot, in S12, the floor information (height direction information: floor information acquired from the parking lot side) specified by GPS 532 (FIG. 1) based on positioning data from four or more satellites. And the floor information is transmitted to the terminal device 1. As shown in FIG. 11, the received floor information is displayed on the display unit 308 on the terminal device 1 side. On the terminal device 1 side as well, the floor information in which the terminal device 1 (that is, the user) exists is specified by the GPS 554 (FIG. 1). In this case, when the floor where the terminal device 1 exists and the parking floor are different, as shown in FIG. 11, floor information that makes it possible to grasp the difference may be displayed on the display unit 308. .

  And in S14, the output which alert | reports a parking position is performed by the various pattern which combined the illuminating device and the sound wave generator. In FIGS. 6 and 7, a horn 502 is used as a sound wave generator for parking position notification, and as a lighting device, a vehicle interior illumination 511 (it is easy to notice because the whole interior becomes bright), a head lamp 504 (lighting device). Is the brightest and has excellent information performance), a hazard lamp 506 (located on the front and back of the vehicle and in some cases on the side, and can be recognized from various directions because it flashes brightly) and a tail lamp 507 (most visible on the rear side of the car) From the viewpoint of lighting), an appropriately selected one is used.

  FIG. 6 shows an example in which the blinking pattern of each illumination and the sound pattern of the horn are both similar intermittent patterns, and the combinations of the types of illumination employed are variously changed. Note that the sounding of the horn and the lighting are alternately performed. On the other hand, FIG. 7 shows an example in which the pattern contents of lighting lighting and horn sounding are variously changed in addition to the combination of types of lighting employed.

  Returning to FIG. 5, the parking position notification output is continued in S14. In addition, a position notification operation stop signal is transmitted from the terminal device 1 to the perceptual output facility control unit 50 on the vehicle side by inputting an instruction to stop the position notification operation from the input unit 305 (FIG. 11) on the terminal device 1 side. Then, the position notification operation may be forcibly terminated on the perceptual output facility control unit 50 side receiving this.

  In addition, the approach direction with respect to a motor vehicle of a user (namely, terminal device 1) can be specified with reference to the detection information of the human sensors 522-525 of FIG. As the human sensors 522 to 525, for example, a sensor whose output changes according to the distance from the approaching person (for example, a laser reflection type distance sensor or a proximity sensor) can be used, and depending on which sensor strongly detects the person. It is possible to recognize whether the user is approaching the automobile from, for example, the front side, the rear side, or the side. Further, it is possible to recognize how close the user is to the automobile by the strength of the detection output.

  For example, if the approach direction is from the front, the front lamp group can be selectively operated. As shown in FIG. 8, a head lamp 504, a fog lamp 505, and a cornering lamp 508 are used as the front lamp group in this embodiment. If the approach direction is from the rear, the rear lamp group can be selectively operated. As shown in FIG. 9, a tail lamp 507, a backup lamp 509, and a stop lamp 510 are used as the rear lamp group in this embodiment. Further, if the approach direction is from the side, the side lamp group can be selectively operated. As shown in FIG. 10, a hazard lamp 506, a tail lamp 507, and an underfloor lamp 512 are used as the side lamp group in this embodiment.

  Note that it is possible to determine which sensor position (that is, the vehicle part) the user is approaching depending on which person sensor output is strong (that is, the user approach direction detection unit is configured). In this embodiment, in order to supplement this function, as shown in FIGS. 8 to 10, between the driver seat sensor 522 and the passenger seat sensor 523, between the left rear seat sensor 524 and the right rear seat sensor 525, An assistant sensor 550 is provided between the driver seat sensor 522 or the passenger seat sensor 523 and the left rear seat sensor 524 or the right rear seat sensor 525, respectively.

  As shown in FIG. 8, when the user approaches from the front of the automobile, the detection intensity of the assistant sensor 550 at the center in the vehicle width direction is the highest, and the headlamp 550 or the fog lamp 505 can be turned on using this. On the other hand, when the user moves toward the side of the vehicle and the detection intensity of the human sensors 522 to 523 at the end in the width direction increases, the corresponding one of the cornering lamps 508 is turned on.

  As shown in FIG. 9, when the user approaches from the rear of the automobile, the backup lamp 509, the tail lamp 507, or the stop lamp 510 can be turned on. Further, when the detection intensity of the assistant sensor 550 at the center of the vehicle is high, only the tail lamp 507 (or only the stop lamp 510) is turned on, the user moves toward the vehicle side, and the human sensor 524 at the end in the width direction. When the detection intensity at 525 is increased, the corresponding side of the backup lamp 509 can be lit.

  Further, as shown in FIG. 10, when the user approaches from the side of the automobile, the hazard lamp 506 or the plurality of underfloor lamps 512 can be selectively turned on. Further, when the detection strength of the assistant sensor 550 at the center in the vehicle length direction is the highest, only the center underfloor lamp 512 is turned on, the user moves in the vehicle length direction, and the detection strength of the human sensors 523 to 524 at the end portions. Can be switched to the lighting of the corresponding underfloor lamp 512. As the user approaches, the illumination area may be changed such that the illumination angle of the underfloor lamp 512 is changed to guide the user toward the automobile.

  Next, since the user side terminal device 1 shown in FIG. 11 is always carried and carried by the user even after getting out of the automobile, there is a possibility that the user side terminal device 1 may be lost or stolen. If the third party outputs the operation command information from the user side terminal device 1, the user's car notifies the irrelevant third party of the parking position (that is, the presence of the car). This is something that bothers me to say "My car is here, so please steal it" and there are many security issues. Since the user side terminal device 1 is configured as a mobile phone, even if the user does not use a car, the user carries the phone function and uses the phone function, so the probability of occurrence of the above problem is high. Further, a lock / unlock signal is wirelessly transmitted to the vehicle side by the operation of the input unit 305 in FIG. 11 so that the door lock unit 513 in FIG. Order is also possible). As a result, if the third party who picked up the user-side terminal device 1 is malicious, the user can easily open the car by operating the terminal device 1 and steal the car itself or in-car items. There is. In particular, in the case of the present invention, in order to make it easier for the user to forget the parking position, if the operation command information is transmitted from the user side terminal device 1 as described above, the location of the vehicle is determined by illumination or a horn (perceptual output equipment). It has come to let you know. However, when the user side terminal device 1 is in the hands of a malicious third party, if the operation command information can be easily transmitted, the third party who cannot originally know the parking position of the user's car In addition, it will bother to inform the parking position (that is, where the car is).

  Therefore, in order to prevent this, the user-side terminal device 1 is provided with a function of personal authentication means for personal authentication of the user. As described above, the above-described operation is performed only when the authentication is accepted. The command information (of course, the unlocking command of the car to the door lock unit 513) can be output.

  Hereinafter, a configuration example of the authentication function unit will be described. In this embodiment, when the person who is subject to authentication processing holds the mobile phone in the same state as when the telephone function other than the authentication process is used, the hand of the person subject to authentication processing touches. A contact-type biometric feature information detection unit that detects biometric feature information of the hand provided at a position where the mobile phone is held in the phone usage grasp holding state by the person to be authenticated. A camera for photographing a face provided at a position where the subject's face can be photographed, a bone conduction sound detection unit for detecting voice information of the person to be authenticated by bone conduction sound, and air information of the person to be authenticated. An authentication feature information acquisition unit including two or more selected from the group consisting of an air conduction sound detection unit that detects by sound, and two or more authentication feature information acquisition units in a state where the telephone use is held Acquisition of authentication feature information by At least two things are executed at the same time, based on the individual authentication feature information acquired by each of the two or more authentication feature information acquisition units, the authentication process target person is authenticated, and the authentication feature information is acquired. If the specified at least two authentication feature information acquisition units are not performed at the same time, acceptance authentication of the person to be authenticated is not performed.

  In the ROM 314 of the user terminal device 1 shown in FIG. 12, a communication program, which is a basic control program for wireless telephone communication, and a display program for controlling the screen display of the liquid crystal monitor 308 are installed. Further, as shown in FIG. 14, an authentication processing means is realized in the ROM 314 by being executed by an authentication program (CPU 312 for authenticating whether or not the user of the mobile phone 1 is a regular user). Is also installed. In the present embodiment, the authentication processing is specifically performed by speaker recognition / collation processing using both the speech waveform of the air conduction sound and the speech waveform of the bone conduction sound. The authentication program includes a main program 201 and a group of submodules used by the main program 201. Specifically, the air conduction sound sampling module 202, the bone conduction sound sampling module 203, the air conduction sound / bone conduction sound phase difference. Calculation / collation determination module 204, air conduction sound / bone conduction sound spectrum calculation / collation determination module 205, face image sampling module 207, face image collation / determination module 208, fingerprint sampling module 209, fingerprint collation / determination module 210, It consists of a pressure-sensitive distribution measurement module 211 for detecting a grasping pressing area, a pressure-sensitive distribution collation / determination module 212, and the like. These programs are all executed by the CPU 312 using the RAM 313 in FIG. 12 as a work area.

  Further, as authentication master data 322, voice spectrum master data, specifically air conduction sound spectrum master data 221 to be used when voice authentication is performed by spectrum matching processing (the module involved is denoted by reference numeral 205). Bone conduction sound spectrum master data 222 and master data 223 of their difference spectrum are prepared. Further, face image master data 224, fingerprint master data 225, and pressure-sensitive distribution master data 226 are also prepared. In the case of the air conduction sound and the bone conduction sound, these data are obtained by a regular user (authentication specific target person) with a sound (“ON”) predetermined for verification, A word or sentence is pronounced, and this is generated by detecting the waveform with the handset 303 (air conduction sound) and the bone conduction microphone 340 (bone conduction sound) and performing a known Fourier transform operation to obtain a spectrum. is there. Further, the face image master data 241 (FIG. 20), the fingerprint master data 243, and the pressure-sensitive distribution master data 226 (FIGS. 21 and 22) are also obtained by the face photographing camera 341, the fingerprint detection unit 342, and the surface contact sensor 343, respectively. What was acquired in advance from a regular user is prepared. These data are different for each user, and the rewritable ROM, specifically, the EEPROM shown in FIG. (Electrically Erasable Programmable Read Only Memory) 322 is stored so as to be rewritable, and is loaded into the authentication data memory of the RAM 313 and used as necessary.

  Since the method for using the mobile phone 1 is well known for the telephone portion, detailed description thereof is omitted, and authentication processing prior to use will be described in detail below. FIG. 24 is a flow of authentication main processing by the main program 201 (FIG. 14). In order to perform the authentication process, it is necessary to perform an initialization process including registration of data for verification (S1). This initialization process is skipped once it is performed, except when the verification master data is updated. S3 and S4 are authentication processes that form the center of the process, and an authentication flag indicating whether or not to permit the use of the function of the mobile phone 1 is set in, for example, the RAM 313 (FIG. 12) based on the authentication result. In S5, the authentication flag is read, and when the prescribed condition is satisfied, the lock is released (S7: that is, usage is permitted), and when not satisfied, the lock is released (S8: that is, that the usage is not permitted). .

  The function of the cellular phone 1 that is unlocked by authentication is not limited to a well-known telephone function (including connection to a telephone communication network or the Internet, a mail function, etc.), for example, lock / unlock of a car. It can also be a wireless remote control unit function for automobile functions, such as starting the engine, turning on / off the headlights and interior lighting.

  Before entering into a specific description of the authentication process, the flow of each process of the initialization process and the voice recognition process will be described with reference to FIGS. In either case, the main part of the process consists of audio data processing that is responsible for acquisition and processing of audio data. In the speaker authentication technology, various methods have been devised for causing the authentication target person to pronounce the voice for authentication for the purpose of improving security and the initial data acquisition method differs depending on the method, but both methods are well known. Therefore, only an outline will be described.

(1) Method of uttering only one character (or sound (for example, vowel)) A character to be uttered is designated and generated by display or the like, and sampling is performed.
(2) Method of sequentially uttering by combining multiple characters Basically the same as (1). The order of utterance is guided by display or the like, and waveform sampling is performed sequentially. During actual verification, the utterance order may be fixed, or the utterance order may be changed every time using a random number (in the latter case, the utterance order of characters designated at the time of authentication is changed randomly) , There ’s an advantage that it ’s useless to record what you say in a fixed order).
(3) Method of uttering a word There may be only one type of word to be used (in this case, it is the same as (2)), or there is a method of selecting from a plurality of types. In the latter case (see FIG. 11 below), a selection list of words to be collated is displayed on the screen 108, and after selection is made by the input unit 305, the selected word is uttered and sampled. In addition, there is a method in which the number of characters (or recording time) is designated, a user's favorite word is arbitrarily input by the input unit 305, and utterance / sampling is performed. In this case, it is clear that the word is substituted for the password. Further, as a more elaborate method, there is a method in which a question that only a legitimate user can understand is voice-output and a registered answer corresponding to this is voice-inputted. In this case, in the initialization process, it is necessary to input or select the question contents to be output and the answer contents to be output.
(4) Method of inputting a sentence This is basically the same as (3), and when a question / answer format is adopted, there may be a method of inputting a plurality of questions and answers in an interactive format.

  When comparing the bone conduction sound and the air conduction sound, the sound component derived from the vocal cord vibration such as a vowel tends to be emphasized from the air conduction sound because the bone conduction sound is closer to the vocal cord. In addition, since the frictional sound and the plosive sound are associated with sound-generating elements other than the vocal cords such as the tongue and lips, the air conduction sound appears more emphasized. Therefore, when performing authentication based on the difference in the waveform or spectrum between bone conduction sound and air conduction sound (especially the difference spectrum), as speech waveform data (bone conduction sound and air conduction sound) to be authenticated, Sounds that include vowels, friction sounds, and plosives (preferably, sound strings in which the most abundant sounds are one of these sound types: for example, “Sashisuseso”, “Sushishinchu no Mushi”, “Aiueo”, etc .: Of course, it may be desirable to specify “sa line”, “ta line” or “a line”. In addition, even in the same vowel, sounds such as “i, e” that use the front part of the tongue for articulation are air conduction sounds, and conversely, sounds such as “u, o” that use the back part of the tongue are bone conduction sounds. Therefore, it is also effective to specify a sound string mainly including either the former or the latter, such as “No (house)” and “Koubo (yeast)”.

  Specific processing can be executed according to the flow of FIG. 25, for example. In step S <b> 501, the designated voice input is input using both the transmitter 304 and the bone conduction microphone 340. In S502, the sampling is performed (implemented by executing the air conduction sound sampling module 202 and the bone conduction sound sampling module 203 in FIG. 14). Since the user emits the requested sound sequence only once, the sampling must be performed simultaneously in time series (therefore, in the first authentication process described later performed using this, two authentications are used) It is clear that the acquisition of the bone conduction sound and the airway sound that make up the characteristic information is performed simultaneously). In this case, when a single CPU is used, it is executed as parallel processing by time division as shown in FIG. Specifically, the sampling counter is reset in S101, and thereafter, while the sampling counter is incremented, reading of the microphone input port for air conduction sound (S102) and writing of the read value to the memory (RAM 313) (S103), Read of the input port of the bone conduction microphone (S104) and writing of the read value to the memory (S105) are repeated alternately. Depending on the length of the audio data to be sampled, the total sampling time (the value of the sampling counter can be used instead, but other timer means may be used), and the sampling is aborted when the time is up (S107) Unless both the bone conduction sound waveform and the air conduction sound waveform are sampled simultaneously, it is impossible to normally obtain the data of both sounds, for example, by sequential sound input using a tape recorder or the like. It is possible to effectively prevent deception and the like.

  In addition, when inputting speech data using words or sentences, it is determined whether or not the input of speech with a predetermined content (meaning) is completed by using a well-known speech recognition technology, and if completed, sampling is terminated. It can also be configured as follows. In this case, the timer means is not always necessary. Although the hardware is somewhat complicated, the sampling of the air conduction sound and the bone conduction sound can be performed independently by separate (ie, two) CPUs. Both audio waveforms can be sampled in parallel without processing.

  Returning to FIG. 25, when sampling of the sound waveforms of the air conduction sound and the bone conduction sound is completed as described above, in S503, it is checked whether or not each sound has been sampled simultaneously. There are various possible check methods. For example, if the air conduction sound and the bone conduction sound are input at a deliberately shifted timing, one of them will protrude outside the sampling time, and the acquired data will have a large blank period. There is a way to take advantage of this because it should happen. In this case, it is checked whether at least one of the acquired air conduction sound waveform and bone conduction sound waveform has a period during which the audio amplitude is equal to or lower than a predetermined lower limit value continuing for a certain period. If is present, it is determined that there is no simultaneity. If it is determined in S503 that there is no simultaneity, the process proceeds to S511, where the processing is terminated and an error or warning is output.

  If simultaneity is satisfied, the process proceeds to S505 and S506, and the detected air conduction sound waveform data and bone conduction sound waveform data are stored and registered in the memory. The following is a calculation process of the composite voice feature information used for authentication (the function of the composite voice feature information calculation means is realized). In S507, the phase difference between the air conduction sound waveform and the bone conduction sound speech waveform is calculated as the composite sound feature information (implemented by executing the air conduction sound / bone conduction sound phase difference calculation / collation determination module 204). As shown in FIG. 8, the air conduction sound waveform and the bone conduction sound waveform are obtained by simultaneously sampling the same sound by individual microphones, and both waveforms when the waveforms are superimposed on the basis of the sampling start timing. Is the reference superposition phase. Since the two waveforms include many common frequency components based on the same voice, as shown in FIG. 19, the overlapping phase of the two waveform data is the phase difference (inherently present in the reference overlapping phase). That is, if the differential waveform is calculated by relatively shifting so as to eliminate the phase difference (φ to be obtained), the integrated amplitude (average amplitude) of the differential waveform is minimized by the superposition phase ( (See the bottom of FIG. 19). Therefore, if the superposition phase of both waveform data is changed variously while calculating the integral amplitude of the difference waveform and the superposition phase where the integral amplitude is minimized is found, this is obtained as the phase difference φ between both waveforms to be obtained. Obtainable.

In consideration of use as personal feature information used for authentication processing, it is only necessary to obtain a parameter that uniquely corresponds to the phase difference φ to be obtained. The phase difference is not limited to the following, and the following can be substituted.
(1) Phase difference that maximizes the integrated amplitude of the differential waveform
(2) Phase difference that minimizes the integrated amplitude of the sum waveform
(3) Phase difference that maximizes the integrated amplitude of the added waveform

  Hereinafter, a process for obtaining the phase difference φ that minimizes the integral amplitude of the differential waveform will be described with reference to the flowchart of FIG. In S201, the superposition phase difference Σt (the waveform is a superposition of various sinusoidal waveforms, so the calculation unit of the phase difference is not an angle but time) is reset. Next, one of the air conduction sound waveform and the bone conduction sound waveform is set as the first waveform, and the other is set as the second waveform, and the phase of the second waveform is shifted by a predetermined minute time Δt in S202 to obtain the first waveform. Is fixed, and the differential waveform is calculated in S203. In S204, the integral amplitude A of the difference waveform is calculated. The method of calculating the integral amplitude is well known, but can be calculated as follows, for example. First, assuming that the waveform is f (t), all the values of f (t) corresponding to each sampling timing t are added and divided by the number of samplings N to obtain the waveform center line f0. Then, | f (t) −f0 | is calculated for each value of t, and this is added for all t and divided by N to obtain an integrated amplitude. In S205, the value of Σt at that time is set as the phase difference φ and stored in association with the value of the integral amplitude A.

  Next, in S206, Σt is incremented by Δt, and the processes in S202 to S206 are repeated until Σt reaches a predetermined maximum value Σtmax. Considering that the user can speak naturally as the voice designated for authentication, it is desirable to secure the length of the voice sample, for example, for 1 second or longer. The amount of waveform shift required to find the phase difference is sufficient for 0.5 to 2 wavelengths. Therefore, considering that the human voice frequency is on average 1 to 2 kHz, Σt is 0. It should be set to about 5 to 2 ms. The sampling period Δt is preferably about 1/1000 to 1/10 of Σt. Note that the second waveform shift interval may be calculated by setting the interval only in one direction, positive or negative, with the reference overlap phase difference as the origin, or by setting the interval in each of positive and negative. It may be.

  When the above calculation is completed, the process proceeds to S208, the stored minimum value A0 of the integrated amplitude A is found, and the phase difference φ0 corresponding to A0 is determined as the phase difference φ0 to be obtained in S209. Note that, as shown in FIG. 16, there is a considerable difference in spectrum between the bone conduction sound and the air conduction sound, and there are frequency components that are not common to each other (for example, in the case of bone conduction sound, the frequency is high). The spectral intensity of the range tends to be missing). Therefore, when calculating the phase difference, it may be desirable to perform waveform calculation after extracting a frequency region with many common components by filtering. This is the end of the description of the phase difference calculation.

  Returning to FIG. 25, in S508 and S509, the frequency spectrum of each waveform of the air conduction sound and the bone conduction sound is calculated, and the result is stored. As described above, this calculation can be performed by performing a well-known Fourier transform process on the original waveform. However, in speaker recognition, the spectral outline as shown below (mainly information reflecting voice quality) is used rather than the spectral waveform including the fine structure as shown in FIG. However, it is known that it has excellent measurement reproducibility, is sufficiently effective as personal identification information, and can be easily verified. This spectral outline is also referred to as spectral envelope, and various well-known speech analysis algorithms (for example, short-time accident correlation analysis method, short-time spectrum analysis method, cepstrum analysis method, band filter bank analysis in the case of non-parametric analysis method) In the case of using a parametric analysis method such as a method or a zero-crossing product method, extraction and calculation can be performed by a linear prediction analysis method, a maximum likelihood spectrum estimation method, a covariance method, a PARCOR analysis method, an LSP analysis method, or the like.

  Returning to FIG. 25, in S510, as shown in FIG. 19, the difference between the frequency spectra of the air conduction sound and the bone conduction sound obtained as described above is calculated and stored as difference spectrum data. The above processing is performed by executing the air conduction sound / bone conduction sound difference spectrum calculation / collation determination module 205 and the waveform spectrum comparison / determination module 206 of FIG. This is the end of the description of the audio data processing.

  Next, the flow of initialization processing will be described with reference to FIG. In the voice data processing of S301, voice input is performed with the voice of the authorized user (authentication specific target person), and the phase difference, the frequency spectrum of the air conduction sound or the bone conduction sound, or the data of the difference spectrum is obtained by the method described above. In step S302, these are registered in the EEPROM 322 (FIG. 12) as master data (standard voice feature information: standard phase difference, standard frequency spectrum, or standard difference spectrum) used in the subsequent voice authentication process. In S303 to S305, the face image master data 241 (FIG. 20), the fingerprint master data 243 (FIG. 21), and the pressure-sensitive distribution master data 226 (by the face photographing camera 341, the fingerprint detection unit 342, and the surface contact sensor 343). 22) are acquired and registered.

  For example, voice authentication processing for simultaneously acquiring bone conduction sound and airway sound as authentication feature information can be performed as follows. First, the user inputs a designated voice for authentication. Using this, the aforementioned audio data processing is executed to calculate the phase difference φ. Then, the phase difference φ is compared with a standard phase difference φ0 stored as master data. Here, the difference φ−φ0 is calculated. Next, it is checked whether or not the deviation between the phase difference φ and the standard phase difference φ0 is within an allowable range. If the deviation is within the allowable range, the authentication flag is set to be permitted, and if it is out of the range, it is set to be not permitted. Instead of registering the standard phase difference φ0 as the master, an allowable phase difference range (given by the maximum values φmax and φmin) including the standard phase difference φ0 is registered, and φ belongs to the range. Authentication can also be performed depending on whether or not there is.

  After execution of the audio data processing, the calculation result of the difference spectrum between the air conduction sound and the bone conduction sound shown in FIG. 16 is read out and compared with the master data (FIG. 14: reference numeral 223) of the difference spectrum, and the two match. If it is determined, the authentication flag may be set to permit, and if it is out of the range, it may be set to non-permit.

  As shown in FIG. 16, the air conduction sound spectrum and the bone conduction sound spectrum have the same main part, but a significant difference is seen in the spectrum intensity in a specific frequency band (for example, a high frequency component). The air conduction sound spectrum appears stronger than the bone conduction sound spectrum). Therefore, matching / mismatching matching can be performed by comparing the shape of the difference spectrum in the frequency band with that of the master. In particular, it is a spectrum envelope peak (as indicated by “x” in FIG. 16) that exists in one of the air conduction sound spectrum and the bone conduction sound spectrum and does not exist in the other, and the peak position is authenticated. When it varies depending on an individual to be detected, the peak can be detected in the difference spectrum, and verification of the peak position (frequency) can be easily performed with high accuracy authentication verification.

  It is also possible to perform voice authentication processing in which each spectrum of bone conduction sound and air conduction sound is individually verified with the master. As shown in FIG. 16, each frequency spectrum of the air conduction sound and the bone conduction sound generates a unique peak position in accordance with the sound in the spectrum envelope. Therefore, the input sound is determined according to the number and position of the peaks. It is possible to identify whether (for example, a word or a character) is the same as the voice indicated by the master (that is, voice recognition). If the content of the voice is the same, the peak position and intensity (or intensity ratio between peaks) can be compared with the master, and it can be authenticated whether it is a legitimate user or not according to the match / mismatch (that is, Speaker recognition).

  As described above, as shown in FIG. 29, as the telephone use holding state, the face contact type holding state in which the handset of the mobile phone 1 is placed on the face is used, and the air conduction sound and the bone conduction sound are used. As an example, the authentication process is performed based on both of the above. However, as shown in FIG. 30, as the telephone use holding state, a face-to-face holding state in which the display unit of the mobile phone 1 and the face photographing camera are in a holding state facing the person to be authenticated is used. Authentication processing can also be performed.

  FIG. 28 shows a first example of authentication processing in that case. Here, the air conduction sound and the face image are processed simultaneously as the authentication feature information. In step S601, the face image (I) is photographed. Next, a predetermined question is displayed on the display unit, and the answer is input by voice. Face image shooting, question display, and answer voice input are repeated twice in this order, and finally a face image is shot again (S601 to S607). In S608, it is checked whether or not the face images (I) to (III) photographed three times coincide with the master (see FIG. 10). In S610 and S612, the response voices (I) and (II) (airway sound spectrum) acquired twice are collated with the master. In S609, S611, and S613, it is determined whether or not there is a match between the respective collations, and if all match, the process proceeds to S614 to set the authentication flag to “permitted” (acceptance authentication), and if there is any mismatch, the process proceeds to S615. Set the authentication flag to non-permitted (rejection authentication).

  Here, it is desirable to authenticate the first or last of the face images taken three times by collating with the master, but the remaining two need only be determined to prevent false authentication, etc. It can be replaced with a simple pattern matching process for confirming whether or not the face is out of view. An example is shown in FIG. If the two patterns have color or gradation, binarization is performed in S701. In S703 to S706, corresponding pixels between pattern frames are sequentially read, and an exclusive OR of pixel setting values (0 or 1) is calculated. If the pattern does not move, the setting value of the corresponding pixel is equal and the value of the exclusive OR is 0, and if the pattern moves, the pixel does not match and the value of the exclusive OR is 1. This exclusive OR value is repeated for each pixel and added to the counter K (S707). If there is an abnormal movement in the pattern, the number of changed pixels increases, and the value of the exclusive OR counter K also increases. In S709 to S714, the final value of K is divided by the total number M of pixels in the frame, and if this value is less than or equal to the allowable value, match determination is performed, and if it exceeds the allowable value, mismatch determination is performed.

  The process of FIG. 26 is not limited to a face image, but can be similarly applied to a fingerprint image and a pressure-sensitive distribution pattern described later (contact change confirmation process). If the holding by hand is released during photographing of the face image 240, a change appears in the detected fingerprint image and pressure-sensitive distribution pattern, and rejection authentication can be performed as an abnormality. In addition, if the face image is absent during hand-holding (that is, during detection of a fingerprint image or a pressure-sensitive distribution pattern), a change appears in the face image pattern. it can.

  In the flow of FIG. 28, a plurality of authentication processes using a plurality of types of authentication feature information are performed, but the acquisition of the authentication feature information is performed in a single stage before the process, and the authentication process using that is performed in the latter stage. I'm trying to batch process. This is because the acquisition process of the authentication feature information is continuously and quickly performed to eliminate redundant time and make it difficult to perform sequential alternative false authentication. Face image, fingerprint, pressure-sensitive distribution, and voice input are sequential in processing, but acquisition of face image, fingerprint, and pressure-sensitive distribution information is only one frame pattern acquisition process. The required time is about 1 to 10 ms, and at most 1 second is sufficient for acquiring these three pieces of information. On the other hand, for voice input, since the voice phrase input time is about 3 to 20 seconds, the ratio of the processing redundant period can be sufficiently limited to 50% or less, and the criminal who intends to perform substitute false authentication. There is no time to replace the “substitute”.

  For example, prior to S601, a viewfinder image captured by the camera 341 is displayed on the display unit 308 to prompt the user to align the face with the camera 341, and a confirmation button (assigned to any key of the input unit 305 or separately) If an activation signal is given by pressing (providing an authentication button) or the like, the processing from S601 to S607 may be executed at once in a state where a break by a user operation is impossible. Also, since the response interval for the question in S602 to S605 should be a regular user, it should be possible to answer immediately, so that the process immediately proceeds to the voice sampling process, and automatically proceeds to the next step when the time required for the answer has passed. To do. On the other hand, since the image capturing in S601, S604, and S607 is all completed in an instant of about several ms, unless the notification is made especially by the shutter sound output or the display of the photographing message, the processing is on the screen from the viewpoint of the user. Every time a question is displayed, it is a flow of just inputting the answer without putting in a short time, and during that time, it is completely unaware that the face has been shot many times. As a result, the user simply exchanges voice as if having a conversation with the mobile phone 1, and does not actually feel that complicated processing including image matching is performed internally, and the authentication process is performed in a simple mood. Can finish.

  If the redundancy time is shortened as described above, for example, if a face image is captured first and a fingerprint or pressure-sensitive distribution is input after a considerable redundancy period has passed, The detectable time of the fingerprint and the pressure-sensitive distribution elapses when the phone is not held by hand. In other words, the information acquisition process is systematically performed in the absence of information sources such as fingerprints and palms, and only the blank fingerprints or pressure-sensitive distribution information that remains in the form remains. If this is subjected to authentication processing, rejection authentication will inevitably result in rejection, so the purpose can be achieved.

The block diagram which shows an example of an electrical structure of the motor vehicle equipment remote control system of this invention. The flowchart which shows the flow of the process in the user side terminal device. The flowchart which similarly shows the flow of the process by the side of a motor vehicle. The flowchart which shows the flow of the position specific process of FIG. The flowchart which shows the flow of a process of the position alerting | reporting operation | movement of FIG. The timing chart which shows the various operation | movement pattern of the perceptual output equipment for parking position alerting | reporting. The timing chart following FIG. The schematic diagram which shows the 1st example of hospitality operation | movement. The schematic diagram which similarly shows a 2nd example. The schematic diagram which similarly shows a 3rd example. The external appearance perspective view which shows an example of the mobile telephone used as a user side terminal device in this invention. FIG. 12 is a block diagram illustrating an example of an electrical configuration of the mobile phone in FIG. 11. The schematic diagram which shows the example of detection of the pressure-sensitive distribution by a surface-type contact sensor. The schematic diagram which shows the memory content of ROM and EEPROM of FIG. The graph which shows the example of an audio | voice spectrum and a spectrum envelope. The conceptual diagram of the individual frequency spectrum of an air conduction sound and a bone conduction sound, and those difference spectra. The schematic waveform diagram which shows the concept used after filtering an audio | voice waveform. The schematic waveform diagram explaining the phase difference of an air conduction sound and a bone conduction sound. Explanatory drawing of the method of calculating | requiring the phase difference of an air conduction sound and a bone conduction sound by a waveform difference. The conceptual diagram of the authentication by a face image. The conceptual diagram of the authentication by a fingerprint. The conceptual diagram of the pressure-sensitive distribution by a fingerprint. The flowchart which shows the flow of an initialization process. The flowchart which shows the flow of an authentication main process. The flowchart which shows the flow of an audio | voice data process. The flowchart which shows the flow of an air conduction sound / bone conduction sound wave form sampling process. The flowchart which shows the flow of an air conduction sound / bone conduction sound phase difference calculation process. The flowchart which shows the flow of another example of an authentication process. The flowchart which shows the flow of the pattern collation process which detects the motion of the biometric information of a face image or a hand. Explanatory drawing of a face contact type | mold holding state. Explanatory drawing of a face-to-face holding state.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 User side terminal apparatus 50 Perceptual output equipment control part 323 Terminal side communication apparatus 501 Car side communication apparatus 502,503 Sound wave generator 504-512 Illuminating device 532 GPS (automobile position identification means, height direction information acquisition means)
554 GPS (terminal location identification means)
1170 Wireless communication network

Claims (11)

A vehicle-side communication means that is provided in the vehicle and communicates with an external terminal device via a wireless communication network;
A user-side terminal device having terminal-side communication means that is carried by the user of the automobile and communicates with the automobile-side communication means via the wireless communication network;
When the operation command information is received from the user side terminal device via the vehicle side communication means provided on the vehicle side, a user mounted on the vehicle and existing outside the vehicle can directly recognize the output information. A perceptual output facility control means for operating a perceptual output facility comprising at least one of a lighting device or a sound wave generator configured as described above,
User approach direction detection means for detecting a relative approach direction of the user to the vehicle;
With
The user terminal device is provided with personal authentication means for personal authentication of the user, and the operation command information can be output only when the authentication is accepted,
The perceptual output facility control means sets the output operation pattern of the perceptual output facility to be changeable for each user, and operates the perceptual output facility that can output in the approaching direction. A remote control system for automobile equipment.   The perceptual output facility control means can output or output the perceptual output facility by the user when the distance between the user terminal device carried by the user and the vehicle approaches a certain level. The vehicle equipment remote control system according to claim 1, wherein the system is operated in a state. An automobile position specifying means for specifying the position of the automobile, and a terminal device position specifying means for specifying the position of the user side terminal device, which are installed in the peripheral equipment of the automobile or the parked automobile;
The perceptual output facility control means determines whether the distance between the user-side terminal device and the automobile approaches a certain value or less based on the position information of the automobile and the user-side terminal device specified by the position specifying means. The vehicle equipment remote control system according to claim 2, which recognizes whether or not.   The perceptual output equipment control means informs the user of the perceptual output equipment and the parking position of the car when the distance between the user terminal device and the car approaches a predetermined distance or less. The vehicle equipment remote control system according to any one of claims 1 to 3, wherein the vehicle is remotely operated.   The vehicle equipment remote control system according to claim 4, wherein the distance is set within a range of 100 m to 400 m.   The vehicle equipment remote control system according to claim 4 or 5, wherein the perceptual output facility control means notifies the user of a parking position of the vehicle by combining outputs of both the lighting device and the sound wave generator.   The vehicle equipment remote control system according to any one of claims 4 to 6, wherein a horn provided in the vehicle is used as the sound wave generator. As the lighting device, at least one of a head lamp, a fog lamp, a hazard lamp, a cornering lamp, a side lamp, a tail lamp, a stop lamp, a backup lamp, and an interior lamp provided on the side of the vehicle is used. The automobile facility remote control system according to any one of claims 4 to 7. The remote control for automobile equipment according to any one of claims 4 to 8, wherein the perceptual output equipment control means sets an output operation pattern for informing a parking position of the perceptual output equipment to be changeable. system. In the vehicle, the height direction information of the parking position of the vehicle is obtained from the height direction information specifying means for specifying the height direction information of the vehicle provided on the vehicle side or the parking facility side of the vehicle. A height direction information output unit for outputting the height direction information received from the vehicle side via the terminal side communication unit is provided in the user side terminal device. The vehicle equipment remote control system according to any one of claims 4 to 9, wherein the vehicle equipment remote control system is provided. The vehicle equipment remote control system according to any one of claims 1 to 10, wherein the user side terminal device is also used as a lock operation unit of the vehicle.

Images