CN119218127A

CN119218127A - Control of motor vehicles

Info

Publication number: CN119218127A
Application number: CN202410511397.4A
Authority: CN
Inventors: M·富尔希纳; D·屈尔泽; O·米勒
Original assignee: Bayerische Motoren Werke AG
Current assignee: Bayerische Motoren Werke AG
Priority date: 2023-06-29
Filing date: 2024-04-26
Publication date: 2024-12-31
Also published as: DE102023117256A1

Abstract

The invention relates to a mobile device (115) comprising means for detecting voice commands, a wireless interface (135) for communicating with a motor vehicle (105, 110), and processing means (125). The processing device (125) is designed to determine a vehicle function associated with the voice command, to determine a plurality of vehicles (105, 110) on which at least one vehicle function can be controlled in each case, to automatically select one of the vehicles (105, 110), and to control the determined vehicle function on the selected vehicle (105, 110). The invention also relates to a control device for a motor vehicle, a system and a method for controlling a motor vehicle.

Description

Control of a motor vehicle

Technical Field

The present invention relates to control of motor vehicles. In particular, the invention relates to control of vehicle functions of a motor vehicle by a mobile device.

Background

The motor vehicle comprises a control device which is designed for communication with the mobile device. The mobile device may be used, for example, by a driver of the motor vehicle when it is not on the motor vehicle. With the aid of the mobile device, a person can control predetermined vehicle functions from outside the vehicle. The mobile device can be used at the same time as a digital key for the motor vehicle, so that control of the vehicle functions can only be possible if the mobile device and the motor vehicle have authenticated one another by means of an encrypted method. For example, the driver can effect opening of the trunk lid when approaching the vehicle, so that the driver can easily store the carried object in the trunk.

Some mobile devices allow control of vehicle functions based on received voice commands. If the mobile device is designed for controlling different vehicles, for example when digital keys for a plurality of vehicles are stored, it may first be unclear which vehicle the voice command relates to. The selection of a motor vehicle on the touch screen of a mobile device is generally undesirable for ergonomic reasons.

Disclosure of Invention

The object of the present invention is to provide an improved technique for the voice-guided control of a vehicle function of one of a plurality of motor vehicles. The invention solves this object by means of the subject matter of the independent claims. The dependent claims give preferred embodiments again.

According to a first aspect of the invention, a mobile device comprises means for detecting a voice command, a wireless interface for communicating with a motor vehicle, and processing means. The processing device is designed to determine a vehicle function associated with the voice command, to determine a plurality of vehicles on which at least one vehicle function can be controlled, to automatically select one of the vehicles, and to control the determined vehicle function on the selected vehicle.

The mobile device is capable of improving voice-guided remote control of a motor vehicle by automatically selecting from a plurality of motor vehicles the one to which the voice command most likely relates. For selecting the motor vehicle, information available locally on the mobile device side can preferably be used. However, it is also possible to transmit information about the motor vehicle in the communication range to the mobile device and to evaluate it there. In this case, a plurality of determinations or a plurality of information items can be associated with one another in order to automatically select them.

The mobile device may comprise a personal device of a person assigned to the motor vehicle. The personal device may in particular comprise a smart phone, a smart watch, a notebook or a tablet. In order to utilize the mobile device or the functionality described therein, a person may be authenticated with respect to the mobile device. Here, the person may, for example, enter a secret or present a biometric for scanning. An encryption key can be stored on the mobile device, which can be checked in a predetermined encryption exchange method with the motor vehicle. In this case, the motor vehicle can be authenticated with respect to the mobile device and/or the mobile device can be authenticated with respect to the motor vehicle. If the authentication is successful, personnel may be allowed to use the vehicle or the mobile device may be allowed to control vehicle functions.

In one embodiment, the processing device is designed to determine that only a communication link to one motor vehicle is present and to select the motor vehicle. The communication connection may comprise, for example, bluetooth LE or Ultra Wide Band (UWB). Wireless communication connections generally have a limited range of application. Motor vehicles which are potentially controllable by the mobile device but which are outside the range of the wireless interface used can be disregarded in the selection. A motor vehicle which is in the communication range but to which a wireless communication connection must first be established may also be dispensed with.

In another embodiment, the selection of the once selected motor vehicle may continue. For example, a first vehicle function of one of the motor vehicles may be related to that motor vehicle within a predetermined time after the control of the other vehicle function.

In another embodiment, the processing means are designed for determining that a voice command is detected. The motor vehicle can then be selected with respect to the previous control on the motor vehicle in comparable situations.

For example, it can be determined that one of the motor vehicles is used in a predetermined usage mode when the mobile device is used. The usage pattern may include, for example, periodic travel from residence to work and back. If it is determined that the request for the vehicle function matches in such a period, the assigned motor vehicle can be selected.

The control situation of the motor vehicle can be determined, for example, by means of a bayesian filter. Alternatively, machine learning techniques may be used to determine common situations. The situation in which the current voice command is detected can then be compared with the known situation in order to select the motor vehicle if necessary.

In a particularly preferred embodiment, the previous control involves a vehicle function comparable to the determined vehicle function. For example, vehicle functions involving the opening or closing of different doors or covers on the same motor vehicle may be considered comparable. This can prevent completely different vehicle functions from being mistakenly regarded as part of the usage rhythm or cycle.

In a further embodiment, the processing device is designed to determine the distance between the mobile device and the plurality of motor vehicles. A motor vehicle having the smallest distance to the mobile device may then be selected. The distance determination is preferably performed using a wireless interface. The approximate distance may be determined based on signal strength or signal-to-noise ratio, for example. If the wireless interface uses bluetooth LE, the distance can be determined by means of a technique called Channel Sounding.

In a further embodiment, it is possible to consider which section of the motor vehicle, on which the vehicle function is active, is furthest toward the mobile device. The processing device may be designed to determine the distance between the mobile device and the section of the plurality of vehicles on which the vehicle function is respectively active, wherein the vehicle having the smallest distance may be selected.

If, for example, two vehicles which can be controlled by means of a mobile device are parked antiparallel, wherein the mobile device is located in the front part of one vehicle and in the rear part of the other vehicle, and the vehicle function involves the opening of the tailgate, then the vehicle whose tailgate is closer to the mobile device can be selected.

In a further embodiment, the processing device is designed to receive a prompt from the motor vehicle for a distance between the mobile device and the motor vehicle. The determination of the distance can be determined with more accurate or other sensors on the vehicle side than on the mobile device side. Furthermore, a distance determination on both sides can be carried out in this way. The motor vehicle may be designed to determine the relative position of the mobile device in addition to the distance.

It is further preferred that the processing device is designed to select a motor vehicle designed to perform the determined vehicle function, said motor vehicle.

If the vehicle function relates to, for example, the opening of a roof, but only one of the two motor vehicles in question has a controllable roof, this motor vehicle can be selected. In particular, if the vehicle function is parameterized or contains further details about the desired mode of operation, it can be easily determined whether the motor vehicle is in principle able to control the desired vehicle function.

According to a further embodiment, the processing device is designed to select a motor vehicle which can directly carry out the determined vehicle function.

If the vehicle function relates, for example, to the opening of a door that has been opened on one of the motor vehicles, this motor vehicle cannot be selected. But another motor vehicle whose door is still closed may be a possible candidate for the specified motor vehicle.

The mobile device can advantageously co-operate with a control device on the motor vehicle to be controlled (on board).

In a further variant of the invention, the mobile device can not uniquely and unambiguously determine for which motor vehicle or speaker the voice command is directed. In this case, the correct motor vehicle can be selected by one or more of the motor vehicles.

The processing means of the mobile device may be designed for selecting a plurality of motor vehicles and transmitting a request for a vehicle function to the plurality of motor vehicles. In this case, a prompt may additionally be transmitted that the request has been transmitted to more than one single motor vehicle. The vehicle evaluating the request may then determine whether the voice command may or may not be directed to the vehicle.

In another implementation, the request may include a geographic location of the mobile device. The received motor vehicle may then determine a distance to the mobile device based on its geographic location. If the distance is below a predetermined threshold, the vehicle may be determined to be a likely recipient of the voice command.

The prompt transmitted to the motor vehicle may comprise a description of the other motor vehicle to which the request has been sent. On the received motor vehicles (on board) it is then possible to estimate with improved accuracy which of these motor vehicles is the most likely recipient of the voice command. In one embodiment, communication between the vehicles that have received the request can take place. Which of these vehicles is the likely recipient of the voice command may then be voted on the basis of the information available locally, respectively.

According to a further aspect of the invention, a control device for a motor vehicle is designed to receive a request for implementing a vehicle function, to receive a prompt that the request has been transmitted to more than one single motor vehicle, to determine the distance of a surrounding motor vehicle from the mobile device, and to implement the vehicle function if the distance is below a predetermined threshold value.

The distance may be determined based on the received signal of the wireless interface, for example with respect to signal strength or SNR. Alternatively, the control device may also determine the distance to the mobile device using a sensor or detection system on board the motor vehicle (on board). The sensor may comprise, for example, a camera or a lidar sensor. For this purpose, the control device can be connected by means of an interface to a corresponding sensor or scanning system of the motor vehicle.

The request may include a geographic location of the mobile device, wherein the distance may be determined based on the geographic location of the motor vehicle. The location of the motor vehicle may be referred to by a positioning system, which comprises, for example, a GNSS receiver.

In a further embodiment, the control device is designed to determine the position of the mobile device relative to the motor vehicle and to provide the position to the mobile device. For example, the position of the mobile device with respect to the motor vehicle can be determined in polar coordinates, wherein the distance and the azimuth angle can be detected. In a further embodiment, one or more zones are defined in the region of the motor vehicle, and the control device is designed to determine whether the mobile device is in one of the zones or in which of the zones the mobile device is in.

The control device may be designed to receive a prompt for a vehicle function to be performed and to provide a reply regarding the feasibility of the vehicle function.

The response may relate not only to the general qualification of the motor vehicle for carrying out the desired vehicle function but also to the possibility of directly carrying out the determined vehicle function. In another embodiment, the mobile device or the digital key used can be checked for the right to carry out the desired vehicle function. If the desired vehicle function should not be implemented by the mobile device in question, the mobile device may support selecting a vehicle from a plurality of vehicles based on the information.

According to yet another aspect of the invention, a motor vehicle includes a control apparatus as described herein. The motor vehicle preferably comprises a car, a van or a bus.

A system includes a mobile device as described herein and a motor vehicle as described herein. Optionally, the system comprises a plurality of motor vehicles of the type described herein. Furthermore, the system may comprise one or more motor vehicles which are designed in a conventional manner for the wireless control of predetermined vehicle functions.

A method for controlling a motor vehicle includes the steps of detecting a voice command, determining a vehicle function assigned to the voice command, determining a plurality of motor vehicles on which the vehicle function can be controlled, automatically selecting one of the motor vehicles, and controlling the vehicle function on the selected motor vehicle.

The method may be implemented partly or entirely by means of the mobile device described herein and/or the control device described herein. The mobile device or the control device may comprise a processing means, which is in particular implemented electronically and may comprise, for example, a programmable microcomputer or microcontroller. The method may be in the form of a computer program product having program code means. The computer program product may be stored on a computer readable data carrier. Features or advantages of the method may be transferred to a mobile device or apparatus and vice versa. In a corresponding manner, features or advantages may also be transferred between the mobile device and the control device.

Drawings

The present invention will now be described more fully with reference to the accompanying drawings, in which:

FIG. 1 shows a system, and

Fig. 2 shows a flow chart of a method.

Detailed Description

Fig. 1 shows a system 100 having a first motor vehicle 105, a second motor vehicle 110, and a mobile device 115. The mobile device 115 is provided with a person 120 who has access to the mobile device 115 and the motor vehicles 105, 110.

For use of one of the motor vehicles 105, 110 or for controlling vehicle functions, a digital key assigned to the respective motor vehicle 105, 110 can be stored in the mobile device 115, the presence and validity of which can be checked before control or use. The digital key may in particular comprise a digital car key according to the known Car Connectivity Consortium specifications. Authentication of the mobile device 115 relative to the motor vehicles 105 and 110 or authentication of the person 120 relative to the mobile device 115 to enable access to a digital key is assumed to be known and not further discussed herein.

The person 120 may use the mobile device 115 to control a predetermined vehicle function of one of the vehicles 105, 110. To this end, an application may be run on the mobile device 115, which may be operated, for example, by a touch screen of the mobile device 115. Currently, this is due to the fact that the application or mobile device 115 can be operated in a voice-controlled manner by the person 120. To this end, the person 120 may issue a voice command to the mobile device 115 that includes a prompt for vehicle functionality. The mobile device 115 is designed to select one of the vehicles 105, 110 for which it is known, to which the voice command most likely relates.

The mobile device 115 includes a processing means 125, a microphone 130 and a wireless interface 135.

A control device 140 can be provided on each of the motor vehicles 105, 110 (on board). The control device 140 comprises processing means 145, an interface 150 and a wireless interface 155. The interface 150 is designed for connection to a further device on board the motor vehicle 105, 110 (on board), which can control predetermined vehicle functions. In general, the interface 150 is connected to a data bus of the respective motor vehicle 105, 110, via which a plurality of controllers can be reached. The wireless interface 155 is designed to communicate with the wireless interface 135 of the mobile device 115. Such as bluetooth, bluetooth LE or UWB based.

One of the control devices 140 may be designed to issue information that provides the mobile device 115 with a selection of the motor vehicle 105, 110 to which the received voice command of the person 120 may relate.

For example, the control device 140 may determine a distance or location of the mobile device 115 with respect to the respective motor vehicle 105, 110. To this end, the control device 140 may access a device of the vehicle itself, which may determine the location of the mobile device 115, via the interface 150. Such devices may include, for example, an environmental detection system or an external camera. Furthermore, the control device 140 can determine via the interface 150 which vehicle functions of the motor vehicle 105, 110 are available for control by the mobile device 115. Furthermore, the state of the controllable vehicle function or of a device that can be controlled by means of the vehicle function can be determined. If the vehicle function relates to, for example, an electrical seat adjustment of a seat on the motor vehicle 105, 110 (on board), the adjustment position of the seat can be determined and provided outwards as the current state. In general or in particular, the controllable vehicle function can be determined via the interface 150 by a dialogue of the control device 140 with another device on the motor vehicle 105, 110 (on board).

Fig. 2 shows a flow chart of an exemplary method 200 for controlling a motor vehicle 105, 110. The method steps shown in the left-hand region are usually carried out on the mobile device 115 side, while the method steps shown in the right-hand region are associated with one of the motor vehicles 105, 110.

In step 205, the voice command of the person 120 may be detected at the mobile device 115 side. The person 120 may, for example, speak a predetermined password based on which the linguistic description of the desired vehicle function is based. The voice command may include parameters or arguments (Argument) for the expressed vehicle function.

In step 210, a vehicle function assigned to the voice command may be determined. Furthermore, arguments or parameters of the vehicle function can be determined. If the vehicle function relates, for example, to a locking function of the motor vehicle 105, 110, it can be stated as a question whether the locking should be opened or closed. The parameter may comprise a value to which the vehicle function should be controlled. If the vehicle function relates, for example, to an adjustment of the seat position in the longitudinal direction, the parameter may describe the longitudinal position, for example in centimeters.

In step 215, it may be determined that the mobile device 115 is designed or equipped for controlling a plurality of motor vehicles 105, 110. Furthermore, it can be determined which motor vehicles can be controlled. Motor vehicles are often equipped with digital keys that are required to access vehicle functions.

Information can then be collected which accordingly gives a prompt as to which of the plurality of vehicles 105, 110 the detected voice command should relate to. One of the vehicles 105, 110 may then be selected based on one of the information or a logical association of the information.

In step 220, it can be determined with respect to which of the vehicles 105, 110 a wireless communication connection has been established. The motor vehicle 105, 110 that is not connected cannot be targeted by the voice command. If multiple vehicles 105, 110 are in wireless communication connection with the mobile device 115, both may be prerecorded as candidates for selection. If no motor vehicle 105, 110 is connected in wireless communication, the selection of motor vehicles 105, 110 may be supported based on other information.

In step 225, a distance between the mobile device 115 and the motor vehicle 105, 110 may be determined. The distance is preferably determined using the wireless interface 135. Known methods for distance measurement by means of radio waves can be used here.

In step 230, a query may be sent to the motor vehicle 105, 110. The vehicle 105, 110 may determine a reply in step 235 and transmit the reply back to the mobile device 115. Alternatively, the motor vehicle 105, 110 checks on which section of the motor vehicle 105, 110 the vehicle function is to act or is available to the user. A hint to the determined section may be attached to the reply.

In a first example, the inquiry relates to a description of a controllable vehicle function or a prompt as to whether a predetermined vehicle function can be or is allowed to be controlled on the motor vehicle 105, 110.

In a second example, the query relates to the location of the mobile device 115 with respect to the motor vehicle 105, 110. The vehicle 105, 110 may determine the location of the mobile device 115 using the wireless interface 155 or another detection system or sensor on board the vehicle 105, 110.

A reply of the motor vehicle 105, 110 or the control device 140 may be received by the mobile device 115 in step 240. The received information may be evaluated to select one of the vehicles 105, 110 as the target of the voice command. For example, the voice command may most likely relate to the motor vehicle 105, 110 that is least distant from the mobile device 115.

In a further embodiment, in step 245, the section to which the vehicle function relates can be determined on the motor vehicle 105, 110. Distances to the respective sections can be formed for the different motor vehicles 105, 110. The motor vehicle 105, 110 having the smallest such distance may be determined to be the most likely target of the voice command.

In step 250, one of the motor vehicles 105, 110 may be selected based on the collected information. A pattern recognition can also be performed in this step in order to correlate the situation in which the voice command was detected in step 205 with other situations in which a function was implemented in the past on one of the motor vehicles 105, 110. Such situations may include, for example, a workday, a time, a geographic location, an identity of person 120, an existing weather, or an intended travel destination.

In step 255, a request for implementing the determined vehicle function may be transmitted to the selected motor vehicle 105, 110. If the mobile device 115 cannot determine exactly one vehicle 105, 110 with sufficient reliability, which is a possible recipient of the voice command, the request may be sent to multiple vehicles 105, 110. The request may not be transmitted to the motor vehicle 105, 110, which is not considered as a recipient on the basis of one of the mentioned determinations. The request may be accompanied by a prompt that the request has been sent to a plurality of vehicles 105, 110. Optionally, a prompt may be attached to one of the other vehicles 105, 110 to which the request has been sent. In addition, locally available data may be appended to the request. In particular, the geographical position of the mobile device 115, which can be determined, for example, by means of a GNSS receiver, can belong to the data. Other data may be appended including a prompt for the distance of the mobile device 115 from the motor vehicle 105, 110.

In step 260, the receiving vehicle 105, 110 may determine whether it is the only recipient of the request. If this is not the case, it can be determined whether the received motor vehicle 105, 110 is with sufficient likelihood the intended recipient of the voice command. For this purpose, the distance between the motor vehicles 105, 110 can be determined. If the distance is below a predetermined threshold, such as about 10m or about 5m, it may be considered relevant

The distance may be determined based on the signal strength, SNR, scanning of the environment of the motor vehicle 105, 110 with an onboard own scanning system, of the message received by the mobile device 115, and/or based on the distance between the received geographic location and the own geographic location.

If the vehicle 105, 110 is the only recipient of the request or the vehicle has been deemed relevant in step 260, the vehicle functions in the vehicle 105, 110 may be controlled in step 265. What may be needed for practical control is a method of implementing encryption based on a key stored on the mobile device 115.

List of reference numerals

100 System

105 First motor vehicle

110 Second motor vehicle

115 Mobile device

120 Personnel

125 Processing device

130 Microphone

135 Radio interface

140 Control apparatus

145 Processing device

150 Interface

155 Wireless interface

200 Method

205 Detect voice command

210 Determining vehicle function

215 Determining a plurality of motor vehicles under consideration

220 Motor vehicle for determining coupling

225 Determining distance

230 Send an inquiry

235 Determine reply

240 Receive a reply

245 Determining distance to the section concerned

250 Selection of motor vehicles

255 Send request

260 To determine correlation

265 Control function

Claims

1. A mobile device (115), comprising:

Means (130) for detecting a voice command;

a wireless interface (135) for communication with a motor vehicle (105, 110), and

-A processing device (125) designed to:

determining a vehicle function assigned to the voice command;

Determining a plurality of vehicles (105, 110) on which at least one vehicle function can be controlled in each case;

automatically selecting one of the motor vehicles (105, 110), and

The determined vehicle function is controlled on the selected motor vehicle (105, 110).

2. The mobile device (115) according to claim 1, wherein the processing means (125) are designed to determine that only a communication connection to one motor vehicle (105, 110) is present and to select the motor vehicle (105, 110).

3. The mobile device (115) according to claim 1 or 2, wherein the processing means (125) are designed to determine that the voice command is detected and to select the motor vehicle (105, 110) with respect to a previous control on the motor vehicle (105, 110) in comparable cases.

4. A mobile device (115) according to claim 3, wherein the previous control relates to a vehicle function comparable to the determined vehicle function.

5. The mobile device (115) according to one of the preceding claims, wherein the processing means (125) are designed to determine the distance between the mobile device (115) and the plurality of vehicles (105, 110) and to select the vehicle (105, 110) having the smallest distance to the mobile device (115).

6. The mobile device (115) according to one of the preceding claims, wherein the processing means (125) are designed to determine the distance between the mobile device (115) and a section of a plurality of motor vehicles (105, 110), on which section the vehicle function acts, respectively, and to select the motor vehicle (105, 110) having the smallest distance.

7. The mobile device (115) according to claim 5 or 6, wherein the processing means (125) are designed to receive a prompt from the motor vehicle (105, 110) for a distance between the mobile device (115) and the motor vehicle (105, 110).

8. The mobile device (115) according to one of the preceding claims, wherein the processing means (125) are designed for selecting a motor vehicle (105, 110) designed for carrying out the determined vehicle function.

9. The mobile device (115) according to one of the preceding claims, wherein the processing means (125) are designed for selecting a motor vehicle (105, 110) which can directly carry out the determined vehicle function.

10. The mobile device (115) according to one of the preceding claims, wherein the processing means (125) are designed to select a plurality of vehicles (105, 110) and to transmit a request for the vehicle function to the plurality of vehicles (105, 110), wherein additionally a prompt is transmitted that the request has been transmitted to more than one single vehicle (105, 110).

11. The mobile device (115) of claim 10, wherein the prompt comprises a description of another vehicle (105, 110) to which the request has been sent.

12. A control device (140) for a motor vehicle (105, 110), wherein the control device is designed to receive a request for implementing a vehicle function, to receive a prompt that the request has been transmitted to more than one single motor vehicle (105, 110), to determine the distance of a surrounding motor vehicle (105, 110) from a mobile device (115), and to implement the vehicle function if the distance is below a predetermined threshold.

13. The control device (140) of claim 12, wherein the request includes a geographic location of the mobile device (115), and the distance is determined based on the geographic location of the vehicle.

14. The control device (140) according to claim 12 or 13, wherein the control device (140) is designed to receive a prompt for a vehicle function to be implemented and to provide a reply about the implementation of the vehicle function.

15. A motor vehicle (105, 110) comprising a control device according to one of claims 12 to 14.

16. A system (100) comprising a mobile device (115) according to one of claims 1 to 11 and a motor vehicle (105, 110) according to claim 15.

17. A method (200) for controlling a motor vehicle (105, 110), wherein the method (200) comprises the steps of:

Detecting (205) a voice command;

Determining (210) a vehicle function assigned to the voice command;

determining (215) a plurality of motor vehicles (105, 110) on which the vehicle function can be controlled;

automatically selecting (250) one of the motor vehicles (105, 110), and

-Controlling (265) said vehicle function on the selected motor vehicle (105, 110).