CN115179966B - Vehicle function control intention determination method, device, electronic device and storage medium - Google Patents
Vehicle function control intention determination method, device, electronic device and storage medium Download PDFInfo
- Publication number
- CN115179966B CN115179966B CN202110373029.4A CN202110373029A CN115179966B CN 115179966 B CN115179966 B CN 115179966B CN 202110373029 A CN202110373029 A CN 202110373029A CN 115179966 B CN115179966 B CN 115179966B
- Authority
- CN
- China
- Prior art keywords
- vehicle
- intention
- information
- feature
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
- B60R16/037—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for occupant comfort, e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel
Landscapes
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Mechanical Engineering (AREA)
- Human Computer Interaction (AREA)
- Transportation (AREA)
- Traffic Control Systems (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the application provides a vehicle function control intention determining method, device, electronic equipment and storage medium, wherein vehicle information is acquired, the vehicle information comprises vehicle exterior information and vehicle interior information, feature elements of each feature in at least one preset feature are extracted from the vehicle interior information, the at least one feature comprises a feature related to the vehicle exterior information, a feature related to an interior environment and a feature related to an interior passenger, target intention judging logic matched with the extracted feature elements is determined from at least one preset intention judging logic, and then the vehicle function control intention indicated by the target intention judging logic can be determined as a target vehicle function control intention. The application does not need to rely on the vehicle firmware carrier or the voice recognition system to realize the determination of the vehicle function control intention, provides convenience for the vehicle function control of the passengers, and improves the passenger experience.
Description
Technical Field
The present invention relates to the field of vehicle man-machine interaction technologies, and in particular, to a method and apparatus for determining a vehicle function control intention, an electronic device, and a storage medium.
Background
Existing vehicle human-machine interaction systems identify occupant appeal, primarily by receiving demands actively communicated by occupants, and maneuver the vehicle. Therefore, the means of interaction between the occupant and the vehicle is limited by a vehicle firmware carrier such as a switch, touch screen, or voice recognition system, and the occupant must issue instructions manually or by voice control to operate the vehicle. Under the condition of applying the interaction method, passengers can use the functions of the vehicle to operate more, the passengers can not find and use the functions conveniently, and the experience of the passengers is reduced.
Disclosure of Invention
In view of the above, the present invention provides a method, an apparatus, an electronic device, and a storage medium for determining a vehicle function control intention, so as to solve the problem that in the prior art, the determination of the vehicle function control intention depends on a vehicle firmware carrier or a voice recognition system, resulting in that passengers use vehicle functions to operate more, which is inconvenient for passengers to control the vehicle functions, and further reduces passenger experience, and the technical scheme is as follows:
A vehicle function control intention determining method, comprising:
collecting vehicle information, wherein the vehicle information comprises vehicle exterior information and vehicle interior information, and the vehicle interior information comprises vehicle interior environment information and vehicle interior passenger information;
Extracting feature elements of each of at least one feature set in advance from the vehicle information, wherein the at least one feature comprises a feature related to the information outside the vehicle, a feature related to the environment inside the vehicle and a feature related to an occupant inside the vehicle;
Determining target intention judgment logic matched with the extracted characteristic elements from at least one preset intention judgment logic;
And determining the vehicle function control intention indicated by the target intention judgment logic as a target vehicle function control intention.
Preferably, the intention judgment logic includes an intention judgment condition and a vehicle function control intention, and the target intention judgment logic for determining a match with the extracted feature element from at least one preset intention judgment logic includes:
querying first intention judgment logic with intention judgment conditions satisfied by the extracted characteristic elements from at least one preset intention judgment logic;
And determining second intention judgment logic related to the vehicle function control intention from the first intention judgment logic according to the identity of the passenger indicated by the passenger information in the vehicle.
Preferably, the method further comprises:
Sending intent alert information to an occupant in the vehicle, the intent alert being for alerting of the target vehicle function control intent;
and acquiring feedback information of the control intention of the passenger on the target vehicle, wherein the feedback information is related to any one or more of sound, expression and limb actions of the passenger.
Preferably, the method further comprises:
and if the feedback information represents that the passenger is not satisfied with the target vehicle function control intention, optimizing the target intention judgment logic according to the feedback information.
Preferably, the method further comprises:
and if the feedback information characterizes that the passenger satisfies the target vehicle function control intention, controlling the function of the vehicle according to the target vehicle function control intention.
Preferably, the in-vehicle information includes any one or more of image information, sound information, and temperature information in the vehicle.
Preferably, the at least one characteristic includes any one or more of occupant count, occupant identity, gender, age, expression, limb movements, clothing, belongings, and body temperature.
A vehicle function control intention determining apparatus comprising:
the information acquisition unit is used for acquiring vehicle information, wherein the vehicle information comprises vehicle exterior information and vehicle interior information, and the vehicle interior information comprises vehicle interior environment information and vehicle interior passenger information;
A feature element extraction unit configured to extract feature elements of each of at least one feature set in advance from the vehicle information, the at least one feature including a feature related to the information outside the vehicle, a feature related to the environment inside the vehicle, and a feature related to an occupant inside the vehicle;
a target intention judgment logic determination unit configured to determine target intention judgment logic matching the extracted feature element from at least one preset intention judgment logic;
A target vehicle function control intention determining unit configured to determine a vehicle function control intention indicated by the target intention judging logic as a target vehicle function control intention.
An electronic device includes a processor and a memory, wherein the processor is configured to call and execute a program stored in the memory, and the memory is configured to store a program for implementing the vehicle function control intention determining method.
A computer-readable storage medium having stored thereon a computer program that is loaded and executed by a processor to implement the steps of the vehicle function control intention determining method.
The embodiment of the application provides a vehicle function control intention determining method, device, electronic equipment and storage medium, wherein vehicle information is acquired, the vehicle information comprises vehicle external information and vehicle internal information, feature elements of each feature in at least one preset feature are extracted from the vehicle information, the at least one feature comprises a feature related to an external environment, a feature related to an internal environment and a feature related to an in-vehicle member, target intention judging logic matched with the extracted feature elements is determined from at least one preset intention judging logic, and then the vehicle function control intention indicated by the target intention judging logic can be determined as a target vehicle function control intention. The application does not need to rely on the vehicle firmware carrier or the voice recognition system to realize the determination of the vehicle function control intention, provides convenience for the vehicle function control of the passengers, and improves the passenger experience.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are required to be used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are only embodiments of the present invention, and that other drawings can be obtained according to the provided drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of a method for determining the control intention of a vehicle according to an embodiment of the present application;
FIG. 2 is a flowchart of another vehicle function control intent determination method provided by an embodiment of the present application;
Fig. 3 is a schematic structural diagram of an intelligent trip system according to an embodiment of the present application;
FIG. 4 is a schematic diagram of an intent determination logic library according to an embodiment of the present application;
FIG. 5 is a schematic diagram of determining intent conclusion according to an intent determination logic library according to an embodiment of the present application;
FIG. 6 is an illustration of an example feedback determination logic library provided by an embodiment of the present application;
FIG. 7 is a schematic diagram of determining a feedback conclusion according to a feedback judgment logic library according to an embodiment of the present application;
Fig. 8 is a schematic structural view of a vehicle control intention determining device according to an embodiment of the present application;
fig. 9 is a block diagram of an implementation manner of an electronic device according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
In the prior art, the determination of the control intention of the vehicle function is dependent on a vehicle firmware carrier or a voice recognition system, and the vehicle occupant needs to perform more operations when using the vehicle function (for example, depending on the mode of the vehicle firmware carrier, different vehicle functions correspond to different vehicle firmware, the vehicle occupant needs to know the vehicle firmware corresponding to the vehicle function and further perform operations on the corresponding vehicle firmware, and depending on the mode of the voice recognition system, different vehicle functions correspond to different voice texts, the vehicle occupant needs to know the voice texts corresponding to the vehicle function and further perform operations on the voice reading corresponding voice texts), so that the vehicle function control is inconvenient for the occupant, and the problem of occupant experience is further reduced.
The vehicle function control intention determining method, device, electronic equipment and storage medium provided by the embodiment of the application can solve the problem that the means of driver intention is limited by a vehicle carrier such as a switch and a touch screen and voice recognition in the prior art, and the vehicle recognition occupant intention is mainly divided into two ways, ① for receiving the requirement actively transmitted by the occupant and ② for analyzing information to calculate the occupant intention. The vehicle function control intention determining method provided by the embodiment of the application can be used for identifying the intention of the passenger through the two approaches.
In order that the above-recited objects, features and advantages of the present invention will become more readily apparent, a more particular description of the invention will be rendered by reference to the appended drawings and appended detailed description.
Fig. 1 is a flowchart of a method for determining a vehicle control intention according to an embodiment of the present application.
As shown in fig. 1, the method includes:
s101, acquiring vehicle information, wherein the vehicle information comprises vehicle exterior information and vehicle interior information, and the vehicle interior information comprises vehicle interior environment information and vehicle interior passenger information;
In the embodiment of the application, the acquired vehicle interior information of the vehicle comprises vehicle interior environment information and vehicle interior passenger information. Illustratively, the in-vehicle environment information is constituted by any one or more of image information, sound information, and temperature information in the vehicle.
For example, off-board information including date, time, weather, road conditions may be downloaded from the cloud.
The above is only preferred contents of the in-vehicle information and the out-of-vehicle information provided by the embodiments of the present application, and specific contents of the in-vehicle information and the out-of-vehicle information may be set by those skilled in the art according to their own needs, which is not limited herein.
S102, extracting feature elements of each feature in at least one preset feature from vehicle information, wherein the at least one feature comprises a feature related to the information outside the vehicle, a feature related to the environment in the vehicle and a feature related to an occupant in the vehicle;
In the embodiment of the application, at least one feature is preset, and the at least one feature comprises feature elements required by date, time, weather, road condition, number of passengers, identity of the passengers, gender of the passengers, age bracket, expression, limb actions, dressing, personal belongings and body temperature.
The storage unit of the cloud end stores a feature element library, the feature element library comprises at least one feature, the vehicle can download the feature element library from the storage unit of the cloud end, and for each feature in the at least one feature, the feature value of the feature is extracted from the acquired vehicle information to serve as a feature element of the feature. If a feature value (feature element) of a feature is not included in the vehicle information for the feature, the feature element of the feature may be regarded as empty. For example, if the feature is a personal belongings, if the occupant in the vehicle does not carry the personal belongings, the feature element of the feature of the personal belongings is empty.
S103, determining target intention judgment logic matched with the extracted characteristic elements from at least one preset intention judgment logic;
In the embodiment of the application, at least one intention judgment logic is preset, each intention judgment logic is composed of an intention judgment condition and a vehicle function control intention, and the intention judgment condition comprises a target feature element of each feature in at least one feature.
The method includes the steps of inquiring at least one preset intention judgment logic, acquiring intention judgment logic with judgment conditions met by the extracted feature elements as first intention judgment logic, judging whether the number of the acquired first intention judgment logic is one, determining the acquired first intention judgment logic as second intention judgment logic if the number of the acquired first intention judgment logic is one, and determining one first intention judgment logic as second intention judgment logic from the acquired first intention judgment logic according to the identity of an occupant indicated by occupant information in the vehicle if the number of the acquired first intention judgment logic is not one.
The method for determining a first intention judgment logic as a second intention judgment logic from the acquired first intention judgment logic according to the identity of the passenger indicated by the passenger information in the vehicle may be that whether the first intention judgment logic carrying the driver ID indicated by the passenger information in the vehicle exists in the acquired first intention judgment logic is judged, and if the first intention judgment logic carrying the driver ID indicated by the passenger information in the vehicle exists in the acquired first intention judgment logic, the first intention judgment logic carrying the driver ID indicated by the passenger information in the vehicle in the acquired first intention judgment logic is regarded as the second intention judgment logic; judging whether the first intention judgment logic of the passenger ID indicated by the passenger information in the vehicle exists or not if the first intention judgment logic of the driver ID indicated by the passenger information in the vehicle does not exist, judging whether the first intention judgment logic of the passenger ID indicated by the passenger information in the vehicle exists or not if the first intention judgment logic of the passenger ID indicated by the passenger information in the vehicle exists, taking the first intention judgment logic of the passenger ID indicated by the passenger information in the vehicle in the first intention judgment logic as the second intention judgment logic if the first intention judgment logic of the passenger ID indicated by the passenger information in the vehicle does not exist, judging whether the first intention judgment logic of the passenger ID indicated by the passenger information in the vehicle exists or not in the first intention judgment logic, and if the first intention judgment logic of the passenger ID indicated by the passenger information in the vehicle exists, the first intention judgment logic of the acquired first intention judgment logic carrying the rear passenger ID indicated by the in-vehicle passenger information is taken as the second intention judgment logic.
For example, the second intent determination logic may be considered target intent determination logic.
In the embodiment of the application, the extracted feature elements comprise feature elements of each feature in at least one feature, the intention judging logic comprises an intention judging condition and a vehicle function control intention, the first intention judging logic for judging whether the intention judging logic is met by the extracted feature elements or not is implemented by taking one intention judging logic as an example, the mode of judging whether the feature elements of the feature in the extracted feature elements meet the target feature elements of the feature in the intention judging condition of the intention judging logic or not for each feature in at least one feature, and the comparison result of the feature is obtained, if the feature elements of the feature in the extracted feature elements meet the target feature elements of the feature in the intention judging condition of the intention judging logic, the comparison result of the feature is met, and if the feature elements of the feature in the extracted feature elements do not meet the target feature elements of the feature in the intention judging condition of the intention judging logic, the comparison result of the feature is not met. In this way, if the comparison result of each feature in at least one feature is characterized as being satisfied, the intention judgment logic is considered to be the first intention judgment logic whose intention judgment condition is satisfied by the extracted feature element, and otherwise, the intention judgment logic is considered not to be the first intention judgment logic whose intention judgment condition is matched by the extracted feature element. That is, as long as there is a feature in at least one feature for which the comparison result characterization is not satisfied, the piece of intention judgment logic is not considered to be the first intention judgment logic for which the intention judgment condition is matched by the extracted feature elements.
In an exemplary case, taking a feature as an example, in the case that the target feature element of the feature represents a numerical value, if the feature element of the feature is the same as the target feature element of the feature, the feature element of the feature may be considered to satisfy the target feature element of the feature, whereas if the feature element of the feature is different from the target feature element of the feature, the feature element of the feature may be considered to not satisfy the target feature element of the feature.
For example, in the case that a feature is represented by a range of values by a target feature element of the feature, if the feature element of the feature is within the range of values represented by the target feature element of the feature, the feature element of the feature may be considered to satisfy the target feature element of the feature, whereas if the feature element of the feature is not within the range of values represented by the target feature element of the feature, the feature element of the feature may be considered to not satisfy the target feature element of the feature.
S104, determining the vehicle function control intention indicated by the target intention judgment logic as a target vehicle function control intention.
In the embodiment of the application, after the target intention judgment logic matched with the extracted feature elements is determined from at least one preset intention judgment logic, the vehicle function control intention in the target intention judgment logic can be acquired, and the acquired vehicle function control intention is determined as the target vehicle function control intention of the vehicle occupant deduced from the in-vehicle information.
Fig. 2 is a flowchart of another vehicle function control intention determining method according to an embodiment of the present application.
As shown in fig. 2, the method includes:
s201, collecting vehicle information, wherein the vehicle information comprises vehicle exterior information and vehicle interior information, and the vehicle interior information comprises vehicle interior environment information and vehicle interior passenger information;
S202, extracting feature elements of each feature in at least one preset feature from vehicle information, wherein the at least one feature comprises a feature related to the information outside the vehicle, a feature related to the environment in the vehicle and a feature related to an in-vehicle member;
Accordingly, in the case where the at least one feature set in advance includes a feature relating to the in-vehicle exterior information, a feature relating to the in-vehicle environment, and a feature relating to the in-vehicle occupant, it is necessary to extract not only a feature element of the feature relating to the in-vehicle environment from the in-vehicle information, but also a feature element of the feature relating to the in-vehicle occupant from the in-vehicle information, and further, a feature element of the feature relating to the out-vehicle information from the out-vehicle information.
S203, determining target intention judgment logic matched with the extracted characteristic elements from at least one preset intention judgment logic;
in the embodiment of the application, for each intention judgment logic in at least one intention judgment logic, the intention judgment condition of the intention judgment logic comprises a preset target feature element of each feature in at least one feature.
In the case where the at least one feature set in advance includes a feature relating to an in-vehicle environment, a feature relating to an in-vehicle member, and a feature relating to out-of-vehicle information, the intention judgment condition of the intention judgment logic includes a target feature element of the feature relating to the in-vehicle environment, a target feature element of the feature relating to an in-vehicle occupant, and a target feature element of the feature relating to out-of-vehicle information, for example.
The intention judgment conditions in the different intention judgment logics are different.
S204, determining the vehicle function control intention indicated by the target intention judgment logic as a target vehicle function control intention;
S205, sending intention reminding information to passengers in the vehicle, wherein the intention reminding is used for reminding the function control intention of the target vehicle;
In the embodiment of the application, after the target vehicle control intention of the vehicle interior member is calculated, intention reminding information can be sent to the vehicle interior member in the vehicle to prompt the vehicle interior member to calculate the target vehicle function control intention currently.
For example, the intention reminding information may be sent to the vehicle occupant by broadcasting. For example, if the currently calculated target vehicle function control intention is the vehicle control intention 1, "your good" may be reported, and the currently calculated your vehicle function control intention is the vehicle control intention 1". Specifically, if the vehicle control intention 1 is "turn off the air conditioner", it may report "your good, and it is currently deduced that your vehicle function control intention is turn off the air conditioner".
S206, acquiring feedback information of control intention of the passenger on the target vehicle, wherein the feedback information is related to any one or more of sound, expression and limb actions of the passenger;
In the embodiment of the application, after the intention reminding information is sent to the passengers in the vehicle to prompt the function control intention of the target vehicle, the feedback information of the passengers in the vehicle on the function control intention of the target vehicle can be collected. For example, image information and sound information in the vehicle are collected to extract feedback information of the control intention of the occupant in the vehicle to the target vehicle from the collected image information and sound information in the vehicle.
S207, judging whether the feedback information represents the passenger satisfaction target vehicle function control intention, if the feedback information represents the passenger satisfaction target vehicle function control intention, executing step S208, and if the feedback information represents the passenger dissatisfaction target vehicle function control intention, executing step S209;
s208, controlling the functions of the vehicle according to the target vehicle function control intention;
In the embodiment of the application, under the condition that the feedback information represents that the passenger satisfies the function control intention of the target vehicle, the calculated target vehicle control intention of the passenger is proved to be in accordance with the real intention of the passenger, and the function of the vehicle can be controlled according to the target vehicle control intention. For example, if the target vehicle control is intended to "turn off the air conditioner", the operation of turning off the air conditioner may be performed on the vehicle, and if the target vehicle control is intended to "turn on the music", the operation of turning on the music may be performed on the vehicle.
S209, optimizing target intention judgment logic according to the feedback information.
In the embodiment of the application, under the condition that the feedback information represents that the passenger is not satisfied with the target vehicle function control intention, the calculated target vehicle control intention of the passenger is not in line with the actual intention of the passenger, and at the moment, the target intention judging logic may be inaccurate, and the target intention judging logic may be optimized according to the feedback information.
The target intention judgment logic is optimized according to the feedback information by creating an intention judgment logic based on the adjustment of the target intention judgment logic. The method comprises the steps of acquiring in-vehicle passenger IDs of all in-vehicle passengers indicated by in-vehicle passenger information, adding the acquired in-vehicle passenger IDs to intention judging conditions of target intention judging logic, determining current real vehicle function control intention, and modifying the vehicle function control intention indicated by the target intention judging logic into the current real vehicle function control intention to obtain new target intention judging logic.
According to the vehicle function control intention determining method provided by the embodiment of the application, the intention of the passenger can be perceived through a plurality of channels, the operation necessary for the passenger to use the vehicle is saved, and the user experience is improved. Meanwhile, the method for determining the control intention of the vehicle function can be applied to an intelligent travel system, and possibility is brought to the vehicle to actively provide a scheme for passengers.
The method for determining the control intention of the vehicle provided by the embodiment of the application can be applied to an intelligent travel system, and the structure of the intelligent travel system provided by the embodiment of the application is described in detail below with reference to fig. 3.
As shown in fig. 3, the smart travel system provided by the embodiment of the present application includes:
1. And downloading data such as date, weather, passenger information, intention judgment logic and the like from the cloud database through the data exchange system.
The intention judgment logic includes an intention judgment condition and a vehicle function control intention, for example. The intention judgment condition includes a target feature element of at least one feature including a date, weather, a feature related to an in-vehicle environment, a feature related to an in-vehicle occupant, a feature related to occupant habit, and the like.
Features related to the occupant in the vehicle may relate to the gender, age, expression, limb movements, clothing, body temperature, mood, etc. of the occupant, and features related to the environment in the vehicle may relate to personal belongings, etc. The specific contents of the features related to the occupant in the vehicle and the features related to the environment in the vehicle can be set by those skilled in the art according to their own needs, and are not limited herein.
According to the embodiment of the application, the current date can be acquired by downloading the date from the cloud database, the current weather can be acquired by downloading the weather from the cloud database, the historical behavior information of the passenger can be acquired by downloading the passenger information from the cloud database, the passenger information can relate to the identity, the recognition characteristics and the habit of the passenger and the like of the passenger, and the method is not limited.
Specifically, data such as date, weather, time, passenger identity, passenger identification characteristics, passenger habit, expression library, limb action library, intention judgment logic library and the like can be downloaded from the cloud database.
2. And acquiring image, sound and temperature data in the vehicle through an occupant sensing system.
According to the embodiment of the application, the sensor is used for collecting data of the vehicle interior information including the vehicle interior environment, the passengers and the articles carried by the passengers, and the collected data include images, sounds and temperatures.
Illustratively, the sensor comprises an impact acquisition sensor such as a camera, an audio acquisition sensor such as a microphone, and a temperature sensor such as an infrared sensor.
3. The image, sound and temperature data in the vehicle are analyzed through the element recognition system, and characteristic elements including the number of passengers, sex, age bracket, expression, limb actions, dressing, personal belongings, body temperature and the like are extracted.
According to the embodiment of the application, the acquired image, audio and temperature data are processed by utilizing a data processing technology, and elements are extracted aiming at various characteristics such as the number of passengers, the sex, the age group, the expression, limb actions, dressing, personal belongings, the body temperature, the language and the like.
The extraction of the feature elements of the expression of the occupant can be realized based on the expression library, and the extraction of the feature elements of the limb actions of the occupant can be realized based on the limb action library.
Exemplary data processing techniques include image-to-image processing techniques, audio processing techniques, and thermographic processing techniques. For recognition of feature elements such as expressions, limb actions, clothes, personal belongings, and speech, it is necessary to learn databases such as expression libraries and limb action libraries by using technologies such as deep learning, and then to discriminate corresponding elements in image and sound data.
4. And the intention judging system calculates the intention of the passenger according to the intention judging logic and the data of the characteristic elements, the date, the weather, the habit of the passenger and the like.
Referring to fig. 4, a schematic diagram of an intent determination logic library according to an embodiment of the present application is provided. The intention judgment logic library comprises a plurality of scenes, and each scene has input (namely, an intention judgment condition, wherein the intention judgment condition comprises characteristic elements/cloud data) and corresponding output (intention conclusion).
For example, as shown in fig. 5, the characteristic elements screened from the inside of the vehicle and the information such as date, weather, time, and passenger identity downloaded from the cloud database may be used as input, and the intention judgment logic library downloaded from the cloud database may be searched to obtain the intention conclusion, that is, obtain the function control intention of the target vehicle.
5. And optimizing intention judgment logic according to feedback of intention of the occupant to the system.
FIG. 6 is a schematic diagram of a feedback determination logic library. The feedback judgment logic library comprises a plurality of scenes, and each scene has an input (characteristic element/cloud data) and a corresponding output (feedback conclusion).
After the intention conclusion is shared to the passengers by using the intelligent travel system, repeating the steps 2-3 again, and then taking the characteristic elements currently screened from the inside of the vehicle and the information such as the date, weather, time, passenger identity and the like downloaded from the cloud database as input to check the feedback judgment logic library to obtain a feedback conclusion (feedback information), and optimizing the intention judgment logic according to the feedback conclusion as shown in fig. 7.
6. And uploading the optimized intention judgment logic and the passenger identity data to a cloud database through a data exchange system.
Furthermore, the optimized intention judgment logic and the passenger identity data can be uploaded to a cloud database.
The man-machine interaction method provided by the invention can sense the intention of the passenger through a plurality of channels, saves the necessary operation of the passenger for using the vehicle, and improves the user experience. Meanwhile, the man-machine interaction method provided by the invention can be applied to an intelligent travel system, and the possibility is brought to the active provision of a scheme for passengers by a vehicle.
Fig. 8 is a schematic structural diagram of a vehicle function control intention determining device according to an embodiment of the present application.
As shown in fig. 8, the apparatus includes:
an information acquisition unit 81 for acquiring vehicle information including outside-vehicle information and inside-vehicle information including inside-vehicle environment information and inside-vehicle occupant information;
A feature element extraction unit 82 for extracting, from the vehicle information, feature elements of each of at least one feature set in advance, the at least one feature including a feature related to the information outside the vehicle, a feature related to the environment inside the vehicle, and a feature related to an occupant inside the vehicle;
A target intention judgment logic determination unit 83 for determining a target intention judgment logic matching the extracted feature element from at least one preset intention judgment logic;
the target vehicle function control intention determining unit 84 is configured to determine the vehicle function control intention indicated by the target intention judging logic as the target vehicle function control intention.
The method for determining the control intention of the vehicle function provided by the embodiment of the application is applied to the electronic equipment, as shown in fig. 9, and is a structural diagram of an implementation manner of the electronic equipment provided by the embodiment of the application, and the computer equipment comprises:
a memory 901 for storing a program;
A processor 902 for executing a program, the program being specifically for:
collecting vehicle information, wherein the vehicle information comprises vehicle exterior information and vehicle interior information, and the vehicle interior information comprises vehicle interior environment information and vehicle interior passenger information;
extracting feature elements of each of at least one preset feature from vehicle information, wherein the at least one feature comprises a feature related to vehicle exterior information, a feature related to vehicle interior environment and a feature related to vehicle interior personnel;
Determining target intention judgment logic matched with the extracted characteristic elements from at least one preset intention judgment logic;
the vehicle function control intention indicated by the target intention judgment logic is determined as the target vehicle function control intention.
The processor 902 may be a central processing unit CPU or an Application SPECIFIC INTEGRATED Circuit.
The control device may further comprise a communication interface 903 and a communication bus 904, wherein the memory 901, the processor 902 and the communication interface 903 communicate with each other via the communication bus 904.
The memory may be an on-board memory, and the processor may be an on-board processor, where the on-board processor and the on-board memory are integrated in the same module and directly communicate or are integrated in different modules and connected by a communication bus.
The embodiment of the application also provides a vehicle function control intention determining system, which comprises electronic equipment and a cloud, wherein the electronic equipment further comprises a data transmission unit and a vehicle-mounted storage unit, the cloud comprises the cloud storage unit, the data transmission unit is used for downloading information outside the vehicle, a characteristic element library and a cloud intention judgment logic library from the cloud storage unit to the vehicle-mounted storage unit, and the characteristic element library comprises at least one characteristic, and all intention judgment logic in the downloaded cloud intention judgment logic library can be regarded as at least one intention judgment logic preset by the electronic equipment.
The vehicle exterior information comprises date, time, weather and road conditions, the characteristic element library comprises characteristic elements required by extracting the number of passengers, the identities of the passengers, the gender of the passengers, the age bracket, the expression, limb actions, dressing, personal belongings and body temperature, and the cloud intention judgment logic library comprises a general intention judgment logic library and an intention judgment logic library customized based on the identities of all the passengers (which can be called as a customization intention judgment logic library).
The cloud end is used for issuing the cloud end intention judgment logic library to the vehicle once according to a preset frequency at each certain time interval, a vehicle-mounted intention judgment logic library is arranged in electronic equipment on the vehicle, and after the vehicle receives the cloud end intention judgment logic library, the content in the vehicle-mounted intention judgment logic library is updated into the content in the received cloud end intention judgment logic library.
The memory of the electronic device includes a first storage unit and a second storage unit, the first storage unit is used for storing a first vehicle intention judging logic library, the first vehicle intention judging logic library is used for storing intention judging logic in a cloud intention judging logic library downloaded from a cloud, the second storage unit is used for storing a second vehicle intention judging logic library, and the second vehicle intention judging logic library can be regarded as an intention judging logic library customized based on the identity of the passenger of the vehicle. After the vehicle receives the cloud intention judgment logic library, updating the content in the first vehicle intention judgment logic library into the content in the received cloud intention judgment logic library, and deleting the intention judgment logic of the customized intention judgment logic library which is uploaded to the cloud in the second vehicle intention judgment logic library from the second vehicle intention judgment logic library.
For example, all intention judgment logics in a first vehicle intention judgment logic library of the vehicle can be regarded as at least one preset intention judgment logic, if the vehicle involves optimization of one intention judgment logic in the at least one intention judgment logic, the vehicle can directly create a new intention judgment logic according to the intention judgment logic without modifying the one intention judgment logic in the first vehicle intention judgment logic, and store the new intention judgment logic into a second vehicle intention judgment logic library.
The cloud storage unit is used for storing the information outside the vehicle, the characteristic element library and the cloud intention judging logic library, and the memory in the electronic equipment can be regarded as a vehicle-mounted memory which is used for storing the information outside the vehicle, the characteristic element library and the cloud intention judging logic library downloaded from the cloud storage unit.
The embodiment of the present application further provides a readable storage medium, on which a computer program is stored, where the computer program is loaded and executed by a processor, to implement the steps of the method for determining a vehicle function control intention, and the specific implementation process may refer to descriptions of corresponding parts of the foregoing embodiment, which is not repeated in this embodiment.
The application also proposes a computer program product or a computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer readable storage medium, and the processor executes the computer instructions, so that the computer device executes the method provided in various alternative implementations of the vehicle function control intention determining method aspect or the vehicle function control intention determining device aspect, and the specific implementation process may refer to the description of the corresponding embodiment and will not be repeated.
The embodiment of the application provides a vehicle function control intention determining method, device, electronic equipment and storage medium, wherein vehicle information is acquired, the vehicle information comprises vehicle exterior information and vehicle interior information, feature elements of each feature in at least one preset feature are extracted from the vehicle interior information, the at least one feature comprises a feature related to the vehicle exterior information, a feature related to an interior environment and a feature related to an interior passenger, target intention judging logic matched with the extracted feature elements is determined from at least one preset intention judging logic, and then the vehicle function control intention indicated by the target intention judging logic can be determined as a target vehicle function control intention. The application does not need to rely on the vehicle firmware carrier or the voice recognition system to realize the determination of the vehicle function control intention, provides convenience for the vehicle function control of the passengers, and improves the passenger experience.
The above description of the method, the device, the electronic apparatus and the storage medium for determining the control intention of the vehicle function provided by the present invention has been provided in detail, and specific examples are provided herein to illustrate the principles and embodiments of the present invention, and the above description of the examples is only for aiding in understanding the method and core concept of the present invention, and meanwhile, for those skilled in the art, according to the concept of the present invention, there are variations in the specific embodiments and application scope, so that the disclosure should not be interpreted as limiting the invention.
It should be noted that, in the present specification, each embodiment is described in a progressive manner, and each embodiment is mainly described as different from other embodiments, and identical and similar parts between the embodiments are all enough to be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant points refer to the description of the method section.
It is further noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include, or is intended to include, elements inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises an element.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (8)
1. A vehicle function control intention determining method, characterized by comprising:
collecting vehicle information, wherein the vehicle information comprises vehicle exterior information and vehicle interior information, and the vehicle interior information comprises vehicle interior environment information and vehicle interior passenger information;
Extracting feature elements of each of at least one feature set in advance from the vehicle information, wherein the at least one feature comprises a feature related to the information outside the vehicle, a feature related to the environment inside the vehicle and a feature related to an occupant inside the vehicle;
Determining target intention judgment logic matched with the extracted characteristic elements from at least one preset intention judgment logic;
Determining the vehicle function control intention indicated by the target intention judgment logic as a target vehicle function control intention;
Sending intent alert information to an occupant in the vehicle, the intent alert being for alerting of the target vehicle function control intent;
Acquiring feedback information of the control intention of the passenger on the target vehicle, wherein the feedback information is related to any one or more of sound, expression and limb actions of the passenger;
if the feedback information characterizes that the passenger is not satisfied with the target vehicle function control intention, optimizing the target intention judgment logic according to the feedback information;
The optimizing the target intention judgment logic according to the feedback information specifically comprises creating an intention judgment logic which is generated based on adjustment of the target intention judgment logic, wherein the in-vehicle passenger ID of each in-vehicle passenger indicated by in-vehicle passenger information is obtained, the obtained in-vehicle passenger ID is added to the intention judgment condition of the target intention judgment logic, the current real vehicle function control intention is determined, and the vehicle function control intention indicated by the target intention judgment logic is modified into the current real vehicle function control intention to obtain a new target intention judgment logic.
2. The method according to claim 1, wherein the intention judgment logic includes an intention judgment condition and a vehicle function control intention, the determining a target intention judgment logic matching the extracted feature element from at least one preset intention judgment logic includes:
querying first intention judgment logic with intention judgment conditions satisfied by the extracted characteristic elements from at least one preset intention judgment logic;
And determining second intention judgment logic related to the vehicle function control intention from the first intention judgment logic according to the identity of the passenger indicated by the passenger information in the vehicle.
3. The method as recited in claim 1, further comprising:
and if the feedback information characterizes that the passenger satisfies the target vehicle function control intention, controlling the function of the vehicle according to the target vehicle function control intention.
4. The method of claim 1, wherein the in-vehicle information includes any one or more of in-vehicle image information, sound information, and temperature information.
5. The method of claim 1, wherein the at least one characteristic comprises any one or more of occupant count, occupant identity, gender, age group, expression, limb movements, clothing, belongings, and body temperature.
6. A vehicle function control intention determining apparatus characterized by comprising:
the information acquisition unit is used for acquiring vehicle information, wherein the vehicle information comprises vehicle exterior information and vehicle interior information, and the vehicle interior information comprises vehicle interior environment information and vehicle interior passenger information;
A feature element extraction unit configured to extract feature elements of each of at least one feature set in advance from the vehicle information, the at least one feature including a feature related to the information outside the vehicle, a feature related to the environment inside the vehicle, and a feature related to an occupant inside the vehicle;
a target intention judgment logic determination unit configured to determine target intention judgment logic matching the extracted feature element from at least one preset intention judgment logic;
A target vehicle function control intention determining unit configured to determine a vehicle function control intention indicated by the target intention judging logic as a target vehicle function control intention;
wherein the vehicle function control intention determining device is further configured to:
Sending intent alert information to an occupant in the vehicle, the intent alert being for alerting of the target vehicle function control intent;
Acquiring feedback information of the control intention of the passenger on the target vehicle, wherein the feedback information is related to any one or more of sound, expression and limb actions of the passenger;
if the feedback information characterizes that the passenger is not satisfied with the target vehicle function control intention, optimizing the target intention judgment logic according to the feedback information;
The optimizing the target intention judgment logic according to the feedback information specifically comprises creating an intention judgment logic which is generated based on adjustment of the target intention judgment logic, wherein the in-vehicle passenger ID of each in-vehicle passenger indicated by in-vehicle passenger information is obtained, the obtained in-vehicle passenger ID is added to the intention judgment condition of the target intention judgment logic, the current real vehicle function control intention is determined, and the vehicle function control intention indicated by the target intention judgment logic is modified into the current real vehicle function control intention to obtain a new target intention judgment logic.
7. An electronic device characterized by comprising a processor and a memory, wherein the processor is configured to call and execute a program stored in the memory, and the memory is configured to store a program for implementing the vehicle function control intention determining method according to any one of claims 1 to 5.
8. A computer-readable storage medium, having stored thereon a computer program loaded and executed by a processor, implementing the steps of the vehicle function control intention determining method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110373029.4A CN115179966B (en) | 2021-04-07 | 2021-04-07 | Vehicle function control intention determination method, device, electronic device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110373029.4A CN115179966B (en) | 2021-04-07 | 2021-04-07 | Vehicle function control intention determination method, device, electronic device and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115179966A CN115179966A (en) | 2022-10-14 |
| CN115179966B true CN115179966B (en) | 2025-03-07 |
Family
ID=83511456
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110373029.4A Active CN115179966B (en) | 2021-04-07 | 2021-04-07 | Vehicle function control intention determination method, device, electronic device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115179966B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20200069585A (en) * | 2018-12-07 | 2020-06-17 | 전자부품연구원 | Appratus and method for intelligent vehicle convenience control |
| CN112130547A (en) * | 2020-09-28 | 2020-12-25 | 广州小鹏汽车科技有限公司 | Vehicle interaction method and device |
| CN112435660A (en) * | 2019-08-08 | 2021-03-02 | 上海博泰悦臻电子设备制造有限公司 | Vehicle control method and system and vehicle |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| FR2935944A1 (en) * | 2008-09-16 | 2010-03-19 | Renault Sas | FUEL CONSUMPTION OPTIMIZATION SYSTEM FOR A MOTOR VEHICLE BASED ON MEASUREMENTS OF DISTANCES AND / OR SPEEDS OF THE PREVIOUS VEHICLE OF THE EQUIPPED VEHICLE. |
| EP2787477A4 (en) * | 2011-12-02 | 2015-09-02 | Toyota Motor Co Ltd | INFORMATION INPUT DEVICE, INFORMATION PROCESSING DEVICE AND INFORMATION PROCESSING SYSTEM |
| KR101512394B1 (en) * | 2013-08-12 | 2015-04-16 | 현대오트론 주식회사 | Hands free liftgate opening system and method using the rear view camera of a vehicle |
| DE102016205142A1 (en) * | 2016-03-29 | 2017-10-05 | Volkswagen Aktiengesellschaft | Methods, apparatus and computer program for initiating or performing a cooperative maneuver |
| BR112018074374B1 (en) * | 2016-05-27 | 2022-12-13 | Nissan Motor Co., Ltd | STEERING CONTROL METHOD AND STEERING CONTROL DEVICE |
| CN109285547B (en) * | 2018-12-04 | 2020-05-01 | 北京蓦然认知科技有限公司 | A voice wake-up method, device and system |
-
2021
- 2021-04-07 CN CN202110373029.4A patent/CN115179966B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20200069585A (en) * | 2018-12-07 | 2020-06-17 | 전자부품연구원 | Appratus and method for intelligent vehicle convenience control |
| CN112435660A (en) * | 2019-08-08 | 2021-03-02 | 上海博泰悦臻电子设备制造有限公司 | Vehicle control method and system and vehicle |
| CN112130547A (en) * | 2020-09-28 | 2020-12-25 | 广州小鹏汽车科技有限公司 | Vehicle interaction method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115179966A (en) | 2022-10-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109416733B (en) | Portable personalization | |
| CN104731854B (en) | Speech recognition inquiry response system | |
| KR100917836B1 (en) | Method and device for context dependent user input proposal | |
| CN104584118B (en) | Multipass vehicle audio identifying system and method | |
| US20140229060A1 (en) | Method and system for selecting driver preferences | |
| CN110232910A (en) | Dialect and language identification for the speech detection in vehicle | |
| CN106597951A (en) | Method for controlling vehicle and terminal thereof | |
| EP2977986B1 (en) | Audio command adaptive processing system and method | |
| CN106537335A (en) | Operating system startup acceleration | |
| CN109754786A (en) | Voice Controls for Vehicles | |
| CN106663009A (en) | Operating system startup acceleration | |
| CN113760423A (en) | Vehicle with intelligent user interface | |
| CN115617861A (en) | Vehicle automatic adjustment method, device, server, vehicle and storage medium | |
| CN107421557B (en) | Method for determining navigation destination, intelligent terminal and device with storage function | |
| CN115179966B (en) | Vehicle function control intention determination method, device, electronic device and storage medium | |
| CN110626303A (en) | Child riding safety protection method and system based on vehicle-mounted terminal and vehicle-mounted terminal | |
| CN106537341A (en) | Operating system startup acceleration | |
| JP2022023800A (en) | Systems and methods to transfer different settings between different types of vehicles | |
| CN116409333A (en) | Interaction method, device and storage medium | |
| US20210049625A1 (en) | System and method for using vehicle data for future vehicle designs | |
| CN117584876A (en) | Hybrid rules engine for vehicle automation | |
| CN116386622A (en) | Bluetooth control method, device, equipment and medium based on vehicle | |
| CN112686183A (en) | Remnant detection device, system, method and electronic equipment | |
| CN113791841A (en) | A method, apparatus, device and storage medium for determining execution instruction | |
| CN115503624B (en) | Control method and device of vehicle-mounted key assembly, vehicle and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |