CN116160978A - Vehicle interaction method, device, electronic equipment, storage medium and program product - Google Patents

Abstract

The application provides a vehicle interaction method, device, electronic equipment, storage medium and program product, belonging to the technical field of vehicles. The method includes: in response to a first interaction instruction, determining that the vehicle complies with a first out-of-vehicle interaction mode, and based on the first out-of-vehicle interaction mode, displaying a first display interface, the first display interface being used to display the first An execution result of an interaction command; in response to a second interaction command, it is determined that the vehicle complies with a second out-of-vehicle interaction mode, and based on the second out-of-vehicle interaction mode, switching the first display interface to a second display interface, the The second display interface is used to display the execution result of the second interactive instruction. When the application performs off-vehicle interaction based on the interactive command, the interactive interface corresponding to the off-vehicle interactive mode triggered by the interactive command is displayed, and the execution result of the interactive command is displayed on the interactive interface. The interactive form is richer.

Description

Vehicle interaction method, device, electronic device, storage medium and program product

technical field

The present application relates to the field of vehicle technology, and in particular to a vehicle interaction method, device, electronic equipment, storage medium and program product.

Background technique

In modern life, vehicles have become the main means of transportation for people to travel. In order to meet the needs of car owners in off-vehicle scenarios, the vehicle has a variety of off-vehicle interaction modes, such as welcome mode, off-vehicle voice mode, etc. In the welcome mode, the vehicle welcomes guests by performing preset welcome actions, which increases the sense of ritual for the owner to drive the vehicle. In the off-vehicle voice mode, the vehicle reduces the operational complexity of the owner by executing the off-vehicle voice commands.

However, when the interaction is performed based on the above-mentioned out-of-vehicle interaction mode, the interaction form is relatively single, and the user experience is poor.

Contents of the invention

Embodiments of the present application provide a vehicle interaction method, device, electronic equipment, storage medium, and program product, which can enrich interaction forms. Described technical scheme is as follows:

In a first aspect, a vehicle interaction method is provided, the method comprising:

In response to the first interaction instruction, it is determined that the vehicle complies with a first out-of-vehicle interaction mode, and based on the first out-of-vehicle interaction mode, a first display interface is displayed, and the first display interface is used to display the execution of the first interaction instruction result;

In response to the second interaction instruction, it is determined that the vehicle complies with a second out-of-vehicle interaction mode, and based on the second out-of-vehicle interaction mode, the first display interface is switched to a second display interface, and the second display interface is used to display An execution result of the second interactive instruction.

In a second aspect, a vehicle interaction device is provided, the device comprising:

A first determination module, configured to determine that the vehicle complies with the first out-of-vehicle interaction mode in response to the first interaction instruction;

A first display module, configured to display a first display interface based on the first out-of-vehicle interaction mode, where the first display interface is configured to display an execution result of the first interaction instruction;

The second determination module is configured to determine that the vehicle complies with the second out-of-vehicle interaction mode in response to the second interaction instruction;

A switching module, configured to switch the first display interface to a second display interface based on the second out-of-vehicle interaction mode, and the second display interface is used to display an execution result of the second interaction instruction.

In a third aspect, a vehicle is provided, the vehicle includes a memory and a processor, at least one computer program is stored in the memory, and the at least one computer program is loaded and executed by the processor to achieve the first The vehicle interaction method described in the aspect.

In a fourth aspect, a computer-readable storage medium is provided, wherein at least one computer program is stored in the computer-readable storage medium, and when the at least one computer program is executed by a processor, the vehicle as described in the first aspect can be implemented. interactive method.

In a fifth aspect, a computer program product is provided, the computer program product includes a computer program, and when the computer program is executed by a processor, the vehicle interaction method as described in the first aspect can be realized.

In the embodiment of the present application, when the out-of-vehicle interaction is performed based on the interaction command, the interaction interface corresponding to the out-of-vehicle interaction mode is displayed according to the out-of-vehicle interaction mode triggered by the interaction command, and the interaction interface is used to display the execution result of the interaction command. In the off-vehicle interaction scene, the switching between different interaction modes is not easy for users to perceive. By displaying the execution results of interactive commands in different interaction modes on the interactive interface, not only the interaction form is enriched, but also the user can view different interactive modes. interactive information, so as to be able to better use the interactive function. In addition, there is no need for the user to manually switch between different interaction modes in this process, and it can be automatically switched according to the interaction command to improve the interaction efficiency.

Description of drawings

FIG. 1 shows a structural block diagram of an electronic device provided by an exemplary embodiment of the present application;

Fig. 2 shows a schematic diagram of a display device of an electronic device provided by an exemplary embodiment of the present application;

3-4 are flowcharts of a vehicle interaction method provided by an embodiment of the present application;

Fig. 5 is an effect diagram of vehicle interaction in a welcome mode provided by an embodiment of the present application;

FIG. 6 is a schematic diagram of a voice mode switching control provided by an embodiment of the present application;

Fig. 7 is a light effect diagram displayed by a three-dimensional vehicle model in an out-of-vehicle interaction scene provided by an embodiment of the present application;

Fig. 8 is an effect diagram of vehicle interaction in an inactive state provided by an embodiment of the present application;

Figures 9-11 are diagrams of an effective strategy for outside-vehicle voice provided by the embodiment of the present application;

Fig. 12 is an effect diagram of vehicle interaction in a listening state provided by an embodiment of the present application;

Fig. 13 is an effect diagram of vehicle interaction in a recognition state provided by an embodiment of the present application;

Figures 14-15 are renderings of vehicle interaction in a feedback state provided by the embodiment of the present application;

Fig. 16 is an interactive flowchart of a parking process provided by the embodiment of the present application;

Fig. 17 is an interactive flowchart of a parking out process provided by an embodiment of the present application;

Fig. 18 is an interactive flowchart of a door opening/closing process provided by an embodiment of the present application;

Fig. 19 is an interactive flowchart of a door locking process provided by the embodiment of the present application;

Fig. 20 is an interactive flowchart of a process of unlocking a car door provided by an embodiment of the present application;

Fig. 21 is a diagram of effective strategies of a different mode provided by the embodiment of the present application;

Fig. 22 is a flowchart of a vehicle interaction method provided by an embodiment of the present application;

Fig. 23-Fig. 26 are the effect diagrams of an alarm triggered by the sentinel mode provided by the embodiment of the present application;

27-37 are flowcharts of a vehicle interaction method provided by an embodiment of the present application;

Fig. 38 is a schematic structural diagram of a vehicle interaction device provided by an embodiment of the present application.

Detailed ways

In order to make the purpose, technical solution and advantages of the present application clearer, the implementation manners of the present application will be further described in detail below in conjunction with the accompanying drawings.

It can be understood that the terms "each", "multiple" and "any" used in the embodiments of the present application include two or more, and each refers to each of the corresponding multiples. Any refers to any one of the corresponding plurality. For example, the plurality of words includes 10 words, and each word refers to each of the 10 words, and any word refers to any one of the 10 words.

The information (including but not limited to user equipment information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in this application are all authorized by the user Or fully authorized by all parties, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions. For example, the voice information involved in this application is obtained under the condition of full authorization.

With the development of vehicle technology, voice interaction has become the mainstream way of human-vehicle interaction. The in-vehicle voice mode includes a single-person voice interaction mode. In the single-person voice interaction mode, the main driver in the cockpit can send voice commands to the vehicle to realize full vehicle control and entertainment functions, such as turning on/off the air conditioning system, adjusting the temperature of the air conditioning system, controlling seat heating, turning on /Close the navigation system, turn on/off the fragrance system, play/close the music player, play/close the video player, etc. In order to reduce the driving burden of the main driver, the in-car voice mode has also developed from a single-person voice interaction mode to a multi-person voice interaction mode. In the multi-person voice interaction mode, the main driver, co-pilot and rear users in the cockpit can control the vehicle by sending voice commands to the vehicle.

In order to meet the needs of users in the scene outside the car, the voice interaction mode has also developed from the in-vehicle voice mode to the out-of-vehicle voice mode. In the voice mode outside the vehicle, the vehicle controls the controlled components to perform corresponding operations based on the received voice commands. In order to meet other interaction needs of users in the off-vehicle scene, in addition to the out-of-vehicle voice mode, it also provides various modes such as welcome mode, charging mode, parking mode, parking mode, pet mode, child mode, sentry mode, etc. Interaction mode outside the vehicle.

Based on the above several modes of out-of-vehicle interaction, an embodiment of the present application provides a vehicle interaction method, which can enrich interaction forms in an out-of-vehicle scene and improve interaction efficiency. The vehicle interaction method can be executed by electronic equipment, and the electronic equipment is not only applicable to vehicles, but also applicable to vehicles such as flying cars and ships. In the subsequent embodiments, a vehicle will be taken as an example for illustration. Among them, the electronic device can be a vehicle-mounted terminal (for example, a vehicle-machine system), or a vehicle, or used to realize some functions in the vehicle, or a mobile electronic device, such as a tablet computer, a mobile phone or a computer, a wearable device , VR, AR devices, etc., are not limited in this embodiment.

The vehicle to which the electronic device is applicable may include passenger compartments, and the number of passenger compartments may be determined based on the number of passengers. For example, a vehicle includes at least two passenger compartments, and each passenger compartment may be provided with at least one seat. Among them, the vehicle has two passenger compartments, and the two passenger compartments constitute the complete interior space of the vehicle. The cabins can be defined by "first" and "second", only to distinguish the two cabin spaces, and There is no limit to the sequence and shape of the cockpit space. For example, the passenger compartment of a vehicle includes a first cockpit and a second cockpit. The first cockpit is the space formed by the main driver's seat and the co-pilot seat in the front of the vehicle, and the second cockpit is two or more rear seats in the rear of the vehicle. A space made of chairs.

Referring to FIG. 1 , the electronic device includes a processor 101 . Some or all functions of the electronic device may be controlled by the computing platform. The computing platform may include one or more processors 101, the processor is a circuit with signal processing capabilities, in one implementation, the processor may be a circuit with instruction reading and execution capabilities, such as a central processing unit ( central processing unit (CPU), microprocessor, graphics processing unit (graphics processing unit, GPU) (can be understood as a microprocessor), or digital signal processor (digital signal processor, DSP), etc.; in another In implementation, the processor can realize certain functions through the logical relationship of the hardware circuit, the logical relationship of the hardware circuit is fixed or reconfigurable, for example, the processor is an application-specific integrated circuit (ASIC) or programmable logic A hardware circuit implemented by a device (programmable logic device, PLD), such as a field programmable logic gate array (field programmable gate array, FPGA). In a reconfigurable hardware circuit, the process of the processor loading the configuration file to realize the configuration of the hardware circuit can be understood as the process of the processor loading instructions to realize the functions of some or all of the above units. In addition, it can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (neural network processing unit, NPU), a tensor processing unit (tensor processing unit, TPU), a deep learning processing unit (deep learning processing unit, DPU), etc. In addition, the computing platform may further include a memory for storing instructions, and part or all of the processors may call the instructions in the memory and execute the instructions to implement corresponding functions.

The electronic device may also include a display device 102 . The display device 102 can be used to display images, videos and the like. The display device may include a display panel, and the display panel may be a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (organic light-emitting diode, OLED), an active matrix organic light-emitting diode or an active matrix organic light-emitting diode. (active-matrixorganic light emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diodes (quantum dot light emitting diodes, QLED), etc.

The display device 102 can be touched to receive an input signal from the user, can sense the boundary of the touch or slide action, and can detect the duration and pressure associated with the touch or slide operation.

Optionally, the display device 102 is mainly used for displaying information to the occupants in the passenger compartment. The direction is roughly the same, basically perpendicular to the direction of the front of the car. Wherein, the display area of the display device 102 at least continuously extends from the front of the main driver's seat to the front of the passenger's seat. In other words, the extension range of the display area of the display device 102 can just cover the range corresponding to the front of the main driver's seat and the front of the passenger seat, and can also exceed the range corresponding to the front of the main driver's seat and the front of the passenger seat. No restrictions. In some embodiments, the width of the display device is at least greater than two-thirds of the width of the vehicle, so as to meet the information acquisition requirements of the occupants on the main driver's seat and the passenger's seat.

In some embodiments, the display area of the display device 102 can be dynamically divided into one or more continuous display areas according to the target occupants in the cockpit. The continuous multiple display areas mean that the multiple display areas are obtained by dynamically dividing the pixels in the display area, not by physical screen division. For example, when the target occupant is a single occupant, the display area may be divided into one or more display areas according to the position or interaction requirements of the single target occupant. When the target occupants are multiple occupants, it can be displayed in full screen or divided into multiple display areas adapted to multiple occupants according to the positions or interaction requirements of the multiple target occupants.

For another example, when the target occupants are located in different occupant compartments, the display area may be divided into one or more display areas according to the positions of the occupant compartments where different occupants are located or the interaction methods. For example, each passenger compartment may correspond to one display area, or one passenger compartment may correspond to multiple display areas, or multiple passenger compartments may correspond to one display area, which is not limited here.

Based on this area division method, the display device 102 can flexibly and dynamically display interactive content, realizing multiple functions on one screen. Referring to FIG. 2 , the display device 102 includes a plurality of display areas, namely a display area 201 , a display area 202 and a display area 203 . Among them, the display area 201 is used to display the voice information of the driver and the three-dimensional vehicle model; the display area 202 is used to display the multimedia information; the display area 203 is used to display the voice information of the co-driver and so on.

It should be noted that the sizes and positions of different display areas are not fixed, that is, when the display area 201 and the display area 202 are adjacent, the boundary between the display area 201 and the display area 202 can be moved; or, the display area 201 can also be partially cover the display area 202; or, the display area 202 may also partially cover the display area 201.

Similarly, when the display area 202 and the display area 203 are adjacent, the boundary between the display area 202 and the display area 203 can be moved; or, the display area 202 can also partially cover the display area 203; or, the display area 203 can also partially cover the display area 202.

In the embodiment of the present application, the processor may control the icons and/or cards of the application programs displayed on the display device 102 . In some possible implementation manners, information such as multimedia information may also be stored in the memory of the computing platform in the form of data.

It should be understood that the foregoing operations may be performed by the same processor, or may also be performed by one or more processors, which is not specifically limited in this embodiment of the present application.

Further, as shown in FIG. 1 , the electronic device further includes: a memory 103 and a communication component 104 . The above-mentioned memory 103 in FIG. 1 can be used to store one or more computer instructions. The memory 103 can be implemented by any type of volatile or non-volatile storage device or their combination, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic or Optical Disk. The processor 101 can execute one or more computer instructions stored in the memory 103 to execute the steps provided by the various embodiments of the present application.

The above-mentioned communication component 104 in FIG. 1 is configured to facilitate wired or wireless communication between the device where the communication component is located and other devices. The device where the communication component is located can access a wireless network based on communication standards, such as WiFi, 2G, 3G, 4G or 5G, or a combination thereof. In one exemplary embodiment, the communication component receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component may be based on Near Field Communication (NFC) technology, Radio Frequency Identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies to fulfill. Based on the communication component 104, the electronic device can acquire data sent by other devices. For example, the sensor data sent by the vehicle sensor and the control instruction sent by the vehicle control system are not limited in this embodiment.

For the above-mentioned several off-vehicle interaction modes, the embodiment of the present application provides a vehicle interaction method. Taking the vehicle executing the embodiment of the present application as an example, the vehicle has at least one driving mode among automatic driving mode and manual driving mode. Referring to Figure 3, the method flow provided by the embodiment of the present application includes:

301. In response to a first interaction instruction, determine that the vehicle complies with a first out-of-vehicle interaction mode, and display a first display interface based on the first out-of-vehicle interaction mode.

302. In response to the second interaction instruction, determine that the vehicle complies with the second out-of-vehicle interaction mode, and switch the first display interface to the second display interface based on the second out-of-vehicle interaction mode.

Wherein, the interaction instruction is used to determine the off-vehicle interaction mode that the vehicle complies with. According to the triggered interaction mode, the interaction instruction is divided into a first interaction instruction and a second interaction instruction. Specifically, the first out-of-vehicle interaction instruction is used to trigger the first out-of-vehicle interaction mode, and the second out-of-vehicle interaction instruction is used to trigger the second out-of-vehicle interaction mode. The interaction instruction can be generated according to the effective condition corresponding to the off-vehicle interaction mode satisfied by the vehicle. When the vehicle is detected to meet the entry into force condition corresponding to the first off-vehicle interaction mode, the first interaction instruction is generated; when the vehicle is detected to meet the second off-vehicle interaction mode If the effective condition corresponding to the mode is not valid, a second interaction instruction is generated.

In order to enrich the interaction content in the first interaction mode, in response to the first interaction instruction, it is determined that the vehicle complies with the first out-of-vehicle interaction mode, and based on the first out-of-vehicle interaction mode, the vehicle will display a first display interface. Wherein, the first display interface is used to display the execution result of the first interactive instruction. When the first display interface is displayed, an interface can be directly displayed on the display screen as the first display interface; a pop-up window can also be displayed on the display screen. , as the first display interface; an interface or pop-up window may also be displayed on the displayed application interface as the first display interface. The display screen can be a central control screen in the vehicle cockpit, or a rear screen, or an LED (Light Emitting Diode, light emitting diode) display screen installed in the vehicle cockpit for displaying multimedia information (such as advertisements, etc.) etc. Of course, the display screen can also be other display screens inside or outside the vehicle, which will not be described one by one at this time.

In the embodiment of the application, the priority of the first out-of-vehicle interaction mode is lower than that of the second out-of-vehicle interaction mode, so in the first out-of-vehicle interaction mode, when it is detected that the vehicle meets the requirements of the second out-of-vehicle interaction mode The effective condition is that the vehicle generates a second interaction instruction, and in response to the second interaction instruction, the vehicle switches the current off-vehicle interaction mode from the first off-vehicle interaction mode to the second off-vehicle interaction mode, and then switches the first display interface is a second display interface, and the second display interface is used to display the execution result of the second interactive instruction. When switching the first display interface to the second display interface, the first display interface can be closed, and then the second display interface can be displayed on the display area of the first display interface, or the first display interface can not be closed, but can be displayed on the first display interface. A second display interface is superimposed on the display interface, and the first display interface is fully or partially blocked.

The above-mentioned first off-vehicle interaction mode can be one of welcome mode, charging mode, pet mode, child mode, sentry mode, etc., and the second off-vehicle interaction mode can be welcome mode, off-vehicle voice mode, or parking mode , one of the park-out modes. In subsequent embodiments, different interaction modes outside the vehicle will be described in detail.

In the method provided in the embodiment of the present application, when the off-vehicle interaction is performed based on the interactive command, the interactive interface corresponding to the off-vehicle interaction mode is displayed according to the off-vehicle interaction mode triggered by the interactive command, and the interactive interface is used to display the execution result of the interactive command . In the off-vehicle interaction scene, the switching between different interaction modes is not easy for users to perceive. By displaying the execution results of interactive commands in different interaction modes on the interactive interface, not only the interaction form is enriched, but also the user can view different interactive modes. interactive information, so as to be able to better use the interactive function. In addition, there is no need for the user to manually switch between different interaction modes in this process, and it can be automatically switched according to the interaction command, and the interaction efficiency is high.

The embodiment of the present application provides a vehicle interaction method, taking the first out-of-vehicle interaction mode as the welcome mode, and the second out-of-vehicle interaction mode as the out-of-vehicle voice mode as an example, see Figure 4, the method flow provided by the embodiment of the present application include:

401. In response to the welcome instruction, determine that the vehicle meets the welcome mode, and display a welcome interface based on the welcome mode.

Among them, the welcome mode is an interactive mode that detects that the main driver is approaching the vehicle, and is used to increase the ritual sense of the main driver driving the vehicle, and at the same time facilitate the main driver to get on and off the vehicle. This interaction mode not only involves the interaction outside the car such as external lights, speakers, and doors, but also involves the interaction in the smart cockpit such as seats, fragrance system, and air conditioning system. The opening of the welcome mode requires the vehicle to meet the welcome conditions. Specifically, the welcome condition is: the digital key is within the first preset range. The first preset range is the communication range between the digital key and the vehicle, and the first preset range is determined by the communication capabilities of the digital key and the vehicle.

Wherein, the welcoming instruction is generated when it is determined that the vehicle meets the welcoming conditions. In response to the greeting command, the vehicle performs an out-of-vehicle interaction based on the greeting mode. When the out-of-vehicle interaction is performed based on the welcome mode, the vehicle can be controlled to execute the welcome instruction according to the welcome mode, that is, the greeting components of the vehicle are controlled to perform preset welcome actions. The welcome component includes at least one of a main driver's door, an exterior lamp, an interior lamp, an exterior speaker, a suspension, an air-conditioning system, a fragrance system, a driver's seat, and the like. The exterior lights include at least four pixel lights, front interactive lights, rear interactive lights, four wheel eyebrow lights or other lighting devices. Interior lights include at least ambient lights, dome lights, or other devices capable of lighting. For the above-mentioned different welcome components, when the vehicle controls the welcome component to perform preset welcome actions, it includes at least one of the following:

For the main driving door, the main driving door can be controlled to open to a preset angle. The preset angle can be set on the welcome function setting interface; it can also be determined according to the surrounding environment, specifically, if no other vehicles are parked near the main driver's door, a larger value can be selected for the preset angle; if If there are other vehicles parked near the main driving door, you can select a smaller value for the preset angle to avoid scratches between the main driving door and other vehicles.

For the exterior lights, the exterior lights can be controlled to display according to the set light effects. Wherein, the set lighting effect can be set on the welcome function setting interface. For example, the first preset color (such as red, yellow, green, white, etc.) can be used to display all or part of the external vehicle lights, or multiple colors can be displayed in a set order, or it can be used to control external vehicle lights. All or some of the lights blink with a first preset frequency.

For the interior lights, the interior lights can be controlled to display according to the set light effects. Wherein, the set lighting effect can be set on the welcome function setting interface. The set lighting effect can be displayed in the preset second preset color (for example, yellow, red, etc.) All or part of is blinking at a first preset frequency.

For the speakers outside the car, the speakers outside the car can be controlled to play preset welcome sound effects. Wherein, the preset welcome sound effect can be set on the welcome function setting interface. The preset welcome sound effect can be a sound effect stored locally in the vehicle, or it can be a sound effect obtained from the outside, for example, a sound effect downloaded from the Internet, or, through a hand-held terminal (for example, a smart phone, tablet computer, etc.) etc.) The sound effect of communication received.

For the suspension, the suspension of the vehicle can be controlled to lower to a preset height. Wherein, the preset height can be determined according to the height of the vehicle itself and the attribute of the main driver itself. For example, if the height of the vehicle itself is relatively high, and the main driver is a female user with a relatively short height, the preset height can be set to a smaller value.

For the air-conditioning system of the vehicle, it can control the air-conditioning of the vehicle to be turned on.

For the fragrance system of the vehicle, it can control the fragrance system of the vehicle to be turned on.

For the main driver's seat, it can be determined whether to heat the main driver's seat according to the outside temperature. When it is detected that the outside temperature is lower than the preset temperature, the heating of the driver's seat is controlled. Wherein, the preset temperature may be 20 degrees, 15 degrees and so on.

According to the distance between the digital key and the vehicle, the welcome mode includes a far-field welcome mode and a near-field welcome mode. When the distance between the digital key and the vehicle is relatively long, the far-field greeting mode can be used for greeting guests; when the distance between the digital key and the vehicle is relatively short, the near-field greeting mode can be used for greeting guests.

In different welcome modes, different welcome parts can be selected for greeting guests, and the same welcome parts can also be selected for greeting guests. When the same welcome parts are selected for greeting guests, the same welcome part will The welcome actions performed in guest mode are different. For example, in the far-field welcome mode, the distance between the user and the vehicle is relatively long, and the welcome components can be external lights, external speakers, etc.; in the near-field welcome mode, the distance between the user and the vehicle is relatively short , The welcome parts can be the main driver's door, interior lights, exterior speakers, suspension, air conditioning system, fragrance system, driver's seat, etc. For external speakers, welcome guests by playing different sound effects in different welcome scenes.

When the out-of-vehicle interaction is performed based on the welcome mode, the embodiment of the present application will also display a welcome interface. When the welcome interface is displayed, it may be displayed directly on the display screen, or displayed in a pop-up window on the display screen, or superimposed on the application interface already displayed on the display screen. The welcome interface is used to display the execution result of the welcome instruction, and the execution result of the welcome instruction is the execution result of the greeting component according to the preset welcome action. In order to display the execution results more vividly, existing components in the driving area, such as 3D vehicle models, can be reused for display. Specifically, according to the execution result of the welcome component according to the preset welcome action, the welcome motion effect of each welcome component on the three-dimensional vehicle model can be displayed. Among them, the dynamic effect refers to the dynamic effect, specifically, refers to the motion effect presented on the vehicle's central control screen, rear screen and other screens. In the welcome mode, at least one of the dynamic effects of opening the main driver's door, the lowering of the suspension, and the heating of the main driver's seat on the three-dimensional vehicle model is included. Certainly, the welcome text message may also be displayed on the welcome interface, and the content of the welcome text message may be "welcome to drive the vehicle" and so on.

The welcome interface may also display options for exiting the welcome mode and setting options for the welcome mode. In the welcome mode, in response to a touch operation for the exit option of the welcome mode, the vehicle will exit the welcome mode. After exiting the welcome mode, the welcome component stops performing the welcome action, and the welcome interface is closed. In response to a touch operation for the setting option, the vehicle displays a greeting mode setting interface, based on which the greeting component and its greeting method can be adjusted.

By displaying the welcome interface, this application can not only better cooperate with the welcome parts to welcome guests, increase the sense of ritual of the target object driving the vehicle, but also directly display the final welcome effect map to the user, so that the user can adjust it according to their own preferences Welcome way.

In another embodiment of the application, in response to the welcome instruction, the lighting effect corresponding to the execution result of the welcome instruction will also be displayed. Among them, the lighting effect refers to the effect presented when one or more lights inside or outside the vehicle adopt different light colors, different brightness, different flicker frequencies or different light flow directions to flow. In the welcome mode, the lights used to welcome guests include interior lights and exterior lights. The interior lights mainly include ambient lights, and the exterior lights mainly include four pixel lights, wheel eyebrow lights, and two interactive lights at the front and rear.

In the welcome mode, the lighting effects of different car lights can be different. Figure 5 shows the lighting effects in the welcome mode, where the front interactive light 501 and the rear interactive light 504 greet guests in a counterclockwise direction of light flow, the pixel lights 502 greet guests with maximum brightness, and the wheel eyebrow lights 503 use Welcome guests with yellow lights.

402. In response to the voice command outside the vehicle, determine that the vehicle complies with the voice mode outside the vehicle, and switch the welcome interface to the voice interface outside the vehicle based on the voice mode outside the vehicle.

Wherein, the off-vehicle voice instruction includes an off-vehicle voice query instruction, and the off-vehicle voice query instruction is used to inquire whether the off-vehicle voice function is available. When detecting whether the off-vehicle voice function is available, it may be determined whether the vehicle satisfies the condition for the availability of the off-vehicle voice, and when it is determined that the vehicle satisfies the condition for the availability of the off-vehicle voice, it is determined that the off-vehicle voice function is available. The off-vehicle voice availability condition is a condition that needs to be met when the vehicle has the off-vehicle voice collection capability. The available conditions for voice outside the car include the following items:

The first item, the digital key, is within the second preset range.

Wherein, the digital key is a car key with a communication function. A communication module is installed in the digital key, and based on the communication module, the digital key can communicate with the vehicle. The communication module includes any one of a Bluetooth module, an infrared module, an NFC module, a WIFI module, and the like. The second preset range is the range within which the microphones outside the vehicle can collect voice information, and the second preset range can be determined according to the number and position of the microphones outside the vehicle and the collection capability of each microphone.

The second item, the main driver is not seated or the vehicle is not in gear.

Item 3, the vehicle is not in a parked state.

Wherein, the parking state includes a parking state or a parking state. When the vehicle is in the parking state, other voice commands may affect the parking effect and even cause damage to the vehicle. Therefore, at this time, the parking command should be executed first, and the outside voice function should not be activated.

The fourth item, the voice mode outside the car is on.

In order to enable the user to flexibly select a corresponding voice mode in different scenarios, the embodiment of the present application supports switching between the in-vehicle voice mode and the out-of-vehicle voice mode. When switching between different voice interaction modes, the following methods can be used:

The first way is to manually switch based on the voice mode switching control displayed on the central control screen. In the voice mode outside the car, switch the voice mode outside the car to the voice mode in the car by touching the voice mode switching control; in the voice mode in the car, switch the voice mode in the car to Voice mode outside the car. After the voice mode outside the car is turned on, the voice mode inside the car is disabled. At this time, the voice image used to represent the voice function in the car on the central control screen is not available. Figure 6 shows the voice mode switching control displayed on the central control screen. The voice mode switching control displays a voice image and a text box used to represent the voice function in the car. The voice mode switching switch and the currently enabled voice mode. In Figure 6, the voice function outside the car is available, but the voice image is not available at this time, the text information in the voice activation outside the car is displayed in the text box, and the text information switched back to the car is displayed on the voice mode switching switch. In the voice mode outside the vehicle, when a touch operation of the voice mode switching switch is detected, the voice mode outside the vehicle can be switched to the voice mode inside the vehicle.

The second way is to switch based on voice commands. In the in-vehicle scenario, when an instruction to turn on the voice mode outside the vehicle is received, the voice mode outside the vehicle is turned on in response to the instruction to turn on; foreign voice mode. After receiving the on/off command of the off-vehicle voice mode, it is detected whether the user account is logged in. If the user account is not logged in, the user is reminded that if the off-vehicle voice mode needs to be turned on, the account needs to be logged in. If the user account is logged in, the in-vehicle foreign voice mode.

Furthermore, when the off-vehicle voice mode is turned on/off, it can be detected whether the user account has been registered with a voiceprint, and if the user account has not been registered with a voiceprint, the user is prompted to register a voiceprint to use the off-vehicle voice function.

In response to the off-vehicle voice query instruction, when it is determined that the off-vehicle voice function of the vehicle is available, it is determined that the vehicle meets the off-vehicle voice mode. At this time, the off-vehicle voice function is not activated, and the vehicle cannot execute the voice command. When it is determined that the vehicle meets the external voice mode, the vehicle switches the welcome interface to the external voice interface. The voice interface outside the vehicle may be in the form of an application interface or in the form of a pop-up window. The interface switching method may include the following situations:

In the first case, the welcome interface is closed, and the voice interface outside the vehicle is displayed on the display area of the welcome interface.

In the second case, an external voice interface is superimposed on the welcome interface, and the welcome interface is partially or completely blocked.

The off-vehicle voice interface is used to display first indication information. The first indication information is used to indicate the available information of the off-vehicle voice. , effect information and text information identified by the position of the microphone. The position of the microphone is determined according to the position of the microphone in a real scene. The text information not only includes text information identifying the available area of the outside-vehicle voice and the position of the microphone, but also includes text information for prompting the user how to activate the outside-vehicle voice function. Figure 7 shows an out-of-vehicle voice interface showing available information for the out-of-vehicle voice.

In another embodiment of the present application, in response to the outside-vehicle voice query instruction, it is determined that the vehicle meets the outside-vehicle voice mode, and in order to indicate to the user that the outside-vehicle voice function is available, the vehicle will also control the target vehicle lights according to the sixth light effect mode. to show. The target vehicle light includes all or part of the vehicle lights, and the embodiment of the present application does not specifically limit the target vehicle light. The sixth light effect can be the light effect that the target car light continuously breathes and flashes according to the second preset frequency, or it can be the light effect that the target car light is turned off, that is, no light effect is used to indicate that the voice outside the car is not activated . The lighting effect in the inactive state can be seen in FIG. 8 . Since the voice function outside the car is not activated, voice commands cannot be executed at this time. If the external speakers play the preset sound effects in the welcome mode, you can also control the external speakers to continue playing the preset welcome sound effects.

When the above-mentioned welcome mode is switched to the voice mode outside the vehicle, because the voice function outside the vehicle is not activated, the vehicle performs part of the welcome operation in the welcome mode. At this time, the part of the welcome mode is displayed on the voice interface outside the vehicle Execution results and partial execution results in the voice mode outside the car. For example, the voice interface outside the vehicle displays the welcome animation effects of some welcome parts in the 3D vehicle model, and also displays the effect information and text that use dynamic effects such as flow and breathing to mark the available area of the voice outside the vehicle and the position of the microphone. Information, as well as the light effect animation of the target car light.

In the embodiment of the application, in response to the query command of the voice outside the vehicle, the vehicle is in the voice mode outside the vehicle. At this time, the voice function outside the vehicle is available and has the ability to collect voice information outside the vehicle. The voice interaction outside the vehicle needs to collect the voice information of the target object to activate the voice function outside the vehicle, so as to realize the voice interaction outside the vehicle. Wherein, the target object is the user whose voice command can be executed in the scene outside the vehicle, and the target object may be the owner user, other users closely related to the user outside the vehicle, for example, family members and friends of the owner user. Under the condition that outside voice is available, there are several ways to activate the outside voice function. For example, the activation of the voice function outside the vehicle can be triggered by at least one of the following two conditions:

The first condition: the target object has registered voiceprint

In the scenario of voice interaction outside the vehicle, in order to prevent illegal users outside the vehicle from illegally controlling the vehicle, it is necessary for the target object to register voiceprint in the vehicle in advance. During voiceprint registration, the vehicle stores the voice information of the target object. In the off-vehicle voice scene, after the vehicle collects the voice information of the target object, compare the voice information with the stored registered voice information, when the voice information matches any of the stored registered voice information , to determine that the target object is a legitimate user who has registered the voiceprint. When comparing the voice information with the stored voice information, the voiceprint features of the voice information can be extracted, and then the extracted voiceprint features are compared with the stored voiceprint features of each registered voice information. When the voiceprint feature of the target object matches the voiceprint feature of any registered voice information stored, it is determined that the voice information of the target object matches the stored voice information.

When the voice information of the target object does not match the stored voice information, it can be determined that the target object has not registered the voiceprint. At this time, the target object needs to be reminded to register the voiceprint before using the voice function outside the car. When reminding the target object of voiceprint registration, the prompt information for voiceprint registration can be broadcast by voice, for example, "You have not registered your voiceprint, you need to register your voiceprint in the car before you can use the voice function outside the car." ; A prompt message for voiceprint registration can also be displayed on the central control screen.

The second condition: the voice message of the target object contains the preset wake-up word

When it is determined that the target object is a legal user who has registered the voiceprint, the voice information of the target object is then recognized. When recognizing the voice information of the target object, the voice information can be input into the voice recognition model, processed by the voice recognition model, and the text content corresponding to the voice information is output, and then it is recognized whether the text content contains preset wake-up word. The speech recognition model is used to convert speech information into text content, and the speech recognition model can be obtained by training with existing deep learning methods, and will not be described in detail here.

When the external voice mode is turned on, the digital key is within the first preset range, the driver is not seated or the vehicle is not in gear, the vehicle is not in parking state, the voiceprint registration of the target object has been performed, and the voice information of the target object When the preset wake-up word is included in , it can be determined that the outside voice function is activated. That is to say, when the vehicle meets all the above items, it is determined that the vehicle's external voice function is activated, and at this time the voice information of the target object can be collected and corresponding operations are performed; when the vehicle meets the above-mentioned partial items, it is determined that the external voice function is not activated. Activated.

Figures 9 to 11 show several scenes outside the car, where 901 indicates the range of voice information that can be collected by the microphone, 902 indicates the communication range of the digital key, 903 indicates the digital key, 904 indicates the registered voiceprint, and 905 indicates Unregistered voiceprint, 906 means the main driver has taken his seat. Referring to Figure 9, in this scenario, the voice function outside the vehicle is turned on, the vehicle is not in the automatic parking state, the digital key is within the second preset range, the target object has registered voiceprint, and the target object’s voice information contains the preset wake-up word , it can be determined that the outside voice function is activated. Referring to FIG. 10 , in this scenario, if the target object has not registered the voiceprint, it can be determined that the voice function outside the vehicle is not activated. Referring to Fig. 11, in this scenario, if the main driver is already seated, it can be determined that the voice function outside the car is not activated.

When the voice function outside the vehicle is activated, the vehicle is in the state of listening to the voice information of the target object. In the listening state, the vehicle can also call the microphones arranged around the vehicle body to detect the voice information of the target object in real time. If the voice information of the target object is detected within the preset time period, for example, within 15 seconds, the voice information will be processed. recognition, if the voice information is valid voice information, that is, includes effective human voice information, then based on the voice instructions recognized in the voice information, the vehicle is controlled to perform corresponding operations, the voice instructions include parking in instructions, parking out instructions, Door open command, door close command, door lock command, door unlock command, etc.

In the embodiment of the present application, after the vehicle is controlled to execute the instruction in the voice mode outside the vehicle, it will also broadcast the execution of the instruction. According to the voice status of the voice information of the target object, the content played by the vehicle to control the external speaker is different. When the voice information of the target object is in the listening state, the vehicle can control the speakers outside the vehicle to play the listening prompt information, so as to convey the feeling of listening to the target object. The listening prompt information can be "here", "hello" and so on; when the voice information is in the broadcast state, control the speaker outside the car to play the execution result of the execution command of the voice outside the car, the type of execution result includes forward execution A result and a negative execution result, the positive execution result is used to indicate that the instruction was successfully executed, and the negative execution result is used to indicate that the instruction failed to be executed or could not be recognized. For the forward execution result, before using the speaker outside the vehicle to broadcast, it is necessary to judge whether the forward execution result can be broadcast. If the forward execution result can be broadcast, then use the speaker outside the vehicle to broadcast the forward execution result. Doors open/closed, locked/unlocked, etc. for you. For the negative execution result, the reason why the instruction cannot be executed can be announced by the voice outside the car, for example, the instruction cannot be recognized, the execution of the instruction is not supported temporarily, and so on.

In another embodiment of the application, in response to the execution instruction of the voice outside the vehicle, the corresponding lighting effect of the execution result of the execution instruction will also be displayed. According to the execution result of the execution instruction, when the vehicle displays the lighting effect corresponding to the execution result, the following situations may be included:

In the first case, when the execution result of the execution instruction is that the voice information of the target object is in the listening state, the target light of the vehicle is controlled to display the first light effect.

Among them, the listening state is also the state of receiving the voice information of the target object. At this time, the effective voice information of the target object is not collected, and the target light of the vehicle will be controlled to display the first light effect. The first light effect can be the target The lights continue to breathe and flash. The lighting effects in this listening state can be seen in Figure 12.

In the second case, when the execution result of the execution command is that the voice information is in the recognition state, the target light of the vehicle is controlled to display the second light effect.

Wherein, the recognition state is a state of collecting voice information of the target object and recognizing the voice information. The second lighting effect can be a lighting effect in which the vehicle's target lights follow the ups and downs of the voice information of the target object to breathe and flash. Since the change of the second lighting effect is consistent with the fluctuation of the voice information of the target object, it conveys Give the feeling that the voice information of the target object is being collected. When controlling the target lights of the vehicle to display the second light effect, voice features can be extracted from the voice information of the target object, such as the high value of the human voice, and then according to the extracted high value of the human voice, the target lights are controlled to follow the target The ebb and flow of the subject's voice message is breath-flickering. The lighting effects in this recognition state can be seen in Figure 13.

In the third case, when the execution result of the execution instruction is that the voice information is in the feedback state, according to the type of the execution result of the second interactive instruction, the control target vehicle lights are displayed according to the corresponding type of light effect.

In this embodiment of the present application, different lighting effects are set in advance for different types of execution results, so that when the execution results are obtained, different lighting effects can be used for displaying different types of execution results. Specifically, the lighting effect that can be set for the positive execution result is the third lighting effect, and the lighting effect that can be set for the negative execution result is the fourth lighting effect. Since there are many types and quantities of car lights inside and outside the vehicle in the embodiment of the present application, and different types of car lights have different styles, when using these car lights to express the success or failure of voice command execution, it can be set for different types of car lights. Different lighting effects can finally show the success or failure of the voice command as a whole. Specifically, for the front and rear two interactive car lights, different light flow directions can be set for different types of execution results, and for the four pixel lights and four wheel eyebrow lights, different colors can be set for different types of execution results and brightness. For example, for the positive execution result, the third lighting effect is set as follows: the light flow in the front and rear two interactive car lights flows in a clockwise direction, and the four pixel lights and the four wheel eyebrow lights display green light effects; for the negative execution As a result, the fourth lighting effect is set: the light flow in the front and rear two interactive car lights flows in a counterclockwise direction, and the four pixel lights and the four wheel eyebrow lights display red light effects.

Based on the pre-set lighting effects for different types of execution results, when the type of execution result is successful, the vehicle control target lights will be displayed using the third lighting effect. The lighting effect of the positive execution result can be seen in Figure 14; The type of the result is failure, and the vehicle control target lamp is displayed using the fourth lighting effect. The lighting effect of the negative execution result can be seen in FIG. 15 .

For the above-mentioned parking in instruction, parking out instruction, door opening instruction, door closing instruction, door locking instruction, and door unlocking instruction, when the vehicle is controlled to execute the instructions in the voice mode outside the vehicle, the following will introduce them respectively.

For the parking command, see Figure 16. In response to the parking command, the vehicle judges whether the voiceprint corresponding to the parking command and the account corresponding to the digital key are the same user. If they are the same user, execute the command. If not For the same user, the user is prompted that the voice function outside the vehicle cannot be used. In response to the parking instruction, the vehicle judges whether the parking instruction is executable, and if the parking instruction is executable, controls the vehicle to park in the parking space, and cooperates with the corresponding lighting effect and Sound effect; if the parking command cannot be executed, for example, it detects people/pets in the car, detects that the four doors and two lids are not closed, the charging plug is not pulled out, and no parking space is selected, etc., the voice broadcasts the reason why it cannot be executed.

For the parking command, see Figure 17. In response to the parking command, the vehicle judges whether the voiceprint corresponding to the parking command and the account corresponding to the digital key are the same user, if they are the same user, execute the command, if not For the same user, the user is prompted that the voice function outside the vehicle cannot be used. In response to the parking command, the vehicle judges whether the parking command is executable. If the parking command is executable, the vehicle is controlled to park from the outside of the vehicle, and during the execution of the parking command, the corresponding lighting effect and Sound effect: If the parking command cannot be executed, for example, it is detected that there are people/pets in the car, it is detected that the four doors and two covers are not closed, the charging plug is not pulled out, and no parking space is selected, etc., the voice broadcasts the reason why it cannot be executed.

For the command to open/close the car door, refer to FIG. 18 , in response to the command to open/close the car door, determine whether the command to open/close the car door contains a precise control area, and the precise control area includes the main driving area, the co-driving area, and the left rear area , right rear area, front row area (including main driver and co-driver), rear row area, left side area (including main driver and left rear area), right side area (including main driver and right rear area), main driver and rear row area , co-pilot and rear area, main driver and right rear area, main driver and left rear area, co-pilot and rear area, co-pilot and left rear area, all areas, etc. Whether the door instruction contains a fuzzy control area, the fuzzy control area includes the front door area, the rear door area, etc., if it does not include the fuzzy control area, then the voice will broadcast "Let's talk when you get in the car", if it includes the fuzzy control area, then judge the Whether the open/close door command is in the wake-up sound zone, if it is in the wake-up sound zone, control the opening/closing of the front door or rear door corresponding to the wake-up sound zone, if it is not in the wake-up sound zone, the voice broadcast "Need to be more specific, try Wake up and say to me, open/close the driver's door". If the precise control area is included, the door opening/closing command is executed based on the precise control area. During execution, it is necessary to judge whether the door opening/closing command is allowed, and if the door opening/closing command is allowed to be executed, control the door opening/closing , and cooperate with corresponding light effects and sound effects during the execution of the door opening/closing command; if the door opening/closing command is not allowed to be executed, for example, the door has been opened/closed, there are obstacles near the door or other reasons, Then the voice broadcast cannot execute the reason.

For the door lock instruction, referring to Fig. 19, in response to the door lock instruction, before executing the door lock instruction, it will also detect whether there is a door that is not closed (including the tailgate), and if there is an unclosed door, the voice broadcast There is also a door that is not closed; if there is no unclosed door, judge whether the instruction is executable, if the instruction is not executable, for example, the door is locked or other reasons, then the instruction will not be executed; if the instruction is executable, Then lock the door based on the instruction, and cooperate with corresponding light effects and sound effects during the execution of the instruction.

For the door unlock command, refer to Figure 20, in response to the door unlock command, judge whether the door unlock command can be executed successfully, if it can be executed successfully, unlock the car door, and cooperate with the corresponding light effect and sound effect; if not execute If it succeeds, the reason for the execution failure can be announced by voice.

In the embodiment of the present application, in response to the execution instruction of the outside-vehicle voice, when the vehicle is controlled to execute the instruction in the outside-vehicle voice mode, the execution result in the outside-vehicle voice mode will also be displayed on the outside-vehicle voice interface. The results include dynamic effects and text information of the 3D vehicle model. Although the off-vehicle voice function is in the off-vehicle voice mode from the available state to the activated state, and when the off-vehicle voice function is in the In different states of the voice function, the interactive content is different, and the dynamic effects and text information of the 3D vehicle model displayed on the voice interface outside the vehicle are different.

When the external voice function is activated, the dynamic effect of the three-dimensional vehicle model displayed on the external voice interface is the dynamic effect of the action performed by the controlled component. For example, the controlled component is the door, and the action performed is to open the door/ When the door is closed, the dynamic effect of opening/closing the controlled door in the 3D vehicle model is displayed; the text information displayed on the voice interface outside the vehicle is the text information describing the success or failure of the execution of the command.

In the embodiment of the application, a voice mode switch control is also displayed on the voice interface outside the vehicle. In the voice mode outside the vehicle, in response to a touch operation on the voice mode switch control, the voice mode outside the vehicle is switched to the voice in the vehicle. model.

The embodiment of the present application describes the switching between the welcome mode and the voice mode outside the vehicle. Both the welcome mode and the voice mode outside the vehicle have corresponding effective ranges in the scene outside the vehicle. As shown in FIG. 21, 2101 represents the welcome Range, 2102 indicates the unlocking range of the voice outside the vehicle, 2103 indicates the available range of the voice outside the vehicle, when the owner enters the welcome range, the vehicle will greet guests based on the welcome mode, when the owner enters the voice unlocking range outside the vehicle, the voice function outside the vehicle will be unlocked , the outside voice function is not available at this time; when the owner enters the range where the outside voice is available, the outside voice function is available.

Referring to Figure 22, the embodiment of the present application provides a vehicle interaction method, taking the first out-of-vehicle interaction mode as the sentry mode, and the second out-of-vehicle interaction mode as the out-of-vehicle voice mode as an example, the method flow provided by the embodiment of the present application includes :

2201. In response to the sentry instruction, determine that the vehicle complies with the sentry mode, and display the sentry interface based on the sentry mode.

Among them, the sentry mode is an interactive mode that realizes vehicle monitoring, vehicle warning, remote notification and event recording after the main driver leaves the car based on body anti-theft alarm and other sensory signals. The sentinel mode can be enabled in the following ways:

The first way is to automatically start the sentry mode. When the vehicle is switched to P gear, if the current location is outside the geographical white list, the sentry mode will be automatically turned on. Among them, the geographical white list can be set by the main driver; the location where the main driver often parks can also be added to the geographical white list according to the driving route of the vehicle.

The second way is to manually start the sentry mode. When the vehicle is switched to the P position, the user calls out the sentry mode switch, and the sentry mode is turned on by touching the sentry mode switch. In P mode, when the sentry mode is turned on, the status bar displays the sentry icon; when the sentry mode is not turned on, the status bar does not display the sentry icon, and the sentry icon on the status bar cannot be clicked, it is only displayed. Usually the sentinel mode enable switch is off by default, and the switch is grayed out when the following conditions are not met:

1. The current vehicle is in P gear;

2. The current account is a legal user;

3. The hardware and software on which the sentinel mode depends are functioning normally;

4. Power condition: it is charging or the current display power is higher than 10%.

In the third way, when the vehicle is switched to the P gear, the vehicle will prompt the user to turn on the sentry mode by means of voice broadcast or display on the screen. Specifically, when the gear is switched to the P position, it is detected whether the sentinel enable switch and the scene switch are off, and whether the power meets the conditions. When it is determined that the sentinel enable switch and the scene switch are turned on, and the power meets the conditions, the scene engine It is judged whether the conditions for recommending Sentinels are currently satisfied, and if so, the P file component pushes Widgets (widgets, in simple terms, can be understood as application widgets) to ask the main driving user whether to enable Sentinel mode. When the main driver chooses to enable the sentry mode, it requests to enable the sentinel.

After the sentry mode is turned on, the sentinel idle state is activated. When it is detected that the main driver leaves the car and locks the car and turns off the power, the sentry mode will run to determine whether the vehicle is charging or the current display power is higher than 10%. If the operation fails, the sentinel switch will be automatically turned off, and a remote message will be sent to remind the main driver; if it is satisfied that it is charging or the current display power is higher than 10%, continue to judge whether the power is higher than 20%, if not, send a remote message The message reminds the main driver that if the currently supported sentinel duration is higher than 20% of the battery capacity, the system will call the ultrasonic radar installed on the vehicle body, the electric inner millimeter wave radar, and the AVM (Around View Monito, panoramic monitoring image system) camera. It senses the external environment, takes a video of the external environment, stores the event photos and videos to the storage device, and then remotely prompts the user terminal (such as a mobile phone) to view the photos and videos.

When the sentry mode is turned on, the vehicle will display the sentinel pattern on the display screen, and voice broadcast the prompt message that the sentry mode is turned on. In order to save power, the sentinel pattern is not displayed all the time. When the sentinel pattern is displayed for a certain period of time (for example, 5 seconds, 10 seconds, etc.), the display screen is turned off. Fig. 23 shows a reminder effect diagram of a sentry mode, where 2301 represents the exterior lights, 2302 represents the display screen inside the car, and 2303 represents the speaker outside the car. When the sentry mode is turned on, the display screen displays a sentinel pattern. The speaker outside the car broadcasts a prompt message that the sentry mode is turned on.

When the vehicle exits sentry mode, the sentry enable is turned off. The exit methods of the sentry mode include: the user unlocks the car door; remotely closes the sentry mode; the power is lower than the power of the sentry mode; the user manually exits in the car; the user exits by voice in the car, etc.

When it is detected that the user gets on the car, if an abnormal sentinel event is recorded while the user is leaving the car and the currently logged-in account is a legal account, for example, the account registered or logged in when the user first turned on the sentry mode, the detected sentinel event will be checked. Reminders, for example, the sentinel event Widget pushes "an abnormal event was detected during leaving the car, click to enter the album-sentry video view".

In the sentinel mode, the vehicle uses external cameras, radars and other equipment to monitor the external environment in real time. When it detects that the external environment changes meet the alarm conditions of the sentinel mode, in response to the vehicle meeting the alarm conditions of the sentinel mode, according to the trigger information of the sentinel mode, control Vehicles use different alarm methods to report to the police.

Specifically, according to the trigger information of the sentinel mode, the control vehicle adopts different alarm methods to alarm, including but not limited to the following situations:

In the first case, when the digital key of the vehicle is not detected, and it is detected that the distance between the object outside the vehicle and the vehicle is less than the first preset distance and the duration is longer than the first preset distance, the lights of the vehicle are controlled according to the third The lighting effect is displayed, and the alarm information is displayed on the first display interface.

Wherein, the external object may be a person or a non-person (such as an animal). For different external objects, the first preset distance is different. When the external object is a person, the first preset distance may be 0.3 meters, 0.5 meters, 1 meter, etc.; when the external object is a non-person, the first preset distance may be 0.2 meters, 0.1 meters, etc. The first preset duration may be 30 seconds, 60 seconds and so on. The third light effect is used to warn external objects that they are approaching, and the third light effect may be a light effect in which the external vehicle lights are continuously on and the internal vehicle lights are yellow. Along with the change of the lighting effect, the alarm information is synchronously displayed on the first display interface, the first display interface is a sentinel interface, and the content of the alarm information can be "recording" and so on.

Fig. 24 shows an alarm effect diagram triggered by sentry mode, where 2301 represents the exterior lights, 2302 represents the display screen inside the car, 2303 represents the speakers outside the car, 2304 represents the interior atmosphere lights, and 2305 represents people outside the car. In the case that the digital key of the vehicle is not detected, when the distance between the person 2305 and the vehicle is detected to be less than the first preset distance and the duration is longer than the first preset duration, the exterior lights 2301 and the interior ambient lights are turned on 2304 , the color of the interior ambient light 2304 is yellow, and an alarm message is displayed on the display screen 2302 at the same time.

In the second case, when the digital key of the vehicle is not detected, and it is detected that the distance between the object outside the vehicle and the vehicle is less than the second preset distance and the duration is longer than the second preset distance, the target lamp of the vehicle is controlled according to the second preset distance. The four light effects are displayed, the speakers outside the car are controlled to play the alarm sound effect, and the alarm information is displayed on the first display interface.

Wherein, the second preset distance is smaller than the first preset distance, and the second preset distance may be 0.1.m, 0.05m, etc. The second preset duration may be 50 seconds, 60 seconds and so on. The fourth light effect is used to warn external objects to stop approaching, and the fourth light effect may be a light effect in which the external vehicle lights are continuously on and the internal vehicle lights are red. Along with the change of the lighting effect, the loudspeaker outside the car plays the alarm sound effect, and the alarm prompt message is synchronously displayed on the first display interface, and the content of the alarm prompt message can be "video recording" and the like.

Fig. 25 shows another alarm effect diagram triggered by the sentry mode. When the digital key of the vehicle is not detected, when the distance between the detected person 2305 and the vehicle is less than the second preset distance and the duration is longer than the first For a preset duration, the exterior lights 2301 and the interior atmosphere lights 2304 are turned on. The interior atmosphere lights 2304 are red in color. At the same time, the speakers outside the car play alarm sound effects, and the alarm information is displayed on the display screen 2302 .

In the third case, when the digital key of the vehicle is not detected and an intrusion event of an object outside the vehicle is detected, the lights of the vehicle are controlled to display according to the fifth light effect, the speakers outside the vehicle are controlled to play an alarm sound effect, and displaying the alarm information on the first display interface.

Wherein, the fifth light effect is used to warn the external object that the alarm has stopped intrusion, and the fifth light effect can also be a light effect in which the external vehicle lights are continuously lit, and the internal vehicle lights use red light to continuously flash. Along with the change of the lighting effect, the loudspeaker outside the car plays the alarm sound effect, and the alarm prompt message is synchronously displayed on the first display interface, and the content of the alarm prompt message can be "video recording" and the like.

Fig. 26 shows another alarm effect diagram triggered by the sentry mode. In the case where the digital key of the vehicle is not detected, when an intrusion event of a person 2305 is detected, the exterior lamp 2301 and the interior ambient lamp 2304 are turned on. And the interior ambient light 2304 is continuously flashing with red light, and at the same time the speaker outside the car plays an alarm sound effect, and the alarm information is displayed on the display screen 2302 .

2202. In response to the voice command outside the vehicle, determine that the vehicle complies with the voice mode outside the vehicle, and switch the sentinel interface to the voice interface outside the vehicle based on the voice mode outside the vehicle.

In the embodiment of the present application, when the vehicle is in sentinel mode, when the vehicle satisfies the availability condition of the external voice, the vehicle generates a query command of the external voice, and in response to the query command of the external voice, it is determined that the vehicle meets the external voice mode , based on the voice mode outside the vehicle, the vehicle will turn off the light effect of the sentry mode, control the light effect of the target car to display the light effect corresponding to the inactive state, and continue to play the alarm sound effect of the sentry mode.

In the embodiment of the present application, based on the voice mode outside the vehicle, the vehicle also switches the sentry interface to the voice interface outside the vehicle. The off-vehicle voice interface is used to indicate available information on the off-vehicle voice. When the sentinel mode is switched to the off-vehicle voice mode, the off-vehicle voice function is not activated, and the vehicle continues to perform some operations in the sentinel mode. Partial execution results in speech mode. For example, the voice interface outside the vehicle displays the welcome animation effects of some welcome parts in the 3D vehicle model, and also displays the effect information and text that use dynamic effects such as flow and breathing to mark the available area of the voice outside the vehicle and the position of the microphone. Information, as well as the light effect animation of the target car light.

Further, when the external voice function is activated based on the available information, the vehicle generates an execution command of the external voice, responds to the execution command of the external voice, turns off the alarm sound effect of the sentry mode, and performs corresponding operations based on the execution command . During the execution of the execution instruction, according to the execution result, the corresponding lighting effect is displayed, and at the same time, the execution result of the execution instruction is displayed on the voice interface outside the vehicle. For the display method of the lighting effect corresponding to the execution result and the display effect of the execution result on the voice interface outside the vehicle, please refer to the above steps, which will not be repeated here.

Due to the activation of the voice function outside the vehicle, the vehicle no longer performs the operation in the sentry mode, and the execution result of the execution command is displayed on the voice interface outside the vehicle.

Referring to Fig. 27, the embodiment of the present application provides a vehicle interaction method, taking the first out-of-vehicle interaction mode as the sentry mode, and the second out-of-vehicle interaction mode as the welcome mode as an example, the method flow provided by the embodiment of the present application includes:

2701. In response to the sentry instruction, determine that the vehicle complies with the sentry mode, and display the sentry interface based on the sentry mode.

2702. In response to the welcome instruction, determine that the vehicle meets the welcome mode, and switch the sentinel interface to the welcome interface based on the welcome mode.

In the embodiment of the application, when the vehicle is in the sentry mode, when the vehicle meets the welcome condition, the vehicle generates a welcome instruction. In response to the greeting instruction, it is determined that the vehicle conforms to the greeting pattern, and based on the greeting pattern, the light effect and the sound effect of the sentry pattern are turned off, and then the greeting instruction is executed according to the greeting pattern.

In the embodiment of the application, based on the welcome mode, the vehicle also switches the sentry interface to the welcome interface. When the sentinel interface is switched to the welcome interface, the sentinel interface can be closed, and the welcome interface can be displayed on the display area of the sentinel interface. The welcome interface can be in the form of an application interface or a pop-up window; it can also be directly The welcome interface is displayed on the sentry interface; the welcome interface can also be displayed in a pop-up window on the sentry interface. The execution result of the welcome mode is displayed on the welcome interface. The display method and display content of the execution result of the welcome mode will not be repeated here.

Referring to Fig. 28, the embodiment of the present application provides a vehicle interaction method, taking the first out-of-vehicle interaction mode as the charging mode, and the second out-of-vehicle interaction mode as the out-of-vehicle voice mode as an example, the method flow provided by the embodiment of the present application includes :

2801. In response to a charging instruction, determine that the vehicle meets the charging mode, and display a charging interface based on the charging mode.

Among them, the charging mode is an out-of-vehicle interactive mode for charging the vehicle by inserting the charging gun into the charging port. For self-driving vehicles, in order to facilitate the user to check the battery power, so that the battery can be charged in time when the battery power is low, when the vehicle is in the D position, the vehicle's central control screen displays the remaining power of the battery and the corresponding cruising range . When the vehicle is not in the charging state, the user can adjust the target charging amount, that is, the charging limit value, by voice, for example, adjust the target power to 90%; when the vehicle is in the charging state, the user can also adjust the target power value by voice. Considering that during the charging process, charging-related information is displayed in the driving information area, in order to avoid information dispersion, after successful execution, the car model components displayed on the central control screen can be reused to display the adjustment results of the target power.

When the vehicle is in the P position, the charging port is opened, and the charging gun can be inserted into the charging port to charge the vehicle. In the charging mode, after plugging and unplugging the charging cable, the current charging status of the vehicle can be broadcast by voice. For example, the voice announces that the vehicle is currently charging; another example, when the charging gun fails to connect to the charging port, the voice broadcast connection is abnormal, and the charging gun needs to be replugged to ensure that the vehicle can be charged normally. In the charging mode, the user can also ask the vehicle's charging capacity, remaining charging time, battery life, etc. by voice.

In the scene outside the vehicle, when the plug-in operation of the charging gun is detected, the vehicle generates a charging command. Based on the charging command, it is determined that the vehicle meets the charging mode, and then the charging interface is displayed based on the charging mode. The charging interface is used to display the charging result of the vehicle, and the charging result includes the charging state of the vehicle, remaining charging time and so on. Among them, the charging state includes the state of opening the cover and not inserting the gun, the state of not charging with the gun inserted, the state of normal charging, the state of fast charging, and the state of abnormal charging/fault. In order to better display these states and enhance the user's perception of different states, various state effects of charging can be reflected through charging ports, charging guns, charging piles, charging effects of vehicle exterior lights, charging parking spaces and other elements in the scene.

For the state of opening the cover and not inserting the gun, the charging gun is not inserted into the charging port at this time, and the charging interface can display the dynamic effect that the 3D car model is located in the charging parking space but is not connected to the charging gun.

For the uncharged state of the gun, when the charging gun is inserted into the charging port, but the vehicle is not charged, the connection status between the charging gun and the 3D vehicle model can be continuously displayed to reflect the effect of the gun insertion.

For the normal charging state, the charging gun is inserted into the charging port at this time, and the vehicle is charged at a normal speed. The color of the 3D elements (such as adjusting the color of the charging pile, charging gun and charging port to blue), relative Elements such as the slower energy flow speed and the charging status of the external lights reflect the charging effect at normal speeds.

For the fast charging state, the charging gun is inserted into the charging port at this time, and the vehicle is charged at a relatively fast speed. The color of the 3D elements (such as adjusting the color of the charging pile, charging gun and charging port to purple), relative Elements such as the slower energy flow speed and the charging status of the exterior lights reflect the faster charging effect.

For abnormal charging/fault status, the charging gun is inserted into the charging port at this time, but the vehicle cannot be charged normally. The abnormal charging status caused by various reasons can be reflected through the color and flashing status of the 3D elements. For example, charging piles, charging The color of the gun and charging port is adjusted to red, and the charging gun and charging port continue to flash.

In the embodiment of the application, in addition to displaying the charging state of the vehicle, remaining charging time, etc. on the charging interface, the 3D vehicle models, Dock bar, status bar, etc. of other vehicles around the vehicle can also be displayed.

In this embodiment of the application, in order to enhance the user's perception of the charging state, when the charging gun is successfully inserted into the charging port, a prompt message for a successful charging connection can be played; when the vehicle is successfully charged, a prompt message for charging can be played; When charging is complete, a prompt message of charging completion can be played.

In the embodiment of the present application, based on different charging states of the vehicle, the external lights can be controlled to display with different lighting effects. For example, when the charging port cover is opened but the gun is not inserted, the external lights can be controlled to display the second preset color, for example, yellow; when the charging gun is inserted into the charging port, the external lights can be controlled to adopt the third preset frequency Flashing; when charging the vehicle at normal speed, the exterior lights can be controlled to flow at the first preset speed; when charging the vehicle at a faster speed, the exterior lights can be controlled to flow at the second preset speed flow, wherein the first preset speed is less than the second preset speed; when the charging is abnormal/faulty, the external lights can be controlled to display a third preset color, for example, red; when the charging is completed, the external lights can be controlled to display A fourth preset color, for example, green.

2802. In response to the voice command outside the vehicle, determine that the vehicle complies with the voice mode outside the vehicle, and switch the charging interface to the voice interface outside the vehicle based on the voice mode outside the vehicle.

When the vehicle is in the charging mode, when the vehicle satisfies the conditions for the external voice to take effect, the vehicle generates an external voice query command, and in response to the external voice query command, it is determined that the vehicle meets the external voice mode. Based on the external voice mode, The vehicle will turn off the lighting effect of the charging mode, and then display the lighting effect that the voice outside the car is not activated.

In the embodiment of the present application, based on the voice mode outside the vehicle, the vehicle also switches the charging interface to the voice interface outside the vehicle. The voice interface outside the vehicle not only displays the available information indicating the voice outside the vehicle, but also displays the information of the three-dimensional vehicle model. Charging information, for example, displaying a three-dimensional vehicle model on the voice interface outside the vehicle. The three-dimensional vehicle model can be displayed in a semi-transparent state, displaying the battery, current power level, charging status and target power level, etc.

When the external voice function is activated based on the available information, the vehicle generates an execution command of the external voice, responds to the execution command of the external voice, executes a corresponding operation based on the execution command, and then displays the external voice interface on the external voice interface. Execute the execution result of the command, and display the corresponding lighting effect of the execution result.

Referring to Fig. 29, the embodiment of the present application provides a vehicle interaction method. Taking the first off-vehicle interaction mode as the charging mode and the second off-vehicle interaction mode as the sentry mode as an example, the method flow provided by the embodiment of the present application includes:

2901. In response to a charging instruction, determine that the vehicle meets the charging mode, and display a charging interface based on the charging mode.

2902. In response to the sentry alarm instruction, determine that the vehicle complies with the sentry mode, and switch the charging interface to the sentry interface based on the sentry mode.

When the vehicle is in the charging mode, when the vehicle meets the conditions for the sentinel mode to take effect, the vehicle generates a sentinel alarm command. In response to the sentinel alarm command, it is determined that the vehicle meets the sentinel mode, and based on the sentinel mode, the light effect and sound effect of the charging mode are turned off, and then the sentry alarm command is executed according to the sentinel mode.

In the embodiment of the present application, based on the sentry mode, the vehicle also switches the charging interface to the sentry interface. When the charging interface is switched to the sentry interface, the charging interface can be closed, and the sentry interface can be displayed on the display area of the charging interface. The sentry interface can be in the form of an application interface or a pop-up window; it can also be directly displayed on the charging interface. The sentry interface is displayed on the charging interface; the sentry interface can also be displayed in a pop-up window on the charging interface. The sentinel interface not only displays the execution result of the sentinel command, but also displays the charging information of the three-dimensional vehicle model.

Referring to Figure 30, the embodiment of the present application provides a vehicle interaction method, taking the pet mode as the first interaction mode outside the vehicle, and the sentry mode as the second interaction mode outside the vehicle as an example, the specific interaction process is as follows:

3001. In response to a pet mode start instruction, determine that the vehicle complies with the pet mode, and display a pet mode interface based on the pet mode.

Among them, the pet mode is an out-of-vehicle interaction mode that is activated when a pet is detected among the accompanying occupants in the out-of-vehicle scene. The pet mode can be operated both when the owner is in the car and after leaving the car. It can not only provide a comfortable riding environment for pets during the car ride, but also ensure the safety of the pet and avoid pet anxiety after the owner leaves the car. After the pet mode is turned on in the scene outside the car, a prompt message for turning on the pet mode can be played to reduce the user's worries about taking pets in the car.

In the scene outside the vehicle, when it is detected that there is a pet among the accompanying occupants, in order to appease the pet and ensure the safety of the pet, the vehicle will generate a pet mode activation command, and in response to the pet mode activation command, determine that the vehicle conforms to the pet mode. Furthermore, based on the pet mode, the vehicle is controlled to execute the pet mode activation instruction according to the pet mode, thereby creating a comfortable riding environment for pets.

Specifically, control the vehicle to execute the pet mode start command according to the pet mode, including at least one of the following: adjusting the temperature of the air conditioning system to a temperature suitable for the pet; lowering the angle of the rear seat to free up more space for the pet ;Play audio/video that calms pets.

In the embodiment of the present application, in response to the start command of the pet mode, the target lights of the vehicle can be controlled to adopt corresponding light effects for display. For example, the ambient light in the car is controlled to display a fifth preset color, for example, yellow. After the pet mode is turned on, a prompt message that the pet mode is turned on can also be played.

In the embodiment of the present application, based on the pet mode, the vehicle will also display the pet mode interface, which is used to display the execution result of the pet mode, the execution result includes the current temperature in the car, the angle of the seat, the audio played /videos, pet images, and more. When the vehicle is in pet mode, when the user leaves the vehicle and the pet is left in the vehicle, the vehicle will not be powered off, and the air conditioning system will continue to work to ensure a suitable environment in the vehicle and avoid pets feeling uncomfortable and anxious. At this time, text prompt information is also displayed on the pet mode interface, and the text prompt information is used to prompt that the pet is in a safe state in this mode, for example, "Don't worry, my master will be back soon", "My pet is safe and comfortable. of" and so on.

Furthermore, in the pet mode, when it is detected that the user has left the car and the pet is not with him, the user can be reminded by voice that the pet is left in the car and pay attention to the safety of the pet.

3002. In response to the sentry alarm instruction, determine that the vehicle conforms to the sentry mode, and based on the sentry mode, switch the pet mode interface to the sentry interface.

In the pet mode, when the vehicle meets the conditions for the sentinel mode to take effect, the vehicle generates a sentinel alarm command. In response to the sentry alarm command, it is determined that the vehicle conforms to the sentry mode, and based on the sentry mode, the light effect and sound effect of the pet mode are turned off, and then the sentry alarm command is executed according to the sentry mode.

In the embodiment of the present application, based on the sentry mode, the pet mode interface is also switched to the sentry interface. When the pet mode interface is switched to the sentry interface, the pet mode interface can be closed, and the sentry interface is displayed on the display area of the pet mode interface. The sentry interface can be in the form of an application interface or a pop-up window; it can also be directly The sentry interface is displayed on the pet mode interface; the sentry interface can also be displayed in a pop-up window on the pet mode interface.

In order to protect the safety of pets in the car, when the pet mode is switched to sentry mode, the vehicle air conditioning system will continue to work to avoid the temperature in the car being too high or too low, which will endanger the safety of pets.

In addition, in order to prevent external objects from invading the vehicle by mistakenly thinking that pets in the vehicle are dangerous, after switching the pet mode interface to the sentry interface, the sentry interface not only displays the execution results of the sentry mode, but also displays the pet mode The following execution results.

Referring to Fig. 31, the embodiment of the present application provides a vehicle interaction method, taking the pet mode as the first interaction mode outside the vehicle, and the welcome mode as the second interaction mode outside the vehicle as an example, the specific interaction process is as follows:

3101. In response to the pet mode start instruction, determine that the vehicle complies with the pet mode, and display a pet mode interface based on the pet mode.

3102. In response to the welcome instruction, determine that the vehicle meets the welcome mode, and switch the pet mode interface to the welcome interface based on the welcome mode.

In the pet mode, when the vehicle meets the conditions for the welcome mode to take effect, the vehicle generates a welcome command. In response to the welcome command, it is determined that the vehicle meets the welcome mode. Based on the welcome mode, the light and sound effects of the pet mode are turned off, and then follow the The welcome mode executes the welcome command, and at the same time switches the pet mode interface to the welcome interface. When the pet mode interface is switched to the welcome interface, the pet mode interface can be closed, and the welcome interface is displayed on the display area of the pet mode interface. The welcome interface can be in the form of an application interface or in the form of a pop-up window; The welcome interface can also be directly displayed on the pet mode interface; the welcome interface can also be popped up on the pet mode interface.

In order to protect the safety of pets in the car, when the pet mode is switched to the welcome mode, the vehicle's air conditioning system will continue to work to prevent the temperature in the car from being too high or too low, which will endanger the safety of pets.

In addition, in order to prevent external objects from invading the vehicle by mistakenly thinking that pets in the vehicle are dangerous, after the pet mode interface is switched to the welcome interface, the welcome interface not only displays the execution results of the welcome mode, but also can Display the execution result in pet mode.

Referring to Fig. 32, the embodiment of the present application provides a vehicle interaction method. Taking the first out-of-vehicle interaction mode as the pet mode and the second out-of-vehicle interaction mode as the out-of-vehicle voice mode as an example, the method flow provided by the embodiment of the present application includes :

3201. In response to a pet mode start instruction, determine that the vehicle complies with the pet mode, and display a pet mode interface based on the pet mode.

3202. In response to the voice command outside the vehicle, determine that the vehicle conforms to the voice mode outside the vehicle, and switch the pet mode interface to the voice interface outside the vehicle based on the voice mode outside the vehicle.

In the pet mode, when the vehicle satisfies the conditions for the external voice to take effect, the vehicle generates a query command for the external voice, and in response to the query command for the external voice, it is determined that the vehicle meets the external voice mode. Based on the external voice mode, the vehicle will Turn off the light effect of the pet mode, and then show the light effect that the voice outside the car is not activated. Based on the voice mode outside the vehicle, the vehicle also switches the pet mode interface to the voice interface outside the vehicle. Specifically, the pet mode interface can be closed, and the out-of-vehicle voice interface is displayed on the display area of the pet mode interface. The out-of-vehicle voice interface can be in the form of an application interface or in the form of a pop-up window; The out-of-vehicle voice interface can be displayed on the screen; a pop-up window can also be displayed on the pet mode interface to display the out-of-vehicle voice interface.

In order to protect the safety of pets in the car, when the pet mode is switched to the voice interface outside the car, the vehicle air conditioning system will continue to work to prevent the temperature in the car from being too high or too low, which will endanger the safety of pets.

In addition, in order to prevent external objects from intruding into the vehicle by mistakenly thinking that pets in the vehicle are dangerous, after the pet mode interface is switched to the voice interface outside the vehicle, the voice interface outside the vehicle not only displays the available information of the voice outside the vehicle, but also It is also possible to display the execution results in pet mode.

When the external voice function is activated based on the available information, the vehicle generates an execution command of the external voice, executes the execution command in response to the execution command of the external voice, and displays the light effect corresponding to the execution result of the execution command, of course , in this process, if voice broadcast is required, an external speaker is called to broadcast. At this time, the execution result of the execution instruction and the execution result in pet mode are displayed on the voice interface outside the vehicle.

Referring to Fig. 33, the embodiment of the present application provides a vehicle interaction method. Taking the first interaction mode outside the vehicle as the children's mode, and the second interaction mode outside the vehicle as the welcome mode as an example, the method flow provided by the embodiment of the application includes:

3301. In response to a child mode activation instruction, determine that the vehicle complies with the child mode, and display a child mode interface based on the child mode.

Among them, the children's mode is an out-of-vehicle interaction mode that is activated when a child is detected among the accompanying passengers. The children's mode can be operated when the owner is in the car and after leaving the car. It can not only provide a comfortable riding environment for children during the ride, but also ensure the safety of the children after the owner leaves the car. After the children's mode is turned on in the scene outside the car, a prompt message for turning on the children's mode can be played.

In the scene outside the vehicle, when it is detected that there is a child among the accompanying passengers, in order to ensure the safety of the child, the vehicle will generate a child mode activation command, and in response to the child mode activation command, determine that the vehicle conforms to the child mode, and then based on the child mode , to control the vehicle to execute the children's mode activation instruction according to the children's mode, so as to create a comfortable riding environment for children.

Specifically, control the vehicle to execute the children's mode startup instruction according to the children's mode, including at least one of the following: adjusting the temperature of the air-conditioning system to a temperature suitable for children; adjusting the angle of the seat; closing the windows; playing nursery rhymes or videos that children like to listen to .

In the embodiment of the present application, based on the child mode, the vehicle will also display the child mode interface, which is used to display the execution result of the child mode, the execution result includes the current temperature in the car, the angle of the seat, the child image, etc. . When the user leaves the car and the child is left in the car, the corresponding function remains in the child mode, and the air conditioner system will continue to work at this time to ensure a suitable environment in the car. At this time, text prompt information is also displayed on the child mode interface, and the text prompt information is used to prompt that children in this mode are in a safe state.

In the embodiment of the present application, in response to the children's mode activation instruction, the target vehicle lights of the vehicle can be controlled to adopt light effects for display. For example, the ambient light in the car is controlled to display a sixth preset color, such as green. When the children's mode is turned on, a prompt message that the children's mode is turned on can also be played.

Furthermore, in the child mode, when it is detected that the user has left the car and the child is not accompanying him, the user can be reminded by voice that the child is left in the car and pay attention to the safety of the child.

3302. In response to the welcome instruction, determine that the vehicle meets the welcome mode, and switch the child mode interface to the welcome interface based on the welcome mode.

In another embodiment of the present application, in the child mode, when the vehicle meets the conditions for the welcome mode to take effect, the vehicle generates a welcome instruction, and in response to the welcome instruction, it is determined that the vehicle meets the welcome mode, and based on the welcome mode, close The lighting effects and sound effects of the children's mode, and then execute the welcome instructions according to the welcome mode, and at the same time switch the children's mode interface to the welcome interface. When the child mode interface is switched to the welcome interface, the welcome mode interface can be closed, and the welcome interface is displayed on the display area of the welcome mode interface. The welcome interface can be in the form of an application interface or a pop-up window. form; the welcome interface can also be directly displayed on the welcome mode interface; the welcome interface can also be popped up on the welcome mode interface.

In order to protect the safety of children in the car, when the welcome mode is switched to the welcome interface, the vehicle air conditioning system will continue to work to prevent the temperature in the car from being too high or too low, which will endanger the safety of children.

In addition, in order to prevent external objects from intruding into the vehicle by mistakenly thinking that children in the vehicle are in danger, after the child mode interface is switched to the welcome interface, the welcome interface not only displays the execution results of the welcome mode, but also can Display the execution result in child mode.

Referring to Fig. 34, the embodiment of the present application provides a vehicle interaction method. Taking the first interaction mode outside the vehicle as the child mode, and the second interaction mode outside the vehicle as the voice mode outside the vehicle as an example, the method flow provided by the embodiment of the application includes :

3401. In response to a child mode activation instruction, determine that the vehicle complies with the child mode, and display a child mode interface based on the child mode.

3402. In response to the voice command outside the vehicle, determine that the vehicle complies with the voice mode outside the vehicle, and switch the child mode interface to the voice interface outside the vehicle based on the voice mode outside the vehicle.

In another embodiment of the present application, in the child mode, when the vehicle satisfies the conditions for the external voice to take effect, the vehicle generates an external voice query command, and in response to the external voice query command, it is determined that the vehicle meets the external voice mode , based on the external voice mode, the vehicle will turn off the lighting effect of the child mode, and then display the lighting effect that the external voice is not activated. Based on the voice mode outside the vehicle, the vehicle also switches the child mode interface to the voice interface outside the vehicle. Specifically, the children's mode interface can be closed, and the out-of-vehicle voice interface can be displayed on the display area of the children's mode interface. The out-of-vehicle voice interface can be in the form of an application interface or in the form of a pop-up window; The out-of-vehicle voice interface can be displayed on the screen; a pop-up window can also be displayed on the child mode interface to display the out-of-vehicle voice interface.

In order to protect the safety of children in the car, when the children's mode is switched to the voice interface outside the car, the vehicle's air conditioning system will continue to work to prevent the temperature in the car from being too high or too low, which will endanger the safety of children.

In addition, in order to avoid intrusion incidents on the vehicle caused by external objects mistakenly thinking that children in the car are in danger, after switching the child mode interface to the out-of-vehicle voice interface, the out-of-vehicle voice interface not only displays the available information of the out-of-vehicle voice, but also It is also possible to display the execution results in child mode.

When the external voice function is activated based on the available information, the vehicle generates an execution command of the external voice, executes the execution command in response to the execution command of the external voice, and displays the light effect corresponding to the execution result of the execution command, of course , in this process, if voice broadcast is required, an external speaker is called to broadcast. At this time, the execution result of the execution instruction and the execution result in the child mode are displayed on the voice interface outside the vehicle.

Referring to Fig. 35, the embodiment of the present application provides a vehicle interaction method. Taking the first interaction mode outside the vehicle as the welcome mode and the second interaction mode outside the vehicle as the parking mode as an example, the method flow provided by the embodiment of the application includes :

3501 Responding to the welcome instruction, determine that the vehicle meets the welcome mode, and display a welcome interface based on the welcome mode.

3502. In response to the parking instruction, determine that the vehicle meets the parking mode, and based on the parking mode, switch the welcome interface to the parking interface.

Wherein, the parking mode is an out-of-vehicle interaction mode in which the vehicle automatically parks out of the parking space. There are two mechanisms for turning on the parking mode. The first mechanism enables the main driver to turn on the parking mode through the central control screen before leaving the car; Park out command, turn on the park out mode. There are two sources of the parking instruction. The first method is the parking instruction sent by the main driver to the vehicle through the digital key; the second method is the parking instruction sent by the main driver to the vehicle through voice information. .

For the second method, after the vehicle receives the parking command from the main driver, before turning on the parking mode, the vehicle will also verify the identity of the main driver, and when the verification is passed, the parking mode will be turned on. When verifying the identity of the main driver user, the voiceprint feature of the main driver user can be extracted, and the registered account corresponding to the voiceprint feature can be obtained based on the extracted voiceprint feature. If the registered account and the registered account corresponding to the digital key are If the account is the same, it is determined that the main driver has passed the verification, and then the vehicle is parked out of the parking space based on the parking mode.

In the park out mode, the vehicle's park out logic is different according to the type of parking space and the direction of the vehicle. When the vehicle is in the vertical parking space, if the front of the car is facing outward, it will park half of the body in a straight line; when the vehicle is in the vertical parking space, if the front of the car is facing inward, it will be parked in a straight line to the position where the door can be opened; when the vehicle is in the horizontal parking space, Then it automatically judges the parking direction and parks out.

In the parking mode, the vehicle can remind the people and animals outside the vehicle to pay attention to safety through the voice outside the vehicle. When the vehicle is successfully parked in the parking space, the vehicle will be successfully parked, and the vehicle will be successfully parked, so as to remind the main driver that the vehicle can be driven.

In the welcome mode, in response to the parking command, it is determined that the vehicle conforms to the parking mode, based on the parking mode, the vehicle turns off the light effect and the sound effect of the welcoming mode, and executes the parking command according to the parking mode. When executing the parking command according to the parking mode, the vehicle judges whether the voiceprint corresponding to the parking command and the account corresponding to the digital key are the same user, and if they are the same user, execute the command. In response to the parking command, the vehicle judges whether the parking command is executable. If the parking command is executable, the vehicle is controlled to park from the outside of the vehicle, and during the execution of the parking command, the corresponding lighting effect and Sound effect: If the parking command cannot be executed, for example, it is detected that there are people/pets in the car, it is detected that the four doors and two covers are not closed, the charging plug is not pulled out, and no parking space is selected, etc., the voice broadcasts the reason why it cannot be executed.

In the embodiment of the present application, during the process of executing the parking instruction according to the parking mode, if a person or animal outside the car is detected, a voice prompt will be given to the person or action outside the car to pay attention to safety.

In the embodiment of the present application, based on the park-out mode, the vehicle also switches the welcome interface to the park-out interface. The parking interface can display the execution result of the parking command, the execution result includes the dynamic effect of the parking process of the vehicle and the surrounding environment information, for example, the 3D model of the vehicle in the surrounding parking spaces, surrounding characters, animals and so on.

Referring to Figure 36, the embodiment of the present application provides a vehicle interaction method, taking the first external interaction mode as the external voice mode, and the second external interaction mode as the parking mode as an example, the method flow provided by the embodiment of the present application include:

3601. In response to the voice command outside the vehicle, determine that the vehicle complies with the voice mode outside the vehicle, and display the voice interface outside the vehicle based on the voice mode outside the vehicle.

3602. In response to the parking instruction, determine that the vehicle meets the parking mode, and based on the parking mode, switch the external voice interface to the parking interface.

Wherein, the parking mode is an out-of-vehicle interaction mode in which the vehicle automatically parks into the parking space. There are two mechanisms for turning on the parking mode. The first mechanism enables the main driver to turn on the parking mode through the central control screen before leaving the car; The parking command sent by the user turns on the parking mode. There are two sources of the parking instruction. The first method is the parking instruction sent by the main driver to the vehicle through the digital key; the second method is the parking instruction sent by the main driver to the vehicle through voice information. .

For the second method, after receiving the parking instruction from the main driver, the vehicle will also verify the identity of the main driver before turning on the parking mode, and turn on the parking mode when the verification is passed. When verifying the identity of the main driver user, the voiceprint feature of the main driver user can be extracted, and the registered account corresponding to the voiceprint feature can be obtained based on the extracted voiceprint feature. If the registered account and the registered account corresponding to the digital key are If the account is the same, it is determined that the main driver user has passed the verification, and then the vehicle is parked in the parking space based on the parking mode.

In the parking mode, the vehicle can remind the people and animals outside the vehicle to pay attention to safety through the voice outside the vehicle. When the vehicle is successfully parked in the parking space, the voice broadcasts the notification message of successful parking, so as to reduce the anxiety of the main driver when leaving the vehicle. .

In the external voice mode, in response to the parking command, it is determined that the vehicle meets the parking mode, based on the parking mode, the vehicle turns off the light effect and the sound effect of the external voice mode, and executes the parking command according to the parking mode. Specifically, it is judged whether the voiceprint corresponding to the parking instruction and the account corresponding to the digital key are the same user, and if so, the instruction is executed; if not, the user is prompted that the voice function outside the car cannot be used. In response to the parking instruction, the vehicle judges whether the parking instruction is executable, and if the parking instruction is executable, the APA or HAPA system is used to control the vehicle to park in the parking space, and during the execution of the parking instruction, cooperate with Corresponding light effects and sound effects; if the parking command cannot be executed, for example, it is detected that there are people/pets in the car, it is detected that the four doors and two covers are not closed, the charging cable is not pulled out, and no parking space is selected, etc., the voice broadcast cannot be executed. reason.

In the embodiment of the present application, based on the parking mode, the vehicle also switches the voice interface outside the vehicle to the parking interface. The parking interface can display the execution result of the parking command, the execution result includes the dynamic effect of the parking process of the vehicle and the surrounding environment information, for example, the 3D car model of the vehicle in the surrounding parking spaces, surrounding characters, animals and so on.

Referring to Fig. 37, the embodiment of the present application provides a vehicle interaction method, taking the first external interaction mode as the external voice mode, and the second external interaction mode as the parking mode as an example, the method flow provided by the embodiment of the present application include:

3701. In response to the voice command outside the vehicle, determine that the vehicle complies with the voice mode outside the vehicle, and display the voice interface outside the vehicle based on the voice mode outside the vehicle.

3702. In response to the parking instruction, determine that the vehicle meets the parking mode, and based on the parking mode, switch the external voice interface to the parking interface.

In the external voice mode, in response to the parking command, it is determined that the vehicle conforms to the parking mode, based on the parking mode, the vehicle turns off the light effect and the sound effect of the external voice mode, and executes the parking command according to the parking mode. When executing the parking command according to the parking mode, the vehicle judges whether the voiceprint corresponding to the parking command and the account corresponding to the digital key are the same user, and if they are the same user, execute the command. In response to the parking command, the vehicle judges whether the parking command is executable. If the parking command is executable, the vehicle is controlled to park from the outside of the vehicle, and during the execution of the parking command, the corresponding lighting effect and Sound effect: If the parking command cannot be executed, for example, it is detected that there are people/pets in the car, it is detected that the four doors and two covers are not closed, the charging plug is not pulled out, and no parking space is selected, etc., the voice broadcasts the reason why it cannot be executed.

In the embodiment of the present application, based on the park-out mode, the vehicle also switches the voice interface outside the vehicle to the park-out interface. The parking interface can display the execution result of the parking command, the execution result includes the dynamic effect of the parking process of the vehicle and the surrounding environment information, for example, the 3D model of the vehicle in the surrounding parking spaces, surrounding characters, animals and so on.

It should be noted that the above is just an example of switching between several off-vehicle interaction modes, and does not exhaustively enumerate the switching between several off-vehicle interaction modes. In fact, as long as the mode switching conditions are met, that is Mode switching is possible.

Please refer to Figure 38, which shows a schematic structural diagram of a vehicle interaction device provided by an embodiment of the present application. The device can be implemented through software, hardware or a combination of the two, and becomes all or part of an electronic device. The device includes:

The first determination module 3801 is configured to determine that the vehicle complies with the first out-of-vehicle interaction mode in response to the first interaction instruction;

The first display module 3802 is configured to display a first display interface based on the first out-of-vehicle interaction mode, and the first display interface is used to display the execution result of the first interaction instruction;

The second determination module 3803 is configured to determine that the vehicle complies with the second out-of-vehicle interaction mode in response to the second interaction instruction;

The switching module 3804 is configured to switch the first display interface to the second display interface based on the second out-of-vehicle interaction mode, and the second display interface is used to display the execution result of the second interaction instruction.

In another embodiment of the present application, the first interactive instruction is a query instruction of the voice outside the vehicle, and the first indication information is displayed on the first display interface, and the first indication information is used to indicate the available information of the voice outside the vehicle; the device also include:

A receiving module, configured to receive a second interactive instruction, the second interactive instruction is determined based on the available information of the voice outside the vehicle;

The first control module is used to control the vehicle to execute the second interaction instruction according to the voice mode outside the vehicle when the second interaction mode outside the vehicle is the voice mode outside the vehicle;

The second display module is used to display the execution result in the voice mode outside the vehicle on the second display interface.

In another embodiment of the present application, the control module is used to control the speaker outside the vehicle to play the listening prompt information when the voice information of the target object is in the listening state; when the voice information is in the broadcast state, control the speaker outside the vehicle to play the second interaction The execution result of the command.

In another embodiment of the present application, the device also includes:

The first display module is used to display the execution result of the first interactive instruction and the corresponding lighting effect in response to the first interactive instruction;

The second display module is configured to display the second lighting effect corresponding to the execution result of the second interactive instruction in response to the second interactive instruction.

In another embodiment of the present application, the second out-of-vehicle interaction mode is an out-of-vehicle voice mode, and the second display module is used to control the voice information of the target object when the execution result of the second interaction instruction is in the listening state The target car light displays the first light effect; when the execution result of the second interactive command is that the voice information is in the recognition state, control the target car light of the vehicle to display the second light effect; when the execution result of the second interactive command is that the voice information is in the feedback state , according to the type of the execution result of the second interactive instruction, the light of the control target vehicle is displayed according to the light effect corresponding to the type.

In another embodiment of the present application, the first interaction mode outside the vehicle is a sentry mode, and the first interaction instruction is a sentry alarm instruction of the vehicle; the device also includes:

The second control module is configured to respond to the sentinel alarm command of the vehicle, and control the vehicle to issue alarms in different alarm modes according to the trigger information of the sentinel mode.

In another embodiment of the present application, the second control module is configured to detect that the digital key of the vehicle is not detected and the duration of the distance between the detected object outside the vehicle and the vehicle is less than the first preset distance and is longer than the first Preset duration, control the lights of the vehicle to display according to the third light effect, and display the alarm information on the first display interface;

The second control module is used to control the target lights of the vehicle when the digital key of the vehicle is not detected and the duration of the detected distance between the object outside the vehicle and the vehicle is less than the second preset distance and the duration is longer than the second preset distance Display according to the fourth light effect, control the speaker outside the vehicle to play the alarm sound effect, and display the alarm information on the first display interface, and the second preset distance is smaller than the first preset distance;

The second control module is used to control the lights of the vehicle to display according to the fifth light effect when the digital key of the vehicle is not detected and an intrusion event of an object outside the vehicle is detected, and to control the external speaker to play the alarm sound effect, and in the second An alarm message is displayed on the display interface.

In another embodiment of the present application, the first interaction mode outside the vehicle is the welcome mode, and the second interaction mode outside the vehicle is the voice mode outside the vehicle; the switching module is configured to respond to the second interaction instruction based on the voice mode outside the vehicle , switch the welcome interface to the voice interface outside the car.

In summary, the device provided in the embodiment of the present application,

When the out-of-vehicle interaction is performed based on the interaction command, an interaction interface corresponding to the off-vehicle interaction mode is displayed according to the out-of-vehicle interaction mode triggered by the interaction command, and the interaction interface is used to display the execution result of the interaction command. In the off-vehicle interaction scenario, switching between different interaction modes is not easy for users to perceive. By displaying the execution results of interactive commands in different interaction modes on the interactive interface, not only the interaction form is enriched, but also the user can view different interactive modes. interaction information, so that the interaction function can be better used. In addition, there is no need for the user to manually switch between different interaction modes in this process, and it can be automatically switched according to the interaction command, and the interaction efficiency is high.

An embodiment of the present application provides a computer-readable storage medium, at least one computer program is stored in the computer-readable storage medium, and the at least one computer program can implement the above-mentioned vehicle interaction method when executed by a processor.

The methods in this application may be fully or partially implemented by software, hardware, firmware or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product. The computer program product comprises one or more computer programs or instructions. When the computer programs or instructions are loaded and executed on the computer, the processes or functions described in this application are executed in whole or in part. The computer may be a general computer, a dedicated computer, a computer network, a network device, a user device, a core network device, an OAM (Operation Administration and Maintenance, operation management and maintenance) or other programmable devices. The computer program or instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer program or instructions may be downloaded from a website, computer, A server or data center transmits to another website site, computer, server or data center by wired or wireless means. The computer-readable storage medium may be any available medium that can be accessed by a computer, or a data storage device such as a server or a data center integrating one or more available media. The available medium may be a magnetic medium, such as a floppy disk, a hard disk, or a magnetic tape; it may also be an optical medium, such as a digital video disk; or it may be a semiconductor medium, such as a solid state disk. The computer readable storage medium may be a volatile or a nonvolatile storage medium, or may include both volatile and nonvolatile types of storage media.

Those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the above-described system, device and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.

The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still apply to the foregoing embodiments Modifications are made to the recorded technical solutions, or equivalent replacements are made to some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims (11)

1. A vehicle interaction method, characterized in that the method comprises: In response to the first interaction instruction, it is determined that the vehicle complies with a first out-of-vehicle interaction mode, and based on the first out-of-vehicle interaction mode, a first display interface is displayed, and the first display interface is used to display the execution of the first interaction instruction result; In response to the second interaction instruction, it is determined that the vehicle complies with a second out-of-vehicle interaction mode, and based on the second out-of-vehicle interaction mode, the first display interface is switched to a second display interface, and the second display interface is used to display An execution result of the second interactive instruction. 2. The method according to claim 1, characterized in that, the first interactive instruction is an inquiry instruction of a voice outside the vehicle, and first indication information is displayed on the first display interface, and the first indication information uses available information for indicating the voice outside the vehicle; the method also includes: receiving the second interaction instruction, the second interaction instruction is determined based on available information of the external voice; When the second out-of-vehicle interaction mode is the out-of-vehicle voice mode, control the vehicle to execute the second interaction instruction according to the out-of-vehicle voice mode, and display in the out-of-vehicle voice mode on the second display interface execution result. 3. The method according to claim 2, wherein the controlling the vehicle to execute the second interaction instruction according to the voice mode outside the vehicle comprises: When the voice information of the target object is in the listening state, control the speakers outside the car to play and listen to the prompt information; When the voice information is in the broadcast state, the speaker outside the vehicle is controlled to play the execution result of the second interaction instruction. 4. The method according to claim 1, wherein the method further comprises: In response to the first interaction instruction, displaying a lighting effect corresponding to an execution result of the first interaction instruction; In response to the second interaction instruction, a lighting effect corresponding to an execution result of the second interaction instruction is displayed. 5. The method according to claim 4, wherein the second outside-vehicle interaction mode is an outside-vehicle voice mode, and the displaying the lighting effect corresponding to the execution result of the second interaction instruction comprises: When the execution result of the second interaction instruction is that the voice information of the target object is in the listening state, control the target vehicle lights of the vehicle to display the first light effect; When the execution result of the second interaction instruction is that the voice information is in the recognition state, controlling the target lights of the vehicle to display a second light effect; When the execution result of the second interaction instruction is that the voice information is in the feedback state, according to the type of the execution result of the second interaction instruction, the target vehicle light is controlled to display according to the light effect corresponding to the type. 6. The method according to any one of claims 1 to 5, wherein the first interaction mode outside the vehicle is a sentry mode, and the first interaction instruction is a sentry alarm instruction of the vehicle; Methods also include: In response to the sentry alarm instruction of the vehicle, the vehicle is controlled to issue alarms in different alarm modes according to the trigger information of the sentry mode. 7. The method according to claim 6, characterized in that, according to the trigger information of the sentinel mode, controlling the vehicle to adopt different alarm modes for alarming comprises: When the digital key of the vehicle is not detected, and it is detected that the distance between the object outside the vehicle and the vehicle is less than the first preset distance and the duration is longer than the first preset distance, control the lights of the vehicle according to the first preset distance. Three lighting effects are displayed, and alarm information is displayed on the first display interface; When the digital key of the vehicle is not detected, and it is detected that the distance between the object outside the vehicle and the vehicle is less than the second preset distance and the duration is longer than the second preset distance, control the target lights of the vehicle according to The fourth light effect is displayed, and the speaker outside the vehicle is controlled to play an alarm sound effect, and the alarm information is displayed on the first display interface, and the second preset distance is smaller than the first preset distance; When the digital key of the vehicle is not detected and an intrusion event of an object outside the vehicle is detected, the lights of the vehicle are controlled to display according to the fifth light effect, and the speakers outside the vehicle are controlled to play an alarm sound effect, and in the first The alarm information is displayed on the display interface. 8. The method according to any one of claims 1 to 5, wherein the first interaction mode outside the vehicle is a welcome mode, and the second interaction mode outside the vehicle is a voice mode outside the vehicle; Based on the second out-of-vehicle interaction mode, switching the first display interface to a second display interface includes: In response to the second interaction instruction, based on the voice mode outside the vehicle, the welcome interface is switched to the voice interface outside the vehicle. 9. A vehicle interaction device, characterized in that the device comprises: A first determination module, configured to determine that the vehicle complies with the first out-of-vehicle interaction mode in response to the first interaction instruction; A first display module, configured to display a first display interface based on the first out-of-vehicle interaction mode, where the first display interface is configured to display an execution result of the first interaction instruction; The second determination module is configured to determine that the vehicle complies with the second out-of-vehicle interaction mode in response to the second interaction instruction; A switching module, configured to switch the first display interface to a second display interface based on the second out-of-vehicle interaction mode, and the second display interface is used to display an execution result of the second interaction instruction. 10. An electronic device, characterized in that the electronic device includes a memory and a processor, at least one computer program is stored in the memory, and the at least one computer program is loaded and executed by the processor to achieve the following: The vehicle interaction method according to any one of claims 1 to 8. 11. A computer program product, characterized in that the computer program product includes a computer program, and when the computer program is executed by a processor, the vehicle interaction method according to any one of claims 1 to 8 can be realized.

Images