[go: up one dir, main page]

WO2024152310A1 - 控制方法、装置和运载工具 - Google Patents

控制方法、装置和运载工具 Download PDF

Info

Publication number
WO2024152310A1
WO2024152310A1 PCT/CN2023/073186 CN2023073186W WO2024152310A1 WO 2024152310 A1 WO2024152310 A1 WO 2024152310A1 CN 2023073186 W CN2023073186 W CN 2023073186W WO 2024152310 A1 WO2024152310 A1 WO 2024152310A1
Authority
WO
WIPO (PCT)
Prior art keywords
display device
frame rate
display
vehicle
display frame
Prior art date
Application number
PCT/CN2023/073186
Other languages
English (en)
French (fr)
Inventor
王倩倩
李平
曲冠存
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to PCT/CN2023/073186 priority Critical patent/WO2024152310A1/zh
Publication of WO2024152310A1 publication Critical patent/WO2024152310A1/zh

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units

Definitions

  • the present application relates to the field of smart cockpits, and in particular, to a control method, device and vehicle.
  • the present application provides a control method, device and vehicle, which can control the display frame rate of the display device of the vehicle according to the operating status of the vehicle and/or the position of the user in the vehicle, thereby improving the user's driving experience and further improving driving safety.
  • a control method which may be executed by a vehicle; or, may be executed by a computing platform of a vehicle; or, may be executed by a chip or circuit module used for a vehicle, and this application does not make any specific limitation on this.
  • the vehicles involved in this application may include road vehicles, water vehicles, air vehicles, industrial equipment, agricultural equipment, or entertainment equipment, etc.
  • the vehicle may be a vehicle, which is a vehicle in a broad sense, and may be a vehicle (such as a commercial vehicle, a passenger car, a motorcycle, a flying car, a train, etc.), an industrial vehicle (such as a forklift, a trailer, a tractor, etc.), an engineering vehicle (such as an excavator, a bulldozer, a crane, etc.), agricultural equipment (such as a lawn mower, a harvester, etc.), amusement equipment, a toy vehicle, etc.
  • the embodiments of this application do not specifically limit the type of vehicle.
  • the vehicle may be a vehicle such as an airplane or a ship.
  • the method includes: determining the display frame rate of the display device based on at least one of the operating status of the vehicle, the position of the user in the cabin of the vehicle, the touch screen operation of the display device of the vehicle, and the type of application to which the interface to be displayed on the display device belongs; and controlling the display device to display at the display frame rate.
  • the above scheme proposes a new reference factor for determining the display frame rate, which can flexibly determine the display frame rate under limited resources, so that the display effect can better meet the needs of users and improve the user experience. For example, when there are multiple display devices, when the computing power of the chip controlling the display device is not enough to support all display devices to display at full frame rate, the display frame rate of one or more display devices is reduced to ensure that the remaining display devices display at a higher display frame rate, thereby improving the fluency of the remaining display devices.
  • the above-mentioned display devices may include, but are not limited to: a head-up display, a central control screen, a co-pilot entertainment screen, a screen behind the main driver's headrest, and a screen behind the co-pilot's headrest.
  • the display frame rate involved in this application refers to: the frequency (or rate) at which a bitmap image in units of frames appears continuously on a display device; or, the display frame rate can also be understood as the frequency (or rate) at which a display synthesis system (surface flinger) displays a bitmap image in units of frames.
  • the number of frames that a display device submits for display data It is understandable that the higher the display frame rate, the smoother the picture.
  • the display frame rate of the display device is determined based on at least one of the operating state of the vehicle, the position of the user in the cabin of the vehicle, the touch-screen operation on the display device of the vehicle, and the type of application to which the interface to be displayed on the display device belongs, including adjusting the display frame rate based on changes in at least one of the operating state, the position of the user in the cabin of the vehicle, the touch-screen operation on the display device of the vehicle, and the type of application to which the interface to be displayed on the display device belongs.
  • dynamic adjustment of the display frame rate of the display device is achieved based on at least one of the operating status of the vehicle, the position of the user in the cockpit, the touch screen operation, and the type of application. For example, when the vehicle is driving, it helps to improve driving safety while ensuring the user experience; when the vehicle is parked, it helps to improve the user's entertainment experience.
  • the change in the operating state includes a transition between a driving state and a parking state, or a change in the level of autonomous driving.
  • the display device is used to display at least one of the operating condition information and navigation information of the vehicle, and the display frame rate is adjusted based on changes in at least one of the operating status, the user's position in the vehicle cabin, the touch screen operation of the display device for the vehicle, and the type of application to which the interface to be displayed by the display device belongs, including: in response to the operating status changing from a parking state to a driving state, increasing the display frame rate; in response to the operating status changing from a driving state to a parking state, reducing the display frame rate; in response to a decrease in the vehicle's autonomous driving level, increasing the display frame rate; or, in response to an increase in the vehicle's autonomous driving level, reducing the display frame rate.
  • the operating condition information may include, but is not limited to: driving speed, rotation speed, gear position, remaining power or remaining fuel, remaining mileage, indicator light or warning light information.
  • the indicator light or warning light may include at least one of the following: antifreeze level warning light, fuel level indicator light, washer level indicator light, charging indicator light, high and low beam change indicator light, gearbox gear position indicator light, anti-lock braking system indicator light, driving force adjustment indicator light, and airbag warning light.
  • the navigation information may include at least one of the following: the destination of the vehicle in the current trip, the travel path of the vehicle from the current location to the destination, and the remaining distance of the vehicle from the current location to the destination.
  • the navigation information is displayed through a navigation application.
  • the display device may include an instrument screen, or may include a head-up display, or may include a central control screen.
  • the display device displaying navigation information and operating condition information when the vehicle is in driving state, the display device displaying navigation information and operating condition information is controlled to display at a higher display frame rate, so as to ensure that the driving safety-related information is refreshed in real time and at a high speed, which helps to improve driving safety.
  • the level of autonomous driving is higher, the driver's dependence on navigation information and operating condition information may be reduced, so the display device displaying navigation information and operating condition information can be controlled to display at a lower display frame rate.
  • the display device is used to display entertainment information, and the display frame rate is adjusted based on changes in at least one of the operating state, the position of the user in the cabin of the vehicle, the touch screen operation of the display device for the vehicle, and the type of application to which the interface to be displayed by the display device belongs, including: in response to the operating state changing from a parking state to a driving state, lowering the display frame rate; in response to the operating state changing from a driving state to a parking state, increasing the display frame rate; in response to the vehicle automatically driving In response to a decrease in the level of the vehicle, the display frame rate is reduced; or, in response to an increase in the level of autonomous driving of the vehicle, the display frame rate is increased.
  • the entertainment information may include, but is not limited to: videos, games, news consultation, and music.
  • the entertainment information is displayed through entertainment-related applications, such as video applications, music applications, game applications, and the like.
  • the display device may include a central control screen, or may also include a co-pilot entertainment screen, or may also include a screen behind the driver's (or co-pilot's) headrest.
  • the display device displaying entertainment information when the vehicle is in a parked state, the display device displaying entertainment information is controlled to display at a higher display frame rate to ensure that entertainment-related information is refreshed in real time and at a high speed, which helps to improve the user's entertainment experience.
  • the display device displaying entertainment information can be controlled to display at a higher display frame rate to provide the user with an entertainment experience.
  • the display frame rate is adjusted based on changes in at least one of the operating status, the user's position in the vehicle cabin, the touch screen operation of the display device of the vehicle, and the type of application to which the interface to be displayed on the display device belongs, including: in response to the user coming to the position in the cabin corresponding to the display device, increasing the display frame rate; or, in response to the user leaving the position in the cabin corresponding to the display device, reducing the display frame rate.
  • the position in the cockpit corresponding to the display device may include: the content displayed by the display device is mainly for viewing by the user at the position.
  • the position in the cockpit corresponding to the display device can be the main driver's position; when the display device is the screen behind the main driver's headrest, the position in the cockpit corresponding to the display device can be the left side of the second row.
  • the display frame rate of the display device corresponding to the user's position is increased, which helps to improve the user's interactive experience and screen usage experience; when the user leaves, the display frame rate of the display device corresponding to the user's position is reduced, which helps to save power consumption.
  • the display frame rate is adjusted based on changes in at least one of the operating status, the user's position in the vehicle cabin, the touch screen operation on the display device of the vehicle, and the type of application to which the interface to be displayed on the display device belongs, including: in response to no further touch screen operation occurring within a predetermined time after the touch screen operation occurs, lowering the display frame rate; or, in response to the touch screen operation, increasing the display frame rate, wherein no touch screen operation occurs within a predetermined time before the touch screen operation occurs.
  • the predetermined time may be 3 seconds, or 5 seconds, or other durations.
  • the display frame rates of other display devices that do not detect the touch screen signal are reduced.
  • the display frame rate of the touched display device is increased, the hand tracking performance of the display device is improved, and it is helpful to improve the user's interactive experience when using the display device.
  • the display device includes a first display device and a second display device, wherein the first display device corresponds to a first area in the cabin and the second display device corresponds to a second area in the cabin, and determining the display frame rate of the display device includes: determining that the display frame rate of the first display device is different from the display frame rate of the second display device.
  • the determining of the display frame rate of the first display device is not The display frame rate of the first display device is the same as that of the second display device, including: in response to there being no user in the first area and there being a user in the second area, determining that the display frame rate of the first display device is lower than the display frame rate of the second display device; in response to there being a user in the first area and there being no user in the second area, determining that the display frame rate of the first display device is higher than the display frame rate of the second display device; or, in response to there being a user in the first area and there being a user in the second area, the first area is the main driving area of the cockpit, and the second area includes one or more areas other than the main driving area, determining that the display frame rate of the first display device is higher than the display frame rate of the second display device.
  • the first display device corresponds to a first area in the cockpit, including: the first display device is arranged in the first area; or the first display device is used to display to users in the first area.
  • the second display device corresponds to a second area in the cockpit, including: the second display device is arranged in the second area; or the second display device is used to display to users in the second area.
  • the first display device may include an instrument screen, or may also include a head-up display, or may also include a central control screen; if the first area is the co-pilot area, the first display device includes a co-pilot entertainment screen; or, if the first area is the rear area, the first display device includes a screen behind the main driver's headrest, and/or a screen behind the co-pilot's headrest.
  • the display devices corresponding to the areas with users in the cockpit are prioritized to display at a higher frame rate, which helps to improve the user experience. Furthermore, when there are users in multiple areas including the main driving area, the display devices in the main driving area are prioritized to display at a higher frame rate, which helps to improve the driving experience and driving safety of the main driving user.
  • determining that the display frame rate of the first display device is different from the display frame rate of the second display device includes: in response to the first display device having a user touch screen operation within a preset time and the second display device having no user touch screen operation within a preset time, determining that the display frame rate of the first display device is higher than the display frame rate of the second display device; or, in response to the first display device having no user touch screen operation within a preset time and the second display device having a user touch screen operation within a preset time, determining that the display frame rate of the first display device is lower than the display frame rate of the second display device.
  • the preset time may be 3 seconds, or 5 seconds, or other durations.
  • the full frame rate of the first display device and the second display device are both 60 frames per second (fps).
  • the display frame rate of the first display device can be controlled to drop to 30fps, or 45fps, and the display frame rate of the second display device can be controlled to increase to 60fps.
  • the display frame rate of the touched display device is increased according to the touch screen operation on the display device, so that it can display at a higher frame rate, thereby improving the hand tracking performance of the display device; the display frame rate of the untouched display device is reduced, which can save energy consumption when the display device is displaying and improve the intelligence of the display device and the vehicle.
  • determining that the display frame rate of the first display device is different from the display frame rate of the second display device includes: in response to a first application to which the interface to be displayed on the first display device belongs having a priority higher than a second application to which the interface to be displayed on the second display device belongs, determining that the display frame rate of the first display device is higher than the display frame rate of the second display device; or, in response to a first application to which the interface to be displayed on the first display device belongs having a priority lower than a second application to which the interface to be displayed on the second display device belongs, determining that the display frame rate of the first display device is higher than the display frame rate of the second display device.
  • the priority of the second application determines that the display frame rate of the first display device is lower than the display frame rate of the second display device.
  • controlling the display frame rate of the display device according to the priority of the application to which the interface to be displayed belongs helps to further improve the intelligence of the vehicle. For example, when the vehicle is in a driving state, the priority of the navigation application can be set to a higher level, and the priority of the entertainment application can be set to a lower level, thereby ensuring that the display device displaying the navigation application is displayed at a higher frame rate, and controlling the display device displaying the entertainment application to display at a lower frame rate, so as to improve driving safety; when the vehicle is in a parking state, the priority of the navigation application can be set to a lower level, and the priority of the navigation application can be set to a higher level, thereby ensuring that the display device displaying the navigation application is displayed at a lower frame rate, and controlling the display device displaying the entertainment application to display at a higher frame rate, so as to improve the user's entertainment experience.
  • determining the display frame rate of the display device includes: determining the display frame rate based on resource occupancy information; wherein the resource occupancy information indicates the used resource capacity of a computing unit and/or the available resource capacity in the remaining resources, and the computing unit is associated with the display device.
  • the computing unit is associated with the display device, and may include: the computing unit performs data processing to implement a display function of the display device.
  • the computing unit may include a central processing unit (CPU), a graphics processing unit (GPU), etc.
  • the display frame rate of the display device in the area with users indicated by the first state is controlled to be reduced.
  • the display frame rate of the display device corresponding to the main driving area such as the central control screen, instrument panel, head-up display
  • the display device corresponding to the co-pilot area such as the co-pilot entertainment screen
  • the display frame rate of the display device is controlled to be increased.
  • the preset capacity threshold may be 75%, or 70%, or other values.
  • the frame rate of the display device is adjusted according to the used resource capacity of the computing unit, which helps to reasonably utilize the chip computing power.
  • the display frame rate of the turned on display device is controlled to be reduced, which helps to prevent the display device from being stuck due to the excessively high used resource capacity of the computing unit;
  • the display device is controlled to display at a higher display frame rate to improve the smoothness of the picture, thereby enhancing the user experience.
  • the display device includes a third display device, which is used to display at least one of entertainment information and navigation information.
  • the determination of the display frame rate includes: when the vehicle is in the driving state and the resource occupancy information indicates that the used resource capacity is greater than or equal to a preset capacity threshold, determining that the display frame rate is a first frame rate; when the vehicle is in the driving state and the resource occupancy information indicates that the used resource capacity is less than the preset capacity threshold, determining that the display frame rate is a second frame rate; wherein the first frame rate is higher than the second frame rate.
  • the third display device may be a display device other than the display device for displaying the operating condition information.
  • the third display device may include at least one of the following: a central control screen, a co-pilot entertainment screen, a screen behind the driver's headrest, and a screen behind the co-pilot's headrest.
  • the third display device may also include a head-up display.
  • the third display device may be a display device other than a display device for displaying a 360-degree surround image and/or a reversing image.
  • the third display device may include at least one of the following: a head-up display, an instrument screen, a co-pilot entertainment screen, a screen behind the main driver's headrest, and a screen behind the co-pilot's headrest.
  • the third display device may be a display device selected by the user.
  • the user may set the display frame rate of display devices such as the passenger entertainment screen or the rear screen to be reduced when the resource occupancy information indicates that the resource capacity used by the computing unit is greater than or equal to a preset capacity threshold.
  • the used resource capacity of the computing unit is greater than or equal to the preset capacity threshold, and the display frame rate of other display devices except the display device displaying the vehicle operation condition information is controlled to be reduced.
  • the display frame rate of display devices such as the instrument screen and the central control screen is guaranteed, which helps to improve driving safety and user experience.
  • the third display device includes one or more display devices other than the instrument screen.
  • determining the display frame rate of the display device includes: when the vehicle is in the driving state and the single frame processing time within the first preset time length is greater than or equal to the preset processing time length, determining to reduce the display frame rate of the display device.
  • the first preset duration may be 1 second, or 1.5 seconds, or other durations; the preset processing duration may be 16.7 milliseconds, or other preset processing durations.
  • the processing duration of a single frame for 1 second is greater than or equal to 16.7 milliseconds, it indicates that the processing capacity of the computing platform is insufficient to support the display device to display at 60fps, and the display frame rate of some or all display devices is controlled to be reduced.
  • the display frame rate of the display device is controlled to be reduced to reduce the probability of freezes and frame drops of the display device and improve the user experience.
  • a control method comprising: determining that a vehicle is in a first preset scene, the first preset scene being associated with at least one of an operating state of the vehicle and a position of a user in a cabin of the vehicle, wherein the operating state comprises a driving state or a parking state; and according to the first preset scene, controlling a display frame rate of a display device of the vehicle.
  • the display frame rate of the display device is adjusted according to the preset scene, so that the picture of the display device can be displayed smoothly, thereby improving the user experience.
  • controlling the display frame rate of the display device of the vehicle according to the first preset scene includes: when it is determined that the vehicle switches from the second preset scene to the first preset scene, controlling the display frame rate to switch from the second frame rate to the first frame rate.
  • the first preset scene indicates that the vehicle is in the parking state
  • the second preset scene indicates that the vehicle is in the driving state
  • the display device is used to display at least one of the operating condition information and navigation information of the vehicle
  • the first frame rate is lower than the second frame rate
  • the first preset scene indicates that the vehicle is in the parking state
  • the second preset scene indicates that the vehicle is in the driving state
  • the display device is used to display entertainment information
  • the first frame rate is higher than the second frame rate
  • the display device includes a first display device and a second display device, wherein the first display device corresponds to a main driving area of the cockpit, and the second display device corresponds to a first area of the cockpit,
  • the first area includes one or more areas other than the main driving area.
  • the display frame rate of the display device of the vehicle is controlled according to the first preset scenario, including: when the first preset scenario indicates that the first user is located in the main driving area and the second user is located in the first area, the display frame rate of the first display device is controlled to be a third frame rate, and the display frame rate of the second display device is controlled to be a fourth frame rate; wherein the third frame rate is higher than the fourth frame rate, and the users include the first user and the second user.
  • the method also includes: obtaining resource occupancy information, the resource occupancy information indicating the used resource capacity of the computing unit and/or the available resource capacity in the remaining resources, the computing unit being associated with the display device; and controlling the display frame rate of the display device of the vehicle according to the first preset scenario, including: controlling the display frame rate of the display device according to the resource occupancy information and the first preset scenario.
  • the display device includes a third display device, which is used to display at least one of entertainment information and navigation information.
  • the display frame rate of the display device is controlled according to the resource occupancy information and the first preset scenario, including: when the resource occupancy information indicates that the used resource capacity is greater than or equal to a preset capacity threshold and the first preset scenario indicates that the vehicle is in the driving state, controlling the reduction of the display frame rate to the third display device.
  • controlling the display frame rate of the display device includes: when a touch screen operation on the third display device is detected, controlling to increase the display frame rate of the third display device.
  • the third display device includes one or more display devices other than the instrument screen.
  • the display device includes a fourth display device, which is used to display at least one of entertainment information and navigation information.
  • the display frame rate of the display device of the vehicle is controlled according to the first preset scenario, including: when the first preset scenario indicates that the vehicle is in the driving state and the single-frame processing time within the first preset time length is greater than or equal to the preset processing time length, controlling to reduce the display frame rate of the fourth display device.
  • a control device which includes a determination unit and a processing unit, wherein the determination unit is used to determine the display frame rate of the display device based on at least one of the operating status of a vehicle, the position of a user in a cabin of the vehicle, a touch screen operation on the display device of the vehicle, and the type of application to which an interface to be displayed on the display device belongs; and the processing unit is used to control the display device to display at the display frame rate.
  • the device also includes an adjustment unit, which is used to adjust the display frame rate based on changes in at least one of the operating state, the user's position in the cabin of the vehicle, the touch screen operation of the display device of the vehicle, and the type of application to which the interface to be displayed on the display device belongs.
  • an adjustment unit which is used to adjust the display frame rate based on changes in at least one of the operating state, the user's position in the cabin of the vehicle, the touch screen operation of the display device of the vehicle, and the type of application to which the interface to be displayed on the display device belongs.
  • the change in the operating state includes a transition between a driving state and a parking state, or a change in the level of autonomous driving.
  • the display device is used to display at least one of the operating condition information and navigation information of the vehicle
  • the adjustment unit is used to: in response to the operating state changing from a parking state to a driving state, increase the display frame rate; in response to the operating state changing from a driving state to a parking state, reduce the display frame rate; in response to a decrease in the vehicle's autonomous driving level, increase the display frame rate; or, in response to an increase in the vehicle's autonomous driving level, reduce the display frame rate.
  • the display device is used to display entertainment information
  • the adjustment unit is used to: in response to the operating state changing from a parking state to a driving state, reduce the display frame rate; in response to the operating state changing from a parking state to a driving state, reduce the display frame rate; In response to a change in the vehicle state from a driving state to a parking state, the display frame rate is increased; in response to a decrease in the autonomous driving level of the vehicle, the display frame rate is decreased; or, in response to an increase in the autonomous driving level of the vehicle, the display frame rate is increased.
  • the adjustment unit is used to: in response to the user coming to the position in the cabin corresponding to the display device, increase the display frame rate; or, in response to the user leaving the position in the cabin corresponding to the display device, reduce the display frame rate.
  • the adjustment unit is used to: in response to no touch screen operation occurring within a predetermined time after the touch screen operation occurs, reduce the display frame rate; or, in response to the touch screen operation, increase the display frame rate, wherein no touch screen operation occurs within a predetermined time before the touch screen operation occurs.
  • the display device includes a first display device and a second display device, wherein the first display device corresponds to a first area in the cabin and the second display device corresponds to a second area in the cabin, and the determination unit is used to determine that a display frame rate of the first display device is different from a display frame rate of the second display device.
  • the determination unit is used to: in response to there being no user in the first area and there being a user in the second area, determine that the display frame rate of the first display device is lower than the display frame rate of the second display device; in response to there being a user in the first area and there being no user in the second area, determine that the display frame rate of the first display device is higher than the display frame rate of the second display device; or, in response to there being a user in the first area and there being a user in the second area, the first area is the main driving area of the cockpit, and the second area includes one or more areas other than the main driving area, determine that the display frame rate of the first display device is higher than the display frame rate of the second display device.
  • the determination unit is used to: determine that the display frame rate of the first display device is higher than the display frame rate of the second display device in response to the first display device having a user touch screen operation within a preset time and the second display device having no user touch screen operation within a preset time; or, determine that the display frame rate of the first display device is lower than the display frame rate of the second display device in response to the first display device having no user touch screen operation within a preset time and the second display device having a user touch screen operation within a preset time.
  • the determination unit is used to: in response to the priority of the first application to which the interface to be displayed on the first display device belongs being higher than the priority of the second application to which the interface to be displayed on the second display device belongs, determine that the display frame rate of the first display device is higher than the display frame rate of the second display device; or, in response to the priority of the first application to which the interface to be displayed on the first display device belongs being lower than the priority of the second application to which the interface to be displayed on the second display device belongs, determine that the display frame rate of the first display device is lower than the display frame rate of the second display device.
  • the determination unit is used to: determine the display frame rate based on resource occupancy information; wherein the resource occupancy information indicates the used resource capacity of the computing unit and/or the available resource capacity in the remaining resources, and the computing unit is associated with the display device.
  • the display device includes a third display device, which is used to display at least one of entertainment information and navigation information, and the determination unit is used to: when the vehicle is in the driving state and the resource occupancy information indicates that the used resource capacity is greater than or equal to a preset capacity threshold, determine that the display frame rate is a first frame rate; when the vehicle is in the driving state and the resource occupancy information indicates that the used resource capacity is less than the preset capacity threshold, determine that the display frame rate is a second frame rate; wherein the first frame rate is higher than the second frame rate.
  • the third display device includes, in addition to the instrument screen One or more display devices.
  • the determination unit is used to determine to reduce the display frame rate of the display device when the vehicle is in the driving state and the single frame processing time within the first preset time length is greater than or equal to the preset processing time length.
  • a control device which includes a determination unit and a processing unit, wherein the determination unit is used to: determine that a vehicle is in a first preset scene, the first preset scene is associated with at least one of an operating state of the vehicle and a position of a user in a cabin of the vehicle, wherein the operating state includes a driving state or a parking state; and the processing unit is used to: control the display frame rate of a display device of the vehicle according to the first preset scene.
  • a control device comprising: a memory for storing a computer program; and a processor for executing the computer program stored in the memory, so that the device performs a method in any possible implementation of the first aspect or the second aspect.
  • a vehicle comprising an apparatus as in any possible implementation of the third to fifth aspects, and a display device.
  • the vehicle is a vehicle.
  • a computer program product comprising: a computer program code, when the computer program code is run on a computer, the computer executes a method in any possible implementation of the first aspect or the second aspect.
  • the above-mentioned computer program code may be stored in whole or in part on a first storage medium, wherein the first storage medium may be packaged together with the processor or may be packaged separately from the processor.
  • a computer-readable medium stores instructions, and when the instructions are executed by a processor, the processor implements the method in any possible implementation of the first aspect or the second aspect.
  • a chip comprising a circuit for executing a method in any possible implementation of the first aspect or the second aspect.
  • the display frame rate of the display device can be dynamically adjusted according to one or more of the operating state of the vehicle, the position of the user in the cockpit, the touch screen operation of the display device of the vehicle, and the type of application to which the interface to be displayed by the display device belongs, so that the display device can smoothly display the picture and improve the user's experience.
  • the display device that displays navigation information and operating condition information is controlled to display at a higher display frame rate to ensure that the driving safety-related information is refreshed in real time and at a high speed, which helps to improve driving safety;
  • the display device that displays entertainment information is controlled to display at a higher display frame rate to ensure that the entertainment-related information is refreshed in real time and at a high speed, which helps to improve the user's entertainment experience.
  • the control method provided in the present application can also give priority to ensuring that the display device in the main driving area displays at a higher frame rate, which helps to improve the driving experience and driving safety of the main driving user.
  • control method provided in the present application can also adjust the frame rate of the display device according to the used resource capacity of the computing unit.
  • the display frame rate of the turned-on display device is controlled to be reduced, which helps to prevent the display device from being stuck due to the excessively high used resource capacity of the computing unit;
  • the display device is controlled to display at a higher display frame rate to improve the smoothness of the picture, thereby enhancing the user experience;
  • the used resource capacity of the computing unit is greater than or equal to the preset capacity threshold, and the display device other than the display device that displays the vehicle's operating condition information is controlled to be reduced.
  • the display frame rate of other display devices other than the equipment can be guaranteed to ensure the display frame rate of display devices such as instrument screens that display operating condition information, which helps to improve driving safety and user experience. It is also possible to increase the display frame rate of the touched display device according to the user's touch screen behavior, improve the hand tracking of the display device, and help improve the user's interactive experience when using the display device.
  • the control method provided in this application controls to reduce the display frame rate of the display device when the computing platform has insufficient processing power, so as to reduce the probability of freezes and frame drops in the display device and improve the user's experience.
  • FIG1 is a functional block diagram of a vehicle provided by an embodiment of the present application.
  • FIG2 is a schematic diagram of a cockpit scene provided in an embodiment of the present application.
  • FIG3 is a schematic diagram of a system architecture required for implementing a control method provided in an embodiment of the present application
  • FIG4 is a schematic flow chart of a control method provided in an embodiment of the present application.
  • FIG5 is a schematic diagram of an application scenario of the control method provided in an embodiment of the present application.
  • FIG6 is another schematic flow chart of a control method provided in an embodiment of the present application.
  • FIG7 is another schematic diagram of an application scenario of the control method provided in an embodiment of the present application.
  • FIG8 is another schematic flow chart of a control method provided in an embodiment of the present application.
  • FIG9 is another schematic diagram of an application scenario of the control method provided in an embodiment of the present application.
  • FIG10 is another schematic flow chart of a control method provided in an embodiment of the present application.
  • FIG11 is another schematic flow chart of a control method provided in an embodiment of the present application.
  • FIG13 is a schematic block diagram of a control device provided in an embodiment of the present application.
  • FIG1 is a functional block diagram of a vehicle 100 provided in an embodiment of the present application.
  • the vehicle 100 may include a perception system 120, a display device 130, and a computing platform 150, wherein the perception system 120 may include one or more sensors for sensing information about the environment surrounding the vehicle 100.
  • the perception system 120 may include a positioning system, which may be a global positioning system (GPS), or a Beidou system or other positioning systems, an inertial measurement unit (IMU), a laser radar, a millimeter wave radar, an ultrasonic radar, and a camera device; the perception system 120 may also include a pressure sensor, which is arranged under a seat to detect whether there is a user on the seat; the perception system 120 may also include an acoustic wave sensor to detect audio information in the cabin.
  • GPS global positioning system
  • IMU inertial measurement unit
  • the computing platform 150 may be a hardware circuit, such as a field programmable gate array (FPGA).
  • FPGA field programmable gate array
  • the process of the processor loading a configuration document to implement the hardware circuit configuration can be understood as the process of the processor loading instructions to implement the functions of some or all of the above units.
  • it can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), a deep learning processing unit (DPU), etc.
  • the computing platform 150 may also include a memory, the memory is used to store instructions, and some or all of the processors 151 to 15n can call the instructions in the memory and execute the instructions to implement the corresponding functions.
  • the vehicle 100 may include an advanced driving assistant system (ADAS).
  • ADAS utilizes a variety of sensors on the vehicle (including but not limited to: lidar, millimeter wave radar, camera, ultrasonic sensor, global positioning system, inertial measurement unit) to obtain information from the surroundings of the vehicle, and analyzes and processes the obtained information to achieve functions such as obstacle perception, target recognition, vehicle positioning, path planning, user monitoring/reminders, etc., thereby improving the safety, automation and comfort of vehicle driving.
  • sensors on the vehicle including but not limited to: lidar, millimeter wave radar, camera, ultrasonic sensor, global positioning system, inertial measurement unit
  • ADAS can achieve different levels of autonomous driving assistance based on artificial intelligence algorithms and information obtained by multiple sensors.
  • the above autonomous driving levels (L0-L5) are based on the grading standards of the Society of Automotive Engineers (SAE). Among them, L0 is no automation; L1 is driving assistance; L2 is partial automation; L3 is conditional automation; L4 is highly automated; L5 is fully automated. The tasks of monitoring road conditions and responding to L1 to L3 are completed by the user and the system, and the user is required to take over the dynamic driving task. L4 and L5 allow users to completely transform into the role of passengers.
  • SAE Society of Automotive Engineers
  • the display device 130 in the cockpit is mainly divided into two categories.
  • the first category is the vehicle display screen;
  • the second category is the projection display screen, such as a head-up display (HUD).
  • the vehicle display screen is a physical display screen and an important part of the vehicle infotainment system.
  • There can be multiple display screens in the cockpit such as a digital instrument screen, a central control screen, a display screen in front of the passenger in the co-pilot seat (also called the front passenger), a display screen in front of the left rear passenger, and a display screen in front of the right rear passenger. Even the window can be used as a display screen for display.
  • Head-up display also known as a head-up display system.
  • the processor may obtain the seat pressure information, the user's facial information, the audio information, etc. detected by the perception system 120, and then control the display frame rate of the display device 130 in combination with the operating state of the vehicle and/or at least one of the seat pressure information, the user's facial information, and the audio information.
  • the seat pressure information, the user's facial information, the audio information, etc. may also be stored in the memory of the computing platform 150 in the form of data.
  • a camera of a driver monitor system (DMS), a camera of a cabin monitor system (CMS), and a camera of a dashcam such as a camera of a driver monitor system (DMS), a camera of a cabin monitor system (CMS), and a camera of a dashcam.
  • the camera used to capture images inside and outside the cabin may be the same camera or different cameras.
  • one or more pressure sensors and acoustic wave sensors are provided in the cockpit to monitor whether there is a user inside the cockpit and the user's position.
  • the display screens 201 to 205 may display a graphical user interface (GUI).
  • GUI graphical user interface
  • the cockpit may include a central control screen, a co-pilot entertainment screen, a screen behind the main driver's headrest, a screen behind the co-pilot's headrest, entertainment screens in the three-row left area, and entertainment screens in the three-row right area.
  • the cockpit may include a front row entertainment screen and a rear row entertainment screen; or, the cockpit may include a display screen in the driving area and an entertainment screen in the passenger area.
  • the entertainment screen in the passenger area may also be set on the top of the cockpit.
  • the embodiments of the present application provide a control method, device and vehicle, which can dynamically adjust the display frame rate of one or more display devices in the cabin according to the operating status of the vehicle and/or the position information of the user in the cabin of the vehicle, reduce the probability of freezes and frame drops during the display process of the display device, improve the smoothness of the picture, and thereby improve the user experience.
  • FIG3 shows a schematic block diagram of the system architecture required for implementing the control method provided in an embodiment of the present application.
  • the layered architecture divides the control software into several layers, each layer having a clear role and division of labor.
  • the layers communicate with each other through software interfaces.
  • the control system can be divided into five layers, namely, from top to bottom, the application layer, the framework layer, the system layer, the kernel layer, and the hardware layer.
  • the application layer can include a series of application packages.
  • the application package can include video applications, navigation applications, communication applications, and search applications.
  • the video application is used to provide users with video playback functions
  • the navigation application is used to provide users with navigation information
  • the communication application is used to provide users with call functions
  • the search application is used to provide users with more convenient access to required information.
  • the framework layer provides application programming interface (API) and programming framework for the application layer.
  • the framework layer may include some predefined functions, as shown in Figure 3, the framework layer may include a multi-display window manager (MDWM) and a drawing and rendering module.
  • MDWM multi-display window manager
  • MDWM includes a detection module and a frame rate decision module, wherein the detection module is used to detect at least one of the following: the operating state of the vehicle, the position of the user in the cockpit, the touch screen signal of the display device, the type of application to which the interface to be displayed on the display device belongs, the used resource capacity of the computing unit, and the time required for single frame processing; and send the detection result to the
  • the frame rate is sent to the frame rate decision module so that the frame rate decision module determines the target frame rate corresponding to the display device according to the detection result.
  • the target frame rate is the frame rate at which surfaceflinger synthesizes display data, that is, the display frame rate of the display device at the hardware layer.
  • the system library may include multiple functional modules.
  • the system library may include: surface flinger.
  • the rendering thread of the rendering module is called to render the layer data sent from the application layer, and the rendered data is sent to surface flinger for synthesis.
  • the frame rate decision module in MDWM sends the target frame rate corresponding to the display device determined according to the detection result to the surface flinger, so that the surface flinger controls the synthesis of data for display on the display device according to the target frame rate.
  • the kernel layer is the layer between hardware and software.
  • the kernel layer contains at least HWC, which is used to combine and display image data using hardware.
  • HWC is used to receive the layer and target frame rate sent by surface flinger, process the layer according to the target frame rate, and send it to one or more display devices of the hardware layer for display.
  • the display devices 351 to 35n of the hardware layer may include one or more of the display apparatuses 130 in FIG. 1 , or the display devices 351 to 35n may include one or more of the display screens 201 to 205 shown in FIG. 2 .
  • FIG4 shows a schematic flow chart of a control method 400 provided in an embodiment of the present application.
  • the method 400 can be applied to the vehicle 100 shown in FIG1 , and the method 400 can also be executed by the system shown in FIG3 . More specifically, the method 400 can be executed by the MDWM shown in FIG3 .
  • the method 400 includes:
  • the vehicle may include the vehicle shown in FIG. 1 .
  • the operating status may include a driving status or a parking status; or, it may also include the autonomous driving level of the vehicle.
  • the operating state of the vehicle can be determined based on the gear information of the vehicle. For example, when the vehicle is in reverse (R) gear or drive (D) gear, it is determined that the vehicle is in a driving state; when the vehicle is in parking (P) gear, it is determined that the vehicle is in a parking state.
  • R reverse
  • D drive
  • P parking
  • the running state of the vehicle can be determined according to the speed of the vehicle. For example, when the speed of the vehicle is greater than a preset speed threshold, it is determined that the vehicle is in a driving state; when the speed of the vehicle is less than or equal to the preset speed threshold, it is determined that the vehicle is in a parking state.
  • the preset speed threshold can be 0 kilometers per hour (kph), or 5 kph, or other values.
  • the display device may include the display apparatus 130 shown in FIG. 1 ; or, the display device may include at least one of the display screens 201 to 205 shown in FIG. 2 ; or, the display device may include at least one of the display devices 351 to 35n shown in FIG. 3 .
  • the relationship between the operating state of the vehicle and the display frame rate of the display device may be pre-set, as shown in Table 1.
  • the instrument screen, AR-HUD and other display devices that display operating condition information and/or navigation information are controlled to display at a higher display frame rate, and the central control screen, co-pilot entertainment screen and other display devices that display entertainment information are controlled to display at a lower display frame rate;
  • the instrument screen, AR-HUD and other display devices that display operating condition information and/or navigation information are controlled to display at a lower display frame rate, and the central control screen, co-pilot entertainment screen and other display devices that display entertainment information are controlled to display at a higher display frame rate Display;
  • the vehicle's autonomous driving level is low, the instrument screen, AR-HUD and other display devices that display operating conditions information and/or navigation information are controlled to display at a higher display frame rate, and the central control screen, co-pilot entertainment screen and other display devices that display entertainment information are controlled to display at a lower display frame rate;
  • the autonomous driving level is high, the instrument screen, AR-HUD and other display devices that display
  • the display frame rate of one or more display devices in the cockpit can be determined according to the specific operating state.
  • the display screens in the cabin may be displayed at different frame rates.
  • the gear bar 501 displayed on the display screen 205 indicates that the vehicle is in gear P
  • the speed information bar 502 and the power information bar 503 indicate that the speed and power of the vehicle are zero, respectively, that is, the vehicle is currently in a parking state.
  • the display device is a display screen 205 that displays operating condition information
  • it can be determined that the display frame rate of the display device is a lower display frame rate, such as 30fps
  • the display device is a display screen 202 that displays entertainment information
  • the display frame rate of the display device is a higher display frame rate, such as 60fps.
  • the gear bar 501 displayed on the display screen 205 indicates that the vehicle is in gear D
  • the speed information bar 502 and the power information bar 503 indicate that the speed and power of the vehicle are 60 km/h and 60 kW, respectively, that is, the vehicle is currently in a driving state.
  • the display device is a display screen 205 that displays operating condition information
  • it can be determined that the display frame rate of the display device is a higher display frame rate, such as 60fps
  • the display device is a display screen 202 that displays entertainment information
  • the display frame rate of the display device is a lower display frame rate, such as 30fps.
  • the information bar 504 of the display screen 205 shows that the vehicle's automatic driving level is L0.
  • the display device is a display screen 205 that displays operating condition information
  • the display device is a display screen 202 for displaying entertainment information
  • it can be determined that the display frame rate of the display device is a lower display frame rate, such as 30fps.
  • the information bar 504 of the display screen 205 shows that the vehicle's autonomous driving level is L3.
  • the display device is a display screen 205 that displays operating condition information
  • it can be determined that the display frame rate of the display device is a lower display frame rate, such as 30fps;
  • the display device is a display screen 202 that displays entertainment information
  • it can be determined that the display frame rate of the display device is a higher display frame rate, such as 60fps.
  • the display frame rate of the display device may also be adjusted according to changes in the operating state of the vehicle, wherein the change in the operating state includes a transition between a driving state and a parking state, or a change in the level of automatic driving.
  • the control method provided in the embodiment of the present application can dynamically adjust the display frame rate of the display device according to the operating state of the vehicle, so that the display device can display the picture smoothly and improve the user experience.
  • the display device displaying navigation information and operating condition information is controlled to display at a higher display frame rate to ensure that the driving safety related information is refreshed in real time and at high speed, which helps to improve driving safety;
  • the display device displaying entertainment information is controlled to display at a higher display frame rate to ensure that the entertainment related information is refreshed in real time and at high speed, which helps to improve the user's entertainment experience.
  • FIG6 shows a schematic flow chart of a control method 600 provided in an embodiment of the present application.
  • the method 600 can be applied to the vehicle 100 shown in FIG1 .
  • the method 600 can also be executed by the system shown in FIG3 . More specifically, the method 600 can be executed by the MDWM shown in FIG3 .
  • the method 600 includes:
  • S601 determining a display frame rate of a display device according to a position of a user in a cockpit of a vehicle.
  • the vehicle may include the vehicle in the above embodiment
  • the display device may include the display device in the above embodiment.
  • the vehicle can determine the user's position in the cabin through sensor information, including but not limited to: determining whether there is a user in a certain seat through an acoustic wave sensor; determining whether there is a user in a certain seat through a camera device or an in-cabin visual sensor; determining whether there is a user in a seat through a pressure sensor set at the seat.
  • sensor information including but not limited to: determining whether there is a user in a certain seat through an acoustic wave sensor; determining whether there is a user in a certain seat through a camera device or an in-cabin visual sensor; determining whether there is a user in a seat through a pressure sensor set at the seat.
  • the relationship between the position of the user in the cockpit and the display frame rate of the display device may be preset, as shown in Table 2.
  • the display frame rate of the display device corresponding to the position of the user in the cabin can be prioritized, and the display device can be controlled to display at a higher display frame rate; when there are multiple users in the cabin, and the multiple users include users in the main driving area, the display frame rate of the display device corresponding to the main driving area is prioritized, and the display device is controlled to display at a higher display frame rate.
  • the display device corresponding to a certain position includes: the content displayed by the display device is mainly for viewing by users at the position.
  • the display device corresponding to a certain area, or a certain area corresponds to a display device includes: the content displayed by the display device is mainly for viewing by users in the area; or the area includes the display device.
  • an area in the cockpit may include a specific location, for example, the main driving area includes the main driving position.
  • the display device may include at least one of an instrument screen, an AR-HUD and a central control screen; if the area is the co-pilot area, the display device may be a co-pilot screen, such as display screen 202; if the area is the left side area of the second row of the vehicle, the display device may be a screen behind the main driver's headrest, such as display screen 203; if the area is the right side area of the second row of the vehicle, the display device may be a screen behind the co-pilot's headrest, such as display screen 204.
  • the display frame rate of one or more display devices in the cockpit is determined according to the actual position of the user in the cockpit.
  • the display frame rate of display device 1 can be determined to be different from the display frame rate of display device 2 according to the position of the user in the cockpit.
  • display device 1 is a central control screen corresponding to the main driving area
  • display device 2 is a co-pilot entertainment screen corresponding to the co-pilot area as an example: when there is a user in the main driving area and no user in the co-pilot area, it is determined that the display frame rate of display device 1 (such as 60fps) is higher than the display frame rate of display device 2 (such as 0 or 30fps); when there is no user in the main driving area and there is a user in the co-pilot area, it is determined that the display frame rate of display device 1 (such as 30fps) is lower than the display frame rate of display device 2 (such as 60fps); when there are users in both the main driving area and the co-pilot area, it
  • display device 1 is the central control screen corresponding to the main driving area and display device 2 is the screen behind the main driving headrest corresponding to the left rear area as an example: when there are users in both the main driving area and the left rear area, it is determined that the display frame rate of display device 1 (such as 60fps) is higher than the display frame rate of display device 2 (such as 30fps).
  • the display frame rate of display device 1 such as 60fps
  • the display frame rate of display device 2 such as 30fps
  • the display frame rate of the display device may also be adjusted according to the change of the position of the user in the cockpit. For example, in response to the user coming to the position corresponding to the display device in the cockpit, the display frame rate of the display device is increased; or in response to the user leaving the position corresponding to the display device in the cockpit, the display frame rate of the display device is reduced.
  • the display frame rate of the display screens in the cabin can be adjusted.
  • the display frame rates of the display screens 201 and 205 corresponding to the main driving area are both 30fps; as shown in (b) of FIG. 7 , when the user 701 sits in the main driving area, the display frame rates of the display screens 201 and 205 corresponding to the main driving area can be increased to 60fps. Furthermore, after the user 701 leaves the main driving area, the display frame rates of the display screens 201 and 205 corresponding to the main driving area can be further reduced to 30fps.
  • the control method provided in the embodiment of the present application can dynamically adjust the display frame rate of the display device according to the position of the user in the cockpit, giving priority to ensuring that the display device corresponding to the area with users in the cockpit displays at a higher frame rate, which helps to improve the user experience. Furthermore, when there are users in multiple areas including the main driving area, the display device in the main driving area is given priority to display at a higher frame rate, which helps to improve the driving experience and driving safety of the main driving user.
  • FIG8 shows a schematic flow chart of a control method 800 provided in an embodiment of the present application.
  • the method 800 can be applied to the vehicle 100 shown in FIG1 , and the method 800 can also be executed by the system shown in FIG3 . More specifically, the method 800 can be executed by the MDWM shown in FIG3 .
  • the method 800 includes:
  • the vehicle may include the vehicle in the above embodiment
  • the display device may include the display device in the above embodiment.
  • the display frame rate of the display device when a display device is displaying at a display frame rate lower than its full frame rate, in response to a touch screen operation on the display device, the display frame rate of the display device is increased, wherein no touch screen operation occurs within a predetermined time before the touch screen operation occurs. Further, if no touch screen operation continues to occur within a predetermined time after the touch screen operation occurs, the display frame rate of the display device may be reduced.
  • the display frame rate of the display device can be controlled to increase to 60fps.
  • the display frame rate of the display device can be controlled to increase directly from 30fps to 60fps (which can be understood as an instantaneous increase); or, the display frame rate of the display device can be controlled to increase from 30fps to 60fps at a fixed rate (which can be understood as a gradual increase).
  • the fixed rate can be 30fps/s, or it can be other rates.
  • the predetermined time may be 3 seconds, or 5 seconds, or other durations.
  • the full frame rate can be understood as the maximum display frame rate supported by the display device.
  • the display frame rate of the display device can be increased while the display frame rates of other display devices that have not detected touch screen signals can be reduced.
  • the display frame rate of the display screen in the cabin can be adjusted.
  • display screen 201 and display screen 202 display at display frame rates of 60fps and 30fps respectively.
  • the display frame rate of display screen 202 can be increased to 60fps, and the display frame rate of display screen 201 can be reduced to 30fps.
  • the control method provided in the embodiment of the present application can dynamically adjust the display frame rate of the display device according to the touch screen operation on the display device of the vehicle.
  • the display frame rate of the touched display device is increased, and the hand tracking performance of the display device is improved, which helps to improve the user's interactive experience when using the display device.
  • the display frame rate of the touched display device is increased, and the display frame rate of the untouched display device is reduced, which can save energy consumption when the display device is displayed and improve the intelligence of the display device and the vehicle.
  • FIG10 shows a schematic flow chart of a control method 1000 provided in an embodiment of the present application.
  • the method 1000 can be applied to the vehicle 100 shown in FIG1 , and the method 1000 can also be executed by the system shown in FIG3 , and more specifically, the method 1000 can be executed by the MDWM shown in FIG3 .
  • the method 1000 includes:
  • S1010 determining a display frame rate of a display device according to a type of an application to which an interface to be displayed on the display device belongs.
  • the vehicle may include the vehicle in the above embodiment
  • the display device may include the display device in the above embodiment.
  • the types of applications may include, but are not limited to, entertainment, driving, and communication.
  • Entertainment applications may include audio applications, video applications, game applications, etc.
  • driving applications may include navigation applications, driving assistance applications, etc.
  • communication applications may include call applications, chat applications, etc.
  • the relationship between the type of application to which the interface to be displayed by the display device belongs and the display frame rate of the display device may be preset, as shown in Table 3.
  • the display frame rate of the central control screen is determined to be 60fps; when the interface to be displayed on the central control screen belongs to an entertainment application or a communication application, the display frame rate of the central control screen is determined to be 30fps.
  • the display device is one of the other display screens, when the interface to be displayed on the display screen belongs to an entertainment application, the display frame rate of the display screen is determined to be 60fps; when the interface to be displayed on the display screen belongs to a driving application or a communication application, the display frame rate of the display screen is determined to be 30fps.
  • the corresponding relationship between the priority of the application and the display frame rate of the display device may be preset, and then the display frame rate of the display device may be determined according to the priority of the application.
  • driving applications have the highest priority, and the display frame rate of driving applications can be 60fps; entertainment applications have a medium priority, and the display frame rate of entertainment applications can be 45fps; communication applications have the lowest priority, and the display frame rate of communication applications can be 30fps.
  • the display frame rate of display device 3 can be determined to be different from the display frame rate of display device 4 according to the priority of the application to which the interface to be displayed by display device 3 and display device 4 belongs.
  • the interface to be displayed by display device 3 belongs to a driving application
  • the interface to be displayed by display device 4 belongs to an entertainment application.
  • the display frame rate of display device 3 (such as 60fps) is determined to be higher than the display frame rate of display device 4 (such as 45fps); the interface to be displayed by display device 3 belongs to a communication application, and the interface to be displayed by display device 4 belongs to an entertainment application. Since the priority of the communication application is lower than that of the entertainment application, the display frame rate of display device 3 (such as 30fps) is determined to be lower than the display frame rate of display device 4 (such as 45fps).
  • the control method provided in the embodiment of the present application can dynamically adjust the display frame rate of the display device according to the type of application to which the interface to be displayed on the display device belongs, which helps to improve the intelligence of the display device and the vehicle.
  • FIG11 shows a schematic flow chart of a control method 1100 provided in an embodiment of the present application.
  • the method 1100 can be applied to the vehicle 100 shown in FIG1 , and the method 1100 can also be executed by the system shown in FIG3 . More specifically, the method 100 can be executed by the MDWM shown in FIG3 .
  • the method 1000 includes:
  • S1110 determining the display frame rate of the display device according to at least one of the operating status of the vehicle, the position of the user in the cabin of the vehicle, the touch screen operation of the display device of the vehicle, and the type of application to which the interface to be displayed on the display device belongs.
  • the vehicle may include the vehicle in the above embodiment
  • the display device may include the display device in the above embodiment.
  • the method for determining the display frame rate of the display device based on any one of the operating status of the vehicle, the position of the user in the cabin of the vehicle, the touch screen operation on the display device of the vehicle, and the type of application to which the interface to be displayed on the display device belongs can refer to the description in method 400, method 600, method 800, and method 1000, which will not be repeated here.
  • the display frame rate of the display device can also be determined based on at least two of the operating status of the vehicle, the user's position in the cabin of the vehicle, touch screen operations on the display device of the vehicle, and the type of application to which the interface to be displayed on the display device belongs.
  • the display frame rate of the display device may be determined based on the operating status of the vehicle and the position of the user in the cabin of the vehicle.
  • At least one of the instrument screen, AR-HUD, and central control screen corresponding to the main driving area can be controlled to display at a higher display frame rate (such as 60fps); or, if the vehicle is in driving state and only the main driving area has a user, the instrument screen, AR-HUD, and central control screen corresponding to the main driving area can be controlled to display at a higher display frame rate (such as 60fps).
  • the instrument screen and/or AR-HUD in the display device corresponding to the domain which is used to display operating condition information and navigation information, displays at a higher display frame rate (such as 60fps), and the central control screen in the display device corresponding to the control and main driving area displays at a lower display frame rate (such as 30fps).
  • At least one of the instrument screen, AR-HUD, and central control screen corresponding to the main driving area can be controlled to display at a higher display frame rate (such as 60fps), and the co-pilot entertainment screen corresponding to the co-pilot area can be controlled to display at a lower display frame rate (such as 30fps).
  • At least one of the instrument screen, AR-HUD and central control screen corresponding to the main driving area can be controlled to display at a higher display frame rate (such as 60fps)
  • the co-pilot entertainment screen corresponding to the co-pilot area can be controlled to display at a lower display frame rate (such as 30fps)
  • the rear screen corresponding to the rear area can be controlled to display at a lower display frame rate (such as 30fps).
  • the instrument screen and/or AR-HUD used to display operating condition information and navigation information in the display device corresponding to the main driver's area can be controlled to display at a lower display frame rate (such as 30fps)
  • the central control screen in the display device corresponding to the main driver's area can be controlled to display at a higher display frame rate (such as 60fps)
  • the co-driver's entertainment screen corresponding to the co-driver's area can be controlled to display at a higher display frame rate (such as 60fps)
  • the rear screen corresponding to the rear row area can be controlled to display at a higher display frame rate (such as 60fps).
  • the display frame rate of the display device after determining the display frame rate of the display device according to the operating state of the vehicle and the position of the user in the vehicle, when a touch screen operation on a certain display device is detected, the display frame rate of the display device can be adjusted according to the touch screen operation.
  • the display frame rate of the co-pilot entertainment screen when the vehicle is in a driving state, and there is a user in the main driving area and the co-pilot area, after determining that the display frame rate of the instrument screen, AR-HUD, and central control screen corresponding to the main driving area is 60fps and the display frame rate of the co-pilot entertainment screen corresponding to the co-pilot area is 30fps, when a touch screen operation on the co-pilot entertainment screen is detected, the display frame rate of the co-pilot entertainment screen can be increased to 60fps.
  • the display frame rate of the display device may be determined according to the operating status of the vehicle and the type of application to which the interface to be displayed on the display device belongs.
  • the central control screen when the vehicle is in driving state, when the instrument screen is displayed at a higher display frame rate (for example, 60fps), and the central control screen displays entertainment applications (such as audio applications, video applications, game applications, etc.), the central control screen can be controlled to display the interface of the application at a lower display frame rate (for example, 30fps), and no matter what interface is displayed on other display screens except the central control screen and the instrument screen, the other display screens are controlled to display at a lower display frame rate (for example, 30fps).
  • a lower display frame rate for example, 30fps
  • the instrument screen displays at a higher frame rate (for example, 60fps), and the central control screen displays driving applications (such as navigation applications, driving assistance applications, etc.), the central control screen can be controlled to display the interface of the application at a higher frame rate (for example, 60fps), and no matter what interface is displayed on other display screens except the central control screen and the instrument screen, the other display screens are controlled to display at a lower frame rate (for example, 30fps).
  • a higher frame rate for example, 60fps
  • driving applications such as navigation applications, driving assistance applications, etc.
  • the instrument screen displays at a lower frame rate (for example, 30fps), and when the central control screen displays an entertainment application, the central control screen can be controlled to display the interface of the application at a higher frame rate (for example, 60fps), and no matter what type of application is displayed on other display screens except the central control screen and the instrument screen, the other display screens are controlled to display at a higher frame rate (for example, 60fps).
  • a lower frame rate for example, 30fps
  • the central control screen displays an entertainment application
  • the central control screen can be controlled to display the interface of the application at a higher frame rate (for example, 60fps)
  • the other display screens are controlled to display at a higher frame rate (for example, 60fps).
  • the instrument screen displays at a lower frame rate (for example, 30fps)
  • the central control screen displays a driving application
  • the central control screen can be controlled to display the interface of the application at a lower frame rate (for example, 30fps)
  • the other display screens are controlled to display at a higher frame rate (for example, 60fps).
  • the display frame rate of the display screens in the cabin can be adjusted according to the operating status of the vehicle and the position of the user in the cabin.
  • the gear bar 1201 displayed on the display screen 205 indicates that the vehicle is in the P gear, that is, the vehicle is currently in a parking state.
  • the display frame rate of the display screen 201 and/or the display 205 corresponding to the main driving area can be determined according to the running state of the vehicle, and the display frame rate of the display screen 204 corresponding to the right rear area can be determined according to the running state of the vehicle. Further, the display frame rate of the display screen can be determined according to the type of application to which the interface to be displayed on the display screen belongs.
  • the display frame rate of the display screen 201 can be determined to be a lower display frame rate, such as 30fps; when the interface to be displayed on the display screen 204 belongs to an entertainment application, such as a video application, the display frame rate of the display screen 204 can be determined to be a higher display frame rate, such as 60fps.
  • the gear bar 1201 displayed on the display screen 205 indicates that the vehicle is in gear P, that is, the vehicle is currently in a parking state.
  • the display frame rate of the display screen 201 can be determined to be a higher display frame rate, such as 60fps;
  • the display frame rate of the display screen 204 can be determined to be a higher display frame rate, such as 60fps.
  • the gear bar 1201 displayed on the display screen 205 indicates that the vehicle is in gear D, that is, the vehicle is currently in driving state.
  • the display frame rate of the display screen 201 and/or display 205 corresponding to the main driving area can be determined according to the running state of the vehicle, and the display frame rate of the display screen 204 corresponding to the right rear area can be determined according to the running state of the vehicle. Further, the display frame rate of the display screen can be determined according to the type of application to which the interface to be displayed on the display screen belongs.
  • the display frame rate of the display screen 201 can be determined to be a higher display frame rate, such as 60fps; when the interface to be displayed on the display screen 204 belongs to an entertainment application, such as a video application, the display frame rate of the display screen 204 can be determined to be a lower display frame rate, such as 30fps.
  • the gear bar 1201 displayed on the display screen 205 indicates that the vehicle is in gear D, that is, the vehicle is currently in driving state.
  • the display frame rate of the display screen 201 can be determined to be a lower display frame rate, such as 30fps;
  • the display frame rate of the display screen 204 can be determined to be a lower display frame rate, such as 30fps.
  • the display frame rate of the display device after determining the display frame rate of the display device based on the operating status of the vehicle, the user's position in the vehicle, and the type of application to which the interface to be displayed on the display device belongs, when a touch screen operation on a certain display device is detected, the display frame rate of the display device can be adjusted according to the touch screen operation.
  • the vehicle in combination with (d) in Figure 12, still taking the vehicle as an example: the vehicle is in a driving state, and after determining that the display frame rates of display screen 201 and display screen 204 are both 30fps, as shown in (e) in Figure 12, a touch screen operation on display screen 204 is detected, the display frame rate of display screen 204 can be increased to 60fps.
  • the method further includes: determining the display frame rate based on resource occupancy information; wherein the resource occupancy information indicates the used resource capacity of the computing unit and/or the available resource capacity in the remaining resources, and the computing unit is associated with the display device.
  • the display frame rate of one or more display devices is controlled to be reduced.
  • the one or more display devices are used to display at least one of entertainment information and navigation information.
  • the display frame rate of one or more display devices including the central control screen, the co-pilot entertainment screen, and the AR-HUD can be controlled to be reduced.
  • the central control screen when the vehicle is in the driving state, the central control screen displays a 360-degree surround image and/or a reversing image, and the resource occupancy information indicates that the used resource capacity is greater than or equal to a preset capacity threshold, the display frame rate of one or more display devices other than the central control screen can be controlled to be reduced.
  • the display frame rate of the instrument screen and/or AR-HUD can be controlled to be reduced.
  • the display frame rate of one or more display devices is controlled to be reduced.
  • the display frame rate of the central control screen and the co-pilot entertainment screen are controlled to display at a display frame rate of 60fps, and when the used resource capacity of the CPU is greater than or equal to 70%, the display frame rate of the central control screen and the co-pilot entertainment screen is reduced to 45fps.
  • the display frame rate of one or more display devices is controlled to be reduced according to the resource occupancy information
  • the display frame rate of the display device is controlled to be increased.
  • the display frame rate of the AR-HUD and the central control screen is controlled to drop to 30fps. Furthermore, when a touch screen signal for the central control screen is detected, the display frame rate of the central control screen is controlled to increase to 60fps. In some possible implementations, in the above scenario, when a touch screen signal for the co-pilot entertainment screen is detected, the touch screen signal of the co-pilot entertainment screen can also be controlled to increase to 60fps.
  • the display frame rate of one or more display devices is controlled to be reduced according to the resource occupancy information
  • the display frame rate of the display device is controlled to be increased, and at the same time, the display frame rates of other display devices among the one or more display devices except the display device are controlled to be further reduced.
  • the display frame rate of the AR-HUD and the central control screen is controlled to drop to 45fps. Further, when a touch screen signal for the central control screen is detected, the display frame rate of the central control screen is controlled to increase to 60fps, and the display frame rate of the AR-HUD is further controlled to drop to 30fps.
  • the display frame rate of which display device is prioritized can be set by the user. For example, if the user sets the display frame rate of the central control screen to be prioritized, then when the used resource capacity is greater than or equal to the preset capacity threshold, the display frame rates of other display devices except the central control screen are reduced according to the user setting control.
  • control is performed to reduce the display frame rate of one or more display devices used to display entertainment information and/or navigation information.
  • the above-mentioned single frame processing time may be the time required to synthesize a frame of data for display by a display device, for example, the single frame processing time may be the time required for a surface flinger to synthesize and render a frame of an image.
  • the preset processing time is the inverse of the display frame rate of the display device. For example, if the display frame rate is 60fps, the preset processing time is 16.7 milliseconds. When the single frame processing time is greater than 16.7 milliseconds, frame loss will occur.
  • the first preset duration may be 1 second, or 1.5 seconds, or other durations; the preset processing duration may be 16.7 milliseconds, or other preset processing durations.
  • the continuous 1-second single-frame processing duration is greater than or equal to 16.7 milliseconds, it indicates that the processing power of the computing platform is insufficient to support the display device to display at 60fps, and the display frame rate of the display device is controlled to be reduced.
  • the one or more display devices may include at least one of a central control screen, a co-pilot entertainment screen, a screen behind the main driver's headrest, and a screen behind the co-pilot's headrest.
  • controlling the display device to display at the display frame rate may include: controlling the surface flinger to control the synthesis of data for display on the display device at the display frame rate.
  • the control method provided in the embodiment of the present application can dynamically adjust the display frame rate of the display device according to at least one of the operating state of the vehicle, the position of the user in the cabin of the vehicle, the touch screen operation of the display device of the vehicle, and the type of application to which the interface to be displayed by the display device belongs, so that the picture of the display device can be
  • the frame rate of the display device can also be adjusted according to the used resource capacity of the computing unit.
  • the display frame rate of the turned-on display device is controlled to be reduced, which helps prevent the display device from being stuck due to the high used resource capacity of the computing unit; when the used resource capacity of the computing unit is small, the display device is controlled to display at a higher display frame rate to improve the smoothness of the picture, thereby improving the user experience.
  • the correspondence between the state of the vehicle and the display frame rate of the display device shown in Tables 1 to 7 is only an exemplary description. In a specific implementation, the correspondence may also have other forms.
  • the display frame rates shown in Tables 1 to 7 may also be other values.
  • the specific value of the display frame rate may be set by the user, and the embodiments of the present application do not specifically limit this.
  • the following example illustrates a method for a vehicle to determine whether there is a user in the cabin and the position of the user in the cabin.
  • an acoustic wave sensor is used to detect whether there is a user in a certain seat.
  • the vehicle can determine whether there is a user in the cabin and the actual location of the user based on the audio information obtained by the acoustic wave sensor.
  • the audio information can be audio information obtained by excluding various invalid audio information from the audio information collected inside the vehicle, and the invalid audio information can be audio information with a volume that is too low.
  • the sound source position can be the position of the sound source corresponding to the audio information.
  • the sound source position can be a relative position to a display device based on sound source positioning, or it can be a specific position coordinate, and the embodiments of the present application do not impose specific restrictions on this.
  • the location of the sound source can be determined based on the time difference of arrival (TDOA) principle according to the audio information collected by multiple acoustic wave sensors.
  • TDOA time difference of arrival
  • the audio information may be a voice containing a specific wake-up word, such as "turn on the smart screen", etc.
  • the above-mentioned acoustic wave sensor may be an ultrasonic transceiver integrated or installed on a display device or an ultrasonic transceiver installed inside a vehicle cabin (including but not limited to a microphone sensor or a microphone sensor array).
  • a camera device or an in-cabin visual sensor which may be specifically: the facial information of the user is obtained by the camera device or the in-cabin visual sensor, and then whether there is a user in the cabin and the actual location of the user are determined based on the facial information of the user.
  • the above-mentioned camera device or in-cabin visual sensor includes but is not limited to: a camera sensor integrated or installed on a display device or a camera sensor installed inside the vehicle cabin, for example, a red green blue (RGB) camera, a red green blue-infrared radiation (RGB-IR) camera, and a time of flight (TOF) camera.
  • RGB red green blue
  • RGB-IR red green blue-infrared radiation
  • TOF time of flight
  • the user's gender, age, etc. may be determined by algorithms such as face attribute recognition algorithms and face gender classification algorithms. For example, after obtaining the user's facial information, it is also possible to determine whether the user's gaze focus is on the display device through a gaze estimation algorithm or a gaze tracking algorithm, thereby controlling the content displayed on the display device.
  • the laser radar integrated or installed on the display device or installed in the vehicle cabin, a radio transceiver on the display device or at the edge of the display device (including but not limited to millimeter wave radar or centimeter wave radar), an infrared sensor integrated on the display device or at the edge of the display device, or a laser radar installed in the vehicle cabin.
  • a sensing device including but not limited to an infrared rangefinder, a laser rangefinder), an eye tracker, etc. is used to detect whether there is a user in a certain seat.
  • a pressure sensor disposed at a seat is used to detect whether a user is seated at the seat. Specifically, when the pressure at a seat is greater than or equal to a preset threshold, it is confirmed that a user is seated at the seat.
  • the preset threshold may be 100 Newton (N), or 200N, or other values, which are not specifically limited in the present embodiment.
  • any one of the above methods can be used, or a combination of the above methods can be used, or other methods can be used, and the embodiments of the present application do not specifically limit this.
  • FIG. 13 shows a schematic block diagram of a control device 2000 provided in an embodiment of the present application.
  • the device 2000 includes a determination unit 2010 and a processing unit 2020 .
  • the apparatus 2000 may include units for executing the method in Figure 4, Figure 6, Figure 8, Figure 10 or Figure 11.
  • each unit in the apparatus 2000 is respectively for implementing the corresponding process of the method embodiment in Figure 4, Figure 6, Figure 8, Figure 10 or Figure 11.
  • the determination unit 2010 may be used to execute S1110 in the method 1100
  • the processing unit 2020 may be used to execute S1120 in the method 1100 .
  • the determination unit 2010 is used to determine the display frame rate of the display device based on at least one of the operating status of the vehicle, the position of the user in the cabin of the vehicle, the touch screen operation of the display device of the vehicle, and the type of application to which the interface to be displayed on the display device belongs; and the processing unit 2020 is used to control the display device to display at the display frame rate.
  • the device also includes an adjustment unit for adjusting the display frame rate based on changes in at least one of the operating state, the user's position in the vehicle cabin, the touch screen operation of the display device of the vehicle, and the type of application to which the interface to be displayed on the display device belongs.
  • the change in the operating state includes a transition between a driving state and a parking state, or a change in the level of autonomous driving.
  • the display device is used to display at least one of the operating condition information and navigation information of the vehicle
  • the adjustment unit is used to: in response to the operating state changing from a parking state to a driving state, increase the display frame rate; in response to the operating state changing from a driving state to a parking state, reduce the display frame rate; in response to a decrease in the automatic driving level of the vehicle, increase the display frame rate; or, in response to an increase in the automatic driving level of the vehicle, reduce the display frame rate.
  • the display device is used to display entertainment information
  • the adjustment unit is used to: in response to the operating state changing from a parking state to a driving state, reduce the display frame rate; in response to the operating state changing from a driving state to a parking state, increase the display frame rate; in response to the reduction of the automatic driving level of the vehicle, reduce the display frame rate; or in response to the As the vehicle's autonomous driving level improves, the display frame rate increases.
  • the adjustment unit is used to: increase the display frame rate in response to the user coming to the position corresponding to the display device in the cabin; or reduce the display frame rate in response to the user leaving the position corresponding to the display device in the cabin.
  • the adjustment unit is used to: reduce the display frame rate in response to no touch screen operation occurring within a predetermined time after the touch screen operation occurs; or increase the display frame rate in response to the touch screen operation, wherein no touch screen operation occurs within a predetermined time before the touch screen operation occurs.
  • the display device includes a first display device and a second display device, wherein the first display device corresponds to a first area in the cabin and the second display device corresponds to a second area in the cabin, and the determination unit 2010 is used to determine that a display frame rate of the first display device is different from a display frame rate of the second display device.
  • the determination unit 2010 is used to: in response to there being no user in the first area and there being a user in the second area, determine that the display frame rate of the first display device is lower than the display frame rate of the second display device; in response to there being a user in the first area and there being no user in the second area, determine that the display frame rate of the first display device is higher than the display frame rate of the second display device; or, in response to there being a user in the first area and there being a user in the second area, the first area being the main driving area of the cockpit, and the second area including one or more areas other than the main driving area, determine that the display frame rate of the first display device is higher than the display frame rate of the second display device.
  • the determination unit 2010 is used to: determine that the display frame rate of the first display device is higher than the display frame rate of the second display device in response to the user touching the screen operation on the first display device within a preset time and the user not touching the screen operation on the second display device within a preset time; or, determine that the display frame rate of the first display device is lower than the display frame rate of the second display device in response to the user not touching the screen operation on the first display device within a preset time and the user touching the screen operation on the second display device within a preset time.
  • the determination unit 2010 is used to: determine that the display frame rate of the first display device is higher than the display frame rate of the second display device in response to the priority of the first application to which the interface to be displayed on the first display device belongs being higher than the priority of the second application to which the interface to be displayed on the second display device belongs; or, determine that the display frame rate of the first display device is lower than the display frame rate of the second display device in response to the priority of the first application to which the interface to be displayed on the first display device belongs being lower than the priority of the second application to which the interface to be displayed on the second display device belongs.
  • the determination unit 2010 is used to: determine the display frame rate according to resource occupancy information; wherein the resource occupancy information indicates the used resource capacity of the computing unit and/or the available resource capacity in the remaining resources, and the computing unit is associated with the display device.
  • the display device includes a third display device, which is used to display at least one of entertainment information and navigation information.
  • the determination unit 2010 is used to: when the vehicle is in the driving state and the resource occupancy information indicates that the used resource capacity is greater than or equal to a preset capacity threshold, determine that the display frame rate is a first frame rate; when the vehicle is in the driving state and the resource occupancy information indicates that the used resource capacity is less than the preset capacity threshold, determine that the display frame rate is a second frame rate; wherein the first frame rate is higher than the second frame rate.
  • the third display device includes one or more display devices other than the instrument screen.
  • the determination unit 2010 is used to determine to reduce the display frame rate of the display device when the vehicle is in the driving state and the single frame processing time within the first preset time is greater than or equal to the preset processing time.
  • the division of the units in the above device is only a division of logical functions. In actual implementation, they can be fully or partially integrated into one physical entity, or they can be physically separated.
  • the units in the device can be implemented in the form of a processor calling software; for example, the device includes a processor, the processor is connected to a memory, and instructions are stored in the memory.
  • the processor calls the instructions stored in the memory to implement any of the above methods or realize the functions of the units of the device, wherein the processor is, for example, a general-purpose processor, such as a CPU or a microprocessor, and the memory is a memory in the device or a memory outside the device.
  • the units in the device can be implemented in the form of hardware circuits, and the functions of some or all of the units can be realized by designing the hardware circuits.
  • the hardware circuit can be understood as one or more processors; for example, in one implementation, the hardware circuit is an ASIC, and the functions of some or all of the above units are realized by designing the logical relationship of the components in the circuit; for another example, in another implementation, the hardware circuit can be implemented by PLD.
  • FPGA as an example, it can include a large number of logic gate circuits, and the connection relationship between the logic gate circuits is configured through the configuration file, so as to realize the functions of some or all of the above units. All units of the above device may be implemented entirely in the form of a processor calling software, or entirely in the form of a hardware circuit, or partially in the form of a processor calling software and the rest in the form of a hardware circuit.
  • Each unit in the above device may be one or more processors (or processing circuits) configured to implement the above method, such as a CPU, a GPU, an NPU, a TPU, a DPU, a microprocessor, a DSP, an ASIC, an FPGA, or a combination of at least two of these processor forms.
  • processors or processing circuits configured to implement the above method, such as a CPU, a GPU, an NPU, a TPU, a DPU, a microprocessor, a DSP, an ASIC, an FPGA, or a combination of at least two of these processor forms.
  • the units in the above device can be fully or partially integrated together, or can be implemented independently. In one implementation, these units are integrated together and implemented in the form of a system-on-a-chip (SOC).
  • SOC may include at least one processor for implementing any of the above methods or implementing the functions of each unit of the device.
  • the type of the at least one processor may be different, for example, including a CPU and an FPGA, a CPU and an artificial intelligence processor, a CPU and a GPU, etc.
  • the operations performed by the determination unit 2010 and the processing unit 2020 may be performed by one processor, or may be performed by different processors.
  • the one or more processors may be processors disposed in the computing platform 150 shown in FIG. 1 ; or the apparatus 2000 may be a chip disposed in the computing platform 150.
  • FIG14 is a schematic block diagram of a control device provided in an embodiment of the present application.
  • the control device 2100 shown in FIG14 may include: a processor 2110, a transceiver 2120, and a memory 2130.
  • the processor 2110, the transceiver 2120, and the memory 2130 are connected via an internal connection path, the memory 2130 is used to store instructions, and the processor 2110 is used to execute the instructions stored in the memory 2130 to implement the control method in the above-mentioned embodiments.
  • the memory 2130 can be coupled to the processor 2110 through an interface, or integrated with the processor 2110.
  • transceiver 2120 may include but is not limited to a transceiver device such as an input/output interface to achieve communication between the device 2100 and other devices or communication networks.
  • Memory 2130 can be a read-only memory (ROM), a static storage device, a dynamic storage device or a random access memory (RAM).
  • ROM read-only memory
  • RAM random access memory
  • the transceiver 2120 uses a transceiver device such as but not limited to a transceiver to implement communication between the device 2100 and other devices or a communication network to receive/send data/information used to implement the control method in the above embodiments.
  • a transceiver device such as but not limited to a transceiver to implement communication between the device 2100 and other devices or a communication network to receive/send data/information used to implement the control method in the above embodiments.
  • the device 2100 may be arranged in the computing platform 150 shown in FIG. 1 , or may also be arranged in the MDWM shown in FIG. 3 .
  • An embodiment of the present application also provides a vehicle, which includes the above-mentioned device 2000 or the above-mentioned device 2100.
  • the vehicle is a vehicle.
  • An embodiment of the present application further provides a computer program product, which includes a computer program code.
  • the computer program code runs on a computer, the computer implements the control method in the above embodiments of the present application.
  • An embodiment of the present application further provides a computer-readable storage medium, which stores computer instructions.
  • the computer instructions When the computer instructions are executed on a computer, the computer implements the control method in the above embodiments of the present application.
  • An embodiment of the present application also provides a chip, including a circuit, for executing the control method in the above embodiments of the present application.
  • At least one of a, b, or c can mean: a, b, c, a-b, a-c, b-c, or a-b-c, where a, b, c can be single or multiple.
  • prefixes such as "first" and “second” used in the embodiments of the present application are only used to distinguish different description objects, and have no limiting effect on the position, order, priority, quantity or content of the described objects.
  • the use of prefixes such as ordinal numbers used to distinguish description objects in the embodiments of the present application does not constitute a limitation on the described objects. For the statement of the described objects, please refer to the description in the context of the claims or embodiments, and the use of such prefixes should not constitute an unnecessary limitation.
  • each step of the above method can be completed by an integrated logic circuit of hardware in a processor or an instruction in the form of software.
  • the method disclosed in conjunction with the embodiment of the present application can be directly embodied as a hardware processor for execution, or a combination of hardware and software modules in a processor for execution.
  • the software module can be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or a power-on erasable programmable memory, a register, etc.
  • the storage medium is located in a memory, and the processor reads the information in the memory and completes the steps of the above method in conjunction with its hardware. To avoid repetition, it is not described in detail here.
  • the disclosed systems, devices and methods can be implemented in other ways.
  • the device embodiments described above are only schematic.
  • the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed.
  • Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)

Abstract

一种控制方法、装置和运载工具,该方法包括:根据运载工具的运行状态、用户在该运载工具座舱内的位置、针对该运载工具的显示设备的触屏操作、以及该显示设备待显示的界面所属的应用程序的类型中的至少一项,确定该显示设备的显示帧率;控制该显示设备以该显示帧率进行显示。本申请的控制方法可以应用于智能车辆中,能够提高用户驾乘体验,进一步地,还可以提高行驶安全性。

Description

控制方法、装置和运载工具 技术领域
本申请涉及智能座舱领域,特别地,涉及一种控制方法、装置和运载工具。
背景技术
随着车辆智能化、网联化水平提高,车辆座舱逐渐向以人机交互为核心、多屏联动的智能座舱发展。智能座舱所能提供的影音娱乐功能越来越丰富,但可能存在显示屏卡顿等情形,导致用户使用体验不佳。因此,在使用车载显示屏的过程中,如何提高用户的使用体验,成为一个亟待解决的问题。
发明内容
本申请提供一种控制方法、装置和运载工具,能够根据运载工具的运行状态和/或用户在运载工具中的位置,控制运载工具的显示设备的显示帧率,能够提高用户驾乘体验,进一步地,还可以提高行驶安全性。
第一方面,提供了一种控制方法,该方法可以由运载工具执行;或者,也可以由运载工具的计算平台执行;或者,还可以由用于运载工具的芯片或电路模块执行,本申请对此不作具体限定。
本申请涉及的运载工具可以包括路上交通工具、水上交通工具、空中交通工具、工业设备、农业设备、或娱乐设备等。例如运载工具可以为车辆,该车辆为广义概念上的车辆,可以是交通工具(如商用车、乘用车、摩托车、飞行车、火车等),工业车辆(如:叉车、挂车、牵引车等),工程车辆(如挖掘机、推土车、吊车等),农用设备(如割草机、收割机等),游乐设备,玩具车辆等,本申请实施例对车辆的类型不作具体限定。再如,运载工具可以为飞机、或轮船等交通工具。
该方法包括:根据运载工具的运行状态、用户在该运载工具座舱内的位置、针对该运载工具的显示设备的触屏操作、以及该显示设备待显示的界面所属的应用程序的类型中的至少一项,确定该显示设备的显示帧率;控制该显示设备以该显示帧率进行显示。
相对于现有技术,上述方案提出了用于确定显示帧率的新型参考因素,能够在资源有限的情况下,灵活确定显示帧率,使显示效果更大程度满足用户的需求,提高用户的使用体验。例如,在有多个显示设备时,控制显示设备的芯片的算力不足以支持所有显示设备以满帧率进行显示时,降低某一个或多个显示设备的显示帧率,以保证剩下的显示设备以较高显示帧率进行显示,从而提高剩下的显示设备的流畅度。
示例性地,上述显示设备可以包括但不限于:抬头显示、中控屏、副驾娱乐屏、主驾驶头枕后部屏幕、副驾驶头枕后部屏幕。
本申请涉及的显示帧率是指:以帧称为单位的位图图像连续出现在显示设备上的频率(或速率);或者,显示帧率也可以理解为显示合成系统(surface flinger)单位时间内向 显示设备提交显示数据的帧数。可以理解的是,显示帧率越高,则画面流畅度越高。
结合第一方面,在第一方面的某些实现方式中,该根据运载工具的运行状态、用户在该运载工具座舱内的位置、针对该运载工具的显示设备的触屏操作、以及该显示设备待显示的界面所属的应用程序的类型中的至少一项,确定该显示设备的显示帧率,包括:基于该运行状态、该用户在该运载工具座舱内的位置、该针对该运载工具的显示设备的触屏操作、以及该显示设备待显示的界面所属的应用程序的类型中的至少一项发生的变化,调整该显示帧率。
在上述技术方案中,根据运载工具的运行状态、用户在座舱中的位置、触屏操作以及应用程序的类型中的至少一个,实现对显示设备显示帧率的动态调节,例如,在运载工具行驶过程中,有助于在保证用户体验的前提下,提升行驶安全;在运载工具停车时,有助于提升用户的娱乐体验。
结合第一方面,在第一方面的某些实现方式中,该运行状态发生的变化,包括行驶状态与停车状态之间的转换,或者自动驾驶等级的变化。
结合第一方面,在第一方面的某些实现方式中,该显示设备用于显示该运载工具的运行工况信息和导航信息中的至少一项,该基于该运行状态、该用户在该运载工具座舱内的位置、该针对该运载工具的显示设备的触屏操作、以及该显示设备待显示的界面所属的应用程序的类型中的至少一项发生的变化,调整该显示帧率,包括:响应于该运行状态由停车状态变为行驶状态,提高该显示帧率;响应于该运行状态由行驶状态变为停车状态,降低该显示帧率;响应于该运载工具自动驾驶等级的降低,提高该显示帧率;或者,响应于该运载工具自动驾驶等级的提高,降低该显示帧率。
示例性地,运行工况信息可以包括但不限于:行驶速度、转速、挡位、剩余电量或剩余油量、剩余可行驶里程、指示灯或警报灯信息。其中,指示灯或警报灯可以包括如下至少一项:防冻液液面警报灯、燃油量指示灯、清洗器液面指示灯、充电指示灯、远近光变光指示灯、变速箱挡位指示灯、制动防抱死系统指示灯、驱动力调节指示灯、安全气囊警报灯。
示例性地,导航信息可以包括如下至少一项:当前行程中运载工具的目的地,运载工具从当前所处位置到目的地之间的行驶路径,运载工具从当前所处位置到目的地的剩余距离。在一些可能的实现方式中,导航信息为通过导航类应用程序显示。
示例性地,该显示设备可以包括仪表屏,或者也可以包括抬头显示,或者还可以包括中控屏。
在上述技术方案中,在运载工具处于行驶状态时,控制显示导航信息和运行工况信息的显示设备以较高显示帧率进行显示,保证驾驶安全相关信息实时高速刷新,有助于提高行驶安全性。在自动驾驶等级较高时,驾驶员对导航信息和运行工况信息的依赖可能降低,因此可以控制显示导航信息和运行工况信息的显示设备以较低显示帧率进行显示。
结合第一方面,在第一方面的某些实现方式中,该显示设备用于显示娱乐信息,该基于该运行状态、该用户在该运载工具座舱内的位置、该针对该运载工具的显示设备的触屏操作、以及该显示设备待显示的界面所属的应用程序的类型中的至少一项发生的变化,调整该显示帧率,包括:响应于该运行状态由停车状态变为行驶状态,降低该显示帧率;响应于该运行状态由行驶状态变为停车状态,提高该显示帧率;响应于该运载工具自动驾驶 等级的降低,降低该显示帧率;或者,响应于该运载工具自动驾驶等级的提高,提高该显示帧率。
示例性地,娱乐信息可以包括但不限于:视频、游戏、新闻咨询、音乐。在一些可能的实现方式中,娱乐信息为通过娱乐相关应用程序显示,例如通过视频类应用程序、音乐类应用程序、游戏类应用程序等显示。
示例性地,该显示设备可以包括中控屏,或者也可以包括副驾娱乐屏,或者还可以包括主驾驶(或副驾驶)头枕后部屏幕。
在上述技术方案中,在运载工具处于停车状态时,控制显示娱乐信息的显示设备以较高显示帧率进行显示,保证娱乐相关信息实时高速刷新,有助于提高用户的娱乐体验。在自动驾驶等级较高时,可以控制显示娱乐信息的显示设备以较高显示帧率进行显示,以提供用户的娱乐体验。
结合第一方面,在第一方面的某些实现方式中,该基于该运行状态、该用户在该运载工具座舱内的位置、该针对该运载工具的显示设备的触屏操作、以及该显示设备待显示的界面所属的应用程序的类型中的至少一项发生的变化,调整该显示帧率,包括:响应于该用户来到该座舱内与该显示设备相对应的位置,提高该显示帧率;或者,响应于该用户离开该座舱内与该显示设备相对应的位置,降低该显示帧率。
示例性地,座舱内与显示设备相对应的位置可以包括:该显示设备所显示的内容主要供该位置的用户观看。
例如,显示设备为中控屏或仪表屏时,座舱内与该显示设备相对应的位置可以为主驾驶处位置;显示设备为主驾驶头枕后部屏幕时,座舱内与该显示设备相对应的位置可以为第二排左侧位置。
在上述技术方案中,在检测到用户时,提高与用户对应位置的显示设备的显示帧率,有助于提升用户的交互体验和屏幕使用体验;在用户离开时,降低与用户对应位置的显示设备的显示帧率,有助于节省功耗。
结合第一方面,在第一方面的某些实现方式中,该基于该运行状态、该用户在该运载工具座舱内的位置、该针对该运载工具的显示设备的触屏操作、以及该显示设备待显示的界面所属的应用程序的类型中的至少一项发生的变化,调整该显示帧率,包括:响应于该触屏操作发生后的预定时间内未继续发生触屏操作,降低该显示帧率;或者,响应于该触屏操作,升高该显示帧率,其中该触屏操作发生之前的预定时间内未发生任何触屏操作。
示例性地,预定时间可以为3秒,或者也可以为5秒,或者还可以为其他时长。
在一些可能的实现方式中,在控制升高该显示设备的显示帧率的同时,降低其他未检测到触屏信号的显示设备的显示帧率。
在上述技术方案中,根据用户的触屏行为,提高被触摸显示设备的显示帧率,提高显示设备的跟手性,有助于提高用户使用显示设备时的交互体验。
结合第一方面,在第一方面的某些实现方式中,该显示设备包括第一显示设备和第二显示设备,其中,该第一显示设备对应于该座舱内的第一区域,该第二显示设备对应于该座舱内的第二区域,该确定该显示设备的显示帧率,包括:确定该第一显示设备的显示帧率不同于该第二显示设备的显示帧率。
结合第一方面,在第一方面的某些实现方式中,该确定该第一显示设备的显示帧率不 同于该第二显示设备的显示帧率,包括:响应于该第一区域无用户且该第二区域有用户,确定该第一显示设备的显示帧率低于该第二显示设备的显示帧率;响应于该第一区域有用户且该第二区域无用户,确定该第一显示设备的显示帧率高于该第二显示设备的显示帧率;或者,响应于该第一区域有用户且该第二区域有用户,该第一区域为该座舱的主驾驶区域,该第二区域包括除了主驾驶区域以外的一个或多个区域,确定该第一显示设备的显示帧率高于该第二显示设备的显示帧率。
其中,该第一显示设备对应于该座舱内的第一区域,包括:第一显示设备设置于第一区域;或者,第一显示设备用于向第一区域的用户进行显示。该第二显示设备对应于该座舱内的第二区域,包括:第二显示设备设置于第二区域;或者,第二显示设备用于向第二区域的用户进行显示。
示例性地,第一区域为主驾驶区域,则第一显示设备可以包括仪表屏,或者也可以包括抬头显示,或者还可以包括中控屏;第一区域为副驾驶区域,则第一显示设备包括副驾娱乐屏;或者,第一区域为后排区域,则第一显示设备包括主驾驶头枕后部屏幕,和/或副驾驶头枕后部屏幕。
在上述技术方案中,优先保障座舱内有用户区域对应的显示设备以较高帧率进行显示,有助于提高用户的使用体验。进一步地,在包括主驾驶区域在内的多个区域有用户时,优先保证主驾驶区域的显示设备以较高帧率进行显示,有助于提高主驾驶用户的驾乘体验和行驶安全性。
结合第一方面,在第一方面的某些实现方式中,该确定该第一显示设备的显示帧率不同于该第二显示设备的显示帧率,包括:响应于该第一显示设备在预设时间内有用户触屏操作且该第二显示设备在预设时间内无用户触屏操作,确定该第一显示设备的显示帧率高于该第二显示设备的显示帧率;或者,响应于该第一显示设备在预设时间内无用户触屏操作且该第二显示设备在预设时间内有用户触屏操作,确定该第一显示设备的显示帧率低于该第二显示设备的显示帧率。
示例性地,该预设时间可以为3秒,或者5秒,或者也可以为其他时长。
在一些可能的实现方式中,第一显示设备和第二显示设备的满帧率均为60每秒传输帧数(frames per second,fps),在第一显示设备以60fps进行显示,第二显示设备以30fps进行显示时,在检测到针对第二显示设备的触屏操作且未检测到针对第一显示设备的触屏操作时,可以控制第一显示设备的显示帧率降至30fps,或者45fps,控制第二显示设备的显示帧率升高至60fps。
在上述技术方案中,在座舱中有多个显示设备进行显示时,根据针对显示设备的触屏操作,提高被触摸显示设备的显示帧率,使其以较高帧率进行显示,提高显示设备的跟手性;降低未被触摸的显示设备的显示帧率,可以节省显示设备进行显示时的能耗,提高显示设备和运载工具的智能性。
结合第一方面,在第一方面的某些实现方式中,该确定该第一显示设备的显示帧率不同于该第二显示设备的显示帧率,包括:响应于该第一显示设备待显示的界面所属的第一应用程序的优先级高于该第二显示设备待显示的界面所属的第二应用程序的优先级,确定该第一显示设备的显示帧率高于该第二显示设备的显示帧率;或者,响应于该第一显示设备待显示的界面所属的第一应用程序的优先级低于该第二显示设备待显示的界面所属的 第二应用程序的优先级,确定该第一显示设备的显示帧率低于该第二显示设备的显示帧率。
在上述技术方案中,根据待显示界面所属的应用程序的优先级控制显示设备进行显示的显示帧率,有助于进一步提高运载设备的智能性。例如,在运载工具处于行驶状态时,可以将导航类应用程序的优先级设置为较高,将娱乐类应用程序的优先级设置为较低,进而可以保证显示导航类应用程序的显示设备以较高帧率进行显示,控制显示娱乐类应用程序的显示设备以较低帧率进行显示,以提高行驶安全性;在运载工具处于停车状态时,可以将导航类应用程序的优先级设置为较低,将导航类应用程序的优先级设置为较高,进而可以保证显示导航类应用程序的显示设备以较低帧率进行显示,控制显示娱乐类应用程序的显示设备以较高帧率进行显示,以提高用户的娱乐体验。
结合第一方面,在第一方面的某些实现方式中,该确定该显示设备的显示帧率,包括:根据资源占用信息,确定该显示帧率;其中,该资源占用信息指示计算单元的已用资源容量和/或剩余资源中的可用资源容量,该计算单元与该显示设备相关联。
示例性地,该计算单元与该显示设备相关联,可以包括:该计算单元执行数据处理以实现为该显示设备的显示功能。例如,该计算单元可以包括中央处理单元(central processing unit,CPU)、图形处理器(graphics processing unit,GPU)等。
在一些可能的实现方式中,座舱内没有用户的区域对应的显示设备为关闭状态,则在资源占用信息指示计算单元的已用资源容量大于或等于预设容量阈值时,控制降低第一状态指示的有用户区域的显示设备的显示帧率。例如,主驾驶和副驾驶区域有用户,则在资源占用信息指示计算单元的已用资源容量大于或等于预设容量阈值时,控制降低主驾驶区域对应的显示设备(如中控屏、仪表盘、抬头显示),以及副驾驶区域对应的显示设备(如副驾娱乐屏)的显示帧率。
进一步地,在计算资源的已用容量小于预设容量阈值时,再控制升高显示设备的显示帧率。
示例性地,预设容量阈值可以为75%,或者也可以为70%,或者还可以为其他数值。
在上述技术方案中,根据计算单元的已用资源容量调节显示设备的帧率,有助于合理利用芯片算力,在计算单元的已用资源容量过高时,控制降低已开启的显示设备的显示帧率,有助于防止显示设备因计算单元的已用资源容量过高而导致的卡顿;在计算单元的已用资源容量较小时,控制显示设备以较高显示帧率进行显示,提高画面流畅度,从而提升用户的使用体验。
结合第一方面,在第一方面的某些实现方式中,该显示设备包括第三显示设备,该第三显示设备用于显示娱乐信息、导航信息中的至少一项,该确定该显示帧率,包括:在该运载工具处于该行驶状态,且资源占用信息指示该已用资源容量大于或等于预设容量阈值,确定该显示帧率为第一帧率;在该运载工具处于该行驶状态,且资源占用信息指示该已用资源容量小于所述预设容量阈值,确定该显示帧率为第二帧率;其中,该第一帧率高于该第二帧率。
示例性地,第三显示设备可以为除了用于显示运行工况信息的显示设备以外的其他显示设备,例如,第三显示设备可以包括如下至少一个:中控屏、副驾娱乐屏、主驾驶头枕后部屏幕、副驾驶头枕后部屏幕。在一些可能的实现方式中,第三显示设备还可以包括抬头显示。
在一些可能的实现方式中,运载工具行驶区域空间比较狭窄,或者运载工具处于倒车过程中,则第三显示设备可以为除了用于显示360度环视影像和/或倒车影像以外的其他显示设备,例如,第三显示设备可以包括如下至少一个:抬头显示、仪表屏、副驾娱乐屏、主驾驶头枕后部屏幕、副驾驶头枕后部屏幕。
在一些可能的实现方式中,第三显示设备可以为用户选择的显示设备,例如,用户可以设定在资源占用信息指示计算单元已用资源容量大于或等于预设容量阈值时,控制降低副驾娱乐屏或后排屏幕等显示设备的显示帧率。
在上述技术方案中,在运载工具处于行驶状态的情况下,计算单元的已用资源容量大于或等于预设容量阈值,控制降低除了显示运载工具运行工况信息的显示设备以外的其他显示设备的显示帧率。在计算单元的资源受限的情况下,保证仪表屏、中控屏等显示设备的显示帧率,有助于提高行驶安全性和用户体验。
结合第一方面,在第一方面的某些实现方式中,该第三显示设备包括除了仪表屏以外的一个或多个显示设备。
结合第一方面,在第一方面的某些实现方式中,该确定该显示设备的显示帧率,包括:在运载工具处于该行驶状态,且第一预设时长内单帧处理时长大于或等于预设处理时长时,确定降低该显示设备的显示帧率。
示例性地,第一预设时长可以为1秒,或者也可以为1.5秒,或者还可以为其他时长;预设处理时长可以为16.7毫秒,或者,也可以为其他预设处理时长。例如,连续1秒单帧处理时长大于或等于16.7毫秒时,说明计算平台的处理能力不足以支撑显示设备以60fps进行显示,则控制降低部分或全部显示设备的显示帧率。
在上述技术方案中,在计算平台处理能力不足时,控制降低显示设备的显示帧率,以降低显示设备发生卡顿、掉帧的几率,提高用户的使用体验。
第二方面,提供了一种控制方法,该方法包括:确定运载工具处于第一预设场景,该第一预设场景与该运载工具的运行状态、用户在该运载工具座舱内的位置中的至少一项相关联,其中,该运行状态包括行驶状态或停车状态;根据该第一预设场景,控制该运载工具的显示设备的显示帧率。
在上述技术方案中,根据预设场景,对显示设备的显示帧率进行调节,使显示设备的画面能够流畅显示,提高用户的使用体验。
在一些可能的实现方式中,根据该第一预设场景控制该运载工具的显示设备的显示帧率,包括:在确定该运载工具由第二预设场景切换至该第一预设场景时,控制该显示帧率由第二帧率切换至第一帧率。
在一些可能的实现方式中,该第一预设场景指示该运载工具处于该停车状态,该第二预设场景指示该运载工具处于该行驶状态,该显示设备用于显示该运载工具的运行工况信息、导航信息中的至少一项,该第一帧率小于该第二帧率。
在一些可能的实现方式中,该第一预设场景指示该运载工具处于该停车状态,该第二预设场景指示该运载工具处于该行驶状态,该显示设备用于显示娱乐信息,该第一帧率高于该第二帧率。
在一些可能的实现方式中,该显示设备包括第一显示设备和第二显示设备,其中,该第一显示设备与该座舱的主驾驶区域相对应,该第二显示设备与该座舱的第一区域相对应, 该第一区域包括除了主驾驶区域以外的一个或多个区域,该根据该第一预设场景,控制该运载工具的显示设备的显示帧率,包括:在该第一预设场景指示第一用户位于该主驾驶区域、第二用户位于该第一区域时,控制该第一显示设备的显示帧率为第三帧率,控制该第二显示设备的显示帧率为第四帧率;其中,该第三帧率高于该第四帧率,该用户包括该第一用户和该第二用户。
在一些可能的实现方式中,该方法还包括:获取资源占用信息,该资源占用信息指示计算单元的已用资源容量和/或剩余资源中的可用资源容量,该计算单元与该显示设备相关联;该根据该第一预设场景,控制该运载工具的显示设备的显示帧率,包括:根据该资源占用信息和该第一预设场景,控制该显示设备的显示帧率。
在一些可能的实现方式中,该显示设备包括第三显示设备,该第三显示设备用于显示娱乐信息、导航信息中的至少一项,该根据该资源占用信息和该第一预设场景,控制该显示设备的显示帧率,包括:在资源占用信息指示该已用资源容量大于或等于预设容量阈值,且该第一预设场景指示该运载工具处于该行驶状态时,控制降低向该第三显示设备的显示帧率。
在一些可能的实现方式中,该控制该显示设备的显示帧率,包括:在检测到针对该第三显示设备的触屏操作时,控制升高该第三显示设备的显示帧率。
在一些可能的实现方式中,该第三显示设备包括除了仪表屏以外的一个或多个显示设备。
在一些可能的实现方式中,该显示设备包括第四显示设备,该第四显示设备用于显示娱乐信息、导航信息中的至少一项,该根据该第一预设场景,控制该运载工具的显示设备的显示帧率,包括:在该第一预设场景指示该运载工具处于该行驶状态,且第一预设时长内单帧处理时长大于或等于预设处理时长时,控制降低该第四显示设备的显示帧率。
第三方面,提供了一种控制装置,该装置包括确定单元和处理单元,其中,该确定单元用于:根据运载工具的运行状态、用户在该运载工具座舱内的位置、针对该运载工具的显示设备的触屏操作、以及该显示设备待显示的界面所属的应用程序的类型中的至少一项,确定该显示设备的显示帧率;该处理单元用于:控制该显示设备以该显示帧率进行显示。
结合第三方面,在第三方面的某些实现方式中,该装置还包括调节单元,该调节单元用于:基于该运行状态、该用户在该运载工具座舱内的位置、该针对该运载工具的显示设备的触屏操作、以及该显示设备待显示的界面所属的应用程序的类型中的至少一项发生的变化,调整该显示帧率。
结合第三方面,在第三方面的某些实现方式中,该运行状态发生的变化,包括行驶状态与停车状态之间的转换,或者自动驾驶等级的变化。
结合第三方面,在第三方面的某些实现方式中,该显示设备用于显示该运载工具的运行工况信息和导航信息中的至少一项,该调节单元用于:响应于该运行状态由停车状态变为行驶状态,提高该显示帧率;响应于该运行状态由行驶状态变为停车状态,降低该显示帧率;响应于该运载工具自动驾驶等级的降低,提高该显示帧率;或者,响应于该运载工具自动驾驶等级的提高,降低该显示帧率。
结合第三方面,在第三方面的某些实现方式中,该显示设备用于显示娱乐信息,该调节单元用于:响应于该运行状态由停车状态变为行驶状态,降低该显示帧率;响应于该运 行状态由行驶状态变为停车状态,提高该显示帧率;响应于该运载工具自动驾驶等级的降低,降低该显示帧率;或者,响应于该运载工具自动驾驶等级的提高,提高该显示帧率。
结合第三方面,在第三方面的某些实现方式中,该调节单元用于:响应于该用户来到该座舱内与该显示设备相对应的位置,提高该显示帧率;或者,响应于该用户离开该座舱内与该显示设备相对应的位置,降低该显示帧率。
结合第三方面,在第三方面的某些实现方式中,该调节单元用于:响应于该触屏操作发生后的预定时间内未继续发生触屏操作,降低该显示帧率;或者,响应于该触屏操作,升高该显示帧率,其中该触屏操作发生之前的预定时间内未发生任何触屏操作。
结合第三方面,在第三方面的某些实现方式中,该显示设备包括第一显示设备和第二显示设备,其中,该第一显示设备对应于该座舱内的第一区域,该第二显示设备对应于该座舱内的第二区域,该确定单元用于:确定该第一显示设备的显示帧率不同于该第二显示设备的显示帧率。
结合第三方面,在第三方面的某些实现方式中,该确定单元用于:响应于该第一区域无用户且该第二区域有用户,确定该第一显示设备的显示帧率低于该第二显示设备的显示帧率;响应于该第一区域有用户且该第二区域无用户,确定该第一显示设备的显示帧率高于该第二显示设备的显示帧率;或者,响应于该第一区域有用户且该第二区域有用户,该第一区域为该座舱的主驾驶区域,该第二区域包括除了主驾驶区域以外的一个或多个区域,确定该第一显示设备的显示帧率高于该第二显示设备的显示帧率。
结合第三方面,在第三方面的某些实现方式中,该确定单元用于:响应于该第一显示设备在预设时间内有用户触屏操作且该第二显示设备在预设时间内无用户触屏操作,确定该第一显示设备的显示帧率高于该第二显示设备的显示帧率;或者,响应于该第一显示设备在预设时间内无用户触屏操作且该第二显示设备在预设时间内有用户触屏操作,确定该第一显示设备的显示帧率低于该第二显示设备的显示帧率。
结合第三方面,在第三方面的某些实现方式中,该确定单元用于:响应于该第一显示设备待显示的界面所属的第一应用程序的优先级高于该第二显示设备待显示的界面所属的第二应用程序的优先级,确定该第一显示设备的显示帧率高于该第二显示设备的显示帧率;或者,响应于该第一显示设备待显示的界面所属的第一应用程序的优先级低于该第二显示设备待显示的界面所属的第二应用程序的优先级,确定该第一显示设备的显示帧率低于该第二显示设备的显示帧率。
结合第三方面,在第三方面的某些实现方式中,该确定单元用于:根据资源占用信息,确定该显示帧率;其中,该资源占用信息指示计算单元的已用资源容量和/或剩余资源中的可用资源容量,该计算单元与该显示设备相关联。
结合第三方面,在第三方面的某些实现方式中,该显示设备包括第三显示设备,该第三显示设备用于显示娱乐信息、导航信息中的至少一项,该确定单元用于:在该运载工具处于该行驶状态,且资源占用信息指示该已用资源容量大于或等于预设容量阈值,确定该显示帧率为第一帧率;在该运载工具处于该行驶状态,且资源占用信息指示该已用资源容量小于所述预设容量阈值,确定该显示帧率为第二帧率;其中,该第一帧率高于该第二帧率。
结合第三方面,在第三方面的某些实现方式中,该第三显示设备包括除了仪表屏以外 的一个或多个显示设备。
结合第三方面,在第三方面的某些实现方式中,该确定单元用于:在运载工具处于该行驶状态,且第一预设时长内单帧处理时长大于或等于预设处理时长时,确定降低该显示设备的显示帧率。
第四方面,提供了一种控制装置,该装置包括确定单元和处理单元,其中,该确定单元用于:确定运载工具处于第一预设场景,该第一预设场景与该运载工具的运行状态、用户在该运载工具座舱内的位置中的至少一项相关联,其中,该运行状态包括行驶状态或停车状态;该处理单元用于:根据该第一预设场景,控制该运载工具的显示设备的显示帧率。
第五方面,提供了一种控制装置,该装置包括:存储器,用于存储计算机程序;处理器,用于执行该存储器中存储的计算机程序,以使得该装置执行如第一方面或第二方面任一种可能实现方式中的方法。
第六方面,提供了一种运载工具,该运载工具包括如第三方面至第五方面任一种可能实现方式中的装置,以及显示设备。
结合第六方面,在第六方面的某些实现方式中,该运载工具为车辆。
第七方面,提供了一种计算机程序产品,上述计算机程序产品包括:计算机程序代码,当上述计算机程序代码在计算机上运行时,使得计算机执行上述第一方面或第二方面中任一种可能实现方式中的方法。
需要说明的是,上述计算机程序代码可以全部或部分存储在第一存储介质上,其中第一存储介质可以与处理器封装在一起的,也可以与处理器单独封装。
第八方面,提供了一种计算机可读介质,上述计算机可读介质存储有指令,当上述指令被处理器执行时,使得处理器实现上述第一方面或第二方面中任一种可能实现方式中的方法。
第九方面,提供了一种芯片,该芯片包括电路,该电路用于执行上述第一方面或第二方面中任一种可能实现方式中的方法。
在本申请中,可以根据运载工具的运行状态、用户在座舱中的位置、针对运载工具的显示设备的触屏操作、以及显示设备待显示的界面所属的应用程序的类型中的一项或多项,对显示设备的显示帧率进行动态调节,以使显示设备能够流畅显示画面,提高用户的使用体验。具体地,在运载工具处于行驶状态时,控制显示导航信息和运行工况信息的显示设备以较高显示帧率进行显示,保证驾驶安全相关信息实时高速刷新,有助于提高行驶安全性;在运载工具处于停车状态时,控制显示娱乐信息的显示设备以较高显示帧率进行显示,保证娱乐相关信息实时高速刷新,有助于提高用户的娱乐体验。此外,本申请提供的控制方法,还可以优先保证主驾驶区域的显示设备以较高帧率进行显示,有助于提高主驾驶用户的驾乘体验和行驶安全性。进一步地,本申请提供的控制方法,还可以根据计算单元的已用资源容量调节显示设备的帧率,在计算单元的已用资源容量过高时,控制降低已开启的显示设备的显示帧率,有助于防止显示设备因计算单元的已用资源容量过高而导致的卡顿;在计算单元的已用资源容量较小时,控制显示设备以较高显示帧率进行显示,提高画面流畅度,从而提升用户的使用体验;在运载工具处于行驶状态的情况下,计算单元的已用资源容量大于或等于预设容量阈值,控制降低除了显示运载工具运行工况信息的显示设 备以外的其他显示设备的显示帧率,保证仪表屏等显示运行工况信息的显示设备的显示帧率,有助于提高行驶安全性和用户体验。还可以根据用户的触屏行为,提高被触摸显示设备的显示帧率,提高显示设备的跟手性,有助于提高用户使用显示设备时的交互体验。本申请提供的控制方法,在计算平台处理能力不足时,控制降低显示设备的显示帧率,以降低显示设备发生卡顿、掉帧的几率,提高用户的使用体验。
附图说明
图1是本申请实施例提供的运载工具的一个功能框图示意;
图2是本申请实施例提供的座舱场景的示意图;
图3是本申请实施例提供的控制方法实施所需的系统架构的示意图;
图4是本申请实施例提供的一种控制方法的示意性流程图;
图5是本申请实施例提供的控制方法应用场景的示意图;
图6是本申请实施例提供的一种控制方法的又一示意性流程图;
图7是本申请实施例提供的控制方法应用场景的又一示意图;
图8是本申请实施例提供的一种控制方法的又一示意性流程图;
图9是本申请实施例提供的控制方法应用场景的又一示意图;
图10是本申请实施例提供的一种控制方法的又一示意性流程图;
图11是本申请实施例提供的一种控制方法的再一示意性流程图;
图12是本申请实施例提供的控制方法应用场景的再一示意图;
图13是本申请实施例提供的一种控制装置的示意性框图;
图14是本申请实施例提供的一种控制装置的示意性框图。
具体实施方式
下面将结合附图,对本申请实施例中的技术方案进行描述。
图1是本申请实施例提供的运载工具100的一个功能框图示意。运载工具100可以包括感知系统120、显示装置130和计算平台150,其中,感知系统120可以包括感测关于运载工具100周边的环境的信息的一种或多种传感器。例如,感知系统120可以包括定位系统,定位系统可以是全球定位系统(global positioning system,GPS),也可以是北斗系统或者其他定位系统、惯性测量单元(inertial measurement unit,IMU)、激光雷达、毫米波雷达、超声雷达以及摄像装置中的一种或者多种;感知系统120还可以包括压力传感器,设置于座椅下方,用于检测座位上是否有用户;感知系统120还可以包括声波传感器,用于检测座舱内的音频信息。
运载工具100的部分或所有功能可以由计算平台150控制。计算平台150可包括一个或多个处理器,例如处理器151至15n(n为正整数),处理器是一种具有信号的处理能力的电路,在一种实现中,处理器可以是具有指令读取与运行能力的电路,例如CPU、微处理器、GPU(可以理解为一种微处理器)、或数字信号处理器(digital signal processor,DSP)等;在另一种实现中,处理器可以通过硬件电路的逻辑关系实现一定功能,该硬件电路的逻辑关系是固定的或可以重构的,例如处理器为专用集成电路(application-specific integrated circuit,ASIC)或可编程逻辑器件(programmable logic device,PLD)实现的硬 件电路,例如现场可编辑逻辑门阵列(field programmable gate array,FPGA)。在可重构的硬件电路中,处理器加载配置文档,实现硬件电路配置的过程,可以理解为处理器加载指令,以实现以上部分或全部单元的功能的过程。此外,还可以是针对人工智能设计的硬件电路,其可以理解为一种ASIC,例如神经网络处理单元(neural network processing unit,NPU)、张量处理单元(tensor processing unit,TPU)、深度学习处理单元(deep learning processing unit,DPU)等。此外,计算平台150还可以包括存储器,存储器用于存储指令,处理器151至15n中的部分或全部处理器可以调用存储器中的指令,执行指令,以实现相应的功能。
运载工具100可以包括高级驾驶辅助系统(advanced driving assistant system,ADAS),ADAS利用在运载工具上的多种传感器(包括但不限于:激光雷达、毫米波雷达、摄像装置、超声波传感器、全球定位系统、惯性测量单元)从运载工具周围获取信息,并对获取的信息进行分析和处理,实现例如障碍物感知、目标识别、运载工具定位、路径规划、用户监控/提醒等功能,从而提升运载工具驾驶的安全性、自动化程度和舒适度。
在不同的自动驾驶等级(L0-L5)下,基于人工智能算法和多传感器所获取的信息,ADAS可以实现不同等级的自动驾驶辅助,上述的自动驾驶等级(L0-L5)是基于汽车工程师协会(society of automotive engineers,SAE)的分级标准的。其中,L0级为无自动化;L1级为驾驶支援;L2级为部分自动化;L3级为有条件自动化;L4级为高度自动化;L5级为完全自动化。L1至L3级监测路况并做出反应的任务都由用户和系统共同完成,并需要用户接管动态驾驶任务。L4和L5级可以让用户完全转变为乘客的角色。
座舱内的显示装置130主要分为两类,第一类是车载显示屏;第二类是投影显示屏,例如抬头显示装置(head up display,HUD)。车载显示屏是一种物理显示屏,是车载信息娱乐系统的重要组成部分,座舱内可以设置有多块显示屏,如数字仪表屏,中控屏,副驾驶位上的乘客(也称为前排乘客)面前的显示屏,左侧后排乘客面前的显示屏以及右侧后排乘客面前的显示屏,甚至是车窗也可以作为显示屏进行显示。抬头显示,也称平视显示系统。主要用于在驾驶员前方的显示设备(例如挡风玻璃)上显示例如时速、导航等驾驶信息。以降低驾驶员视线转移时间,避免因驾驶员视线转移而导致的瞳孔变化,提升行驶安全性和舒适性。HUD例如包括组合型抬头显示(combiner-HUD,C-HUD)系统、风挡型抬头显示(windshield-HUD,W-HUD)系统、增强现实型抬头显示系统(augmented reality HUD,AR-HUD)。
在本申请实施例中,处理器可以获取感知系统120检测到的座椅压力信息、用户的面容信息、音频信息等,进而结合运载工具的运行状态,和/或座椅压力信息、用户的面容信息、音频信息中的至少一个,控制显示装置130的显示帧率。在一些可能的实现方式中,上述座椅压力信息、用户的面容信息、音频信息等信息,还可以以数据的形式存储于计算平台150中的存储器中。
应理解,上述操作可以由同一个处理器执行,或者,也可以由一个或多个处理器执行,本申请实施例对此不作具体限定。
图2为本申请实施例提供的一种车辆座舱场景的示意图,该车辆可以为图1所示的运载工具100的一种示例。智能座舱内部设置一个或多个车载显示屏(或称车载屏幕),包括但不限于显示屏201(或者,也可以称为中控屏)、显示屏202(或者,也可以称为副 驾娱乐屏)、显示屏203(或者,也可以称为主驾驶头枕后部屏幕)、显示屏204(或者,也可以称为副驾驶头枕后部屏幕)以及显示屏205(或者,也可以称为仪表屏)。在一些可能的实现方式中,显示屏201也可以为延伸至副驾驶区域的长屏。图2所示座舱内还可以安装有一个或多个摄像头,用于捕捉舱内或舱外的图像,例如,驾驶员监测系统(driver monitor system,DMS)的摄像头,座舱监测系统(cabin monitor system,CMS)的摄像头,以及行车记录仪(dashcam)的摄像头。其中,用于捕捉舱内和舱外的摄像头可以是同一个摄像头,也可以是不同摄像头。此外,座舱内还设置一个或多个压力传感器、声波传感器,用于监测座舱内部是否有用户以及用户所处位置。进一步地,显示屏201至205可以显示图形用户界面(graphical user interface,GUI)。
应理解,以下实施例中的控制显示的方法是以图2所示的5座车辆为例进行说明的,本申请实施例并不限于此。例如,对于7座运动型多用途车(sport/suburban utility vehicle,SUV),座舱内可以包括中控屏、副驾娱乐屏、主驾驶头枕后部屏幕、副驾驶头枕后部屏幕、三排左侧区域的娱乐屏以及三排右侧区域的娱乐屏。又例如,对于客车而言,座舱内可以包括前排娱乐屏和后排娱乐屏;或者,座舱内可以包括驾驶区域的显示屏和乘客区域的娱乐屏。在一种实现中,乘客区域的娱乐屏也可以设置在座舱顶部。
在当前技术背景下,surface flinger每分钟向座舱内多个显示设备中的每个显示设备提交显示数据的帧数是固定的,且surface flinger向多个显示设备中的每个显示设备提交显示数据的帧数可能是相同的,例如,可能均为60fps。由于对多个显示设备,surface flinger和硬件合成处理器(hardware composer,HWC)不作区分地进行图像合成、渲染和显示,使得多个显示设备无法均以最高帧率(例如60fps)进行显示时,可能造成多个显示设备的画面卡顿、丢帧,进而严重影响用户的使用体验。
鉴于此,本申请实施例提供一种控制方法、装置和运载工具,能够根据运载工具的运行状态和/或用户在运载工具座舱内的位置信息,动态调整座舱内一个或多个显示设备的显示帧率,降低显示设备显示过程中发生卡顿、丢帧的概率,提高画面流畅度,进而提高用户使用体验。
图3示出了本申请实施例提供的控制方法实施所需系统架构的示意性框图。如图3所示,分层架构将控制软件分成若干个层,每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中,可以将控制系统分为五层,从上至下分别为应用程序层、框架(framework)层、系统层、内核层(kernel)、以及硬件(hardware)层。
应用程序层可以包括一系列应用程序包。如图3所示,应用程序包可以包括视频应用、导航应用、通讯应用以及搜索应用等应用程序。其中,视频应用用于为用户提供视频播放功能;导航应用用于为用户提供导航信息;通讯应用用于为用户提供通话功能;搜索应用用于为用户更便捷地获取所需信息。
框架层为应用层的应用程序提供应用编程接口(application programming interface,API)和编程框架。框架层中可以包括一些预先定义的函数,如图3所示,框架层可以包括多屏窗口管理模块(multi-display window manager,MDWM)和绘制渲染模块。
MDWM包括检测模块和帧率决策模块,其中,检测模块用于检测如下至少一项:运载工具的运行状态、用户在座舱内的位置、显示设备的触屏信号、显示设备待显示的界面所属的应用程序的类型、计算单元的已用资源容量、单帧处理所需时长;并将检测结果发 送至帧率决策模块,以使帧率决策模块根据检测结果确定显示设备对应的目标帧率,该目标帧率为surfaceflinger进行显示数据合成的帧率,即硬件层的显示设备的显示帧率。
系统库可以包括多个功能模块。例如图3所示,系统库可以包括:surface flinger。
示例性地,应用程序(如视频应用)被surface flinger触发绘制渲染后,调用绘制渲染模块的绘制渲染线程,将应用程序层中发来的图层数据进行绘制渲染,并将绘制渲染后的数据发送至surface flinger进行合成。
在本申请实施例中,MDWM中帧率决策模块将根据检测结果确定的显示设备对应的目标帧率发送给surface flinger,以使得surface flinger按目标帧率控制用于显示设备进行显示的数据的合成。
内核层是硬件和软件之间的层。内核层至少包含HWC,HWC用于利用硬件完成图像数据组合并显示。HWC用于接收surface flinger发送的图层和目标帧率,按照目标帧率对图层进行处理,并发送至硬件层的一个或多个显示设备进行显示。
硬件层的显示设备351至35n可以包括图1中显示装置130中的一个或多个,或者,显示设备351至35n可以包括图2中所示的显示屏201至205中的一个或多个。
应理解,上述模块及装置仅为一个示例,实际应用中,上述模块和装置有可能根据实际需要添加或删除。
图4示出了本申请实施例提供的控制方法400的示意性流程图。该方法400可以应用于图1所示的运载工具100中,该方法400也可以由图3所示的系统执行,更具体地,该方法400可以由图3所示的MDWM执行。该方法400包括:
S401,根据运载工具的运行状态,确定运载工具的显示设备的显示帧率。
示例性地,该运载工具可以包括图1中所示的运载工具。
示例性地,该运行状态可以包括行驶状态或停车状态;或者,还可以包括运载工具的自动驾驶等级。
一示例中,可以根据运载工具的挡位信息确定运载工具的运行状态。例如,在运载工具处于倒车(reverse,R)挡或行驶(drive,D)挡,确定运载工具处于行驶状态;在运载工具处于停车(parking,P)挡时,确定运载工具处于停车状态。
又一示例中,可以根据运载工具的速度确定运载工具的运行状态。例如,在运载工具的速度大于预设速度阈值时,确定运载工具处于行驶状态;在运载工具的速度小于或等于预设速度阈值时,确定运载工具处于停车状态。示例性地,预设速度阈值可以为0公里每小时(kilometers per hour,kph),或者也可以为5kph,或者也可以为其他数值。
示例性地,显示设备可以包括图1所示的显示装置130;或者,显示设备可以包括图2中所示的显示屏201至205中的至少一个;或者,显示设备可以包括图3所示的显示设备351至35n中的至少一个。
在一些可能的实现方式中,运载工具的运行状态和显示设备的显示帧率之间的关系可以为预先设定的,如表1所示。
表1

如表1所示,在运载工具处于行驶状态时,控制仪表屏、AR-HUD等显示运行工况信息和/或导航信息的显示设备以较高显示帧率进行显示,控制中控屏、副驾娱乐屏等显示娱乐信息的显示设备以较低显示帧率进行显示;在运载工具处于停车状态时,控制仪表屏、AR-HUD等显示运行工况信息和/或导航信息的显示设备以较低显示帧率进行显示,控制中控屏、副驾娱乐屏等显示娱乐信息的显示设备以较高显示帧率进行显示;在运载工具的自动驾驶等级较低时,控制仪表屏、AR-HUD等显示运行工况信息和/或导航信息的显示设备以较高显示帧率进行显示,控制中控屏、副驾娱乐屏等显示娱乐信息的显示设备以较低显示帧率进行显示;在自动驾驶等级较高时,控制仪表屏、AR-HUD等显示运行工况信息和/或导航信息的显示设备以较低显示帧率进行显示,控制中控屏、副驾娱乐屏等显示娱乐信息的显示设备以较高显示帧率进行显示。
在具体实现中,在运载工具处于不同运行状态时,可以根据具体的运行状态,确定座舱内一个或多个显示设备的显示帧率。
示例性地,以运载工具为5座车辆、车内座舱包括显示屏201至205为例,如图5所示,在车辆处于不同运行状态时,座舱内的显示屏可以以不同的帧率进行显示。
如图5中的(a)所示,显示屏205显示的挡位栏501指示车辆处于P挡,速度信息栏502和功率信息栏503指示车辆的速度和功率分别为零,即车辆当前处于停车状态。则在显示设备为显示运行工况信息的显示屏205时,可以确定该显示设备的显示帧率为较低的显示帧率,如30fps;在显示设备为显示娱乐信息的显示屏202时,可以确定该显示设备的显示帧率为较高的显示帧率,如60fps。
如图5中的(b)所示,显示屏205显示的挡位栏501指示车辆处于D挡,速度信息栏502和功率信息栏503指示车辆的速度和功率分别为60千米/小时和60千瓦,即车辆当前处于行驶状态。则在显示设备为显示运行工况信息的显示屏205时,可以确定该显示设备的显示帧率为较高的显示帧率,如60fps;在显示设备为显示娱乐信息的显示屏202时,可以确定该显示设备的显示帧率为较低的显示帧率,如30fps。
如图5中的(c)所示,显示屏205的信息栏504显示车辆的自动驾驶等级为L0,则在显示设备为显示运行工况信息的显示屏205时,可以确定该显示设备的显示帧率为较高 的显示帧率,如60fps;在显示设备为显示娱乐信息的显示屏202时,可以确定该显示设备的显示帧率为较低的显示帧率,如30fps。
如图5中的(d)所示,显示屏205的信息栏504显示车辆的自动驾驶等级为L3,则在显示设备为显示运行工况信息的显示屏205时,可以确定该显示设备的显示帧率为较低的显示帧率,如30fps;在显示设备为显示娱乐信息的显示屏202时,可以确定该显示设备的显示帧率为较高的显示帧率,如60fps。
S402,控制该显示设备以该显示帧率进行显示。
在一些可能的实现方式中,还可以根据运载工具的运行状态的变化,调整显示设备的显示帧率。其中,运行状态的变化包括行驶状态与停车状态之间的转换,或者自动驾驶等级的变化。
示例性地,结合表1,在运载工具由行驶状态变为停车状态时,或者在运载工具的自动驾驶等级提高时,可以降低仪表屏、AR-HUD等显示运行工况信息和/或导航信息的显示设备的显示帧率,提高中控屏、副驾娱乐屏等显示娱乐信息的显示设备的显示帧率;在运载工具由停车状态变为行驶状态时,或者在运载工具的自动驾驶等级降低时,可以提高仪表屏、AR-HUD等显示运行工况信息和/或导航信息的显示设备的显示帧率,降低中控屏、副驾娱乐屏等显示娱乐信息的显示设备的显示帧率。
本申请实施例提供的控制方法,可以根据运载工具的运行状态,对显示设备的显示帧率进行动态调节,以使显示设备能够流畅显示画面,提高用户的使用体验。在运载工具处于行驶状态时,控制显示导航信息和运行工况信息的显示设备以较高显示帧率进行显示,保证驾驶安全相关信息实时高速刷新,有助于提高行驶安全性;在运载工具处于停车状态时,控制显示娱乐信息的显示设备以较高显示帧率进行显示,保证娱乐相关信息实时高速刷新,有助于提高用户的娱乐体验。
图6示出了本申请实施例提供的控制方法600的示意性流程图,该方法600可以应用于图1所示的运载工具100中,该方法600也可以由图3所示的系统执行,更具体地,该方法600可以由图3所示的MDWM执行。该方法600包括:
S601,根据用户在运载工具座舱内的位置,确定显示设备的显示帧率。
示例性地,该运载工具可以包括上述实施例中的运载工具,该显示设备可以包括上述实施例中的显示设备。
示例性地,运载工具可以通过传感器信息确定用户在座舱内的位置,包括但不限于:通过声波传感器确定某座椅处是否有用户在位;通过摄像装置或舱内视觉传感器确定某座椅处是否有用户在位;通过设置在座椅处的压力传感器确定座椅处是否有用户在位。
在一些可能的实现方式中,用户在座舱内的位置和显示设备的显示帧率之间的关系可以为预先设定的,如表2所示。
表2

如表2所示,在座舱内只有一个用户时,可以优先保障该用户在座舱内的位置对应的显示设备的显示帧率,控制该显示设备以较高显示帧率进行显示;在座舱内有多个用户时,且多个用户中包括在主驾驶区域的用户,则优先保障与主驾驶区域对应的显示设备的显示帧率,控制该显示设备以较高显示帧率进行显示。
需要说明的是,某位置对应的显示设备,包括:该显示设备所显示的内容主要供该位置的用户观看。某区域对应的显示设备,或者某区域与显示设备相对应,包括:该显示设备所显示的内容主要供该区域的用户观看;或者,该区域包括该显示设备。在本申请实施例中,座舱内的一个区域可以包括具体的位置,例如,主驾驶区域包括主驾驶处位置。
例如,该区域为主驾驶区域,则该显示设备可以包括仪表屏、AR-HUD以及中控屏中的至少一个;该区域为副驾驶区域,则该显示设备可以为副驾驶处屏幕,如显示屏202;该区域为运载工具的第二排左侧区域,则该显示设备可以为主驾驶头枕后部屏幕,如显示屏203;该区域为运载工具的第二排右侧区域,则该显示设备可以为副驾驶头枕后部屏幕,如显示屏204。
在具体实现中,根据用户在座舱内的实际位置,确定座舱内一个或多个显示设备的显示帧率。
在一些可能的实现方式中,在显示设备包括两个及以上显示设备时,例如包括显示设备1和显示设备2,则可以根据用户在座舱内的位置确定显示设备1的显示帧率不同于显示设备2的显示帧率。一示例中,结合表2,以显示设备1为与主驾驶区域对应的中控屏、显示设备2为与副驾驶区域对应的副驾娱乐屏为例:在主驾驶区域有用户,副驾驶区域无用户时,确定显示设备1的显示帧率(如60fps)高于显示设备2的显示帧率(如0或30fps);在主驾驶区域无用户,副驾驶区域有用户时,确定显示设备1的显示帧率(如30fps)低于显示设备2的显示帧率(如60fps);在主驾驶区域和副驾驶区域均有用户时,确定显示设备1的显示帧率(如60fps)高于显示设备2的显示帧率(如30fps)。又一示例中,结合表2,以显示设备1为与主驾驶区域对应的中控屏、显示设备2为与后排左侧区域对应的主驾驶头枕后部屏幕为例:在主驾驶区域和后排左侧区域均有用户时,确定显示设备1的显示帧率(如60fps)高于显示设备2的显示帧率(如30fps)。
S602,控制该显示设备以该显示帧率进行显示。
在一些可能的实现方式中,还可以根据用户在座舱内的位置的变化,调整显示设备的显示帧率。例如,响应于用户来到座舱内与显示设备相对应的位置,提高该显示设备的显示帧率;或者,响应于用户离开座舱内与显示设备相对应的位置,降低该显示设备的显示帧率。
示例性地,以运载工具为5座车辆、车内座舱包括显示屏201至205为例,如图7所示,在用户在座舱内的位置的发生变化时,可以调整座舱内的显示屏的显示帧率。
如图7中的(a)所示,在用户701进入主驾驶区域之前,与主驾驶区域对应的显示屏201和205的显示帧率均为30fps;如图7中的(b)所示,在用户701落座主驾驶处位置时,可以将与主驾驶区域对应的显示屏201和205的显示帧率提高至60fps。进一步地,在用户701离开主驾驶区域后,可以将与主驾驶区域对应的显示屏201和205的显示帧率再降低至30fps。
本申请实施例提供的控制方法,可以根据用户在座舱内的位置,对显示设备的显示帧率进行动态调节,优先保障座舱内有用户区域对应的显示设备以较高帧率进行显示,有助于提高用户的使用体验。进一步地,在包括主驾驶区域在内的多个区域有用户时,优先保障主驾驶区域的显示设备以较高帧率进行显示,有助于提高主驾驶用户的驾乘体验和行驶安全性。
图8示出了本申请实施例提供的控制方法800的示意性流程图。该方法800可以应用于图1所示的运载工具100中,该方法800也可以由图3所示的系统执行,更具体地,该方法800可以由图3所示的MDWM执行。该方法800包括:
S801,根据针对运载工具的显示设备的触屏操作,确定显示设备的显示帧率。
示例性地,该运载工具可以包括上述实施例中的运载工具,该显示设备可以包括上述实施例中的显示设备。
在一些可能的实现方式中,在显示设备以低于其满帧率的显示帧率进行显示时,响应于针对该显示设备的触屏操作,升高该显示设备的显示帧率,其中该触屏操作发生之前的预定时间内未发生任何触屏操作。进一步地,在触屏操作发生后的预定时间内未继续发生触屏操作,可以降低该显示设备的显示帧率。
例如,显示设备的满帧率为60fps,在显示设备以30fps进行显示时,检测到针对该显示设备的触屏操作,则可以控制显示设备的显示帧率升高至60fps。示例性地,可以控制显示设备的显示帧率由30fps直接升至60fps(可以理解为瞬时升高);或者,也可以控制显示设备的显示帧率以固定速率由30fps升至60fps(可以理解为逐步升高)。示例性地,固定速率可以为30fps/s,或者也可以为其他速率。
示例性地,预定时间可以为3秒,或者也可以为5秒,或者还可以为其他时长。
本申请实施例中,满帧率可以理解为显示设备支持的最大显示帧率。
在一些可能的实现方式中,在座舱内两个及以上显示设备都在进行显示时,检测到针对某一个显示设备的触屏操作,则控制升高该显示设备的显示帧率的同时,可以降低其他未检测到触屏信号的显示设备的显示帧率。
示例性地,以运载工具为5座车辆、车内座舱包括显示屏201至205为例,如图9所示,在检测到针对一个显示屏的触屏操作时,可以调整座舱内的显示屏的显示帧率。
如图9中的(a)所示,显示屏201和显示屏202分别以60fps和30fps的显示帧率进行显示,此时,检测到针对显示屏202的触屏信号(如图9中的(b)所示),则可以将显示屏202的显示帧率提高至60fps,将显示屏201的显示帧率降低至30fps。
S802,控制该显示设备以该显示帧率进行显示。
本申请实施例提供的控制方法,可以根据针对运载工具的显示设备的触屏操作,实现对显示设备的显示帧率的动态调整。根据用户的触屏行为,提高被触摸显示设备的显示帧率,提高显示设备的跟手性,有助于提高用户使用显示设备时的交互体验。在座舱中有多个显示设备进行显示时,根据针对显示设备的触屏操作,提高被触摸显示设备的显示帧率,降低未被触摸的显示设备的显示帧率,可以节省显示设备进行显示时的能耗,提高显示设备和运载工具的智能性。
图10示出了本申请实施例提供的控制方法1000的示意性流程图。该方法1000可以应用于图1所示的运载工具100中,该方法1000也可以由图3所示的系统执行,更具体地,该方法1000可以由图3所示的MDWM执行。该方法1000包括:
S1010,根据显示设备待显示的界面所属的应用程序的类型,确定显示设备的显示帧率。
示例性地,该运载工具可以包括上述实施例中的运载工具,该显示设备可以包括上述实施例中的显示设备。
示例性地,应用程序的类型可以包括但不限于:娱乐类、驾驶类、通讯类。其中,娱乐类应用程序可以包括音频应用、视频应用、游戏应用等,驾驶类应用程序可以包括导航应用、驾驶辅助应用等;通讯类应用程序可以包括通话应用、聊天应用等。
在一些可能的实现方式中,显示设备待显示的界面所属的应用程序的类型和显示设备的显示帧率之间的关系可以为预先设定的,如表3所示。
表3
如表3所示,在显示设备为中控屏时,在中控屏待显示界面属于驾驶类应用程序时,确定中控屏的显示帧率为60fps;在中控屏待显示界面属于娱乐类应用程序或通讯类应用程序时,确定中控屏的显示帧率为30fps。在显示设备为其他显示屏中的一个显示屏时,在该显示屏待显示界面属于娱乐类应用程序时,确定该显示屏的显示帧率为60fps;在该显示屏待显示界面属于驾驶类应用程序或通讯类应用程序时,确定该显示屏的显示帧率为30fps。
在一些可能的实现方式中,还可以预先设置应用程序的优先级和显示设备的显示帧率之间的对应关系,进而根据应用程序的优先级确定显示设备的显示帧率。
如表4所示,驾驶类应用程序优先级最高,显示驾驶类应用程序的显示帧率可以为 60fps;娱乐类应用程序优先级中等,显示娱乐类应用程序的显示帧率可以为45fps;通讯类应用程序优先级最低,显示通讯类应用程序的显示帧率可以为30fps。
表4
在一些可能的实现方式中,结合表4,在显示设备包括两个及以上显示设备时,例如包括显示设备3和显示设备4,则可以根据显示设备3和显示设备4待显示的界面所属的应用程序的优先级,确定显示设备3的显示帧率不同于显示设备4的显示帧率。例如,显示设备3的待显示界面属于驾驶类应用程序,显示设备4的待显示界面属于娱乐类应用程序,由于驾驶类应用程序的优先级高于娱乐类应用程序的优先级,则确定显示设备3的显示帧率(如60fps)高于显示设备4的显示帧率(如45fps);显示设备3的待显示界面属于通讯类应用程序,显示设备4的待显示界面属于娱乐类应用程序,由于通讯类应用程序的优先级低于娱乐类应用程序的优先级,则确定显示设备3的显示帧率(如30fps)低于显示设备4的显示帧率(如45fps)。
S1020,控制该显示设备以该显示帧率进行显示。
本申请实施例提供的控制方法,可以根据显示设备待显示的界面所属的应用程序的类型,实现对显示设备的显示帧率的动态调整,有助于提高显示设备和运载工具的智能性。
图11示出了本申请实施例提供的控制方法1100的示意性流程图。该方法1100可以应用于图1所示的运载工具100中,该方法1100也可以由图3所示的系统执行,更具体地,该方法100可以由图3所示的MDWM执行。该方法1000包括:
S1110,根据运载工具的运行状态、用户在该运载工具座舱内的位置、针对该运载工具的显示设备的触屏操作、显示设备待显示的界面所属的应用程序的类型中的至少一项,确定显示设备的显示帧率。
示例性地,该运载工具可以包括上述实施例中的运载工具,该显示设备可以包括上述实施例中的显示设备。
示例性地,根据运载工具的运行状态、用户在该运载工具座舱内的位置、针对该运载工具的显示设备的触屏操作、显示设备待显示的界面所属的应用程序的类型中的任一项,确定显示设备的显示帧率的方法可以参考方法400、方法600、方法800、方法1000中的描述,在此不再赘述。
在一些可能的实现方式中,还可以根据运载工具的运行状态、用户在该运载工具座舱内的位置、针对该运载工具的显示设备的触屏操作、显示设备待显示的界面所属的应用程序的类型中的至少两项,确定显示设备的显示帧率。
一示例中,可以根据运载工具的运行状态和用户在该运载工具座舱内的位置,确定显示设备的显示帧率。
如表5所示,若运载工具处于行驶状态,且仅主驾驶区域有用户时,可以控制与主驾驶区域对应的仪表屏、AR-HUD、中控屏中的至少一个以较高显示帧率(如60fps)进行显示;或者,若运载工具处于行驶状态,且仅主驾驶区域有用户时,可以控制与主驾驶区 域对应显示设备中、用于显示运行工况信息、导航信息的仪表屏和/或AR-HUD以较高显示帧率(如60fps)进行显示,控制与主驾驶区域对应显示设备中的中控屏以较低显示帧率(如30fps)进行显示。
若运载工具处于行驶状态,且主驾驶区域和副驾驶区域各有一个用户,可以控制与主驾驶区域对应的仪表屏、AR-HUD、中控屏中的至少一个以较高显示帧率(如60fps)进行显示,控制与副驾驶区域对应的副驾娱乐屏以较低显示帧率(如30fps)进行显示。
若运载工具处于行驶状态,且主驾驶区域、副驾驶区域以及后排区域各有一个用户,可以控制与主驾驶区域对应的仪表屏、AR-HUD、中控屏中的至少一个以较高显示帧率(如60fps)进行显示,控制与副驾驶区域对应的副驾娱乐屏以较低显示帧率(如30fps)进行显示,控制与后排区域对应的后排屏幕以较低显示帧率(如30fps)进行显示。
若运载工具处于停车状态,且主驾驶、副驾驶和座舱后排各有一个用户时,可以控制与主驾驶区域对应显示设备中、用于显示运行工况信息、导航信息的仪表屏和/或AR-HUD以较低显示帧率(如30fps)进行显示,控制与主驾驶区域对应显示设备中的中控屏以较高显示帧率(如60fps)进行显示,控制与副驾驶区域对应的副驾娱乐屏以较高显示帧率(如60fps)进行显示,控制与后排区域对应的后排屏幕以较高显示帧率(如60fps)进行显示。
表5

在一些可能的实现方式中,根据运载工具的运行状态、用户在运载工具中的位置确定显示设备的显示帧率之后,检测到针对某个显示设备的触屏操作时,可以根据该触屏操作调整显示设备的显示帧率。例如,结合表5,在运载工具处于行驶状态,且主驾驶区域和副驾驶区域各有一个用户,确定与主驾驶区域对应的仪表屏、AR-HUD、中控屏的显示帧率为60fps、与副驾驶区域对应的副驾娱乐屏的显示帧率为30fps之后,检测到针对副驾娱乐屏的触屏操作时,可以将副驾娱乐屏的显示帧率提高至60fps。
又一示例中,可以根据运载工具的运行状态和显示设备待显示的界面所属的应用程序的类型,确定显示设备的显示帧率。
如表6所示,运载工具处于行驶状态,在仪表屏以较高显示帧率(例如,60fps)进行显示,且中控屏显示娱乐类应用程序(例如音频应用、视频应用、游戏应用等)时,可以控制中控屏以较低显示帧率(例如,30fps)显示该应用程序的界面,并且,无论除中控屏和仪表屏以外的其他显示屏显示什么界面,均控制其他显示屏以较低显示帧率(例如,30fps)进行显示。
运载工具处于行驶状态,仪表屏以较高显示帧率(例如,60fps)进行显示,且中控屏显示驾驶类应用程序(例如导航应用、驾驶辅助应用等)时,可以控制中控屏以较高显示帧率(例如,60fps)显示该应用程序的界面,并且,无论除中控屏和仪表屏以外的其他显示屏显示什么界面,均控制其他显示屏以较低显示帧率(例如,30fps)进行显示。
运载工具处于停车状态,仪表屏以较低显示帧率(例如,30fps)进行显示,且中控屏显示娱乐类应用程序时,可以控制中控屏以较高显示帧率(例如,60fps)显示该应用程序的界面,并且,无论除中控屏和仪表屏以外的其他显示屏显示什么类型的应用程序,均控制其他显示屏以较高显示帧率(例如,60fps)进行显示。
运载工具处于停车状态,仪表屏以较低显示帧率(例如,30fps)进行显示,且中控屏显示驾驶类应用程序时,可以控制中控屏以较低显示帧率(例如,30fps)显示该应用程序的界面,并且,无论除中控屏和仪表屏以外的其他显示屏显示什么界面,均控制其他显示屏以较高显示帧率(例如,60fps)进行显示。
表6

示例性地,以运载工具为5座车辆、车内座舱包括显示屏201至205为例,如图12所示,根据车辆的运行状态和用户在座舱内的位置,可以调整座舱内的显示屏的显示帧率。
如图12中的(a)所示,显示屏205显示的挡位栏1201指示车辆处于P挡,即车辆当前处于停车状态。车辆的主驾驶区域和后排右侧区域有用户时,可以根据车辆的运行状态确定与主驾驶区域对应的显示屏201和/或显示205的显示帧率,以及根据车辆的运行状态确定与后排右侧区域对应的显示屏204的显示帧率。进一步地,可以根据显示屏的待显示界面所属应用程序的类型,确定显示屏的显示帧率。例如,在显示屏201待显示界面属于驾驶类应用程序,如导航应用1202时,可以确定显示屏201的显示帧率为较低的显示帧率,如30fps;在显示屏204的待显示界面属于娱乐类应用程序,如视频应用时,可以确定显示屏204的显示帧率为较高的显示帧率,如60fps。
如图12中的(b)所示,显示屏205显示的挡位栏1201指示车辆处于P挡,即车辆当前处于停车状态。在显示屏201待显示界面属于娱乐类应用程序,如音频应用1203时,可以确定显示屏201的显示帧率为较高的显示帧率,如60fps;在显示屏204的待显示界面属于娱乐类应用程序,如视频应用时,可以确定显示屏204的显示帧率为较高的显示帧率,如60fps。
如图12中的(c)所示,显示屏205显示的挡位栏1201指示车辆处于D挡,即车辆当前处于行驶状态。车辆的主驾驶区域和后排右侧区域有用户时,可以根据车辆的运行状态确定与主驾驶区域对应的显示屏201和/或显示205的显示帧率,以及根据车辆的运行状态确定与后排右侧区域对应的显示屏204的显示帧率。进一步地,可以根据显示屏的待显示界面所属应用程序的类型,确定显示屏的显示帧率。例如,在显示屏201待显示界面属于驾驶类应用程序,如导航应用1202时,可以确定显示屏201的显示帧率为较高的显示帧率,如60fps;在显示屏204的待显示界面属于娱乐类应用程序,如视频应用时,可以确定显示屏204的显示帧率为较低的显示帧率,如30fps。
如图12中的(d)所示,显示屏205显示的挡位栏1201指示车辆处于D挡,即车辆当前处于行驶状态。在显示屏201待显示界面属于娱乐类应用程序,如音频应用1203时,可以确定显示屏201的显示帧率为较低的显示帧率,如30fps;在显示屏204的待显示界面属于娱乐类应用程序,如视频应用时,可以确定显示屏204的显示帧率为较低的显示帧率,如30fps。
在一些可能的实现方式中,根据运载工具的运行状态、用户在运载工具中的位置以及显示设备待显示界面所属的应用程序的类型确定显示设备的显示帧率之后,检测到针对某个显示设备的触屏操作时,可以根据该触屏操作调整显示设备的显示帧率。
例如,结合图12中的(d),仍以运载工具为车辆为例:车辆处于行驶状态,确定显示屏201和显示屏204的显示帧率均为30fps之后,如图12中的(e)所示,检测到针对显示屏204的触屏操作,则可以将显示屏204的显示帧率提高至60fps。
在一些可能的实现方式中,该方法还包括:根据资源占用信息,确定该显示帧率;其中,该资源占用信息指示计算单元的已用资源容量和/或剩余资源中的可用资源容量,该计算单元与该显示设备相关联。
示例性地,在资源占用信息指示该已用资源容量大于或等于预设容量阈值,且该第一 状态指示该运载工具处于该行驶状态时,控制降低一个或多个显示设备的显示帧率。其中,该一个或多个显示设备用于显示娱乐信息、导航信息中的至少一项。
例如,如表7所示,以计算单元为CPU、预设容量阈值为70%为例,在CPU的已用资源容量大于或等于70%时,可以控制降低中控屏、副驾娱乐屏、AR-HUD中一个或多个显示设备的显示帧率。
在一些可能的实现方式中,在运载工具处于该行驶状态、中控屏显示360度环视影像和/或倒车影像,且资源占用信息指示该已用资源容量大于或等于预设容量阈值时,可以控制降低除中控屏以外的一个或多个显示设备的显示帧率,例如可以控制降低仪表屏和/或AR-HUD的显示帧率。
在一些可能的实现方式中,在资源占用信息指示该已用资源容量大于或等于预设容量阈值,且运载工具处于该停车状态时,控制降低一个或多个显示设备的显示帧率。示例性地,如表7所示,在CPU的已用资源容量小于70%时,控制中控屏和副驾娱乐屏以60fps的显示帧率进行显示,在CPU的已用资源容量大于或等于70%时,中控屏和副驾娱乐屏的显示帧率降至45fps。
表7

在一些可能的实现方式中,在资源占用信息指示该已用资源容量大于或等于预设容量阈值,且根据资源占用信息控制一个或多个显示设备的显示帧率降低后,在检测到针对一个或多个显示设备中某个显示设备的触屏信号时,控制升高该显示设备的显示帧率。
例如,结合表7,在运载工具处于行驶状态,且CPU的已用资源容量为85%时,控制AR-HUD和中控屏的显示帧率降至30fps。进一步地,在检测到针对中控屏的触屏信号时,控制中控屏的显示帧率升高至60fps。在一些可能的实现方式中,在上述场景中,检测到针对副驾娱乐屏的触屏信号时,也可以控制副驾娱乐屏的触屏信号升高至60fps。
在一些可能的实现方式中,在资源占用信息指示该已用资源容量大于或等于预设容量阈值,且根据资源占用信息控制一个或多个显示设备的显示帧率降低后,在检测到针对一个或多个显示设备中某个显示设备的触屏信号时,控制升高该显示设备的显示帧率,同时控制一个或多个显示设备中除该显示设备以外的其他显示设备的显示帧率进一步降低。
例如,结合表7,在运载工具处于行驶状态,且CPU的已用资源容量为85%时,控制AR-HUD和中控屏的显示帧率降至45fps。进一步地,在检测到针对中控屏的触屏信号时,控制中控屏的显示帧率升高至60fps,并且控制AR-HUD的显示帧率进一步降至30fps。
在一些可能的实现方式中,已用资源容量大于或等于预设容量阈值时,优先保障哪个显示设备的显示帧率可以为用户设定。例如,用户设定优先保障中控屏的显示帧率,则在已用资源容量大于或等于预设容量阈值时,根据用户设定控制降低除了中控屏以外的其他显示设备的显示帧率。
在一些可能的实现方式中,在第一预设时长内单帧处理时长大于或等于预设处理时长时,控制降低一个或多个显示设备的显示帧率,该一个或多个显示设备用于显示娱乐信息和/或导航信息。
需要说明的是,上述单帧处理时长可以为合成一帧用于显示设备进行显示的数据所需的时长,例如该单帧处理时长可以为surface flinger合成并渲染一帧图像所需的时长。一般而言,预设处理时长为显示设备的显示帧率的倒数,例如,显示帧率为60fps,则预设处理时长为16.7毫秒,在单帧处理时长大于16.7毫秒时,则会发生丢帧。
示例性地,第一预设时长可以为1秒,或者也可以为1.5秒,或者还可以为其他时长;预设处理时长可以为16.7毫秒,或者,也可以为其他预设处理时长。例如,连续1秒单帧处理时长大于或等于16.7毫秒时,说明计算平台的处理能力不足以支撑显示设备以60fps进行显示,则控制降低显示设备的显示帧率。示例性地,该一个或多个显示设备可以包括中控屏、副驾娱乐屏、主驾驶头枕后部屏幕、副驾驶头枕后部屏幕中的至少一个。
1120,控制该显示设备以该显示帧率进行显示。
示例性地,控制显示设备以该显示帧率进行显示可以包括:控制surface flinger按该显示帧率控制用于显示设备进行显示的数据的合成。
本申请实施例提供的控制方法,可以根据运载工具的运行状态、用户在该运载工具座舱内的位置、针对该运载工具的显示设备的触屏操作、显示设备待显示的界面所属的应用程序的类型中的至少一项,对显示设备的显示帧率进行动态调节,以使显示设备的画面能 够流畅显示,提高用户的使用体验。还可以根据计算单元的已用资源容量调节显示设备的帧率,在计算单元的已用资源容量过高时,控制降低已开启的显示设备的显示帧率,有助于防止显示设备因计算单元的已用资源容量过高而导致的卡顿;在计算单元的已用资源容量较小时,控制显示设备以较高显示帧率进行显示,提高画面流畅度,从而提升用户的使用体验。
需要说明的是,表1至表7所示运载工具的状态与显示设备的显示帧率之间的对应关系仅为示例性说明,在具体实现中,对应关系还可以有其他形式。此外,表1至表7所示的显示帧率也可以为其他数值,例如,显示帧率的具体数值可以为用户设定的,本申请实施例对此不作具体限定。
下面举例说明运载工具确定座舱内是否有用户以及用户在座舱中的位置的方法。
示例性地,通过声波传感器检测某座椅处是否有用户在位,具体可以为:运载工具可以根据声波传感器获取的音频信息确定座舱内是否有用户,以及用户实际所在的位置。其中,音频信息可以是从采集的运载工具内部的音频信息中排除各种无效音频信息后得到的音频信息,无效音频信息可以是音量过低的音频信息。声源位置可以是音频信息对应的声源所处的位置,声源位置可以是与基于声源定位的显示设备的相对位置,也可以是具体的位置坐标,本申请实施例对此不作具体限制。
示例性地,可以基于到达时间差(time difference of arrival,TDOA)原理根据多个声波传感器采集的音频信息确定声源位置。例如,声波传感器A和B分别检测到音频从声源S处发出,其中声源S的声源信号到达声波传感器A的时间为t1,到达声波传感器B的时间为t2,则时间差dt=|t1-t2|,设定声源S与声波传感器A的距离为AS,声源S与声波传感器B的距离为BS,音速为c,则可以得到dt=t1-t2=AS/c-BS/c,再根据两个声波传感器之间的距离a,选择其中一个传感器为基准点,即可确定声源的位置。
在一些可能的实现方式中,音频信息可以为包含特定唤醒词的语音,例如“开启智能屏幕”等。上述声波传感器可以为集成或安装于显示设备上的超声波收发装置或安装在运载工具座舱内部的超声波收发装置(包括但不局限于麦克风传感器或者麦克风传感器阵列)。
示例性地,通过摄像装置或舱内视觉传感器检测某座椅处是否有用户在位,具体可以为:通过摄像装置或舱内视觉传感器获取的用户的面容信息,进而根据用户的面容信息确定座舱内是否有用户,以及用户实际所在的位置。上述摄像装置或舱内视觉传感器包括但不限于:集成或安装于显示设备上的摄像头传感器或安装在车辆座舱内部的摄像头传感器,例如,红绿蓝(red green blue,RGB)相机、红绿蓝红外线(red green blue-infrared radiation,RGB-IR)相机、飞行时间(time of flight,TOF)相机。
在一些可能的实现方式中,在获取用户面容信息后,可以通过人脸属性识别算法、人脸性别分类算法等算法确定用户的性别、年龄等。示例性地,在获取用户面容信息后,还可以通过视线估计(gaze estimation)算法或视线追踪算法等,确定用户的视线关注点是否在显示设备上,进而控制显示设备上显示的内容。
在一些可能的实现方式中,也可以通过集成或安装于显示设备上的激光雷达或安装在车辆座舱内部的激光雷达、在显示设备上或者显示设备边缘处的无线电收发装置(包括但不局限于毫米波雷达或者厘米波雷达)、集成在显示设备上或者显示设备边缘处的红外感 知装置(包括但不局限于红外测距仪、激光测距仪)、眼动仪等检测某座椅处是否有用户在位。
示例性地,通过设置在座椅处的压力传感器检测座椅处是否有用户在位,具体可以为:在某座椅处的压力大于或等于预设阈值时,确认座椅处有用户座位。示例性地,上述预设阈值可以为100牛顿(Newton,N),或者为200N,或者也可以为其他数值,本申请实施例对此不作具体限定。
应理解,在检测座舱内是否有用户,以及用户实际所在的位置时,可以使用上述方法中的任意一种,或者也可以使用上述方法的结合,或者也可以使用其他方法,本申请实施例对此不作具体限定。
在本申请的各个实施例中,如果没有特殊说明以及逻辑冲突,各个实施例之间的术语和/或描述具有一致性、且可以相互引用,不同的实施例中的技术特征根据其内在的逻辑关系可以组合形成新的实施例。
上文中结合图1至图12详细说明了本申请实施例提供的方法。下面将结合图13和图14详细说明本申请实施例提供的装置。应理解,装置实施例的描述与方法实施例的描述相互对应,因此,未详细描述的内容可以参见上文方法实施例,为了简洁,这里不再赘述。
图13示出了本申请实施例提供的控制装置2000的示意性框图,该装置2000包括确定单元2010和处理单元2020。
该装置2000可以包括用于执行图4、图6、图8、图10或图11中的方法的单元。并且,该装置2000中的各单元分别为了实现图4、图6、图8、图10或图11中的方法实施例的相应流程。
其中,当该装置2000用于执行图11中的方法1100时,确定单元2010可用于执行方法1100中的S1110,处理单元2020可用于执行方法1100中的S1120。
具体地,该确定单元2010用于:根据运载工具的运行状态、用户在该运载工具座舱内的位置、针对该运载工具的显示设备的触屏操作、以及该显示设备待显示的界面所属的应用程序的类型中的至少一项,确定该显示设备的显示帧率;该处理单元2020用于:控制该显示设备以该显示帧率进行显示。
可选地,该装置还包括调节单元,该调节单元用于:基于该运行状态、该用户在该运载工具座舱内的位置、该针对该运载工具的显示设备的触屏操作、以及该显示设备待显示的界面所属的应用程序的类型中的至少一项发生的变化,调整该显示帧率。
可选地,该运行状态发生的变化,包括行驶状态与停车状态之间的转换,或者自动驾驶等级的变化。
可选地,该显示设备用于显示该运载工具的运行工况信息和导航信息中的至少一项,该调节单元用于:响应于该运行状态由停车状态变为行驶状态,提高该显示帧率;响应于该运行状态由行驶状态变为停车状态,降低该显示帧率;响应于该运载工具自动驾驶等级的降低,提高该显示帧率;或者,响应于该运载工具自动驾驶等级的提高,降低该显示帧率。
可选地,该显示设备用于显示娱乐信息,该调节单元用于:响应于该运行状态由停车状态变为行驶状态,降低该显示帧率;响应于该运行状态由行驶状态变为停车状态,提高该显示帧率;响应于该运载工具自动驾驶等级的降低,降低该显示帧率;或者,响应于该 运载工具自动驾驶等级的提高,提高该显示帧率。
可选地,该调节单元用于:响应于该用户来到该座舱内与该显示设备相对应的位置,提高该显示帧率;或者,响应于该用户离开该座舱内与该显示设备相对应的位置,降低该显示帧率。
可选地,该调节单元用于:响应于该触屏操作发生后的预定时间内未继续发生触屏操作,降低该显示帧率;或者,响应于该触屏操作,升高该显示帧率,其中该触屏操作发生之前的预定时间内未发生任何触屏操作。
可选地,该显示设备包括第一显示设备和第二显示设备,其中,该第一显示设备对应于该座舱内的第一区域,该第二显示设备对应于该座舱内的第二区域,该确定单元2010用于:确定该第一显示设备的显示帧率不同于该第二显示设备的显示帧率。
可选地,该确定单元2010用于:响应于该第一区域无用户且该第二区域有用户,确定该第一显示设备的显示帧率低于该第二显示设备的显示帧率;响应于该第一区域有用户且该第二区域无用户,确定该第一显示设备的显示帧率高于该第二显示设备的显示帧率;或者,响应于该第一区域有用户且该第二区域有用户,该第一区域为该座舱的主驾驶区域,该第二区域包括除了主驾驶区域以外的一个或多个区域,确定该第一显示设备的显示帧率高于该第二显示设备的显示帧率。
可选地,该确定单元2010用于:响应于该第一显示设备在预设时间内有用户触屏操作且该第二显示设备在预设时间内无用户触屏操作,确定该第一显示设备的显示帧率高于该第二显示设备的显示帧率;或者,响应于该第一显示设备在预设时间内无用户触屏操作且该第二显示设备在预设时间内有用户触屏操作,确定该第一显示设备的显示帧率低于该第二显示设备的显示帧率。
可选地,该确定单元2010用于:响应于该第一显示设备待显示的界面所属的第一应用程序的优先级高于该第二显示设备待显示的界面所属的第二应用程序的优先级,确定该第一显示设备的显示帧率高于该第二显示设备的显示帧率;或者,响应于该第一显示设备待显示的界面所属的第一应用程序的优先级低于该第二显示设备待显示的界面所属的第二应用程序的优先级,确定该第一显示设备的显示帧率低于该第二显示设备的显示帧率。
可选地,该确定单元2010用于:根据资源占用信息,确定该显示帧率;其中,该资源占用信息指示计算单元的已用资源容量和/或剩余资源中的可用资源容量,该计算单元与该显示设备相关联。
可选地,该显示设备包括第三显示设备,该第三显示设备用于显示娱乐信息、导航信息中的至少一项,该确定单元2010用于:在该运载工具处于该行驶状态,且资源占用信息指示该已用资源容量大于或等于预设容量阈值,确定该显示帧率为第一帧率;在该运载工具处于该行驶状态,且资源占用信息指示该已用资源容量小于所述预设容量阈值,确定该显示帧率为第二帧率;其中,该第一帧率高于该第二帧率。
可选地,该第三显示设备包括除了仪表屏以外的一个或多个显示设备。
可选地,该确定单元2010用于:在运载工具处于该行驶状态,且第一预设时长内单帧处理时长大于或等于预设处理时长时,确定降低该显示设备的显示帧率。
示例性地,确定单元2010和处理单元2020可以设置在图1所示的运载工具100中,更具体地,确定单元2010和处理单元2020可以设置在图1所示的计算平台150中;或者, 确定单元2010和处理单元2020还可以设置在图3所示的MDWM中。
应理解,以上装置中各单元的划分仅是一种逻辑功能的划分,实际实现时可以全部或部分集成到一个物理实体上,也可以物理上分开。此外,装置中的单元可以以处理器调用软件的形式实现;例如装置包括处理器,处理器与存储器连接,存储器中存储有指令,处理器调用存储器中存储的指令,以实现以上任一种方法或实现该装置各单元的功能,其中处理器例如为通用处理器,例如CPU或微处理器,存储器为装置内的存储器或装置外的存储器。或者,装置中的单元可以以硬件电路的形式实现,可以通过对硬件电路的设计实现部分或全部单元的功能,该硬件电路可以理解为一个或多个处理器;例如,在一种实现中,该硬件电路为ASIC,通过对电路内元件逻辑关系的设计,实现以上部分或全部单元的功能;再如,在另一种实现中,该硬件电路为可以通过PLD实现,以FPGA为例,其可以包括大量逻辑门电路,通过配置文件来配置逻辑门电路之间的连接关系,从而实现以上部分或全部单元的功能。以上装置的所有单元可以全部通过处理器调用软件的形式实现,或全部通过硬件电路的形式实现,或部分通过处理器调用软件的形式实现,剩余部分通过硬件电路的形式实现。
以上装置中的各单元可以是被配置成实施以上方法的一个或多个处理器(或处理电路),例如:CPU、GPU、NPU、TPU、DPU、微处理器、DSP、ASIC、FPGA,或这些处理器形式中至少两种的组合。
此外,以上装置中的各单元可以全部或部分可以集成在一起,或者可以独立实现。在一种实现中,这些单元集成在一起,以片上系统(system-on-a-chip,SOC)的形式实现。该SOC中可以包括至少一个处理器,用于实现以上任一种方法或实现该装置各单元的功能,该至少一个处理器的种类可以不同,例如包括CPU和FPGA,CPU和人工智能处理器,CPU和GPU等。
在具体实现过程中,上述确定单元2010和处理单元2020执行的操作可以由一个处理器执行,或者,也可以由不同的处理器执行。在具体实现过程中,上述一个或多个处理器可以为设置在图1所示的计算平台150中的处理器;或者,上述装置2000可以为设置在计算平台150中的芯片。
图14是本申请实施例提供的控制装置的示意性框图。图14所示的控制装置2100可以包括:处理器2110、收发器2120以及存储器2130。其中,处理器2110、收发器2120以及存储器2130通过内部连接通路相连,该存储器2130用于存储指令,该处理器2110用于执行该存储器2130存储的指令,以实现上述各实施例中的控制方法。可选地,存储器2130既可以和处理器2110通过接口耦合,也可以和处理器2110集成在一起。
需要说明的是,上述收发器2120可以包括但不限于输入/输出接口(input/output interface)一类的收发装置,来实现装置2100与其他设备或通信网络之间的通信。
存储器2130可以是只读存储器(read only memory,ROM),静态存储设备,动态存储设备或者随机存取存储器(random access memory,RAM)。
收发器2120使用例如但不限于收发器一类的收发装置,来实现装置2100与其他设备或通信网络之间的通信,以接收/发送用于实现上述各实施例中的控制方法的数据/信息。
在具体实现过程中,该装置2100可以设置于图1所示的计算平台150中,或者也可以设置在图3所示的MDWM中。
本申请实施例还提供一种运载工具,该运载工具包括上述装置2000,或者上述装置2100。
在一些可能的实现方式中,该运载工具为车辆。
本申请实施例还提供一种计算机程序产品,该计算机程序产品包括计算机程序代码,当计算机程序代码在计算机上运行时,使得计算机实现本申请上述各实施例中的控制方法。
本申请实施例还提供一种计算机可读存储介质,该计算机可读介质存储有计算机指令,当计算机指令在计算机上运行时,使得计算机实现本申请上述各实施例中的控制方法。
本申请实施例还提供一种芯片,包括电路,用于执行本申请上述各实施例中的控制方法。
在本申请实施例的描述中,除非另有说明,“/”表示或的意思,例如,A/B可以表示A或B;本文中的“和/或”是一种描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。本申请中,“至少一个”是指一个或者多个,“多个”是指两个或两个以上。“以下至少一项(个)”或其类似表达,是指的这些项中的任意组合,包括单项(个)或复数项(个)的任意组合。例如,a,b,或c中的至少一项(个),可以表示:a,b,c,a-b,a-c,b-c,或a-b-c,其中a,b,c可以是单个,也可以是多个。
本申请实施例中采用诸如“第一”、“第二”的前缀词,仅仅为了区分不同的描述对象,对被描述对象的位置、顺序、优先级、数量或内容等没有限定作用。本申请实施例中对序数词等用于区分描述对象的前缀词的使用不对所描述对象构成限制,对所描述对象的陈述参见权利要求或实施例中上下文的描述,不应因为使用这种前缀词而构成多余的限制。
在实现过程中,上述方法的各步骤可以通过处理器中的硬件的集成逻辑电路或者软件形式的指令完成。结合本申请实施例所公开的方法可以直接体现为硬件处理器执行完成,或者用处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器,闪存、只读存储器,可编程只读存储器或者上电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于存储器,处理器读取存储器中的信息,结合其硬件完成上述方法的步骤。为避免重复,这里不再详细描述。
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统、装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
在本申请所提供的几个实施例中,应该理解到,所揭露的系统、装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以所述权利要求的保护范围为准。

Claims (34)

  1. 一种控制方法,其特征在于,包括:
    根据运载工具的运行状态、用户在所述运载工具座舱内的位置、针对所述运载工具的显示设备的触屏操作、以及所述显示设备待显示的界面所属的应用程序的类型中的至少一项,确定所述显示设备的显示帧率;
    控制所述显示设备以所述显示帧率进行显示。
  2. 如权利要求1所述的方法,其特征在于,所述根据运载工具的运行状态、用户在所述运载工具座舱内的位置、针对所述运载工具的显示设备的触屏操作、以及所述显示设备待显示的界面所属的应用程序的类型中的至少一项,确定所述显示设备的显示帧率,包括:
    基于所述运行状态、所述用户在所述运载工具座舱内的位置、所述针对所述运载工具的显示设备的触屏操作、以及所述显示设备待显示的界面所属的应用程序的类型中的至少一项发生的变化,调整所述显示帧率。
  3. 如权利要求2所述的方法,其特征在于,所述运行状态发生的变化,包括行驶状态与停车状态之间的转换,或者自动驾驶等级的变化。
  4. 如权利要求2或3所述的方法,其特征在于,所述显示设备用于显示所述运载工具的运行工况信息和导航信息中的至少一项,所述基于所述运行状态、所述用户在所述运载工具座舱内的位置、所述针对所述运载工具的显示设备的触屏操作、以及所述显示设备待显示的界面所属的应用程序的类型中的至少一项发生的变化,调整所述显示帧率,包括:
    响应于所述运行状态由停车状态变为行驶状态,提高所述显示帧率;
    响应于所述运行状态由行驶状态变为停车状态,降低所述显示帧率;
    响应于所述运载工具自动驾驶等级的降低,提高所述显示帧率;或者,
    响应于所述运载工具自动驾驶等级的提高,降低所述显示帧率。
  5. 如权利要求2至4中任一项所述的方法,其特征在于,所述显示设备用于显示娱乐信息,所述基于所述运行状态、所述用户在所述运载工具座舱内的位置、所述针对所述运载工具的显示设备的触屏操作、以及所述显示设备待显示的界面所属的应用程序的类型中的至少一项发生的变化,调整所述显示帧率,包括:
    响应于所述运行状态由停车状态变为行驶状态,降低所述显示帧率;
    响应于所述运行状态由行驶状态变为停车状态,提高所述显示帧率;
    响应于所述运载工具自动驾驶等级的降低,降低所述显示帧率;或者,
    响应于所述运载工具自动驾驶等级的提高,提高所述显示帧率。
  6. 如权利要求2至5中任一项所述的方法,其特征在于,所述基于所述运行状态、所述用户在所述运载工具座舱内的位置、所述针对所述运载工具的显示设备的触屏操作、以及所述显示设备待显示的界面所属的应用程序的类型中的至少一项发生的变化,调整所述显示帧率,包括:
    响应于所述用户来到所述座舱内与所述显示设备相对应的位置,提高所述显示帧率;或者,响应于所述用户离开所述座舱内与所述显示设备相对应的位置,降低所述显示帧率。
  7. 如权利要求2至6中任一项所述的方法,其特征在于,所述基于所述运行状态、所述用户在所述运载工具座舱内的位置、所述针对所述运载工具的显示设备的触屏操作、以及所述显示设备待显示的界面所属的应用程序的类型中的至少一项发生的变化,调整所述显示帧率,包括:
    响应于所述触屏操作发生后的预定时间内未继续发生触屏操作,降低所述显示帧率;或者,
    响应于所述触屏操作,升高所述显示帧率,其中所述触屏操作发生之前的预定时间内未发生任何触屏操作。
  8. 如权利要求1至7中任一项所述的方法,其特征在于,所述显示设备包括第一显示设备和第二显示设备,其中,所述第一显示设备对应于所述座舱内的第一区域,所述第二显示设备对应于所述座舱内的第二区域,所述确定所述显示设备的显示帧率,包括:
    确定所述第一显示设备的显示帧率不同于所述第二显示设备的显示帧率。
  9. 如权利要求8所述的方法,其特征在于,所述确定所述第一显示设备的显示帧率不同于所述第二显示设备的显示帧率,包括:
    响应于所述第一区域无用户且所述第二区域有用户,确定所述第一显示设备的显示帧率低于所述第二显示设备的显示帧率;
    响应于所述第一区域有用户且所述第二区域无用户,确定所述第一显示设备的显示帧率高于所述第二显示设备的显示帧率;或者,
    响应于所述第一区域有用户且所述第二区域有用户,所述第一区域为所述座舱的主驾驶区域,所述第二区域包括除了主驾驶区域以外的一个或多个区域,确定所述第一显示设备的显示帧率高于所述第二显示设备的显示帧率。
  10. 如权利要求8或9所述的方法,其特征在于,所述确定所述第一显示设备的显示帧率不同于所述第二显示设备的显示帧率,包括:
    响应于所述第一显示设备在预设时间内有用户触屏操作且所述第二显示设备在预设时间内无用户触屏操作,确定所述第一显示设备的显示帧率高于所述第二显示设备的显示帧率;或者,
    响应于所述第一显示设备在预设时间内无用户触屏操作且所述第二显示设备在预设时间内有用户触屏操作,确定所述第一显示设备的显示帧率低于所述第二显示设备的显示帧率。
  11. 如权利要求8至10中任一项所述的方法,其特征在于,所述确定所述第一显示设备的显示帧率不同于所述第二显示设备的显示帧率,包括:
    响应于所述第一显示设备待显示的界面所属的第一应用程序的优先级高于所述第二显示设备待显示的界面所属的第二应用程序的优先级,确定所述第一显示设备的显示帧率高于所述第二显示设备的显示帧率;或者,
    响应于所述第一显示设备待显示的界面所属的第一应用程序的优先级低于所述第二显示设备待显示的界面所属的第二应用程序的优先级,确定所述第一显示设备的显示帧率低于所述第二显示设备的显示帧率。
  12. 如权利要求1至11中任一项所述的方法,其特征在于,所述确定所述显示设备的显示帧率,包括:
    根据资源占用信息,确定所述显示帧率;
    其中,所述资源占用信息指示计算单元的已用资源容量和/或剩余资源中的可用资源容量,所述计算单元与所述显示设备相关联。
  13. 如权利要求12所述的方法,其特征在于,所述显示设备包括第三显示设备,所述第三显示设备用于显示娱乐信息、导航信息中的至少一项,所述确定所述显示帧率,包括:
    在所述运载工具处于所述行驶状态,且资源占用信息指示所述已用资源容量大于或等于预设容量阈值,确定所述显示帧率为第一帧率;在所述运载工具处于所述行驶状态,且资源占用信息指示所述已用资源容量小于所述预设容量阈值,确定所述显示帧率为第二帧率;其中,所述第一帧率高于所述第二帧率。
  14. 如权利要求13所述的方法,其特征在于,所述第三显示设备包括除了仪表屏以外的一个或多个显示设备。
  15. 如权利要求1至14中任一项所述的方法,其特征在于,所述确定所述显示设备的显示帧率,包括:
    在运载工具处于所述行驶状态,且第一预设时长内单帧处理时长大于或等于预设处理时长时,确定降低所述显示设备的显示帧率。
  16. 一种控制装置,其特征在于,包括确定单元和处理单元,其中,
    所述确定单元用于:根据运载工具的运行状态、用户在所述运载工具座舱内的位置、针对所述运载工具的显示设备的触屏操作、以及所述显示设备待显示的界面所属的应用程序的类型中的至少一项,确定所述显示设备的显示帧率;
    所述处理单元用于:控制所述显示设备以所述显示帧率进行显示。
  17. 如权利要求16所述的装置,其特征在于,所述装置还包括调节单元,所述调节单元用于:
    基于所述运行状态、所述用户在所述运载工具座舱内的位置、所述针对所述运载工具的显示设备的触屏操作、以及所述显示设备待显示的界面所属的应用程序的类型中的至少一项发生的变化,调整所述显示帧率。
  18. 如权利要求17所述的装置,其特征在于,所述运行状态发生的变化,包括行驶状态与停车状态之间的转换,或者自动驾驶等级的变化。
  19. 如权利要求17或18所述的装置,其特征在于,所述显示设备用于显示所述运载工具的运行工况信息和导航信息中的至少一项,所述调节单元用于:
    响应于所述运行状态由停车状态变为行驶状态,提高所述显示帧率;
    响应于所述运行状态由行驶状态变为停车状态,降低所述显示帧率;
    响应于所述运载工具自动驾驶等级的降低,提高所述显示帧率;或者,
    响应于所述运载工具自动驾驶等级的提高,降低所述显示帧率。
  20. 如权利要求17至19中任一项所述的装置,其特征在于,所述显示设备用于显示娱乐信息,所述调节单元用于:
    响应于所述运行状态由停车状态变为行驶状态,降低所述显示帧率;
    响应于所述运行状态由行驶状态变为停车状态,提高所述显示帧率;
    响应于所述运载工具自动驾驶等级的降低,降低所述显示帧率;或者,
    响应于所述运载工具自动驾驶等级的提高,提高所述显示帧率。
  21. 如权利要求17至20中任一项所述的装置,其特征在于,所述调节单元用于:
    响应于所述用户来到所述座舱内与所述显示设备相对应的位置,提高所述显示帧率;或者,响应于所述用户离开所述座舱内与所述显示设备相对应的位置,降低所述显示帧率。
  22. 如权利要求17至21中任一项所述的装置,其特征在于,所述调节单元用于:
    响应于所述触屏操作发生后的预定时间内未继续发生触屏操作,降低所述显示帧率;或者,
    响应于所述触屏操作,升高所述显示帧率,其中所述触屏操作发生之前的预定时间内未发生任何触屏操作。
  23. 如权利要求16至22中任一项所述的装置,其特征在于,所述显示设备包括第一显示设备和第二显示设备,其中,所述第一显示设备对应于所述座舱内的第一区域,所述第二显示设备对应于所述座舱内的第二区域,所述确定单元用于:
    确定所述第一显示设备的显示帧率不同于所述第二显示设备的显示帧率。
  24. 如权利要求23所述的装置,其特征在于,所述确定单元用于:
    响应于所述第一区域无用户且所述第二区域有用户,确定所述第一显示设备的显示帧率低于所述第二显示设备的显示帧率;
    响应于所述第一区域有用户且所述第二区域无用户,确定所述第一显示设备的显示帧率高于所述第二显示设备的显示帧率;或者,
    响应于所述第一区域有用户且所述第二区域有用户,所述第一区域为所述座舱的主驾驶区域,所述第二区域包括除了主驾驶区域以外的一个或多个区域,确定所述第一显示设备的显示帧率高于所述第二显示设备的显示帧率。
  25. 如权利要求23或24所述的装置,其特征在于,所述确定单元用于:
    响应于所述第一显示设备在预设时间内有用户触屏操作且所述第二显示设备在预设时间内无用户触屏操作,确定所述第一显示设备的显示帧率高于所述第二显示设备的显示帧率;或者,
    响应于所述第一显示设备在预设时间内无用户触屏操作且所述第二显示设备在预设时间内有用户触屏操作,确定所述第一显示设备的显示帧率低于所述第二显示设备的显示帧率。
  26. 如权利要求23至25中任一项所述的装置,其特征在于,所述确定单元用于:
    响应于所述第一显示设备待显示的界面所属的第一应用程序的优先级高于所述第二显示设备待显示的界面所属的第二应用程序的优先级,确定所述第一显示设备的显示帧率高于所述第二显示设备的显示帧率;或者,
    响应于所述第一显示设备待显示的界面所属的第一应用程序的优先级低于所述第二显示设备待显示的界面所属的第二应用程序的优先级,确定所述第一显示设备的显示帧率低于所述第二显示设备的显示帧率。
  27. 如权利要求16至26中任一项所述的装置,其特征在于,所述确定单元用于:
    根据资源占用信息,确定所述显示帧率;
    其中,所述资源占用信息指示计算单元的已用资源容量和/或剩余资源中的可用资源容量,所述计算单元与所述显示设备相关联。
  28. 如权利要求27所述的装置,其特征在于,所述显示设备包括第三显示设备,所述第三显示设备用于显示娱乐信息、导航信息中的至少一项,所述确定单元用于:
    在所述运载工具处于所述行驶状态,且资源占用信息指示所述已用资源容量大于或等于预设容量阈值,确定所述显示帧率为第一帧率;
    在所述运载工具处于所述行驶状态,且资源占用信息指示所述已用资源容量小于所述预设容量阈值,确定所述显示帧率为第二帧率;其中,所述第一帧率高于所述第二帧率。
  29. 如权利要求28所述的装置,其特征在于,所述第三显示设备包括除了仪表屏以外的一个或多个显示设备。
  30. 如权利要求16至29中任一项所述的装置,其特征在于,所述确定单元用于:
    在运载工具处于所述行驶状态,且第一预设时长内单帧处理时长大于或等于预设处理时长时,确定降低所述显示设备的显示帧率。
  31. 一种控制装置,其特征在于,包括:
    存储器,用于存储计算机程序;
    处理器,用于执行所述存储器中存储的计算机程序,以使得所述装置执行如权利要求1至15中任一项所述的方法。
  32. 一种运载工具,其特征在于,包括如权利要求16至31中任一项所述的装置,以及所述显示设备。
  33. 一种计算机可读存储介质,其特征在于,其上存储有指令,所述指令被处理器执行时,以使得处理器实现如权利要求1至15中任一项所述的方法。
  34. 一种芯片,其特征在于,所述芯片包括电路,所述电路用于执行如权利要求1至15中任一项所述的方法。
PCT/CN2023/073186 2023-01-19 2023-01-19 控制方法、装置和运载工具 WO2024152310A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2023/073186 WO2024152310A1 (zh) 2023-01-19 2023-01-19 控制方法、装置和运载工具

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2023/073186 WO2024152310A1 (zh) 2023-01-19 2023-01-19 控制方法、装置和运载工具

Publications (1)

Publication Number Publication Date
WO2024152310A1 true WO2024152310A1 (zh) 2024-07-25

Family

ID=91955023

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/073186 WO2024152310A1 (zh) 2023-01-19 2023-01-19 控制方法、装置和运载工具

Country Status (1)

Country Link
WO (1) WO2024152310A1 (zh)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019114679A1 (zh) * 2017-12-15 2019-06-20 蔚来汽车有限公司 用于控制车辆部件的装置及方法
CN112102780A (zh) * 2020-10-26 2020-12-18 努比亚技术有限公司 一种显示帧率调控方法、设备及计算机可读存储介质
CN114443269A (zh) * 2021-08-27 2022-05-06 荣耀终端有限公司 帧率调节方法和相关装置

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019114679A1 (zh) * 2017-12-15 2019-06-20 蔚来汽车有限公司 用于控制车辆部件的装置及方法
CN112102780A (zh) * 2020-10-26 2020-12-18 努比亚技术有限公司 一种显示帧率调控方法、设备及计算机可读存储介质
CN114443269A (zh) * 2021-08-27 2022-05-06 荣耀终端有限公司 帧率调节方法和相关装置

Similar Documents

Publication Publication Date Title
US11657263B2 (en) Neural network based determination of gaze direction using spatial models
US20240192320A1 (en) Object detection and detection confidence suitable for autonomous driving
US11704781B2 (en) Enhanced high-dynamic-range imaging and tone mapping
US11841987B2 (en) Gaze determination using glare as input
US10696308B2 (en) Road condition heads up display
US10625676B1 (en) Interactive driving system and method
US20230319218A1 (en) Image stitching with dynamic seam placement based on ego-vehicle state for surround view visualization
JP2022536030A (ja) ビデオ分析アプリケーションにおける相関フィルタを使用した複数物体追跡
JP2021195124A5 (zh)
US20230018303A1 (en) Presentation control device and non-transitory computer readable storage medium
US20230024474A1 (en) Stitching quality assessment for surround view systems
WO2024051691A1 (zh) 一种调节方法、装置和运载工具
JP2023165383A (ja) 機械学習モデルのためのデータ・セット生成及び拡張
CN115470000A (zh) 资源分配的方法、装置和运载工具
JP7485216B2 (ja) 車両用表示システム、車両用表示方法、及び車両用表示プログラム
CN115309285A (zh) 控制显示的方法、装置和移动载体
US20210354705A1 (en) Method for avoiding a field of view disturbance for an operator of an object, device for carrying out the method as well as vehicle and computer program
WO2024152310A1 (zh) 控制方法、装置和运载工具
US12093505B2 (en) Display control device and method for displaying instructions to vehicle occupants
US20240297963A1 (en) Duplicate frame detection in multi-camera views for autonomous systems and applications
US20240112376A1 (en) Image stitching with color harmonization of de-processed images for surround view systems and applications
WO2024000391A1 (zh) 一种控制方法、装置和车辆
JP2023166308A (ja) 自律システム及びアプリケーションのためのrgb-irデータ処理
US20240135487A1 (en) Image stitching with saccade-based control of dynamic seam placement for surround view visualization
WO2024088337A1 (zh) 一种控制方法、装置和运载工具

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23916790

Country of ref document: EP

Kind code of ref document: A1