CN115460352A - Vehicle-mounted video processing method, device, equipment, storage medium and program product - Google Patents

Abstract

The present disclosure relates to the technical field of image communication, and in particular, to a processing method, device, device, storage medium and program product for vehicle-mounted video. The method includes: acquiring a video stream collected by a vehicle-mounted camera; displaying the video stream through a display area of a vehicle-mounted display screen; in response to any display area being selected, displaying the selected display area as a selected state; responding to a recording request , generating target image data according to the video stream corresponding to the selected display area.

Description

Vehicle-mounted video processing method, device, device, storage medium and program product

technical field

The present disclosure relates to the technical field of image communication, and in particular, to a method for processing vehicle-mounted video, a processing device for vehicle-mounted video, electronic equipment, storage media, and program products.

Background technique

When people take a vehicle, if they see the scenery they want to take through the window, they usually take pictures with their mobile phones or cameras. Due to road bumps and other situations that often occur during the driving of the vehicle, it is difficult for people to take satisfactory photos or videos with mobile phones or cameras, which easily leads to missing beautiful scenery, or requires repeated shooting.

Contents of the invention

The present disclosure provides a technical solution for processing vehicle-mounted video.

According to an aspect of the present disclosure, a method for processing in-vehicle video is provided, including:

Obtain the video stream collected by the vehicle camera;

Displaying the video stream through the display area of the vehicle display screen;

In response to any display area being selected, displaying the selected display area as a selected state;

In response to the recording request, target image data is generated according to the video stream corresponding to the selected display area.

In a possible implementation manner, the video stream displayed in the display area is a first preset resolution, and the video stream used to generate the target image data is a second preset resolution, wherein the first The preset resolution is lower than the second preset resolution.

In a possible implementation manner, the acquisition of the video stream collected by the vehicle camera includes:

Encoding the original video data collected by the vehicle camera into a video stream with the first preset resolution and a video stream with the second preset resolution.

In a possible implementation manner, the vehicle-mounted display screen includes a recording mode selection control;

The generating target image data according to the video stream corresponding to the selected display area in response to the recording request includes:

In response to triggering of any recording mode selection control, target image data corresponding to the recording mode is generated according to the video stream corresponding to the selected display area.

In a possible implementation manner, there are at least two recording mode selection controls, and the at least two recording controls can be in a trigger state at the same time.

In a possible implementation manner, the vehicle-mounted display screen includes multiple display areas, and the multiple display areas respectively display video streams collected by multiple vehicle-mounted cameras, and the relative positional relationship between the multiple display areas The determination is based on the relative positional relationship between the shooting areas of the plurality of vehicle-mounted cameras.

In a possible implementation manner, if there is an intersection area between the shooting areas corresponding to the first display area and the second display area among the plurality of display areas, the image of any sub-area of the intersection area Information is displayed only through the first display area or only through the second display area.

In a possible implementation manner, for any sub-area of the intersection area, in response to the distortion degree of the sub-area in the first video stream being lower than the distortion degree of the sub-area in the second video stream, by The first display area displays the image information of the sub-area; or, for any sub-area of the intersection area, in response to the distortion degree of the sub-area in the first video stream being higher than or equal to the The degree of distortion of the sub-region in the second video stream, displaying the image information of the sub-region through the second display area; wherein, the first video stream is the first vehicle-mounted camera corresponding to the first display area The collected video stream, the second video stream is the video stream collected by the second vehicle-mounted camera corresponding to the second display area.

In a possible implementation manner, the number of the display areas is at least two;

The method also includes:

In response to the recording request, an unselected display area of the at least two display areas is hidden.

In a possible implementation, the method further includes:

Enlarging the selected display area in response to the recording request.

In a possible implementation manner, the generating target image data according to the video stream corresponding to the selected display area includes:

In response to the number of the selected display areas being greater than or equal to two, the target image data is generated according to the relative positional relationship of the shooting areas corresponding to at least two selected display areas.

In a possible implementation manner, the generating target image data according to the relative positional relationship of the shooting areas corresponding to at least two selected display areas includes:

According to the relative positional relationship of the shooting areas corresponding to at least two selected display areas, video streams corresponding to the display areas are spliced to generate target image data.

In a possible implementation manner, the vehicle display screen includes:

The display screen set in the passenger cabin, and/or, the display screen set in the rear seat area.

According to an aspect of the present disclosure, a vehicle-mounted video processing device is provided, including:

The obtaining module is used to obtain the video stream collected by the vehicle camera;

The first display module is used to display the video stream through the display area of the vehicle display screen;

The second display module is configured to display the selected display area as a selected state in response to any display area being selected;

The generating module is configured to generate target image data according to the video stream corresponding to the selected display area in response to the recording request.

In a possible implementation manner, the video stream displayed in the display area is a first preset resolution, and the video stream used to generate the target image data is a second preset resolution, wherein the first The preset resolution is lower than the second preset resolution.

In a possible implementation, the acquisition module is used to:

Encoding the original video data collected by the vehicle camera into a video stream with the first preset resolution and a video stream with the second preset resolution.

In a possible implementation manner, the vehicle-mounted display screen includes a recording mode selection control;

The build modules are used to:

In response to triggering of any recording mode selection control, target image data corresponding to the recording mode is generated according to the video stream corresponding to the selected display area.

In a possible implementation manner, there are at least two recording mode selection controls, and the at least two recording controls can be in a trigger state at the same time.

In a possible implementation manner, the vehicle-mounted display screen includes multiple display areas, and the multiple display areas respectively display video streams collected by multiple vehicle-mounted cameras, and the relative positional relationship between the multiple display areas The determination is based on the relative positional relationship between the shooting areas of the plurality of vehicle-mounted cameras.

In a possible implementation manner, if there is an intersection area between the shooting areas corresponding to the first display area and the second display area among the plurality of display areas, the image of any sub-area of the intersection area Information is displayed only through the first display area or only through the second display area.

In a possible implementation manner, for any sub-area of the intersection area, in response to the distortion degree of the sub-area in the first video stream being lower than the distortion degree of the sub-area in the second video stream, by The first display area displays the image information of the sub-area; or, for any sub-area of the intersection area, in response to the distortion degree of the sub-area in the first video stream being higher than or equal to the The degree of distortion of the sub-region in the second video stream, displaying the image information of the sub-region through the second display area; wherein, the first video stream is the first vehicle-mounted camera corresponding to the first display area The collected video stream, the second video stream is the video stream collected by the second vehicle-mounted camera corresponding to the second display area.

In a possible implementation manner, the number of the display areas is at least two;

The device also includes:

A hiding module, configured to hide an unselected display area among at least two display areas in response to the recording request.

In a possible implementation manner, the device further includes:

An enlargement module, configured to enlarge the selected display area in response to the recording request.

In a possible implementation, the generating module is used for:

In response to the number of the selected display areas being greater than or equal to two, the target image data is generated according to the relative positional relationship of the shooting areas corresponding to at least two selected display areas.

In a possible implementation, the generating module is used for:

According to the relative positional relationship of the shooting areas corresponding to at least two selected display areas, video streams corresponding to the display areas are spliced to generate target image data.

In a possible implementation manner, the vehicle display screen includes:

The display screen set in the passenger cabin, and/or, the display screen set in the rear seat area.

According to an aspect of the present disclosure, there is provided an electronic device, comprising: one or more processors; a memory for storing executable instructions; wherein the one or more processors are configured to call the memory storage executable instructions to perform the above method.

According to one aspect of the present disclosure, there is provided a computer-readable storage medium, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the above method is implemented.

According to an aspect of the present disclosure, there is provided a computer program product, including computer readable codes, or a non-volatile computer readable storage medium bearing computer readable codes, when the computer readable codes are stored in an electronic device During operation, the processor in the electronic device executes the above method.

In the embodiment of the present disclosure, by acquiring the video stream collected by the vehicle-mounted camera, the video stream is displayed through the display area of the vehicle-mounted display screen, and in response to any display area being selected, the selected display area is displayed as a selected state, and In response to the recording request, generate target image data according to the video stream corresponding to the selected display area, so that when the user is in the cabin, the video stream collected by the vehicle camera can be used to complete image and/or video shooting, Without the need of external photography equipment such as mobile phones or cameras, the operation difficulty of shooting images and/or videos outside the cabin and/or inside the cabin can be reduced, and the quality of the captured images and/or videos can be improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Other features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments with reference to the accompanying drawings.

Description of drawings

The accompanying drawings here are incorporated into the description and constitute a part of the present description. These drawings show embodiments consistent with the present disclosure, and are used together with the description to explain the technical solution of the present disclosure.

FIG. 1 shows a flow chart of a method for processing a vehicle-mounted video provided by an embodiment of the present disclosure.

FIG. 2 shows a schematic diagram of a physical link between a vehicle-mounted camera and a vehicle-mounted display screen in the method for processing vehicle-mounted video provided by an embodiment of the present disclosure.

Fig. 3 shows a schematic diagram of a method for processing a vehicle-mounted video provided by an embodiment of the present disclosure.

FIG. 4 shows a schematic diagram of a display interface of a vehicle-mounted display screen in a method for processing vehicle-mounted video provided by an embodiment of the present disclosure.

FIG. 5 shows another schematic diagram of a display interface of a vehicle-mounted display screen in the method for processing vehicle-mounted video provided by an embodiment of the present disclosure.

FIG. 6 shows another schematic diagram of a display interface of a vehicle-mounted display in the method for processing vehicle-mounted video provided by an embodiment of the present disclosure.

FIG. 7 shows another schematic diagram of a display interface of a vehicle-mounted display screen in the method for processing vehicle-mounted video provided by an embodiment of the present disclosure.

Fig. 8 shows a block diagram of a vehicle-mounted video processing device provided by an embodiment of the present disclosure.

FIG. 9 shows a block diagram of an electronic device 800 provided by an embodiment of the present disclosure.

detailed description

Various exemplary embodiments, features, and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numbers in the figures indicate functionally identical or similar elements. While various aspects of the embodiments are shown in drawings, the drawings are not necessarily drawn to scale unless specifically indicated.

The word "exemplary" is used exclusively herein to mean "serving as an example, embodiment, or illustration." Any embodiment described herein as "exemplary" is not necessarily to be construed as superior or better than other embodiments.

The term "and/or" in this article is just an association relationship describing associated objects, which means that there can be three relationships, for example, A and/or B can mean: A exists alone, A and B exist simultaneously, and there exists alone B these three situations. In addition, the term "at least one" herein means any one of a variety or any combination of at least two of the more, for example, including at least one of A, B, and C, which may mean including from A, Any one or more elements selected from the set formed by B and C.

In addition, in order to better illustrate the present disclosure, numerous specific details are given in the following specific implementation manners. It will be understood by those skilled in the art that the present disclosure may be practiced without some of the specific details. In some instances, methods, means, components and circuits that are well known to those skilled in the art have not been described in detail so as to obscure the gist of the present disclosure.

Embodiments of the present disclosure provide a vehicle-mounted video processing method, a vehicle-mounted video processing device, electronic equipment, a storage medium, and a program product. By acquiring the video stream collected by the vehicle-mounted camera, the video is displayed in the display area of the vehicle-mounted display screen. In response to any display area being selected, the selected display area is displayed as a selected state, and in response to the recording request, target image data is generated according to the video stream corresponding to the selected display area, thus when the user is in When in the cabin, the video stream collected by the on-board camera can be used to complete the shooting of images and/or videos without the need for external photography equipment such as mobile phones or cameras, thereby reducing the need for shooting images and/or videos outside the cabin and/or inside the cabin. or the operation difficulty of the video, and is conducive to improving the quality of the captured image and/or video.

The vehicle-mounted video processing method provided by the embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.

FIG. 1 shows a flow chart of a method for processing a vehicle-mounted video provided by an embodiment of the present disclosure. In a possible implementation manner, the vehicle-mounted video processing method may be executed by a vehicle-mounted video processing device, for example, the vehicle-mounted video processing method may be executed by a vehicle-mounted device or other electronic devices. Among them, the on-board device can be the car machine, domain controller or processor in the cabin, and can also be used in DMS (Driver Monitor System, driver monitoring system) or OMS (Occupant Monitoring System, occupant monitoring system) to execute image Device hosts for data processing operations, etc. In some possible implementation manners, the method for processing on-vehicle video may be implemented in a manner in which a processor invokes computer-readable instructions stored in a memory. As shown in FIG. 1 , the processing method of the vehicle-mounted video includes steps S11 to S14.

In step S11, the video stream captured by the vehicle camera is acquired.

In step S12, the video stream is displayed through the display area of the vehicle display screen.

In step S13, in response to any display area being selected, the selected display area is displayed as a selected state.

In step S14, target image data is generated according to the video stream corresponding to the selected display area in response to the recording request.

In the embodiment of the present disclosure, the number of on-vehicle cameras may be one or more than two. In a possible implementation manner, the number of on-board cameras may be at least two, and the at least two on-board cameras may belong to at least one camera type. In a possible implementation manner, the at least two vehicle-mounted cameras may belong to at least two camera types.

In a possible implementation manner, camera types can be classified according to installation locations and/or functions. For example, camera types may include front-view cameras, surround-view cameras, rear-view cameras, side-view cameras, built-in cameras, and the like.

Wherein, the number of front view cameras of the vehicle may be at least one. The forward-looking camera can be mounted inside or outside the cabin, for example, on the front windshield. The video stream collected by the forward-looking camera can at least be used for lane departure warning (Lane Departure Warning, LDW), pedestrian collision warning (Pedestrian CollisionWarning, PCW), forward collision warning (Forward Collision Warning, FCW), front vehicle departure warning, traffic At least one video analysis of sign recognition (Traffic Sign Recognition, TSR) and traffic signal light recognition (Traffic Light Recognition, TLR), etc., which is not limited herein.

The number of surround view cameras of the vehicle may be at least two. For example, the number of surround view cameras may be 4 to 8. Surround view cameras can be installed outside the cabin. For example, the surround view camera can be installed on the car logo, left rearview mirror, right rearview mirror, etc. The surround view camera may be a wide-angle camera. For example, the surround-view camera can also be divided into a forward-facing fish-eye camera, a left-side fish-eye camera, a right-side fish-eye camera, a rear-facing fish-eye camera, and the like. Each surround-view camera can be calibrated before leaving the factory to achieve accurate panoramic stitching. The video stream collected by the surround view camera is the basis for the realization of panoramic parking. For example, the video stream collected by the surround view camera can be used to display the panoramic view function, and can be used to integrate the visual perception and target detection of the parking function to reduce the driver's blind spot and improve parking and driving safety.

The number of the rear view camera of the vehicle may be at least one, and the rear view camera may be installed outside the vehicle cabin. For example, a rear view camera could be mounted in the rear trunk. Based on the video stream collected by the rear view camera, the reversing image can be displayed to assist parking.

The number of side view cameras of the vehicle may be at least one, and the side view cameras may be installed outside the cabin. Side view cameras can also be divided into side front view cameras and side rear view cameras. Wherein, the side front-view camera can be installed at positions such as the B-pillar or the bottom of the rearview mirror, and the side rear-view camera can be installed at positions such as the front fender of the vehicle. The video stream collected by the side forward-looking camera can be used to detect sideways vehicles and pedestrians. The video stream collected by the side rear view camera can be used in application scenarios such as lane changing and merging into other roads.

There may be at least one built-in camera, and the built-in camera may be installed in the vehicle cabin. For example, built-in cameras can be installed in interior rearview mirrors, A-pillars, dashboards, center consoles, etc. The video stream collected by the built-in camera can be used to monitor the status of the driver or other occupants in the cabin. For example, functions such as fatigue reminder can be realized by monitoring the driver's status.

In the embodiments of the present disclosure, all or part of the video streams collected by the vehicle-mounted cameras may be obtained. For example, at least two video streams collected by at least two vehicle-mounted cameras may be acquired in real time.

In the embodiment of the present disclosure, in the case of acquiring at least two video streams captured by at least two vehicle-mounted cameras, the at least two video streams may be displayed respectively through at least two display areas. Wherein, the video streams collected by each vehicle-mounted camera can be displayed in different display areas, or the video streams collected by related vehicle-mounted cameras can be displayed in the same display area. In a possible implementation, when the at least two cameras include a surround-view camera group, the video streams collected by multiple surround-view cameras in the surround-view camera group can be spliced into a panoramic video stream, and can be passed through a single The display area displays the panoramic video stream. That is, video streams collected by multiple surround-view cameras in the surround-view camera group may be displayed in the same display area. Users can switch perspectives by interacting with the on-board display. For example, in the case that the vehicle display screen is a touch screen, the user can switch the viewing angle by touching.

In a possible implementation manner, at least two video streams collected by at least two vehicle-mounted cameras may be obtained, and the at least two video streams are respectively displayed through at least two display areas of the vehicle-mounted display screen, and the at least two video streams are displayed in response to the at least Any display area in the two display areas is selected, and the selected display area is displayed as a selected state, and in response to the recording request, target image data is generated according to the video stream corresponding to the selected display area, thereby in When the user is in the car cabin, the video stream collected by the car camera can be used to complete the shooting of multi-angle images and/or videos without the need for external photography equipment such as mobile phones or cameras, thereby reducing the number of shots taken outside the car cabin and/or the car cabin. The operation difficulty of the image and/or video in the image and/or video is beneficial to improve the quality of the captured image and/or video. In the following, "obtaining at least two video streams captured by at least two vehicle-mounted cameras, and displaying the at least two video streams respectively through at least two display areas of the vehicle-mounted display screen" will be described as an example.

In a possible implementation manner, the vehicle-mounted display screen includes: a display screen set in the passenger cab, and/or a display screen set in the rear seat area.

In this implementation, by acquiring the video stream collected by the on-board camera, the video stream is displayed on the display area of the on-board display screen set in the passenger cab, and in response to any display area being selected, the selected display area will be displayed In the selected state, and in response to the recording request, according to the video stream corresponding to the selected display area, target image data is generated, so that it is convenient for the occupant in the passenger compartment to complete the image and/or video using the video stream collected by the vehicle camera. without the need for the occupants in the co-pilot to take out their mobile phones or cameras to shoot, which can reduce the operational difficulty of shooting images and/or videos outside the cabin and/or inside the cabin, and help improve the quality of shooting Image and/or video quality; by obtaining the video stream collected by the vehicle-mounted camera, the video stream is displayed on the display area of the vehicle-mounted display in the rear seat area, and will be selected in response to any display area being selected. The display area of the display area is displayed as a selected state, and in response to the recording request, target image data is generated according to the video stream corresponding to the selected display area, so that the rear passengers can use the video stream collected by the vehicle camera to complete the image and/or or video shooting, without the need for rear passengers to take out their mobile phones or cameras to shoot, thereby reducing the operational difficulty of shooting images and/or videos outside the cabin and/or inside the cabin, and helping to improve the quality of shooting Image and/or video quality.

In a possible implementation manner, the vehicle-mounted display screen includes: a display screen arranged in a main driver's cab. In this implementation manner, when the vehicle is in a stationary state, the driver can use the video stream collected by the vehicle camera to complete the shooting of multi-view images and/or videos.

FIG. 2 shows a schematic diagram of a physical link between a vehicle-mounted camera and a vehicle-mounted display screen in the method for processing vehicle-mounted video provided by an embodiment of the present disclosure. In the example shown in Figure 2, the multi-camera module includes multiple vehicle-mounted cameras, and the multi-camera module may include a complementary metal-oxide-semiconductor (Complementary Metal-Oxide-Semiconductor, CMOS) sensor and an image signal processor (Image Signal Processor). Processor, ISP). The video streams collected by each vehicle camera can be serialized through the serializer to obtain serial data, and then transmitted to the deserializer on the domain controller side. Among them, serial data transmission can be performed based on GMSL (Gigabit Multimedia Serial Links, Gigabit Multimedia Serial Links) or FAKARA wiring harness. The deserializer at the domain controller side can transmit the deserialized data to the system-level chip (System of Chip, SoC) of the domain controller through MIPI (Mobile Industry Processor Interface, mobile industry processor interface). Among them, the system-on-a-chip can be powered by the vehicle power supply. The system-on-a-chip processes video streams captured by multiple cameras. For example, in the case that the multi-camera module includes a surround-view camera group, the panoramic video stream can be spliced through the system-on-a-chip. The system-on-a-chip may also support a high-speed controller area network (Controller Area Network, CAN) and/or UDS (University Diagnostics System, universal diagnostic system), etc., which are not limited here. After the system-on-chip processes the video streams collected by multiple cameras, the processed video data can be serialized through the serializer and transmitted to the deserializer on the vehicle display side. In Figure 2, the on-board display screens include the central control screen for the main driver, the entertainment screen for the co-pilot and the rear entertainment screen. As shown in Figure 2, multiple vehicle-mounted display screens can be daisy-chained to simplify the use of serializers and realize multiple vehicle-mounted display screens to display different content.

Fig. 3 shows a schematic diagram of a method for processing a vehicle-mounted video provided by an embodiment of the present disclosure. In the example shown in FIG. 3 , the system-on-a-chip in the domain controller can obtain the video streams collected by the left camera of the car, the right camera of the car, the front camera, the rear camera of the car, the surround view camera and the camera inside the car.

In a possible implementation manner, the video stream displayed in the display area is a first preset resolution, and the video stream used to generate the target image data is a second preset resolution, wherein the first The preset resolution is lower than the second preset resolution.

In this implementation manner, the displaying the video stream through the display area of the vehicle-mounted display may include: displaying the video stream with a first preset resolution through the display area of the vehicle-mounted display; the responding to the recording request , generating the target image data according to the video stream corresponding to the selected display area may include: in response to the recording request, generating the target image according to the video stream of the second preset resolution corresponding to the selected display area data.

In this implementation, the video stream with the first preset resolution is displayed through the display area of the vehicle-mounted display screen, thereby improving the real-time performance of the video stream display; by responding to the recording request, according to the selected display area The target image data is generated corresponding to the video stream with the second preset resolution, and the quality of the generated target image data can be improved. Therefore, by adopting this implementation manner, both the real-time display of the video stream and the quality of the generated target image data can be taken into account.

As an example of this implementation, the acquiring the video stream collected by the vehicle-mounted camera includes: encoding the raw video data collected by the vehicle-mounted camera into a video stream with the first preset resolution and the second preset resolution resolution video stream. For example, for any one of the at least two on-vehicle cameras, the raw video data collected by the on-vehicle camera may be encoded into a video stream with a first preset resolution and a video stream with a second preset resolution.

In the example shown in FIG. 3 , the SoC may provide a video stream with a first preset resolution and a video stream with a second preset resolution to an in-vehicle application (Application, APP). Wherein, the video stream of the first preset resolution may be displayed on a vehicle display screen (such as a passenger screen or a rear screen). The video stream with the second preset resolution may be used to generate at least one of the target image, the target image sequence, and the target video.

In the example shown in Figure 3, the system-on-a-chip can also implement functions such as blind spot detection, pedestrian warning, parking assistance, panoramic view, and driver assistance monitoring.

By adopting this example, both the real-time display of the video stream and the quality of the generated target image data can be taken into account.

As an example of this implementation manner, the first preset resolution and the second preset resolution have the same aspect ratio. For example, the aspect ratios of the first preset resolution and the second preset resolution are both 4:3; another example, the aspect ratios of the first preset resolution and the second preset resolution are both 16:9 ;wait. For example, the first preset resolution may be 540P (ie 960×540), and the second preset resolution may be 1080P (ie 1920×1080). Of course, those skilled in the art can flexibly set the first preset resolution and the second preset resolution according to actual application scenario requirements, which are not limited here.

In one example, the system-level chip can obtain the original video data collected by the left camera of the car, and can encode the original video data collected by the left camera of the car into a 540P video stream and a 1080P video stream; The original video data collected by the right camera of the car can be encoded into a 540P video stream and a 1080P video stream; the system-level chip can obtain the original video data collected by the front camera of the car, and can collect the The original video data of the car is encoded into a 540P video stream and a 1080P video stream; the system-on-a-chip can obtain the original video data collected by the rear camera of the car, and can encode the original video data collected by the rear camera into a 540P video stream and a 1080P video stream. Video stream; the system-level chip can obtain the original video data collected by the surround-view camera, and can encode the original video data collected by the surround-view camera into 540P video stream and 1080P video stream; the system-level chip can obtain the original video collected by the camera in the car Data, and can encode the original video data collected by the camera in the car into a 540P video stream and a 1080P video stream.

By encoding the raw video data collected by the vehicle-mounted camera into a video stream of the first preset resolution and a video stream of the second preset resolution with the same aspect ratio, the user can distinguish the first preset resolution through the display area. A modification operation (for example, a cropping operation) performed on a video stream with a high resolution can be conveniently applied to a video stream with a second preset resolution, thereby reducing the amount of computation for in-vehicle video processing.

In another possible implementation manner, the acquiring at least two video streams captured by at least two vehicle-mounted cameras includes: for any vehicle-mounted camera in the at least two vehicle-mounted cameras, only acquiring a preset resolution rate video stream. For example, for each vehicle camera, a 1080P video stream can be obtained separately.

In a possible implementation manner, before displaying the at least two video streams on the vehicle-mounted display screen, picture correction may be performed on at least part of the at least two video streams. For example, a fisheye image correction algorithm can be used to remove the fisheye effect and obtain a head-up image.

In a possible implementation manner, before displaying the at least two video streams through the vehicle display screen, at least one of the color temperature, white balance, exposure level, etc. of the at least two video streams may be unified.

In the embodiment of the present disclosure, the preview content of the vehicle display screen may be transmitted based on the AVB (Audio Video Bridging, Audio Video Bridging) protocol of the vehicle Ethernet. Alternatively, in the case of a coaxial connection, MIPI signals can be transmitted directly.

In a possible implementation manner, the vehicle-mounted display screen includes multiple display areas, and the multiple display areas respectively display video streams collected by multiple vehicle-mounted cameras, and the relative positional relationship between the multiple display areas The determination is based on the relative positional relationship between the shooting areas of the plurality of vehicle-mounted cameras.

For example, the at least two video streams include a first video stream and a second video stream, and the at least two display areas include a first display area and a second display area, wherein the first video stream and the second video stream The second video stream is any two video streams in the at least two video streams, the first display area is the display area corresponding to the first video stream, and the second display area is the second video stream Corresponding display area; according to the relative positional relationship between the first shooting area corresponding to the first video stream and the second shooting area corresponding to the second video stream, determine the first display area and the second Displays the relative positional relationship between areas. Wherein, in this implementation manner, the first display area may be used to display the first video stream, and the second display area may be used to display the second video stream. The first shooting area may represent a shooting area corresponding to the first video stream, and the second shooting area may represent a shooting area corresponding to the second video stream.

FIG. 4 shows a schematic diagram of a display interface of a vehicle-mounted display screen in a method for processing vehicle-mounted video provided by an embodiment of the present disclosure. In the example shown in Figure 4, the picture of the camera in the car can represent the picture of the video stream collected by the camera in the car, the picture of the front camera can represent the picture of the video stream collected by the camera in front of the car, and the picture of the surround view camera on the roof can represent multiple surround views The stitching screen of multiple video streams collected by the camera, the left camera screen can represent the video stream screen collected by the left camera of the car, the rear camera screen can represent the video stream screen collected by the rear camera of the car, and the right camera screen can represent the video stream collected by the right camera of the car footage of the video stream.

Wherein, the shooting area corresponding to the video stream collected by the front camera is in front of the shooting area corresponding to the video stream collected by the rear camera, therefore, the display area corresponding to the front camera can be set above the display area corresponding to the rear camera. The shooting area corresponding to the video stream collected by the left camera of the car is on the left side of the shooting area corresponding to the video stream collected by the rear camera of the car. Therefore, the display area corresponding to the left camera of the car can be set on the left side of the display area corresponding to the rear camera. The shooting area corresponding to the video stream collected by the right camera of the car is on the right side of the shooting area corresponding to the video stream collected by the rear camera of the car. Therefore, the display area corresponding to the right camera of the car can be set on the right side of the display area corresponding to the rear camera of the car.

In this implementation manner, by determining the relative positional relationship between the plurality of display areas based on the relative positional relationship between the shooting areas of the plurality of vehicle-mounted cameras, a more natural preview effect can be achieved, thereby enabling To enable users to obtain a better viewing experience.

As an example of this implementation, in response to an intersection area between the first shooting area corresponding to the first video stream and the second shooting area corresponding to the second video stream, according to the first shooting area and The relative positional relationship between the second shooting areas determines the relative positional relationship between the first display area corresponding to the first video stream and the second display area corresponding to the second video stream.

In this example, when there is an intersection area between the first shooting area and the second shooting area, the same image information exists in the first video stream and the second video stream.

In this example, in response to the intersection area between the first shooting area corresponding to the first video stream and the second shooting area corresponding to the second video stream, according to the first shooting area and the second shooting area The relative positional relationship between the two shooting areas determines the relative positional relationship between the first display area corresponding to the first video stream and the second display area corresponding to the second video stream, thereby facilitating the user to preview multiple Stitching effects for perspective images and/or videos.

As another example of this implementation, if there is no intersection area between the first shooting area corresponding to the first video stream and the second shooting area corresponding to the second video stream, the The relative positional relationship between the first shooting area and the second shooting area, determining the relative positional relationship between the first display area corresponding to the first video stream and the second display area corresponding to the second video stream .

As an example of this implementation, if there is an intersection area between the shooting areas corresponding to the first display area and the second display area among the plurality of display areas, the image information of any sub-area of the intersection area displayed only through the first display area or only through the second display area. In this example, by only displaying the image information of any sub-area of the intersection area in the first display area or only in the second display area, repeated display can be reduced, so that it is more convenient for the user to preview the stitching effect.

In an example, for any sub-area of the intersection area, in response to the degree of distortion of the sub-area in the first video stream is lower than the degree of distortion of the sub-area in the second video stream, through the first The display area displays the image information of the sub-area; or, for any sub-area of the intersection area, in response to the fact that the degree of distortion of the sub-area in the first video stream is higher than or equal to that of the second video stream The degree of distortion of the sub-area, the image information of the sub-area is displayed through the second display area; wherein, the first video stream is the video stream collected by the first vehicle-mounted camera corresponding to the first display area , the second video stream is a video stream collected by a second vehicle-mounted camera corresponding to the second display area. In this example, for any sub-area of the intersection area, the preview effect can be improved by displaying the image information corresponding to the sub-area with less distortion.

In another example, the image information of the intersection area may be randomly displayed in the first display area or the second display area.

In another example, the image information of the intersection area may be displayed through the first display area and the second display area respectively. In this example, the first display area may display the complete first video stream, and the second display area may display the complete second video stream.

In another possible implementation manner, when setting the position of each display area, the relative positional relationship between the shooting areas of the video stream corresponding to each display area may not be considered.

In the embodiments of the present disclosure, the sizes of different display areas in the vehicle display screen may be the same or different.

In a possible implementation manner, the aspect ratio of the display area may be a fixed ratio. For example, the pixel size of the display area may be 960x540. In this implementation, if the aspect ratio of the video frame of the video stream collected by any vehicle camera is different from that of the display area, the display area may be filled with black borders or the like.

In another possible implementation, for any vehicle-mounted camera, the aspect ratio of the display area corresponding to the vehicle-mounted camera may be determined according to the aspect ratio of the video frame of the video stream collected by the vehicle-mounted camera, so that The aspect ratio of the display area corresponding to the vehicle camera is equal to the aspect ratio of the video frame of the video stream collected by the vehicle camera.

In an embodiment of the present disclosure, different display areas of at least two display areas may be in a selected state at the same time. That is, target image data may be generated based on video streams corresponding to more than two selected display areas. Wherein, the data type of the target image data may be an image, an image sequence, or a video, etc., which is not limited here.

In the embodiment of the present disclosure, the user may select the display area through touch or voice. As shown in FIG. 4 , in an example, the user can select the display area by clicking the circle at the upper right corner of the display area.

In the embodiment of the present disclosure, the recording request may be generated by triggering a recording mode selection control, or may be generated through a voice instruction, and so on. In the way of voice recognition, it can be linked with the voice assistant of the car, and take pictures or videos by controlling the voice commands of the car camera to shoot or record. For example, the user can issue a voice command of "Xiao X Xiao X, record the front and the right", and control the vehicle video processing device to generate the target video based on the video stream collected by the front camera of the car and the video stream collected by the right camera of the car. For another example, the user can issue a voice command of "Xiao X Xiao X, record the front", and control the vehicle video processing device to generate the target video based on the video stream collected by the front camera.

In a possible implementation manner, the vehicle display screen may display a single recording mode selection control, and the recording mode selection control may be used to trigger at least one recording mode. In this implementation manner, in response to detecting a trigger operation on the recording mode selection control, the recording mode may be determined according to the type of the trigger operation. For example, in FIG. 4, the vehicle display screen can display the shooting/recording control, can generate a recording request for requesting to take a photo in response to detecting a click operation on the shooting/recording Record long presses on controls, generate recording requests for recording, etc.

In a possible implementation manner, the number of the display areas is at least two; the method further includes: in response to the recording request, hiding an unselected display area of the at least two display areas. In this implementation, by hiding the unselected display areas of the at least two display areas in response to the recording request, the interference of the unselected display areas to the user can be reduced, thereby improving user utilization. The experience of taking pictures and/or recording videos through the video stream collected by the car camera.

In another possible implementation manner, after the recording request is detected, unselected display areas of the at least two display areas may not be hidden.

In a possible implementation manner, the method further includes: in response to the recording request, enlarging the selected display area. In this implementation manner, the selected display area is enlarged in response to the recording request, so that the user can obtain a better preview effect through the limited screen space of the vehicle display screen.

FIG. 5 shows another schematic diagram of a display interface of a vehicle-mounted display screen in the method for processing vehicle-mounted video provided by an embodiment of the present disclosure. In the example shown in Figure 5, the selected display area includes the display area corresponding to the front camera of the car (that is, the display area corresponding to the front camera screen) and the display area corresponding to the left camera of the car (that is, the display area corresponding to the left camera screen) . As shown in FIG. 5 , in response to the recording request, the display area corresponding to the front camera of the car and the display area corresponding to the left camera of the car may be enlarged, and the display areas corresponding to other cameras may be hidden. In addition, recording the video may also be stopped in response to the end control being triggered.

In a possible implementation manner, the on-vehicle display screen includes a recording mode selection control; the generating target image data according to the video stream corresponding to the selected display area in response to the recording request includes: responding to the The triggering of any recording mode selection control generates target image data corresponding to the recording mode according to the video stream corresponding to the selected display area.

In this implementation, the recording mode selection control may represent a control for selecting a recording mode. Wherein, the vehicle display screen may include at least one recording mode selection control. As an example of this implementation manner, the vehicle display screen may include at least two recording mode selection controls. For example, the recording method may include at least one of taking a single photo, taking multiple photos continuously, recording video, time-lapse photography, etc. Correspondingly, the recording method selection control may include taking a single photo control, taking multiple photos continuously At least one of controls, video recording controls, time-lapse photography controls, and the like.

In this implementation manner, in response to triggering of any recording mode selection control, a recording request may be generated according to the recording mode corresponding to the recording mode selection control.

In this implementation, target image data of different image types can be generated according to different recording modes selected by the user, so that the flexibility of generating target image data can be improved and the user's preference for image types can be satisfied.

As an example of this implementation manner, the number of the recording mode selection controls is at least two, and the at least two recording controls can be in a trigger state at the same time.

In this example, at least two recording mode selection controls corresponding to at least two recording modes may be displayed on the vehicle display screen, wherein the at least two recording mode selection controls can be in an open state at the same time, that is, the At least two recording controls can be active at the same time. A recording request may be generated according to a recording mode corresponding to the recording mode selection control in response to an opening instruction for any one of the at least two recording mode selection controls.

For example, the camera control and video recording control can be displayed through the vehicle display screen; for another example, the control of taking a single photo, the control of continuous shooting of multiple photos, the control of recording video and the control of time-lapse photography can be displayed through the vehicle display screen; and so on.

FIG. 6 shows another schematic diagram of a display interface of a vehicle-mounted display in the method for processing vehicle-mounted video provided by an embodiment of the present disclosure. In the example shown in FIG. 6 , the camera control and the video recording control are displayed through the vehicle display screen, wherein the camera control and the video recording control may be in an activated state at the same time. For example, after the user selects the display area corresponding to the left camera screen and the display area corresponding to the right camera screen, and clicks the recording control, the video can be recorded according to the video stream collected by the left camera of the car and the video stream collected by the right camera of the car. In the process of recording the video, if the user sees the scenery of interest and wants to take a photo, he can click the camera control to take a photo according to the video stream collected by the left camera of the car and the video stream collected by the right camera of the car.

In this implementation, at least two recording mode selection controls corresponding to at least two recording modes are displayed on the vehicle-mounted display screen, wherein the at least two recording mode selection controls can be in a triggered state at the same time, thereby It can solve the contradiction between users wanting to shoot videos and taking photos when they see the scenery they want to shoot. Mobile phone or camera to shoot, so as to further meet the needs of users.

In a possible implementation manner, the generating target image data according to the video stream corresponding to the selected display area includes: in response to the number of the selected display areas being greater than or equal to 2, according to at least two The relative positional relationship of the shooting area corresponding to each selected display area to generate the target image data.

For example, the selected display area includes a display area corresponding to the front camera of the car and a display area corresponding to the rear camera of the car. Therefore, in the target image data, the image information corresponding to the front camera may be above the image information corresponding to the rear camera.

As another example, the selected display area includes the display area corresponding to the left camera of the car and the display area corresponding to the rear camera of the car, wherein the shooting area corresponding to the video stream collected by the left camera of the car is the shooting area corresponding to the video stream collected by the rear camera of the car Therefore, in the target image data, the image information corresponding to the left camera of the vehicle may be on the left side of the image information corresponding to the rear camera of the vehicle.

As another example, the selected display area includes the display area corresponding to the right camera of the car and the display area corresponding to the rear camera of the car, wherein the shooting area corresponding to the video stream collected by the right camera of the car is the shooting area corresponding to the video stream collected by the rear camera of the car Therefore, in the target image data, the image information corresponding to the right camera of the vehicle may be on the right side of the image information corresponding to the rear camera of the vehicle.

In this implementation, in response to the number of the selected display areas being greater than or equal to 2, the target image data can be generated according to the relative positional relationship of the shooting areas corresponding to at least two selected display areas, thereby enabling The generated target image data is more harmonious and natural.

As an example of this implementation, the generating target image data according to the relative positional relationship of the shooting areas corresponding to the at least two selected display areas includes: Positional relationship, splicing the video streams corresponding to the display area to generate target image data.

In this example, target image data is generated by splicing video streams corresponding to at least two selected display areas according to the relative positional relationship of shooting areas corresponding to at least two selected display areas, thereby obtaining more natural target image data.

As an example of this implementation, the generating target image data according to the relative positional relationship of the shooting areas corresponding to the at least two selected display areas includes: responding to any of the at least two selected display areas There is an intersection area between the shooting areas corresponding to the two display areas, and the video streams corresponding to the display areas where the intersection area exists are spliced to generate target image data.

For example, there is an intersection area between the shooting area corresponding to the video stream collected by the left camera of the car and the shooting area corresponding to the video stream collected by the front camera of the car. If the at least two selected display areas include the display area corresponding to the left camera of the car and the display area corresponding to the front camera of the car, then the video stream collected by the left camera of the car and the video stream collected by the front camera of the car can be spliced.

For another example, there is an intersection area between the shooting area corresponding to the video stream collected by the camera on the left of the car and the shooting area corresponding to the video stream collected by the camera on the rear of the car. If the at least two selected display areas include a display area corresponding to the left camera of the car and a display area corresponding to the rear camera, the video stream collected by the left camera of the car and the video stream collected by the rear camera may be spliced.

For another example, there is an intersection area between the shooting area corresponding to the video stream collected by the camera on the right side of the car and the shooting area corresponding to the video stream collected by the front camera of the car. If the at least two selected display areas include a display area corresponding to the right camera of the car and a display area corresponding to the front camera of the car, the video stream collected by the right camera of the car and the video stream collected by the front camera of the car may be spliced.

For another example, there is an intersection area between the shooting area corresponding to the video stream collected by the camera on the right side of the car and the shooting area corresponding to the video stream collected by the camera on the rear of the car. If the at least two selected display areas include a display area corresponding to the right camera of the car and a display area corresponding to the rear camera, the video stream collected by the right camera of the car and the video stream collected by the rear camera may be spliced.

For another example, there is an intersection area between the shooting area corresponding to the video stream collected by the camera in front of the car and the shooting area corresponding to the video stream collected by the camera behind the car. If the at least two selected display areas include a display area corresponding to the front camera and a display area corresponding to the rear camera, the video stream collected by the front camera and the video stream collected by the rear camera may be spliced.

In this example, when the number of selected display areas is at least three, the number of spliced video streams may also be more than three. For example, the video stream collected by the front camera of the car, the video stream collected by the left camera of the car, and the video stream collected by the rear camera of the car can be spliced; Splicing with the video stream collected by the rear camera of the car; as another example, the video stream collected by the left camera of the car, the video stream collected by the front camera of the car and the video stream collected by the right camera of the car can be spliced; The video stream collected, the video stream collected by the camera behind the car and the video stream collected by the right camera of the car are spliced; and so on.

In this example, by splicing the video streams corresponding to the display areas with intersection areas in response to the intersection areas between the shooting areas corresponding to any two display areas among the at least two selected display areas, generating The target image data, so that seamless wide-angle image data can be obtained.

As another example of this implementation, the generating target image data according to the relative positional relationship of the shooting areas corresponding to the at least two selected display areas includes: responding to the at least two selected display areas, There is an intersection area between the shooting areas corresponding to any two display areas, and the focal length and model of the two vehicle cameras corresponding to the two display areas in the intersection area are the same, the video streams corresponding to the two display areas in the intersection area Splicing is performed to generate target image data. Since the pictures of vehicle-mounted cameras with different focal lengths in the same shooting area may not be aligned, and the brightness and color of different types of vehicle-mounted cameras may be inconsistent, therefore, by responding to any two of the at least two selected display areas, There is an intersection area between the shooting areas corresponding to the display area, and the focal length and model of the two vehicle-mounted cameras corresponding to the two display areas in the intersection area are the same, and the video streams corresponding to the two display areas in the intersection area are spliced. By generating target video data, it is possible to generate higher-quality target video data.

As another example of this implementation, the generating target image data according to the relative positional relationship of the shooting areas corresponding to the at least two selected display areas includes: responding to the at least two selected display areas, There is an intersection area between the shooting areas corresponding to any two display areas, and the focal lengths of the two vehicle cameras corresponding to the two display areas in the intersection area are the same, and the video streams corresponding to the two display areas in the intersection area are spliced. Generate target image data.

As another example of this implementation, the generating target image data according to the relative positional relationship of the shooting areas corresponding to the at least two selected display areas includes: responding to the at least two selected display areas, There is an intersection area between the shooting areas corresponding to any two display areas, and the two vehicle-mounted cameras corresponding to the two display areas in the intersection area are of the same model, and the video streams corresponding to the two display areas in the intersection area are spliced. Generate target image data.

As another example of this implementation, the splicing control may be displayed through the vehicle display screen, and may respond to the splicing control being turned on, and among the at least two selected display areas, any two display areas corresponding to the shooting area There is an intersection area between them, and the video streams corresponding to the display areas where the intersection area exists are spliced to generate target image data. FIG. 7 shows another schematic diagram of a display interface of a vehicle-mounted display screen in the method for processing vehicle-mounted video provided by an embodiment of the present disclosure. In the example shown in Figure 7, the splicing controls are displayed through the on-board display.

In a possible implementation manner, after the target image data is generated, the method further includes: generating a file name corresponding to the target image data according to the orientation information of the vehicle-mounted camera corresponding to the target image data; The file name stores the target image data.

As an example of this implementation manner, the file name of the target image data may further include at least one of a generation date of the target image data, a generation time of the target image data, and the like. For example, if the target image data is "20220808_183059_front.mp4", it may indicate that the target image data is the image information collected by the front camera of the vehicle. For another example, if the target image data is "20220808_183059_front_rear.mp4", it may indicate that the target image data includes image information collected by the front camera of the vehicle and image information collected by the rear camera of the vehicle.

In this implementation, by generating the file name corresponding to the target image data according to the orientation information of the vehicle-mounted camera corresponding to the target image data, and storing the target image data according to the file name, it is possible to facilitate Users can quickly find target image data.

In a possible implementation manner, after the target image data is generated, the length or size desired by the user may be cut or a filter may be added according to the user's requirements, which is not limited here.

In a possible implementation manner, after the target image data is generated, the method further includes: performing sharing processing on the target image data in response to a sharing request for the target image data. For example, the target image data may be shared and processed through Wi-Fi (wireless network) and other means.

As an example of this implementation manner, in response to a sharing request for the target image data, the target image data may be shared to a designated terminal device. For example, the designated terminal device may be a user's mobile phone or the like.

As another example of this implementation manner, in response to a sharing request for the target image data, the target image data may be shared to a designated social platform.

The on-vehicle video processing method provided by the embodiments of the present disclosure may be applied to technical fields such as in-vehicle, photography, video streaming, image processing, etc., and is not limited herein.

The method for processing a vehicle-mounted video provided by an embodiment of the present disclosure is described below through a specific application scenario. In this application scenario, as shown in Figure 7, the vehicle display can include the display area corresponding to the camera in the car, the display area corresponding to the front camera, the display area corresponding to the surround view camera, the display area corresponding to the left camera of the car, and the display area corresponding to the rear camera. The display area corresponding to the camera and the display area corresponding to the right camera of the vehicle, and the vehicle display can display shooting/recording controls and splicing controls. Users can select the display area by clicking the circle in the upper right corner of the display area. A recording request for requesting to take pictures may be generated in response to detecting a single-click operation on the shooting/recording control, and a recording request for requesting video recording may be generated in response to detecting a long-press operation on the shooting/recording control. After the target image data is generated, the duration or size can be cropped according to user needs, and filters can be added. Moreover, in response to the sharing request, the target image data can also be shared to the user's mobile phone or social platform.

It can be understood that the above-mentioned method embodiments mentioned in this disclosure can all be combined with each other to form a combined embodiment without violating the principle and logic. Due to space limitations, this disclosure will not repeat them. Those skilled in the art can understand that, in the above method in the specific implementation manner, the specific execution order of each step should be determined according to its function and possible internal logic.

In addition, the present disclosure also provides a vehicle-mounted video processing device, electronic equipment, a computer-readable storage medium, and a computer program product, all of which can be used to implement any of the vehicle-mounted video processing methods provided in the present disclosure, corresponding technical solutions and technical effects Reference can be made to the corresponding records in the method section, and details will not be repeated here.

Fig. 8 shows a block diagram of a vehicle-mounted video processing device provided by an embodiment of the present disclosure. As shown in Figure 8, the processing device of the vehicle video includes:

Obtaining module 21, is used for obtaining the video flow that vehicle-mounted camera collects;

The first display module 22 is configured to display the video stream through the display area of the vehicle display screen;

The second display module 23 is configured to display the selected display area as a selected state in response to any display area being selected;

The generation module 24 is configured to generate target image data according to the video stream corresponding to the selected display area in response to the recording request.

In a possible implementation manner, the video stream displayed in the display area is a first preset resolution, and the video stream used to generate the target image data is a second preset resolution, wherein the first The preset resolution is lower than the second preset resolution.

In a possible implementation manner, the acquisition module 21 is configured to:

Encoding the original video data collected by the vehicle camera into a video stream with the first preset resolution and a video stream with the second preset resolution.

In a possible implementation manner, the vehicle-mounted display screen includes a recording mode selection control;

The generating module 24 is used for:

In response to triggering of any recording mode selection control, target image data corresponding to the recording mode is generated according to the video stream corresponding to the selected display area.

In a possible implementation manner, there are at least two recording mode selection controls, and the at least two recording controls can be in a trigger state at the same time.

In a possible implementation manner, the vehicle-mounted display screen includes multiple display areas, and the multiple display areas respectively display video streams collected by multiple vehicle-mounted cameras, and the relative positional relationship between the multiple display areas The determination is based on the relative positional relationship between the shooting areas of the plurality of vehicle-mounted cameras.

In a possible implementation manner, if there is an intersection area between the shooting areas corresponding to the first display area and the second display area among the plurality of display areas, the image of any sub-area of the intersection area Information is displayed only through the first display area or only through the second display area.

In a possible implementation manner, for any sub-area of the intersection area, in response to the distortion degree of the sub-area in the first video stream being lower than the distortion degree of the sub-area in the second video stream, by The first display area displays the image information of the sub-area; or, for any sub-area of the intersection area, in response to the distortion degree of the sub-area in the first video stream being higher than or equal to the The degree of distortion of the sub-region in the second video stream, displaying the image information of the sub-region through the second display area; wherein, the first video stream is the first vehicle-mounted camera corresponding to the first display area The collected video stream, the second video stream is the video stream collected by the second vehicle-mounted camera corresponding to the second display area.

In a possible implementation manner, the number of the display areas is at least two;

The device also includes:

A hiding module, configured to hide an unselected display area among at least two display areas in response to the recording request.

In a possible implementation manner, the device further includes:

An enlargement module, configured to enlarge the selected display area in response to the recording request.

In a possible implementation, the generating module 24 is used for:

In response to the number of the selected display areas being greater than or equal to two, the target image data is generated according to the relative positional relationship of the shooting areas corresponding to at least two selected display areas.

In a possible implementation, the generating module 24 is used for:

According to the relative positional relationship of the shooting areas corresponding to at least two selected display areas, video streams corresponding to the display areas are spliced to generate target image data.

In a possible implementation manner, the vehicle display screen includes:

The display screen set in the passenger cabin, and/or, the display screen set in the rear seat area.

In some embodiments, the functions or modules included in the device provided by the embodiments of the present disclosure can be used to execute the methods described in the above method embodiments, and its specific implementation and technical effects can refer to the descriptions of the above method embodiments, for It is concise and will not be repeated here.

An embodiment of the present disclosure also provides a computer-readable storage medium, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the foregoing method is implemented. Wherein, the computer-readable storage medium may be a non-volatile computer-readable storage medium, or may be a volatile computer-readable storage medium.

An embodiment of the present disclosure also proposes a computer program, including computer readable codes. When the computer readable codes are run in an electronic device, a processor in the electronic device executes the above method.

An embodiment of the present disclosure also provides a computer program product, including computer-readable codes, or a non-volatile computer-readable storage medium carrying computer-readable codes, when the computer-readable codes are run in an electronic device , the processor in the electronic device executes the above method.

An embodiment of the present disclosure also provides an electronic device, including: one or more processors; a memory for storing executable instructions; wherein the one or more processors are configured to call the executable instructions stored in the memory instruction to perform the above method.

Electronic devices may be provided as terminals, servers, or other forms of devices.

FIG. 9 shows a block diagram of an electronic device 800 provided by an embodiment of the present disclosure. For example, the electronic device 800 may be a vehicle engine, a domain controller or a processor in a vehicle cabin, and may also be a device host in a DMS or an OMS for performing data processing operations such as images.

9, electronic device 800 may include one or more of the following components: processing component 802, memory 804, power supply component 806, multimedia component 808, audio component 810, input/output interface 812, sensor component 814, and communication component 816.

The processing component 802 generally controls the overall operations of the electronic device 800, such as those associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above method. Additionally, processing component 802 may include one or more modules that facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802 .

The memory 804 is configured to store various types of data to support operations at the electronic device 800 . Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phonebook data, messages, pictures, videos, and the like. The memory 804 can be realized by any type of volatile or non-volatile storage device or their combination, such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read Only Memory (EEPROM), Erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic Disk or Optical Disk.

The power supply component 806 provides power to various components of the electronic device 800 . Power components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for electronic device 800 .

The multimedia component 808 includes a screen providing an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may not only sense a boundary of a touch or swipe action, but also detect duration and pressure associated with the touch or swipe action. In some embodiments, the multimedia component 808 includes a front camera and/or a rear camera. When the electronic device 800 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capability.

The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a microphone (MIC), which is configured to receive an external audio signal when the electronic device 800 is in an operation mode, such as a call mode, a recording mode and a voice recognition mode. Received audio signals may be further stored in memory 804 or sent via communication component 816 . In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

The input/output interface 812 provides an interface between the processing component 802 and a peripheral interface module, which may be a keyboard, a click wheel, a button, and the like. These buttons may include, but are not limited to: a home button, volume buttons, start button, and lock button.

Sensor assembly 814 includes one or more sensors for providing status assessments of various aspects of electronic device 800 . For example, the sensor component 814 can detect the open/closed state of the electronic device 800, the relative positioning of components, such as the display and the keypad of the electronic device 800, the sensor component 814 can also detect the electronic device 800 or a Changes in position of components, presence or absence of user contact with electronic device 800 , electronic device 800 orientation or acceleration/deceleration and temperature changes in electronic device 800 . Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact. The sensor assembly 814 may also include an optical sensor, such as a complementary metal-oxide-semiconductor (CMOS) or charge-coupled device (CCD) image sensor, for use in imaging applications. In some embodiments, the sensor component 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.

The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 can access wireless networks based on communication standards, such as wireless networks (Wi-Fi), second-generation mobile communication technologies (2G), third-generation mobile communication technologies (3G), fourth-generation mobile communication technologies (4G ), long-term evolution (LTE) of universal mobile communication technology, fifth generation mobile communication technology (5G) or their combination. In an exemplary embodiment, the communication component 816 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on Radio Frequency Identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

In an exemplary embodiment, electronic device 800 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable A programmable gate array (FPGA), controller, microcontroller, microprocessor or other electronic component implementation for performing the method described above.

In an exemplary embodiment, there is also provided a non-volatile computer-readable storage medium, such as the memory 804 including computer program instructions, which can be executed by the processor 820 of the electronic device 800 to implement the above method.

The present disclosure can be a system, method and/or computer program product. A computer program product may include a computer readable storage medium having computer readable program instructions thereon for causing a processor to implement various aspects of the present disclosure.

A computer readable storage medium may be a tangible device that can retain and store instructions for use by an instruction execution device. A computer readable storage medium may be, for example, but is not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (non-exhaustive list) of computer-readable storage media include: portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), or flash memory), static random access memory (SRAM), compact disc read only memory (CD-ROM), digital versatile disc (DVD), memory stick, floppy disk, mechanically encoded device, such as a A hole card or a raised structure in a groove, and any suitable combination of the above. As used herein, computer-readable storage media are not to be construed as transient signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (for example, pulses of light through fiber optic cables), or transmitted electrical signals.

Computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or downloaded to an external computer or external storage device over a network, such as the Internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers. A network adapter card or a network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in each computing/processing device .

Computer program instructions for performing the operations of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or Source or object code written in any combination, including object-oriented programming languages—such as Smalltalk, C++, etc., and conventional procedural programming languages—such as the “C” language or similar programming languages. Computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server implement. In cases involving a remote computer, the remote computer can be connected to the user computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as through the Internet using an Internet service provider). connect). In some embodiments, electronic circuits, such as programmable logic circuits, field programmable gate arrays (FPGAs) or programmable logic arrays (PLAs), can be customized by utilizing state information of computer-readable program instructions, which can Various aspects of the present disclosure are implemented by executing computer readable program instructions.

Aspects of the present disclosure are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It should be understood that each block of the flowcharts and/or block diagrams, and combinations of blocks in the flowcharts and/or block diagrams, can be implemented by computer-readable program instructions.

These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine such that when executed by the processor of the computer or other programmable data processing apparatus , producing an apparatus for realizing the functions/actions specified in one or more blocks in the flowchart and/or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause computers, programmable data processing devices and/or other devices to work in a specific way, so that the computer-readable medium storing instructions includes An article of manufacture comprising instructions for implementing various aspects of the functions/acts specified in one or more blocks in flowcharts and/or block diagrams.

It is also possible to load computer-readable program instructions into a computer, other programmable data processing device, or other equipment, so that a series of operational steps are performed on the computer, other programmable data processing device, or other equipment to produce a computer-implemented process , so that instructions executed on computers, other programmable data processing devices, or other devices implement the functions/actions specified in one or more blocks in the flowcharts and/or block diagrams.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, a portion of a program segment, or an instruction that includes one or more Executable instructions. In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved. It should also be noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by a dedicated hardware-based system that performs the specified function or action , or may be implemented by a combination of dedicated hardware and computer instructions.

The computer program product can be specifically realized by means of hardware, software or a combination thereof. In an optional embodiment, the computer program product is embodied as a computer storage medium. In another optional embodiment, the computer program product is embodied as a software product, such as a software development kit (Software Development Kit, SDK), etc. Wait.

The above descriptions of the various embodiments tend to emphasize the differences between the various embodiments, the same or similar points can be referred to each other, and for the sake of brevity, details are not repeated herein.

If the technical solutions of the embodiments of the present disclosure involve personal information, the products applying the technical solutions of the embodiments of the present disclosure have been clearly notified of the personal information processing rules and obtained the individual's voluntary consent before processing personal information. If the technical solutions of the embodiments of the present disclosure involve sensitive personal information, the products applying the technical solutions of the embodiments of the present disclosure have obtained individual consent before processing sensitive personal information, and at the same time meet the requirement of "express consent". For example, at a personal information collection device such as a camera, a clear and prominent sign is set up to inform that it has entered the scope of personal information collection, and personal information will be collected. If an individual voluntarily enters the collection scope, it is deemed to agree to the collection of his personal information; or On the personal information processing device, when the personal information processing rules are informed with obvious signs/information, personal authorization is obtained through pop-up information or by asking individuals to upload their personal information; among them, the personal information processing rules may include Information such as the information processor, the purpose of personal information processing, the method of processing, and the type of personal information processed.

Having described various embodiments of the present disclosure above, the foregoing description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and alterations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principle of each embodiment, practical application or improvement of technology in the market, or to enable other ordinary skilled in the art to understand each embodiment disclosed herein.

Claims (17)

1. A processing method of vehicle-mounted video is characterized by comprising the following steps:

acquiring a video stream acquired by a vehicle-mounted camera;

displaying the video stream through a display area of a vehicle-mounted display screen;

in response to the selection of any display area, displaying the selected display area in a selected state;

and responding to the recording request, and generating target image data according to the video stream corresponding to the selected display area.

2. The method of claim 1, wherein the video stream displayed in the display area is of a first predetermined resolution, and the video stream used for generating the target video data is of a second predetermined resolution, wherein the first predetermined resolution is lower than the second predetermined resolution.

3. The method according to claim 2, wherein the acquiring the video stream captured by the vehicle-mounted camera comprises:

and encoding the original video data acquired by the vehicle-mounted camera into the video stream with the first preset resolution and the video stream with the second preset resolution.

4. The method of claim 1, wherein the vehicle-mounted display screen includes a recording mode selection control;

the generating of the target image data according to the video stream corresponding to the selected display area in response to the recording request includes:

and responding to the trigger of any recording mode selection control, and generating target image data corresponding to the recording mode according to the video stream corresponding to the selected display area.

5. The method according to claim 4, wherein the number of the recording mode selection controls is at least two, and the at least two recording controls can be simultaneously in a trigger state.

6. The method according to any one of claims 1 to 5, wherein the on-board display screen comprises a plurality of display areas, the plurality of display areas respectively display video streams captured by a plurality of on-board cameras, and the relative positional relationship between the plurality of display areas is determined based on the relative positional relationship between the shooting areas of the plurality of on-board cameras.

7. The method according to claim 6, wherein, in a case where there is an intersection region between the photographing regions corresponding to a first display region and a second display region among the plurality of display regions, the image information of any sub-region of the intersection region is displayed only by the first display region or only by the second display region.

8. The method of claim 7,

for any sub-region of the intersection region, responding to the fact that the distortion degree of the sub-region in a first video stream is lower than that of the sub-region in a second video stream, and displaying image information of the sub-region through the first display region; or, for any sub-region of the intersection region, in response to the distortion degree of the sub-region in the first video stream being higher than or equal to the distortion degree of the sub-region in the second video stream, displaying the image information of the sub-region through the second display region; the first video stream is a video stream acquired by a first vehicle-mounted camera corresponding to the first display area, and the second video stream is a video stream acquired by a second vehicle-mounted camera corresponding to the second display area.

9. The method according to any one of claims 1 to 4, wherein the number of display areas is at least two;

the method further comprises the following steps:

and hiding the unselected display area in the at least two display areas in response to the recording request.

10. The method according to any one of claims 1 to 4, further comprising:

and responding to the recording request, and enlarging the selected display area.

11. The method according to any one of claims 1 to 4, wherein the generating target image data according to the video stream corresponding to the selected display area comprises:

and generating target image data according to the relative position relation of the shooting areas corresponding to at least two selected display areas in response to the number of the selected display areas being more than or equal to 2.

12. The method according to claim 11, wherein generating the target image data according to the relative position relationship between the capturing areas corresponding to the at least two selected display areas comprises:

and splicing the video streams corresponding to the display areas according to the relative position relation of the shooting areas corresponding to the at least two selected display areas to generate target image data.

13. The method of any of claims 1 to 4, wherein the in-vehicle display screen comprises:

the display screen is arranged in the copilot cab and/or the display screen is arranged in the rear seat area.

14. An apparatus for processing a vehicle-mounted video, comprising:

the acquisition module is used for acquiring the video stream acquired by the vehicle-mounted camera;

the first display module is used for displaying the video stream through a display area of the vehicle-mounted display screen;

the second display module is used for responding to the fact that any display area is selected and displaying the selected display area in a selected state;

and the generating module is used for responding to the recording request and generating target image data according to the video stream corresponding to the selected display area.

15. An electronic device, comprising:

one or more processors;

a memory for storing executable instructions;

wherein the one or more processors are configured to invoke the memory-stored executable instructions to perform the method of any one of claims 1 to 13.

16. A computer readable storage medium having computer program instructions stored thereon, which when executed by a processor implement the method of any one of claims 1 to 13.

17. A computer program product comprising computer readable code, or a non-transitory computer readable storage medium carrying computer readable code, which when run in an electronic device, a processor in the electronic device performs the method of any one of claims 1 to 13.

Images