CN115567691A - Method and device for real-time display of front-view camera video stream by back-row entertainment system - Google Patents

Abstract

The invention discloses a method for displaying a front-view camera video stream in real time by a back row entertainment system, which comprises the following steps: acquiring a video stream recorded by a vehicle-mounted front-view camera; optimizing the obtained video stream to obtain an optimized video stream; and sending the obtained optimized video stream to a back row playing screen for playing. The method comprises the steps of obtaining a video stream with a resolution of 1080p transmitted by a vehicle-mounted forward-looking camera through an LVDS wiring harness, and optimizing the obtained video stream, so that the step of obtaining the optimized video stream comprises the following steps: and processing each frame of image in the acquired video stream as follows: and judging whether the image is shot in a backlight mode, and if so, carrying out image sharpening on the image. The following processing is further performed on each frame of image in the acquired video stream: and performing smooth pixel processing on the sharpened image. Through the scheme, the visual readability of the video is improved, and clear and accurate image information is provided for the back row personnel to assist the driver.

Description

Method and device for real-time display of front-view camera video stream in rear entertainment system

technical field

The invention relates to the technical field of camera video streams, in particular to a method for real-time display of a front-view camera video stream by a rear-row entertainment system, and a device for real-time display of a front-view camera video stream by a rear-row entertainment system.

Background technique

Passengers in the rear seats of existing models cannot observe the traffic conditions in front of the vehicle, and cannot assist in reminding the driver to avoid vehicles and pedestrians in time. Although there are video signals from the driving recorder, they are not used to expand the viewing angle of the rear passengers.

At the same time, the existing driving recorder itself also has deficiencies. For example, after taking pictures, the image processing effect on highlight processing is poor, it is easy to produce glare and other phenomena, and it is difficult to identify the details of the information in the image; for example, the shooting angle of the driving recorder is directly in front of the vehicle. The shooting angle and field of view are fixed, and the engine cover is unavoidable in the picture, resulting in insufficient editing value when the video is used to determine responsibility for traffic accidents.

Based on the above reasons, it is necessary to obtain a solution, which can use the video display function of the rear seat entertainment system of the vehicle to display the images recorded by the front view camera of the vehicle in real time, to meet the needs of the rear members to observe the road conditions in front of the vehicle, and to make it have the ability to remind the driver Ability to drive safely.

At the same time, the video stream is visually optimized to eliminate defects such as glare and insufficient viewing angles, improve the readability of the screen, and provide clear and accurate image information for the rear passengers to assist the driver.

Contents of the invention

The object of the present invention is to provide a method for displaying the video stream of the front-view camera in the rear entertainment system in real time, and a device for displaying the video stream of the front-view camera in the rear entertainment system in real time, so as to meet the needs of the rear row members to observe the road conditions in front of the vehicle, and improve The readability of the screen provides clear and accurate image information for the rear passengers to assist the driver.

The present invention provides following scheme:

According to one aspect of the present invention, a method for displaying a video stream of a front-view camera in real time in a rear entertainment system is provided, and the method for displaying a video stream of a front-view camera in a rear entertainment system in real time includes:

Obtain the video stream recorded by the vehicle's front-view camera;

Optimizing the obtained video stream to obtain an optimized video stream;

The obtained optimized video stream is sent to the rear playback screen for playback.

Further, said obtaining the video stream recorded by the vehicle-mounted front-view camera includes:

Obtain the 1080p resolution video stream transmitted by the vehicle's front-view camera through the LVDS harness.

Further, the obtained video stream is optimized, so that the optimized video stream includes:

Each frame image in the acquired video stream is processed as follows:

Determine whether the image is taken against the light, if so, then

Apply image sharpening to the image.

Further, after performing image sharpening processing on the image, performing the following processing on each frame of image in the acquired video stream further includes:

Smooths pixels on a sharpened image.

Further, the judging whether the image is taken against the light includes:

Obtain pixel group acquisition rules;

Divide each image into multiple pixel sets according to the pixel group acquisition rules;

Obtain the average brightness of each pixel set;

Whether the image is shot against the light is judged according to the average brightness of each pixel set.

Further, said performing image sharpening processing on the image includes:

The Sobel sharpening algorithm is used for image processing on each pixel point in each pixel set, so as to obtain the pixel point information of each pixel point after processing, so as to obtain the sharpened image.

Further, the smoothing pixel processing of the sharpened image includes:

The sharpened image is iteratively calculated through an anisotropic diffusion filter algorithm to obtain an image after smooth pixel processing.

Further, the method for displaying the video stream of the front-view camera in the rear entertainment system in real time further includes:

Obtaining the danger signals generated by the users in the rear row based on the optimized video stream played on the playback screen in the rear row;

Obtain the radar information transmitted by each millimeter-wave radar of the vehicle;

According to the radar information, it is judged whether the distance between the obstacle and the vehicle is less than the preset warning value, and if so, then

The danger signal generated by the rear seat users is sent to the vehicle control system, and the vehicle control system generates a brake signal according to the danger signal, so as to stop the vehicle.

Further, the sending the danger signal generated by the rear row users to the vehicle control system, the vehicle control system generating a braking signal according to the danger signal, so as to stop the vehicle includes:

Obtain each radar information;

Obtain the distance information of the obstacle closest to the vehicle according to each radar information;

Obtain current vehicle speed information;

Obtain collision time information based on current vehicle speed information and distance information;

Generate braking rate curve information according to the collision time information;

Control the vehicle to stop according to the braking rate curve information.

According to another aspect of the present invention, a device for displaying the video stream of the front-view camera in real time in the rear entertainment system is provided, and the device for displaying the video stream of the front-view camera in the rear entertainment system in real time includes:

A video stream acquisition module, the video stream acquisition module is used to obtain the video stream recorded by the vehicle-mounted front-view camera;

An optimization module, the optimization module is used to optimize the obtained video stream, so as to obtain the optimized video stream;

A playing module, the playing module is used to send the obtained optimized video stream to the rear playing screen for playing.

Compared with the prior art, the present invention has the following advantages:

(1) This application uses the Sobel sharpening algorithm for image processing, which optimizes the overexposure of local pixel areas to a certain extent, and improves the visual readability of the video.

(2) The present application uses an anisotropic diffusion filter algorithm to perform iterative calculations to process image information, so that the differences between pixel regions are smoothed out, and the integrity of image information is improved.

(3) This application integrates millimeter-wave radar information and image information into information that jointly warns of obstacles ahead, so that on the one hand, the occupants in the vehicle can accept passive reminders of obstacles, and on the other hand, they can actively locate and identify obstacles. Information such as contours and attributes allows the driver to have more options for dealing with obstacles, such as turning instead of having to brake suddenly.

(4) This application uses the information of warning obstacles ahead as the basis for judging and triggering automatic braking, so that automatic braking has double information sources for cross-validation and improves security.

(5) This application obtains information such as accurate braking distance and evasive route by warning the information of obstacles in front, so as to realize automatic braking in the way of braking curve; while preventing personnel from being greatly injured by collision, it also reduces Minor injuries to personnel caused by excessive braking are eliminated, and personnel safety is further improved.

Description of drawings

In order to more clearly illustrate the specific implementation of the present invention or the technical solutions in the prior art, the following will briefly introduce the accompanying drawings that need to be used in the specific implementation or description of the prior art. Obviously, the accompanying drawings in the following description The drawings show some implementations of the present invention, and those skilled in the art can obtain other drawings based on these drawings without any creative work.

FIG. 1 is a flow chart of a method for displaying a front-view camera video stream in real time in a rear entertainment system in this embodiment.

FIG. 2 is a structural diagram of a device for real-time displaying a video stream of a front-view camera in a rear entertainment system according to this embodiment.

Fig. 3 is a flow chart of a method for processing over-exposed and over-dark video streams in a specific embodiment.

Fig. 4 is a flowchart of a pre-output video stream adjustment processing method according to a specific embodiment.

Fig. 5 is a flow chart of a method for processing the display size of a video stream in a specific embodiment.

Fig. 6 is a schematic diagram of a pixel point selection processing method in a specific embodiment.

FIG. 7 is a structural diagram of a hardware structure of an electronic device in this embodiment.

detailed description

The technical solutions of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Apparently, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

FIG. 1 is a flow chart of a method for displaying a front-view camera video stream in real time in a rear entertainment system in this embodiment.

As shown in Fig. 1, the present invention discloses a method for real-time displaying the video stream of the front-view camera in the rear entertainment system, including:

Step S1, obtaining the video stream recorded by the vehicle-mounted front-view camera;

Step S2, optimizing the obtained video stream, so as to obtain the optimized video stream;

In step S3, the obtained optimized video stream is sent to the playback screen in the back row for playback.

Specifically, a video stream refers to the transmission of video data, for example, it can be regarded as a stable and continuous data stream, which involves decoding, modulation, optimization and other video decoding technology processing. Although these processes are complicated, they are carried out continuously without affecting the instant viewing effect.

By adopting the method of the present application, the passengers in the rear row can know the specific situation in front of the vehicle or in other directions, so as to remind the driver when the driver is distracted.

In this embodiment, obtaining the video stream recorded by the vehicle-mounted front-view camera includes:

Obtain the 1080p resolution video stream transmitted by the vehicle's front-view camera through the LVDS harness.

Specifically, LVDS adopts a differential transmission mechanism, and each LVDS signal uses two traces, and the voltage difference between the two traces defines the LVDS signal value. LVDS can realize point-to-point or point-to-multipoint connection, and has the characteristics of low power consumption, low bit error rate, low crosstalk and low radiation. The rear entertainment display can therefore smoothly obtain the video stream recorded by the car's front-view camera.

1080p is a display format that achieves a resolution of 1920×1080 under progressive scanning. Optimizing image information can be performed based on the pixel characteristics of 1920×1080 resolution.

In this embodiment, optimizing the obtained video stream, so that obtaining the optimized video stream includes:

Each frame image in the acquired video stream is processed as follows:

Determine whether the image is taken against the light, if so, then

Apply image sharpening to the image.

Specifically, image sharpening is to compensate the outline of the image, enhance the edge of the image and the part of the grayscale jump, so that the image becomes clear, and it is divided into two types: spatial domain processing and frequency domain processing. Image sharpening is to highlight the edges and contours of objects on the image, or the features of some linear target elements. This filtering method improves the contrast between the edge of the ground object and the surrounding pixels, so it is also called edge enhancement.

Because it is a video stream, the backlighting situation does not always remain the same, and there is a change in video quality. It is necessary to perform image sharpening processing on the overexposed and dark images in each frame, and then return to the original video stream sequence to ensure the continuity of the video. sex.

In this embodiment, after performing image sharpening processing on the image, performing the following processing on each frame of image in the acquired video stream further includes:

Smooths pixels on a sharpened image.

Specifically, there are two types of smooth pixel processing purposes: one is blurring; the other is noise removal. The smoothing filter in the spatial domain is generally carried out by the simple average method, which is to calculate the average brightness value of adjacent pixel points.

In this embodiment, judging whether the image is taken against the light includes:

Obtain pixel group acquisition rules;

Divide each image into multiple pixel sets according to the pixel group acquisition rules;

Obtain the average brightness of each pixel set;

Whether the image is shot against the light is judged according to the average brightness of each pixel set.

Specifically, when calculating the average brightness value of neighboring pixels, the size of the neighborhood is directly related to the smoothing effect. The larger the neighborhood, the better the smoothing effect, but if the neighborhood is too large, the smoothing will cause the loss of edge information. Large, so that the output image becomes blurred, so it is necessary to choose the size of the neighborhood reasonably.

The pixel group acquisition rule performs average division according to the specific image format. For example, in the format of 1080P video, the 1920*1080 image is averagely divided into units of 192*108 pixels, and each 192*108 pixels is defined as a set X _(m,n) , that is, an image is 10*10 sets composition. Translate (x, y) 4 pixels to the left and down in sequence to obtain the sets X _(1,1) , X _(1,2) ... X _(m,n) .

The method of judging whether it is backlight by the average brightness is mainly by comparing the average brightness of each adjacent pixel set, such as taking the average brightness of all pixels in each set, and comparing X _{(m,n )} and X _(m,n-1) , X _(m,n+1) , X _(m-1,n) , X _(m+1,n) brightness average.

To judge whether it is backlighting, for example, when the average brightness value of the set X _(m,n) is greater than 1.5 times the brightness value of each neighborhood set, or when the average brightness value of the adjacent set is greater than the preset threshold, it is proved that the If a segment of the video stream is shot against the light, etc., there is a highlighted area in the collection area that affects video viewing.

In this embodiment, performing image sharpening processing on an image includes:

The Sobel sharpening algorithm is used for image processing on each pixel point in each pixel set, so as to obtain the pixel point information of each pixel point after processing, so as to obtain the sharpened image.

Specifically, the Sobel operator in the Sobel sharpening algorithm is one of the most important operators in pixel image edge detection, and plays a pivotal role in information technology fields such as machine learning, digital media, and computer vision. Technically, it is a discrete first-order difference operator used to calculate an approximation of the first-order gradient of the image brightness function. Using this operator at any point in the image will generate the gradient vector corresponding to that point or its normal vector.

In this embodiment, performing smooth pixel processing on the sharpened image includes:

The sharpened image is iteratively calculated through an anisotropic diffusion filter algorithm to obtain an image after smooth pixel processing.

Specifically, anisotropic diffusion filtering mainly overcomes the defect of Gaussian blur in smoothing images, and anisotropic diffusion preserves image edges when smoothing images.

In the iterative calculation through the anisotropic diffusion filtering algorithm, it is determined whether to diffuse to the surrounding according to the relationship between the current pixel and the surrounding pixels. For example, if there is a large difference between a certain neighboring pixel and the current pixel, it means that this neighboring pixel is likely to be a boundary, then the current pixel will not spread in this direction, and this boundary will be preserved.

In this embodiment, the method for the rear entertainment system to display the video stream of the front-view camera in real time further includes:

Obtain the danger signals generated by the users in the rear row based on the optimized video stream played on the playback screen in the rear row;

Obtain the radar information transmitted by each millimeter-wave radar of the vehicle;

According to the radar information, it is judged whether the distance between the obstacle and the vehicle is less than the preset warning value, and if so, then

The danger signal generated by the user in the rear seat is sent to the vehicle control system, and the vehicle control system generates a braking signal according to the danger signal, so as to stop the vehicle.

In this way, when a special situation occurs to the driver of the vehicle (for example, when the driver has a sudden illness and cannot recognize and evaluate the current state of the vehicle), the danger signal can be generated through the control of the rear passengers, and the vehicle can detect the danger. After receiving the signal, it can be judged according to the radar whether there is indeed an obstacle in the direction of the vehicle, and if so, the vehicle will be controlled.

In this way, it is not only relying on artificial intelligence to take over the vehicle, but to realize the control of the vehicle through the cooperation of passengers and artificial intelligence, so that the certainty of danger is stronger than relying on artificial intelligence alone or artificial intelligence alone, Avoid artificial intelligence misjudgment.

In this embodiment, sending the danger signal generated by the rear row users to the vehicle control system, the vehicle control system generates a braking signal according to the danger signal, so that the vehicle stops include:

Obtain each radar information;

Obtain the distance information of the obstacle closest to the vehicle according to each radar information;

Obtain current vehicle speed information;

Obtain collision time information based on current vehicle speed information and distance information;

Generate braking rate curve information according to the collision time information;

Control the vehicle to stop according to the braking rate curve information.

Specifically, in the face of obstacles, braking is the most basic operation, but it is not the best to stop at the end. According to the specific situation of obstacles, adopt a more appropriate braking strategy.

For example, if the obstacle closest to your own vehicle is still far away from the vehicle, but it is discovered in time, or the speed of the vehicle is not fast, etc., you can choose to brake slowly and remind the driver to give the driver a chance to turn to avoid the obstacle, otherwise, The driver can only passively accept the operation of stopping rapidly on the spot, and loses the flexibility to ensure the safety of the vehicle, especially when there is a car behind, sudden braking may also cause a rear-end collision.

The method of using the braking curve, on the one hand, reduces the secondary damage caused by the emergency braking of the vehicle, and on the other hand, does not lose the effectiveness of the minimum safety guarantee.

In this embodiment, the braking curve can be set manually. For example, when the vehicle is 20 meters away from the obstacle and the vehicle speed does not exceed 60 km/h, manually set a braking curve for the vehicle to brake through experience.

FIG. 2 is a structural diagram of a device for real-time displaying a video stream of a front-view camera in a rear entertainment system according to this embodiment.

As shown in Figure 2, the present invention discloses a device for displaying the video stream of the front-view camera in real time in the rear entertainment system, including: a video stream acquisition module, an optimization module, and a playback module;

The video stream obtaining module is used to obtain the video stream recorded by the vehicle-mounted front-view camera;

An optimization module, configured to optimize the acquired video stream, so as to obtain an optimized video stream;

The playback module is configured to send the obtained optimized video stream to the rear playback screen for playback.

It is worth noting that although only the video stream acquisition module, optimization module, and playback module are disclosed in this system, it does not mean that the composition of this system is only limited to the above-mentioned basic functional modules. On the contrary, the meaning expressed by the present invention is : On the basis of the above-mentioned basic functional modules, those skilled in the art can arbitrarily add one or more functional modules in combination with the prior art to form infinitely many embodiments or technical solutions, that is to say, the system is open rather than closed Yes, because this embodiment only discloses individual basic functional modules, it cannot be considered that the protection scope of the claims of the present invention is limited to the disclosed basic functional modules. At the same time, for the convenience of description, when describing the above devices, the functions are divided into various units and modules and described separately. Of course, when implementing the present application, the functions of each unit and module can be implemented in one or more software and/or hardware.

Fig. 3 is a flow chart of a method for processing over-exposed and over-dark video streams in a specific embodiment.

As shown in FIG. 3 , the present invention discloses a method for processing over-exposed and over-dark video streams.

Cameras are installed in the front, rear, left, and right directions of the vehicle, and the 1080p resolution video in the front, rear, left, and right directions of the vehicle is recorded through the vehicle-mounted surround view camera with the help of software algorithms, and the video is transmitted to the car entertainment system through the LVDS wiring harness;

The in-vehicle entertainment system performs hard decoding on the received 1080p video stream in real time using the integrated graphics GPU, and the decoded video stream records the original image for the camera, and the in-vehicle entertainment system saves the video stream in the memory in the format of mp4 file.

When affected by external factors, there are problems of over-exposure and over-darkness in the original video when shooting, and the problematic video can be edited with the help of the UI of the on-board video editing software.

Step P1, select the over-exposed and over-dark images, and perform sharpening processing on the over-exposed and over-dark images.

Image sharpening method: Take a frame of overexposed and overdark image in the video, divide the 1920*1080 image into units of 192*108 pixels, and define every 192*108 pixels as a set X _{(m,n )} , that is, an image is composed of 10*10 sets; take the average brightness value for each set, for example, when the average brightness value of the set X _(m,n) is greater than 1.5 times the brightness value of each neighborhood set, then There are highlighted areas in this collection area that affect video viewing. Similarly, it is also possible to obtain information that there is an over-dark area in the collection area that affects video watching.

Perform Sobel sharpening processing on the X _{(m, n)} set, use the sharpened X (m, n) and its neighborhood image to compare the local details of the original image, reduce the brightness of the highlighted area, reduce the area, and visualize The degree is strengthened, and the processed local image is used to replace the pixels in the same position of the original image, and the obtained image initially has the ability to distinguish visual details.

Although the effects of overexposure and overdarkening are eliminated at this time, due to the sharpening processing of each pixel set, the sense of screen segmentation becomes stronger, and the next step of smoothing processing is required.

Step P2, smoothing the sharpened video.

Smoothing method: use anisotropic diffusion filter algorithm for iterative calculation; customize the number of filter iterations t and filter coefficient k through the UI;

Iterative formula:

Output after t iterations;

If the processing effect this time does not meet the smoothing requirements, the original image can be re-adjusted for the number of times t and the coefficient k until the preset effect requirements are met.

Regarding the derivation formula,

I is the gray information value of the image, and the number of iterations is t.

The four divergence formulas are to calculate the partial derivative of the current pixel in four directions, n, e, w, s represent the four directions of southeast, northwest;

cN, cS, cE, cW represent the thermal conductivity in four directions;

There are three main parameters that need to be set in the whole formula, the number of iterations t, which is set according to the situation; the larger the value of k related to the thermal conductivity, the smoother it is, and the less likely it is to retain the edge; the larger the value of lambda, the smoother it is.

Step P3, adjusting the playback speed, adjusting the screen size, deleting, and inserting part of the video area to enhance the artistry of the video.

Step P4, adding a watermark to the video, adding producer information, time, location, etc., and recording to prevent theft of the video.

In step P5, use the vehicle entertainment system to integrate the music application, and superimpose the music selected by the user as background music on the video.

Step P6, upload the edited video to the cloud server, and after uploading to the server, download the video from the cloud server to the mobile phone through the app on the mobile phone.

Fig. 4 is a flowchart of a pre-output video stream adjustment processing method according to a specific embodiment.

As shown in FIG. 4 , the present invention discloses a pre-output adjustment processing method of a video stream.

In step P3, adjust the playback speed, adjust the screen size, delete, insert, and enhance the artistry of the video in some areas of the video. The specific operations are as follows:

Step P31, respectively select the start point and end point of the area to be processed, select the playback speed to be processed, and stitch the selected area after processing with the remaining area of the original video.

Step P32, respectively select the start point and end point of the area to be processed, zoom in/out the picture to be processed, and stitch the selected area after processing with the remaining area of the original video.

Step P33, respectively select the start point and end point of the area to be processed, delete the area to be processed, and stitch the remaining areas of the original video.

Step P34, select a certain point of the video as the insertion point, insert the video segment or picture to be inserted into the selected point, and splice with the remaining area of the original video.

Fig. 5 is a flow chart of a method for processing the display size of a video stream in a specific embodiment.

As shown in Fig. 5, the present invention discloses a method for processing the display size of a video stream.

The 1080p resolution video stream is recorded through the front-view camera on the vehicle, and the video stream is transmitted to the rear seat entertainment system of the vehicle through the LVDS wiring harness. The stream records the original image for the camera. Due to external influences, the original image may have many possibilities such as backlight shooting and night shooting, resulting in problems such as blurred content and low resolution of the original video image. Therefore, select images that affect viewing recognition for sharpening and smoothing.

Step P101, selecting over-exposed and over-dark images, and performing sharpening processing on the over-exposed and over-dark images.

Fig. 6 is a schematic diagram of a pixel point selection processing method in a specific embodiment.

As shown in FIG. 6 , this embodiment discloses a pixel point selection processing method.

In step P101, digital image processing is performed on each frame of the original video stream accepted by the rear seat entertainment system. Taking one frame of image as an example, take the second column and second row of pixels from the left in the image as (x, y) , define the pixel point (x, y) to expand 2 pixels around to get 25 points as a set X; each pixel point in the set X can be represented by (x±n, y±n), where n is the distance from the center point (x , the pixel value of y). When there are less than 2 pixels around the (x, y) point, the X set can be reduced accordingly, such as the (a, b) pixel points of the X set.

Translate (x, y) 4 pixels to the left and down in sequence to obtain the sets X _(1,1) , X _(1,2) ... X _(m,n) . Take the average brightness of all pixels in each set, and compare X _(m,n) with X _(m,n-1) , X _(m,n+1) , X _(m-1,n) , X _(m+1,n) average brightness, for example, when the average brightness of adjacent sets is greater than the threshold 47, it proves that there is backlight shooting in this video stream;

This set X _(m,n) produces a very obvious brightness difference, which affects the resolution of video content. Therefore, a total of 9 sets of X _(m,n) and its neighborhood need to be sharpened.

A total of 25*9 pixels in 9 sets of X _(m,n) and its neighborhood are processed by Sobel sharpening algorithm, and each pixel is named g(x, y) after operation, then:

in,

Specifically, the Sobel sharpening algorithm in this embodiment is equivalent to quoting the Sobel edge operator;

The operator includes two sets of 3x3 matrices, which are horizontal and vertical respectively, and plane convolution is performed with the image to obtain the approximate values of the horizontal and vertical brightness differences respectively. If A represents the original image, Gx and Gy represent the images detected by horizontal and vertical edges respectively, the formula is as follows:

The horizontal and vertical gradient approximation values of each pixel of the image can be combined with the following formula to calculate the magnitude of the gradient.

The gradient direction can be calculated with the following formula.

In the above embodiments, if the above angle Θ is equal to zero, it means that the image has a vertical edge, and the left side is darker than the right side.

Step P201, smoothing the sharpened image.

Use the sharpened X _{(m, n)} and its neighborhood image to compare the local details of the original image, the brightness of the highlighted area is reduced, the area area is reduced, and the degree of visualization is enhanced. Use the processed partial image to compare the same position of the original image Pixel replacement, the obtained image initially has the ability to distinguish visual details, but the sense of screen segmentation is strong, and the image processing area in the screen can be clearly perceived, so it is necessary to filter the entire image to achieve the purpose of smooth pixel replacement edge splitting effect, using various The anisotropic diffusion filter algorithm is used for iterative calculation, and the number of iterations is t=3. In order to ensure the image clarity after processing, the coefficient k=30 is taken, and the iterative formula is:

After three iterations, the obtained image is relatively smooth without a sense of fragmentation, and can be displayed as a frame of image.

Step P301, performing image splicing and cropping on the smoothed image.

After performing the above processing on each frame of the video stream, the images can be spliced into a video stream of 60 frames per second. The car rear entertainment system has a built-in universal video player. The player takes the screen length as width and height as height. When recording video When the pixel x on the long side of the stream is > width, the long side of the video is compressed so that x = width, and the short side y is compressed in equal proportions to ensure that the final aspect ratio of the video after adaptive screen remains unchanged.

When recording the short side pixel y>height of the video stream, compress the short side of the video stream so that y=height, and at the same time cut the left and right sides of the long side of the video stream to the same length to ensure that the final video distortion is small after adapting to the screen.

Compared with the prior art, the present invention has the following advantages:

(1) This application uses the Sobel sharpening algorithm for image processing, which optimizes the overexposure of local pixel areas to a certain extent, and improves the visual readability of the video.

(2) The present application uses an anisotropic diffusion filter algorithm to perform iterative calculations to process image information, so that the differences between pixel regions are smoothed out, and the integrity of image information is improved.

(3) This application integrates millimeter-wave radar information and image information into information that jointly warns of obstacles ahead, so that on the one hand, the occupants in the vehicle can accept passive reminders of obstacles, and on the other hand, they can actively locate and identify obstacles. Information such as contours and attributes allows the driver to have more options for dealing with obstacles, such as turning instead of having to brake suddenly.

(4) This application uses the information of warning obstacles ahead as the basis for judging and triggering automatic braking, so that automatic braking has double information sources for cross-validation and improves security.

(5) This application obtains information such as accurate braking distance and evasive route by warning the information of obstacles in front, so as to realize automatic braking in the way of braking curve; while preventing personnel from being greatly injured by collision, it also reduces Minor injuries to personnel caused by excessive braking are eliminated, and personnel safety is further improved.

FIG. 7 is a structural diagram of a hardware structure of an electronic device in this embodiment.

As shown in Figure 7, the present application also discloses an electronic device, including: a processor, a communication interface, a memory, and a communication bus, wherein, the processor, the communication interface, and the memory complete mutual communication through the communication bus; There is a computer program. When the computer program is executed by the processor, the processor executes the steps of the method for displaying the video stream of the front-view camera in real time in the rear seat entertainment system.

The present application also provides a computer-readable storage medium, which stores a computer program executable by an electronic device, and when the computer program runs on the electronic device, the electronic device executes the method for displaying the video stream of the front-view camera in real time in the rear entertainment system A step of.

The communication bus mentioned in the above electronic device may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus or the like. The communication bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.

An electronic device includes a hardware layer, an operating system layer running on the hardware layer, and an application layer running on the operating system. The hardware layer includes hardware such as a central processing unit (CPU, Central Processing Unit), a memory management unit (MMU, Memory Management Unit) and memory. The operating system can be any one or more computer operating systems that realize electronic device control through processes, for example, Linux operating system, Unix operating system, Android operating system, iOS operating system, or windows operating system. And in the embodiment of the present invention, the electronic device may be a handheld device such as a smart phone or a tablet computer, or may be an electronic device such as a desktop computer or a portable computer, which is not particularly limited in the embodiment of the present invention.

The execution subject of electronic device control in the embodiment of the present invention may be an electronic device, or a functional module in the electronic device that can call a program and execute the program. The electronic device can obtain the firmware corresponding to the storage medium. The firmware corresponding to the storage medium is provided by the supplier. The firmware corresponding to different storage media may be the same or different, which is not limited here. After the electronic device obtains the firmware corresponding to the storage medium, it may write the firmware corresponding to the storage medium into the storage medium, specifically burn the firmware corresponding to the storage medium into the storage medium. The process of burning the firmware into the storage medium can be realized by using the existing technology, and will not be repeated in the embodiment of the present invention.

The electronic device can also obtain a reset command corresponding to the storage medium. The reset command corresponding to the storage medium is provided by the supplier. The reset commands corresponding to different storage media can be the same or different, which is not limited here.

At this time, the storage medium of the electronic device is the storage medium in which the corresponding firmware is written, and the electronic device can respond to the reset command corresponding to the storage medium in the storage medium in which the corresponding firmware is written, so that the electronic device can The reset command resets the storage medium in which the corresponding firmware is written. The process of resetting the storage medium according to the reset command can be implemented in the prior art, and will not be described in detail in this embodiment of the present invention.

For the convenience of description, when describing the above devices, the functions are divided into various units and modules and described separately. Of course, when implementing the present application, the functions of each unit and module can be implemented in one or more software and/or hardware.

Those skilled in the art can understand that, unless otherwise defined, all terms (including technical terms and scientific terms) used herein have the same meaning as commonly understood by those of ordinary skill in the art to which this invention belongs. It should also be understood that terms, such as those defined in commonly used dictionaries, should be understood to have meanings consistent with the meanings in the context of the prior art, and will not be used in an idealized or overly formal sense unless specifically defined to explain.

For the method embodiment, for the sake of simple description, it is expressed as a series of action combinations, but those skilled in the art should know that the embodiment of the present invention is not limited by the described action order, because according to the embodiment of the present invention , certain steps may be performed in other order or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification belong to preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

It can be known from the above description of the implementation manners that those skilled in the art can clearly understand that the present application can be implemented by means of software plus a necessary general-purpose hardware platform. Based on this understanding, the essence of the technical solution of this application or the part that contributes to the prior art can be embodied in the form of software products, and the computer software products can be stored in storage media, such as ROM/RAM, disk , optical disc, etc., including several instructions to make a computer device (which may be a personal computer, server or network device, etc.) execute the methods described in various embodiments or some parts of the embodiments of this application.

On the basis of disclosing the electronic equipment and storage medium corresponding to a method and device for displaying the video stream of the front-view camera in real time in the rear-row entertainment system, the present invention also discloses a method for displaying the video stream of the front-view camera in real-time in the rear-row entertainment system Vehicles, specifically:

The electronic device is used to realize the real-time display method of the front-view camera video stream in the rear entertainment system;

Processor, the processor runs the program, and when the program is running, the data output from the electronic device executes the steps of the rear entertainment system to display the video stream of the front-view camera in real time;

The storage medium is used for storing a program, and the program executes the steps of the method for displaying the video stream of the front-view camera in real time by the rear seat entertainment system for the data output from the electronic device when the program is running.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present invention, rather than limiting them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: It is still possible to modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the various embodiments of the present invention. scope.

Claims (10)

1. a rear row entertainment system displays a method for front-view camera video stream in real time, characterized in that, the method for rear row entertainment system real-time display front-view camera video stream comprises: Obtain the video stream recorded by the vehicle's front-view camera; Optimizing the obtained video stream to obtain an optimized video stream; The obtained optimized video stream is sent to the rear playback screen for playback. 2. the rear entertainment system as claimed in claim 1 displays the method for front-view camera video stream in real time, is characterized in that, the video stream that described obtaining vehicle-mounted front-view camera recording comprises: Obtain the 1080p resolution video stream transmitted by the vehicle's front-view camera through the LVDS harness. 3. The method for displaying the video stream of the front-view camera in real time in the rear entertainment system as claimed in claim 2, wherein optimizing the obtained video stream so as to obtain the optimized video stream comprises: Each frame image in the acquired video stream is processed as follows: Determine whether the image is taken against the light, if so, then Apply image sharpening to the image. 4. The method for displaying the video stream of the front-view camera in real time in the rear seat entertainment system according to claim 3, characterized in that, after performing image sharpening processing on the image, each frame in the acquired video stream is The image is further processed as follows: Smooths pixels on a sharpened image. 5. The method for displaying the video stream of the front-view camera in real time in the rear entertainment system according to claim 4, wherein said judging whether the image is shot against the light comprises: Obtain pixel group acquisition rules; Divide each image into multiple pixel sets according to the pixel group acquisition rules; Obtain the average brightness of each pixel set; Whether the image is shot against the light is judged according to the average brightness of each pixel set. 6. The method for displaying the video stream of the front-view camera in real time in the rear entertainment system according to claim 5, wherein said performing image sharpening processing on the image comprises: The Sobel sharpening algorithm is used for image processing on each pixel point in each pixel set, so as to obtain the pixel point information of each pixel point after processing, so as to obtain the sharpened image. 7. The method for displaying the video stream of the front-view camera in real time in the rear entertainment system according to claim 6, wherein said performing smooth pixel processing on the sharpened image comprises: The sharpened image is iteratively calculated through the anisotropic diffusion filter algorithm, so as to obtain the image after smooth pixel processing. 8. The method for displaying the video stream of the front-view camera in real time by the rear entertainment system of claim 7, wherein the method for displaying the video stream of the front-view camera in the rear entertainment system in real time further comprises: Obtaining the danger signals generated by the users in the rear row based on the optimized video stream played on the playback screen in the rear row; Obtain the radar information transmitted by each millimeter-wave radar of the vehicle; According to the radar information, it is judged whether the distance between the obstacle and the vehicle is less than the preset warning value, and if so, then The danger signal generated by the rear seat users is sent to the vehicle control system, and the vehicle control system generates a brake signal according to the danger signal, so as to stop the vehicle. 9. The method for displaying the video stream of the front-view camera in real time in the rear seat entertainment system according to claim 8, characterized in that, the dangerous signal generated by the user in the rear seat is sent to the vehicle control system, and the vehicle control system Generating a brake signal based on the hazard signal to stop the vehicle includes: Obtain each radar information; Obtain the distance information of the obstacle closest to the vehicle according to each radar information; Obtain current vehicle speed information; Obtain collision time information based on current vehicle speed information and distance information; Generate braking rate curve information according to the collision time information; Control the vehicle to stop according to the braking rate curve information. 10. A device for displaying the front-view camera video stream in real time in a rear row entertainment system, characterized in that the device for displaying the front-view camera video stream in real time in the rear row entertainment system includes: A video stream acquisition module, the video stream acquisition module is used to obtain the video stream recorded by the vehicle-mounted front-view camera; An optimization module, the optimization module is used to optimize the obtained video stream, so as to obtain the optimized video stream; A playing module, the playing module is used to send the obtained optimized video stream to the rear playing screen for playing.

Images