CN118528920A - Car door screen projection system - Google Patents

Abstract

The present invention relates to the field of vehicle technology, and discloses a door screen projection system, which includes a door display area and a first camera; the door display area includes a glass layer, a screen layer and a metal layer, and the metal layer is the external structure of the right door; the first camera is arranged at the center of the surface of the metal layer away from the screen layer; the first camera is used to collect image information of the right side of the vehicle, and transmit the image information of the right side of the vehicle to the door display area, and the door display area is used to receive the image information of the right side of the vehicle for display, so as to observe the road conditions on the right side of the vehicle in the vehicle. The present invention enables the driver to directly observe the road condition information on the right side of the vehicle through the co-driver's door in the vehicle, solves the problem that the right side of the vehicle is a visual blind spot, thereby reducing the probability of traffic accidents and improving driving safety.

Description

Car door screen projection system

Technical Field

The invention relates to the technical field of vehicles, and in particular to a door screen projection system.

Background Art

With the popularity of car travel, traffic accidents caused by the visual blind spot on the right side of the vehicle are increasing. The right side of the vehicle has always been the biggest blind spot for drivers, and most traffic accidents occur on the right side. For example, it is difficult for drivers to directly observe vehicles or pedestrians in the right blind spot, so when changing lanes, overtaking or turning right, they may collide with other road users in the area. Therefore, how to observe the visual blind spot on the right side of the car to avoid traffic accidents is a problem that needs to be solved.

Summary of the invention

In view of this, the present invention provides a door screen projection system to solve the problem of traffic accidents caused by the inability to observe the visual blind spot on the right side of the vehicle.

In a first aspect, the present invention provides a vehicle door screen projection system, the system comprising a vehicle door display area and a first camera;

The door display area includes a glass layer, a screen layer, and a metal layer. The metal layer is the outer structure of the right door.

The first camera is arranged at the center of the surface of the metal layer away from the screen layer;

The first camera is used to collect image information on the right side of the vehicle and transmit the image information on the right side of the vehicle to the door display area. The door display area is used to receive the image information on the right side of the vehicle for display so that the road conditions on the right side of the vehicle can be observed in the vehicle.

The door screen projection system provided by the embodiment of the present invention uses the front passenger door as a display area and provides a first camera on the metal layer of the door. The image information of the right side of the vehicle collected by the first camera is displayed in the door display area, so that the driver can directly observe the road condition information on the right side of the vehicle through the front passenger door while in the vehicle, thereby solving the problem of the right side of the vehicle being a visual blind spot, thereby reducing the probability of traffic accidents and improving driving safety.

In an optional embodiment, the system further includes a co-pilot display area and a second camera;

The co-pilot display area is inlaid and fixed in front of the co-pilot;

The second camera is arranged at the bottom edge of the surface of the metal layer away from the screen layer;

The second camera is used to collect image information of the shoulder and the road surface and transmit it to the co-pilot display area. The co-pilot display area is used to receive image information of the shoulder and the road surface for display, so as to observe obstacles on the shoulder and the road surface on the right side of the vehicle in the vehicle.

The door screen projection system provided by the embodiment of the present invention, by setting a display area on the co-pilot and providing a second camera on the door, can display the image information of the shoulder and the road surface collected by the second camera in the co-pilot display area, so that the driver and the co-pilot can directly observe the obstacles on the shoulder and the road surface on the right side of the vehicle while in the car, further reducing the driver's visual blind spots and improving driving safety.

In an optional embodiment, the system further includes a steering wheel display area;

The steering wheel display area is fixed in front of the steering wheel;

The first camera is also used to transmit image information from the right side of the vehicle to the steering wheel display area;

The steering wheel display area is used to receive image information from the right side of the vehicle for display.

The door screen projection system provided by the embodiment of the present invention sets a display area in the steering wheel area, and displays the image information of the right side of the vehicle collected by the first camera in the steering wheel display area, so that the driver does not need to turn his head to observe through the door display area of the front passenger door, but can directly observe the road condition information on the right side of the vehicle through the steering wheel display area, thereby further improving driving safety and the convenience of observing the right side of the vehicle.

In an optional embodiment, the system further includes an information processing module;

The information processing module is used to process the image information of the right side of the vehicle, and transmit the processed image information to the door display area and/or the steering wheel display area for display.

The door screen projection system provided in an embodiment of the present invention processes the collected image information of the right side of the vehicle through an information processing module, so that the processed image is more suitable for display in the door display area and the steering wheel display area, thereby being able to better observe the road condition information on the right side of the vehicle and improve driving safety.

In an optional embodiment, the information processing module also includes an automatic control switch, which is used to control the automatic control switch to turn on when the detected vehicle speed is less than a preset threshold. The automatic control switch is used to control the door display area to display image information on the right side of the vehicle.

The door screen projection system provided by the embodiment of the present invention cannot observe the visual blind spot on the right side of the vehicle, which may cause a great safety hazard when the vehicle is turning at a low speed or about to stop. Therefore, the vehicle speed is detected by the information processing module, and the automatic control switch can be automatically turned on when the vehicle speed is less than a preset threshold, so that the door display area can automatically display the road condition information on the right side of the vehicle, thereby improving driving safety.

In an optional embodiment, the system further includes a parking detection module;

The parking detection module is used to detect the horizontal distance between the vehicle and the curb and the height of the curb, and transmit it to the co-pilot display area for display;

The parking detection module is also used to output a warning reminder message when it detects that the horizontal distance is less than a preset distance threshold, and transmit the warning reminder message to the co-pilot display area for display.

The door screen projection system provided by the embodiment of the present invention detects the horizontal distance between the vehicle and the curb and the height of the curb through the parking detection module when parking and displays them in the co-pilot display area. It can promptly issue warning reminder information when there are safety hazards in the driver's parking, and display the warning reminder information in time to facilitate the driver to park.

In an optional embodiment, the system further includes a collision detection module and a collision warning module;

The collision detection module is used to detect within a preset range of the vehicle, and when an object is detected, continuously detect the moving speed of the object and the horizontal distance between the object and the vehicle, and transmit the outline mark and horizontal distance of the object to the door display area and/or the steering wheel display area for display;

The collision detection module is also used to determine whether a collision with a vehicle will occur based on the moving speed and horizontal distance of the object;

The collision warning module is used to generate a simulated collision animation and transmit it to the door display area and/or the steering wheel display area for display when the collision detection module detects that an object has collided with the vehicle.

The door screen projection system provided by the embodiment of the present invention detects that there is an object near the vehicle through the collision detection module, continuously detects the moving speed and horizontal distance of the object, and displays the outline mark and horizontal distance of the object, so that the driver can intuitively observe the situation outside the vehicle. By detecting whether a collision occurs, if a possible collision is detected, the collision warning module will generate a simulated collision animation and display it in the door display area and/or steering wheel display area, so that the driver can adjust the vehicle in time to avoid a collision, thereby improving driving safety.

In an optional embodiment, the system further includes a display control switch, and the display control switch is used to control the display of image information of the right side of the vehicle in the door display area.

The door screen projection system provided by the embodiment of the present invention, by setting a display control switch, allows the driver to manually control whether the door display area is displayed, thereby improving convenience and ensuring driving safety.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

FIG1 is a schematic diagram of a door screen projection system according to an embodiment of the present invention;

FIG2 is a schematic diagram of a door display area according to an embodiment of the present invention;

FIG3 is a schematic diagram of a first camera according to an embodiment of the present invention;

4 is an exemplary diagram of a viewing area of a door display area according to an embodiment of the present invention;

FIG5 is a schematic diagram of the structure of a door display area according to an embodiment of the present invention;

FIG6 is a schematic diagram of a co-pilot display area according to an embodiment of the present invention;

7 is a flowchart of a parking detection module according to an embodiment of the present invention;

FIG. 8 is a flowchart of the collision detection module and the collision warning module according to an embodiment of the present invention.

DETAILED DESCRIPTION

In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

The door screen projection system provided by the embodiment of the present invention uses the passenger door as a display area to display road condition information on the right side of the vehicle, thereby solving the problem of traffic accidents caused by the visual blind spot on the right side of the vehicle, and improving driving safety.

In this embodiment, a door screen projection system is provided. FIG1 is a schematic diagram of a door screen projection system according to an embodiment of the present invention, and the system includes: a door display area and a first camera; the door display area includes a glass layer, a screen layer and a metal layer, and the metal layer is the external structure of the right door; the first camera is arranged at the center position of the surface of the metal layer away from the screen layer; the first camera is used to collect image information of the right side of the vehicle, and transmit the image information of the right side of the vehicle to the door display area, and the door display area is used to receive the image information of the right side of the vehicle for display, so as to observe the road conditions on the right side of the vehicle in the vehicle.

Specifically, FIG. 2 is a schematic diagram of a door display area according to an embodiment of the present invention. As shown in FIG. 2 , the door display area is located at the front passenger door, including the door part and the frame part of the door, and can be divided into area A, area B, area C, area D and area E. FIG. 3 is a schematic diagram of a first camera according to an embodiment of the present invention. As shown in FIG. 3 , the first camera is located at the center of the metal layer of each interval shown in FIG. 2 . Optionally, if the first camera is a wide-angle camera, one can be installed in any of the five intervals for the purpose of cost saving, and the other intervals can be installed. The embodiment of the present invention takes the first camera as an ordinary camera and is installed in all the five areas as an example. Referring to FIG. 2 , the viewing angle of the first camera in area A is mainly the front part of the vehicle, and the viewing angle of the first camera in area B is mainly the right side of the vehicle. FIG. 4 is an example diagram of the field of view of the door display area according to an embodiment of the present invention. As shown in FIG. 4 , the angles between the first camera viewing angle in area A and the first camera viewing angle in area B of the door display area and the horizontal line are both 30°, from which it can be seen that the field of view formed by the first camera in area A and the first camera in area B is 120°. Optionally, the viewing angles of the first cameras in areas A and B can be dynamically adjusted through real vehicle training, and FIG4 is only an example and is not intended to be limiting. In addition, the viewing angles of the first cameras in areas C, D, and E are all level viewing. FIG5 is a schematic diagram of the structure of a door display area according to an embodiment of the present invention. As shown in FIG5, the five areas of the door display area all include a glass layer, a screen layer, and a metal layer. Among them, the glass layer is an internal protective layer, the screen layer is a door projection screen, and the metal layer is the outer protective layer of the vehicle. By using the co-driver's door as a display area to display the road condition information on the right side of the vehicle, the problem of the right side of the vehicle being a visual blind spot is solved, thereby reducing the possibility of traffic accidents and improving driving safety.

In some optional embodiments, the door screen projection system also includes a co-pilot display area and a second camera; the co-pilot display area is embedded and fixed in front of the co-pilot; the second camera is arranged at the bottom edge of the surface of the metal layer away from the screen layer; the second camera is used to collect image information of the shoulder and the road surface and transmit it to the co-pilot display area, and the co-pilot display area is used to receive image information of the shoulder and the road surface for display, so as to observe obstacles on the shoulder and the road surface on the right side of the vehicle in the vehicle.

Specifically, Figure 6 is a schematic diagram of the co-pilot display area according to an embodiment of the present invention. As shown in Figure 6, the co-pilot display area is area F shown in Figure 6. The first camera set in area A shown in Figure 2 can be used as the second camera, and the second camera can be additionally set in area A according to actual needs. The embodiment of the present invention is not limited to this. The embodiment of the present invention takes the first camera in area A as the second camera as an example. Since the second camera is located at the bottom edge of the vehicle, it can collect image information of the shoulder and the road surface and display it in the co-pilot display area, so that the obstacles on the shoulder and the road surface on the right side of the vehicle can be understood, further reducing the driver's visual blind spot and improving driving safety.

In some optional embodiments, the system also includes a steering wheel display area; the steering wheel display area is fixed in front of the steering wheel; the first camera is also used to transmit image information from the right side of the vehicle to the steering wheel display area; the steering wheel display area is used to receive image information from the right side of the vehicle for display.

Specifically, by displaying the image information of the right side of the vehicle collected by the first camera on the steering wheel display area, the driver does not need to turn his head to observe through the door display area of the front passenger door, but can directly observe the road condition information on the right side of the vehicle through the steering wheel display area, thereby further improving driving safety and the convenience of observing the right side of the vehicle.

In some optional embodiments, the system also includes an information processing module; the information processing module is used to perform image processing on the image information of the right side of the vehicle, and transmit the processed image information to the door display area and/or the steering wheel display area for display.

Specifically, for the image information of the right side of the car to be transmitted to the door display area, according to the partition of the door display area shown in FIG. 2, assuming that the first camera is a wide-angle camera, the image information of the right side of the car collected by the first camera set in area A and area B is a wide-angle image, which needs to be proportionally enlarged and reduced before display. Assuming that the first camera is an ordinary camera, the image information of the right side of the car collected by the first camera set in area A and area B can be proportionally enlarged and reduced according to actual needs. However, since the screen layers of areas C, D and E are relatively narrow, the redundant images in the image information on the right side of the car need to be cropped before display. Among them, the redundant images can be repeated images of images collected from other areas, or images that exceed the area, and can also be cropped according to needs, and the present invention does not limit this. As for the image information on the right side of the vehicle to be transmitted to the steering wheel display area, as shown in FIG2, since the window is not provided with the first camera, the image information on the right side of the vehicle corresponding to the window cannot be obtained. In order to fully display the road condition information on the right side of the vehicle, the image information on the right side of the vehicle collected by the first camera set in area A, area B, area C, area D and area E in FIG2 is required, and the image information on the right side of the vehicle corresponding to the window is supplemented and displayed by any existing image supplementation method. For example, firstly, the images collected in the above five intervals are used to perform image stitching by any existing image stitching method. Then, a deep neural network is used for image supplementation, such as using a convolutional neural network to generate image content that conforms to the window. If the vehicle is in a driving state, the consistency and continuity of the image in the time series must also be considered. Technologies such as optical flow estimation and video inter-frame prediction can be introduced to ensure that the image information on the right side of the window changes with the movement of the vehicle. Finally, through contrast adjustment, color balance and noise reduction, the image of the window part obtained by supplementation can be naturally integrated with the images of other areas. The collected image information of the right side of the vehicle is processed by the information processing module, so that the processed image is more suitable for display in the door display area and the steering wheel display area, so that the road condition information on the right side of the vehicle can be better observed and driving safety can be improved.

In some optional embodiments, the information processing module also includes an automatic control switch, which is used to control the automatic control switch to turn on when the detected vehicle speed is less than a preset threshold. The automatic control switch is used to control the door display area to display image information on the right side of the vehicle.

Specifically, taking the preset threshold of 3m/s as an example, when the vehicle speed is less than 3m/s, the vehicle may be turning at a low speed or about to stop. At this time, the right side of the vehicle is not visible, and pedestrians or cyclists may collide with the vehicle, which poses a great safety hazard. Therefore, the information processing module can control the automatic control switch to turn on, so that the door display area automatically displays the image information of the right side of the vehicle. At this time, the driver can directly observe the road condition information on the right side of the vehicle to ensure driving safety.

In some optional embodiments, the system also includes a parking detection module; the parking detection module is used to detect the horizontal distance between the vehicle and the curb and the height of the curb, and transmit it to the co-pilot display area for display; the parking detection module is also used to output a warning reminder message when it detects that the horizontal distance is less than a preset distance threshold, and transmit the warning reminder message to the co-pilot display area for display.

Specifically, the parking detection module uses a laser radar arranged in area A shown in FIG2 to perform the above detection process. The warning reminder information can be the screen of the entire co-pilot display area flashing red, displaying text prompt content or displaying a simulated warning animation. This is only an example and is not limited to this. Optionally, while the co-pilot display area displays the warning reminder information, the parking detection module can also transmit the warning reminder information to the voice module of the vehicle for voice broadcasting. The voice broadcast content can be the content of the warning reminder information, or it can be a self-set alarm information. The embodiment of the present invention does not limit this. The parking detection module uses a laser radar to continuously detect the distance between the vehicle and the curb, and outputs a warning reminder information when the distance is less than a preset distance threshold, so that the driver can park safely. In addition, the parking detection module detects the height of the curb through a laser radar, which can provide support for the driver when he needs to drive to the curb to park.

In some optional embodiments, FIG. 7 is a flowchart of the parking detection module according to an embodiment of the present invention. As shown in FIG. 7 , the laser radar first identifies the curb, then detects the horizontal distance between the vehicle and the curb and the height of the curb, and transmits it to the co-pilot display area. Optionally, the co-pilot display area has displayed image information. In order to more intuitively display the situation outside the vehicle, the horizontal distance and the height of the curb can be calibrated on the image information. Then, the laser radar detects whether the horizontal distance is less than the preset distance threshold. When the horizontal distance is less than the preset distance threshold, the vehicle may collide with the curb. At this time, the parking detection module outputs a warning reminder message and transmits the warning reminder message to the co-pilot display area for display.

In some optional embodiments, the system also includes a collision detection module and a collision warning module; the collision detection module is used to perform detection within a preset range of the vehicle, and when an object is detected, continuously detects the moving speed of the object and the horizontal distance between the object and the vehicle, and transmits the object's outline mark and horizontal distance to the door display area and/or steering wheel display area for display; the collision detection module is also used to determine whether a collision with the vehicle will occur based on the moving speed and horizontal distance of the object; the collision warning module is used to generate a simulated collision animation and transmit it to the door display area and/or steering wheel display area for display when the collision detection module detects that an object has collided with the vehicle.

Specifically, the collision detection module also uses a laser radar arranged in area A shown in FIG. 2 for detection. The object can be an object or a human body, and the embodiment of the present invention does not limit this. When the collision detection module detects that there is an object near the vehicle, the moving speed and horizontal distance of the object are continuously detected, and the contour mark and horizontal distance of the object are displayed in the door display area and/or the steering wheel display area, so that the driver can intuitively observe the position relationship between the object and the vehicle. In addition, based on the moving speed and horizontal distance, whether a collision occurs is detected. For example, the movement trend of the object can be judged based on the moving speed and horizontal distance of the object. If the object shows an unstable path of travel, it is considered that a collision will occur. Alternatively, if it is detected that the horizontal distance does not belong to a safe distance, it is considered that a collision will occur. Optionally, other methods can be used to detect whether an object and a vehicle collide, and the embodiment of the present invention does not limit this. If it is detected that the object and the vehicle will collide, the collision warning module will generate a simulated collision animation and display it in the door display area and/or the steering wheel display area, so that the driver can adjust the vehicle in time to avoid a collision, thereby improving driving safety.

In some optional embodiments, FIG8 is a flowchart of a collision detection module and a collision warning module according to an embodiment of the present invention. As shown in FIG8, the collision detection module detects an object within a preset range through a laser radar. If an object is detected, the laser radar continuously detects the moving speed of the object and the horizontal distance between the object and the vehicle. The collision detection module transmits the contour mark and horizontal distance of the object to the door display area and/or the steering wheel display area for display. Then, the collision detection module detects whether a collision will occur between the object and the vehicle. If a collision is detected, the collision warning module will generate a simulated collision animation and transmit it to the door display area and/or the steering wheel display area for display.

In some optional embodiments, the system further includes a display control switch, and the display control switch is used to control the display of image information on the right side of the vehicle in the door display area.

Specifically, assuming that the vehicle wants to change lanes to the right while driving at high speed, in order to eliminate the safety hazard caused by the visual blind spot on the right side of the vehicle, a display control switch can be set so that the driver can manually control whether the door display area is displayed, and then observe the road conditions on the right side of the vehicle, which improves convenience and ensures driving safety.

The door screen projection system provided by the embodiment of the present invention uses the front passenger door as a display area and provides a first camera on the metal layer of the door. The image information of the right side of the vehicle collected by the first camera is displayed in the door display area, so that the driver can directly observe the road condition information on the right side of the vehicle through the front passenger door while in the vehicle, thereby solving the problem of the right side of the vehicle being a visual blind spot, thereby reducing the probability of traffic accidents and improving driving safety.

Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the present invention, and such modifications and variations are all within the scope defined by the appended claims.

Claims (8)

1. A door screen projection system, the system comprising a door display area and a first camera;

the vehicle door display area comprises a glass layer, a screen layer and a metal layer, wherein the metal layer is an external structure of the right vehicle door;

the first camera is arranged at the center of the surface of one side of the metal layer far away from the screen layer;

The first camera is used for collecting image information on the right side of the vehicle, transmitting the image information on the right side of the vehicle to the vehicle door display area, and the vehicle door display area is used for receiving the image information on the right side of the vehicle and displaying the image information so as to observe road conditions on the right side of the vehicle in the vehicle.

2. The system of claim 1, further comprising a co-pilot display area and a second camera;

The copilot display area is inlaid and fixed at the front position of the copilot;

The second camera is arranged at the bottom edge of the metal layer, which is far away from the surface of one side of the screen layer;

the second camera is used for acquiring image information of the road shoulder and the road surface and transmitting the image information to the copilot display area, and the copilot display area is used for receiving the image information of the road shoulder and the road surface and displaying the image information so as to observe the obstacle condition of the road shoulder and the road surface on the right side of the vehicle in the vehicle.

3. The system of claim 1, further comprising a steering wheel display area;

The steering wheel display area is fixed at the front position of the steering wheel;

the first camera is also used for transmitting the image information on the right side of the vehicle to the steering wheel display area;

The steering wheel display area is used for receiving and displaying the image information on the right side of the vehicle.

4. The system of claim 3, further comprising an information processing module;

The information processing module is used for carrying out image processing on the image information on the right side of the vehicle and transmitting the processed image information to the vehicle door display area and/or the steering wheel display area for display.

5. The system of claim 4, wherein the information processing module further comprises an automatic control switch, the information processing module further configured to control the automatic control switch to be turned on in a case where the detected vehicle speed is less than a preset threshold, the automatic control switch being configured to control the vehicle door display area to display image information on the right side of the vehicle.

6. The system of claim 2, further comprising a parking detection module;

the parking detection module is used for detecting the horizontal distance between the vehicle and the curb and detecting the height of the curb, and transmitting the horizontal distance and the height of the curb to the copilot display area for display;

The parking detection module is also used for outputting warning reminding information when the horizontal distance is detected to be smaller than a preset distance threshold value, and transmitting the warning reminding information to the copilot display area for display.

7. The system of claim 3, further comprising a collision detection module and a collision early warning module;

The collision detection module is used for detecting within a preset range of a vehicle, continuously detecting the moving speed of an object and the horizontal distance between the object and the vehicle under the condition that the object is detected, and transmitting the outline mark of the object and the horizontal distance to the vehicle door display area and/or the steering wheel display area for display;

The collision detection module is further used for judging whether collision can occur with a vehicle or not based on the moving speed of the object and the horizontal distance;

the collision early warning module is used for generating simulation collision animation to be transmitted to the vehicle door display area and/or the steering wheel display area for display under the condition that the collision detection module detects that an object collides with the vehicle.

8. The system of claim 1, further comprising a display control switch for controlling the display of image information on the right side of the vehicle by the door display area.