JP2020178302A - Communication device - Google Patents

Abstract

To provide a communication device that can provide, for use of a TV conference or the like, an image taken with an infrared camera that photographs the crew of a vehicle.SOLUTION: A communication device 1 according to the present invention includes: an infrared camera 2 for photographing the crew of a vehicle; an image processing unit 3 for converting an image captured with the infrared camera 2 into a color image to generate an output image; a communication unit 4 for transmitting the output image to the outside of the vehicle and receiving an input image from the outside of the vehicle; and a display 5 for displaying the output image or the input image.SELECTED DRAWING: Figure 1

Description

The present invention relates to a communication device using an infrared camera for photographing a occupant of a vehicle.

In recent years, the development of a technique of providing a camera on a vehicle to photograph the state of an occupant has been progressing. ing. This occupant monitoring device estimates the seatbelt wearing state of the occupant by imaging the seatbelt formed of the material containing infrared rays with an infrared camera and specifying the form of the seatbelt from the captured image. .. The reason why infrared cameras are used for occupant monitoring devices in this way is that visible light cameras cannot take good pictures when the sun is shining, at night, when occupants wear sunglasses, etc., so it is possible to make such pictures possible. is there.

Japanese Unexamined Patent Publication No. 2018-118671

By the way, if the occupant is photographed with a camera, it is convenient if the occupant can participate in a video conference or the like by using the photographed image. For example, when the vehicle is automatically driven, the driver is also released from the driving operation, so that the time can be effectively utilized by participating in the meeting while moving by the vehicle.

However, the image taken by the infrared camera is black and white, and the pupil of the photographed occupant may shine, so it is not suitable for use as it is for a video conference or the like. On the other hand, if a visible light camera is installed for a video conference or the like, there is a problem that the existing infrared camera is not effectively used and the cost is high.

The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a communication device capable of using an image taken by an infrared camera for photographing a occupant of a vehicle for use in a video conference or the like.

In order to solve the above problems, the communication device according to the present invention includes an infrared camera that captures a vehicle occupant, an image processing unit that converts an image captured by the infrared camera into a color image, and generates an output image. It is characterized by including a communication unit that transmits an output image to the outside of the vehicle and receives an input image from the outside of the vehicle, and a display unit that displays the output image or the input image.

The image processing unit may detect a scenery portion in which the scenery outside the vehicle is reflected in the captured image and replace the scenery portion with another image to generate the output image.

Further, the image processing unit may detect a person portion in which the occupant is captured in the captured image and replace the background portion other than the person portion with another image to generate the output image.

Further, the image processing unit may detect a face portion in which the face of the occupant is reflected in the captured image and replace the face portion with an image of the character to generate the output image.

According to the communication device according to the present invention, the captured image of the infrared camera that captures the occupant of the vehicle can be used for video conferencing and the like.

It is explanatory drawing which shows the structure of the communication apparatus which concerns on embodiment for carrying out an invention. It is explanatory drawing which shows the example which the output image and the input image are displayed on the display of FIG. It is explanatory drawing which shows the example which converts the photographed image into a color image, and generates an output image by the image processing unit of FIG. It is explanatory drawing which shows the example which replaces the landscape part in a photographed image with a fixed image, and generates an output image by the image processing unit of FIG. It is explanatory drawing which shows the example which replaces the background part of an occupant in a photographed image with a fixed image, and generates an output image by the image processing unit of FIG. It is explanatory drawing which shows the example which replaces the face part of the occupant in the photographed image with the image of a character, and generates an output image by the image processing unit of FIG.

A mode for carrying out the present invention will be described with reference to the drawings.

As shown in FIG. 1, the communication device 1 according to the present embodiment is provided in a vehicle (not shown) and includes an infrared camera 2, an image processing unit 3, a communication unit 4, and a display 5.

The infrared camera 2 is used for a occupant monitoring device or the like, and is provided on an instrument panel, a steering column, or the like of a vehicle to photograph the upper body of a occupant of the vehicle. The image processing unit 3 processes the captured image of the infrared camera 2 (in the present embodiment, a video rather than a still image) as described later to generate an output image Io, and the communication unit 4 generates the output image Io. Is transmitted to the outside of the vehicle, and the input image Ii is received from the outside of the vehicle. As shown in FIG. 2, the display 5 is provided on the instrument panel 6 of the vehicle, and can display the output image Io and the input image Ii generated by the image processing unit 3 at the same time or by switching.

As shown in FIG. 3, when the occupant 7, the vehicle window 8 and the steering wheel 9 are captured in monochrome in the captured image Ic of the infrared camera 2, the image processing unit 3 is the skin portion which is the skin portion of the occupant 7. 7a and Hattori 7b, which is a part of clothes, are detected. Then, the skin portion 7a is colored based on the skin color of the occupant registered in advance, and the Hattori 7b is colored based on the preset favorite color of the occupant to color the captured image Ic. Convert to an image to generate an output image Io. The communication unit 4 transmits the output image Io to the outside of the vehicle and uses it for video conferencing and the like.

As shown in FIG. 4, the image processing unit 3 has a view portion (a portion in which the view of the vehicle window is reflected or may be reflected) 8a in the window 8 due to the edge of the window frame or the like of the window 8. It is also possible to detect 8b and replace the landscape portions 8a and 8b with fixed images (images that do not change at all or hardly change even if they flow as an image) 10a and 10b to generate an output image Io. The fixed images 10a and 10b may be a single-color image or an image composed of a plurality of colors such as a gradation, and some pattern may be drawn, and the design is not particularly limited.

Further, as shown in FIG. 5, the image processing unit 3 detects a person portion (a portion composed of the skin portion 7a and the hat portion 7b in the same figure) in which the occupant 7 is captured, and the other background portion 11 with time. It is also possible to generate an output image Io by replacing it with a fixed image 12 that does not change to. The design of the fixed image 12 is not particularly limited as in the fixed images 10a and 10b, but the entire background is replaced by the fixed image 12, and the output image Io makes it impossible to see the interior of the vehicle. , The fixed image 12 may be used as an image of a conference room or the like.

Further, as shown in FIG. 6, the image processing unit 3 detects the face portion in which the face of the occupant 7 is reflected (the portion composed of the skin portion 7a in the figure), and also detects the direction, line of sight, and facial expression of the face. Then, the face portion can be replaced with the image 13 of the (color) character to generate an output image Io that reproduces the direction, line of sight, and facial expression of the face. The image of the character is an image of a deformed dog in the figure, but it can be various images of other animals, people, fictitious creatures, and the like.

The communication device 1 according to the present embodiment includes an infrared camera 2 that captures a vehicle occupant, an image processing unit 3 that converts an image Ic captured by the infrared camera 2 into a color image, and generates an output image Io, and an output image. Since the communication unit 4 that transmits Io to the outside of the vehicle and receives the input image Ii from the outside of the vehicle and the display 5 that displays the output image Io and / or the input image Ii are provided, the captured image of the infrared camera 2 is provided. By transmitting the color output image Io generated by the image processing unit 3 instead of the Ic itself to the outside of the vehicle by the communication unit 4, the captured image Ic can be inexpensively used for video conferencing and other communication purposes. Can be done.

Further, since the output image Io and the input image Ii are displayed on the display 5 at the same time or by switching, the occupant can confirm the output image Io transmitted to the communication partner and the face of the communication partner. You can hold a video conference while watching.

When the image processing unit 3 detects the scenery portions 8a and 8b in which the scenery outside the vehicle is captured in the captured image Ic and replaces the scenery parts 8a and 8b with the fixed images 10a and 10b to generate the output image Io. In You can also protect your privacy.

Further, the image processing unit 3 detects a person portion (skin portion 7a and hat portion 7b) in which the occupant 7 is captured in the captured image Ic, replaces the background portion 11 other than the person portion with the fixed image 12, and outputs the image Io. In addition to preventing the situation where the communication partner dynamically sees annoying images and the image sickness of the communication partner, the communication partner does not even know that the occupant is in the vehicle, which further increases the occupant's image. You can protect your privacy.

On the other hand, when the image processing unit 3 detects the face portion (skin portion 7a) in which the face of the occupant 7 is reflected in the captured image Ic and replaces the face portion with the character image 13 to generate the output image Io. Is particularly suitable for private communication between family members and friends, because communication becomes smoother and communication has an entertaining element, rather than communicating with the communication partner with the actual face of the occupant.

Although the embodiments for carrying out the present invention have been illustrated above, the embodiments of the present invention are not limited to those described above, and may be appropriately modified without departing from the spirit of the invention.

For example, in the above embodiment, the output image Io and the input image Ii are displayed simultaneously or switched on the display 5, but only one of them may be displayed, and an image that replaces the background portion 11 is displayed. Is desirable, but is not limited to, such as the fixed image 12, which does not give dynamic annoyance.

1 Communication device 2 Infrared camera 3 Image processing unit 4 Communication unit 5 Display (display unit)
7 Crew 7a Skin (face)
8a, 8b Scenery part 10a, 10b Fixed image (other images)
11 Background part 12 Fixed image (other images)
Ic captured image Ii input image Io output image

Claims (4)

An infrared camera that captures the occupants of the vehicle,
An image processing unit that converts an image taken by the infrared camera into a color image and generates an output image.
A communication unit that transmits the output image to the outside of the vehicle and receives an input image from the outside of the vehicle.
A communication device including a display unit for displaying the output image or the input image. Claim 1 is characterized in that the image processing unit detects a landscape portion in which a landscape outside the vehicle is captured in the captured image, replaces the landscape portion with another image, and generates the output image. The communication device described in. Claim 1 is characterized in that the image processing unit detects a person portion in which the occupant is captured in the captured image, replaces a background portion other than the person portion with another image, and generates the output image. The communication device described in. The first aspect of claim 1, wherein the image processing unit detects a face portion in which the face of the occupant appears in the captured image, replaces the face portion with an image of a character, and generates the output image. Communication device.

Images