CN100498928C - Image interpolation device and display device - Google Patents

Abstract

An image interpolation device (310) includes: a characteristic amount calculation unit (313) for calculating a characteristic amount of pixels according to pixels located in an area to be interpolated and pixels in the vicinity of the pixels; an image interpolation processing unit (314) for extracting a pixel having the largest characteristic amount from the pixels located in the area to be interpolated and setting the pixel value of the pixel as the pixel value of the interpolation pixel; a resolution conversion processing unit (315) for subjecting the image data in which the interpolation pixel has been interpolated by the video interpolation processing unit (314), to resolution conversion; and a display control processing unit (316) for performing control to rearrange a plurality of image data including at least one image data which has been subjected to the resolution conversion by the resolution conversion processing unit (315) into a predetermined display format and displaying the data.

Description

Image interpolation device and display device

technical field

The present invention relates to a technique for interpolating the pixel value of a certain pixel based on the pixel values of pixels located near the pixel.

Background technique

JP-A-6-186526 and JP-A-2000-137443 disclose display devices capable of simultaneously displaying two screens with one liquid crystal display (LCD). According to this display device, for example, different screens can be displayed for persons in the driver's seat and the passenger's seat. In addition, JP-A-11-331876 and JP-A-9-46622 disclose display devices that simultaneously display two types of video on the same screen.

However, in the case of displaying image data from a plurality of video sources on one display unit, it is necessary to perform resolution (resolution) conversion on each image data (for example, setting the image horizontal resolution of each video to 1/2, so that the resolution conversion of "dual-screen display" is performed). However, if the simple resolution conversion of thinning out pixels is performed, the video becomes incomprehensible depending on the displayed content of the video.

Japanese Patent Laid-Open No. 2004-104368 discloses a technique for solving this problem. Specifically, the average or weighted average of a plurality of pieces of pixel data around the position where the pixel data is to be interpolated is calculated to create interpolation data.

However, in the technique disclosed in Japanese Patent Application Laid-Open No. 2004-104368, interpolation data that averages or weights averages a plurality of pixel data around the position where pixel data interpolation is to be performed is collectively produced. Interpolation data that blurs the pixels that add character to the image. Therefore, there is a problem that the image quality is significantly degraded along with the resolution conversion of the image data.

For example, even if the luminance levels of adjacent pixels deviate, interpolation data that is averaged or weighted averaged between the pixel and surrounding pixels can be created, so that the feature added to the image in the original image can be added. The luminance level of the pixel is smoothed to the luminance level of the surrounding pixels, and the interpolation data is made by processing the pixels that add features to the image indefinitely. When the image data is converted to the resolution, there is a problem with the image quality. Significant deterioration of the problem.

Contents of the invention

The present invention is conceived to solve at least the above-mentioned problems of the prior art, and an object of the present invention is to provide an image interpolation device and a display device for suppressing image quality degradation accompanying resolution conversion of image data.

In order to solve the above problems and achieve the purpose, the image interpolation device and display device of the present invention calculate the feature value of the pixel according to the pixel located in the above-mentioned interpolation target area and the nearby pixels of the pixel, and according to whether the pixel has a feature in the image to determine the pixel value of the interpolated pixel.

The image interpolation device and display device of the present invention have the effect of suppressing image quality degradation accompanying resolution conversion of image data and maintaining the characteristics of the original image.

Description of drawings

FIG. 1 is a conceptual diagram of a display device according to an embodiment of the present invention.

Fig. 2 is a perspective view showing mounting of the display device shown in Fig. 1 on a vehicle.

FIG. 3 is a cross-sectional view of the display unit shown in FIG. 1 .

FIG. 4 is a schematic diagram of the structure of the display panel viewed from the front.

FIG. 5 is a circuit diagram showing an outline of a TFT substrate.

FIG. 6 is a block diagram showing the display device shown in FIG. 1 .

FIG. 7 is a block diagram of the image output unit 211 shown in FIG. 6 .

FIG. 8 is a block diagram of the control unit 200 shown in FIG. 6 .

FIG. 9 is a block diagram of the memory 218 shown in FIG. 6 .

Fig. 10 is a block diagram showing the configuration of the image interpolation device of the first embodiment.

FIG. 11A is an explanatory diagram for explaining a two-screen display method.

FIG. 11B is an explanatory diagram for explaining a 2-view display method.

FIG. 12 is an explanatory diagram illustrating calculation of feature quantities.

FIG. 13 is a conceptual diagram for explaining processing contents of a feature amount calculation unit and an image interpolation processing unit.

FIG. 14 is a conceptual diagram for explaining resolution conversion processing and processing contents of a display control processing unit.

Fig. 15A is an explanatory diagram (Part 1) for explaining a specific example of image interpolation processing.

Fig. 15B is an explanatory diagram (Part 2) for explaining a specific example of image interpolation processing.

Fig. 16 is a flowchart of image interpolation processing.

FIG. 17 is an explanatory diagram for explaining a modified example of the display device shown in FIG. 1 .

FIG. 18 is an explanatory diagram for explaining a modified example of the display device shown in FIG. 1 .

Symbol Description

1: 1st image source; 2: 2nd image source; 3: 1st image data; 4: 2nd image data; 5: display control unit; 6: display data; 7: display unit; 8: first display image ;9: second display image; 10: observer; 11: observer; 12: passenger seat; 13: driver's seat; 14: windshield; 15: operation part; 16: speaker; 100: LCD panel; 101: backlight ;102: polarizing plate; 103: polarizing plate; 104: TFT substrate; 105: liquid crystal layer; 106: color filter; 107: glass substrate; 108: parallax barrier; Pixels; 110: Pixels for display on the right side (driver's seat side); 111: Display panel driver; 112: Scanning line driver circuit; 113: Data line driver circuit; 114: TFT element; 115~118 data lines; 119~ 121: scanning line; 122: pixel electrode; 123: sub-pixel; 124: touch panel; 200: control unit; 201: CD/MD playback unit; 202: radio receiving unit; 203: TV receiving unit; 204: DVD playback unit 205: HD (Hard Disk) playback unit; 206: navigation unit; 207: distribution circuit; 208: first image adjustment circuit; 209: second image adjustment circuit; 210: sound adjustment circuit; 211: image output unit; 212 : VICS information receiving unit; 213: GPS information receiving unit; 214: selector; 215: operating unit; 216: remote control sending and receiving unit; 217: remote controller; 218: memory; 219: external audio/video input unit; 220: Camera; 221: brightness detection unit; 222: occupant detection unit; 223: rear display unit; 224: ETC vehicle-mounted device; 225: communication unit; 226: first writing circuit; 227: second writing circuit; 228: VRAM (Video RAM); 229: interface; 230: CPU; 231: program storage unit; 232: data storage unit; 233: first image RAM; 234: second image RAM; 235: image quality setting information storage unit; 236 : Environment adjustment value holding unit; 310: Image interpolation device; 311: Image data input unit; 312: Image data input control unit; 313: Feature quantity calculation unit; 314: Image interpolation processing unit; 315: Resolution Conversion processing unit; 316: display control processing unit; 317: display unit; 320: AV unit; 330: navigation unit.

Detailed ways

Embodiments of the present invention will be described below with reference to the drawings. However, the technical scope of the present invention is not limited to these embodiments, but extends to the invention described in the scope of the claims and its equivalent scope.

FIG. 1 is a conceptual diagram of a display device of the present invention. In the figure, 1 is the first image source, 2 is the second image source, 3 is the first image data from the third image source, 4 is the second image data from the second image source, 5 is the display control part, 6 7 is the display part (such as a liquid crystal panel, etc.), 8 is the first display image based on the first image source 1, 9 is the second display image based on the second image source 2, and 10 is the position opposite to the display part 7. An observer (user) on the left side, and 11 is an observer (user) on the right side with respect to the display unit.

The conceptual diagram of FIG. 1 conceptually shows that according to the relative positions of the observers 10 and 11 with respect to the display unit 7, in other words, according to the angle of view relative to the display unit 7, the observer 10 can actually see the first display image 8 at the same time, The observer 11 sees the second display image 9 , and each of the display images 8 , 9 can be viewed in full on the entire display screen of the display unit 7 . In FIG. 1 , the first image source 1 is, for example, a movie image of a DVD player, a received image of a TV set, etc., and the second image source 2 is, for example, a map of a car navigation device, a route guidance image, etc., and the first image data 3 and Each of the second image data 4 is supplied to the display control unit 5, and they are processed so as to be displayed on the display unit 7 substantially simultaneously.

The display unit 7 supplied with the display data 6 from the display control unit 5 is constituted by a liquid crystal panel or the like provided with a parallax barrier described later. Half of the total pixels in the horizontal direction of the display unit 7 are used for displaying the first display image 8 by the first pixel source 1 , and the remaining half of the pixels are used for displaying the second display image 9 by the second image source 2 . The observer 10 on the left side of the display unit 7 can only see the pixels corresponding to the first display image 8 , and the second display image 9 is blocked by the parallax barrier formed on the surface of the display unit 7 and cannot actually be seen. On the other hand, the observer 11 located on the right side of the display unit 7 can only see the pixels corresponding to the second display image 9 , and the first display image 8 cannot actually be seen because it is blocked by the parallax barrier. Furthermore, the structures disclosed in JP-A-10-123462 and JP-A-11-84131 can be applied to the parallax barrier, for example.

With this configuration, different information and contents can be provided to left and right users on a single screen. Of course, if the first and second image sources 1 and 2 are the same, the left and right users can see the same image as conventionally.

Fig. 2 is a perspective view showing an example of mounting the multi-view display device of the present invention on a vehicle. In the figure, 12 is a passenger's seat, 13 is a driver's seat, 14 is a windshield, 15 is an operation part, and 16 is a speaker.

The display unit 7 of the multi-view display device in FIG. 1 is disposed on the instrument panel at the approximate center of the driver's seat 13 and the passenger's seat 12 as shown in FIG. 2 , for example. Various operations on the multi-view display device are performed by operating a touch panel (not shown) integrally formed on the surface of the display unit 7 , the operation unit 15 , or an infrared or wireless remote controller (not shown). Speakers 16 are arranged on the windows of the vehicle to output sounds linked to displayed images, warning sounds, and the like.

The observer 11 in FIG. 1 is seated on the driver's seat 13 , and the observer 10 is seated on the passenger seat 12 . The image that can be seen from the first viewing direction (driver's seat side) relative to the display unit 7 is, for example, an image of a map of a car navigation system, etc., and the image that can actually be viewed from the second viewing direction (passenger seat side) is, for example These are TV reception images, DVD movie images, and the like. Therefore, the driver in the driver's seat 13 can watch TV, DVD, etc. while receiving the driving assistance from the navigation system. In addition, since each image is displayed on a screen of, for example, 7 inches as a whole, the screen size will not be reduced as in the conventional multi-view display. That is, for the driver and fellow passengers, it is possible to provide optimal information and content to each of them as if they had separate dedicated displays.

FIG. 3 is a schematic diagram of a cross-sectional structure of the display unit 7 . In the figure, 100 is a liquid crystal panel, 101 is a backlight, 102 is a polarizing plate disposed on the backlight side of the liquid crystal panel, 103 is a polarizing plate disposed on the front side of the light emitting direction of the liquid crystal panel, and 104 is a TFT (Thin FilmTransistor (thin film transistor) substrate, 105 is a liquid crystal layer, 106 is a color filter substrate, 107 is a glass substrate, and 108 is a parallax barrier. The structure of the liquid crystal panel 100 is a pair of substrates with a liquid crystal layer 105 sandwiched between a TFT substrate 104 and a color filter substrate 106 disposed opposite thereto between two polarizing plates 102, 103, and disposed on The parallax barrier 108 and the glass substrate 107 on the front side of the light emitting direction are arranged slightly away from the backlight 101 . In addition, the liquid crystal panel 100 has pixels composed of RGB colors (three primary colors).

Each pixel of the liquid crystal panel 100 is divided into left (passenger seat side) display and right (driver seat side) display for display control. Therefore, the display pixels on the left side (the passenger's seat side) are blocked by the parallax barrier 108 and the display on the right side (the driver's seat side) can be seen from the left side (the passenger's seat side). In addition, the display pixels on the right side (driver's seat side) are blocked by the parallax barrier 108 to the left side (passenger's seat side), and can be viewed from the right side (driver's seat side). Thus, different displays can be provided to the driver's seat and fellow passengers. That is, map information for navigation is given to the driver, and at the same time, it is possible to let fellow passengers watch DVD movies, etc. Furthermore, by changing the configuration of each pixel of the parallax barrier 108 and the above-mentioned liquid crystal panel 100 , it is also possible to form a structure in which different images are displayed in multiple directions such as three directions. In addition, the parallax barrier 108 itself may be configured with an electrically driven liquid crystal shutter or the like to make the viewing angle variable.

Fig. 4 is a schematic view of the structure of the display panel viewed from the front, and Fig. 3 is a cross section taken along line A-A' of Fig. 4 . In the figure, 109 is a pixel for left (passenger seat side) display, and 110 is a pixel for right (driver's seat side) display. 3 and 4 show, for example, a part of the liquid crystal panel 100 in which 800 pixels are arranged in the horizontal direction and 480 pixels are arranged in the vertical direction. The left (passenger seat side) display pixels 109 and the right (driver's seat side) display pixels 110 are grouped vertically and arranged alternately. The parallax barriers 108 are arranged at certain intervals in the horizontal direction, and the same in the vertical direction. Thus, when the display panel is viewed from the left, the parallax barrier 108 hides the right (driver's seat side) display pixels 110 and the left (passenger seat side) display pixels 109 are visible. Also, when viewed from the right side, the parallax barrier 108 hides the left (passenger seat side) display pixels 109 and the right (driver seat side) display pixels 110 are visible. Furthermore, in the vicinity of the front, since both the left (passenger seat side) display pixels 109 and the right (driver's seat side) display pixels 110 can be seen, the left display image and the right display image are actually superimposed. See. Here, the left side (passenger seat side) display pixels 109 and the right side (driver's seat side) display pixels 110 alternately arranged in FIG. 4 have RGB colors as shown in FIG. The R column, the G column, and the B column may be configured in a single color, or may be configured as a plurality of RGB mixed columns.

FIG. 5 is a circuit diagram showing an outline of the TFT substrate 104 . 111 is a display panel driving unit, 112 is a scanning line driving circuit, 113 is a data line driving circuit, 114 is a TFT element, 115-118 are data lines, 119-121 are scanning lines, 122 is a pixel electrode, and 123 is a sub-pixel. As shown in FIG. 5 , a plurality of sub-pixels 123 are formed by taking the area surrounded by the respective data lines 115 to 118 and the respective scanning lines 119 to 121 as a unit. A pixel electrode 122 for applying a voltage to the liquid crystal layer 105 and a TFT element 114 for switching and controlling the pixel electrode 122 are formed in each sub-pixel. The display panel driving unit 111 controls the driving timing of the scanning line driving circuit 112 and the data line driving circuit 113 . The scanning line driving circuit 112 performs selective scanning of the TFT element 114 , and the data line driving circuit 113 controls the voltage applied to the pixel electrode 122 .

The above plurality of sub-pixels transmit the first pixel data (for displaying the left image) to the data lines 115 and 117, for example, based on the composite data of the first image data 3 and the second image data 4 or the respective image data of the first and second images. In addition, the second image data (for right image display) is sent to the data lines 116 and 118 to form a first image data group displaying the first image and a second image data group displaying the second image.

FIG. 6 is a block diagram showing the outline of the display device of the present invention, which is an application example to a so-called audio visual navigation (Audio Visual Navigation) combination machine. In the figure, 12 is a touch panel, 200 is a control unit, 201 is a CD/MD player, 202 is a radio receiver, 203 is a TV receiver, 204 is a DVD player, and 205 is an HD (Hard Disk: hard disk) player 206 is a navigation section, 207 is a distribution circuit, 208 is a first image adjustment circuit, 209 is a second image adjustment circuit, 210 is a sound adjustment circuit, 211 is an image output section, 212 is a VICS information receiving section, and 213 is a GPS information Receiving part, 214 is a selector, 215 is an operation part, 216 is a remote control sending and receiving part, 217 is a remote controller, 218 is a memory, 219 is an external sound/image input part, 220 is a camera, 221 is a brightness detection unit, 222 is a In the occupant detection unit, 223 is a rear display unit, 224 is an ETC vehicle-mounted device, and 225 is a communication unit.

The display unit 7 includes a touch panel 124 , a liquid crystal panel 100 , and a backlight 101 . As described above, the liquid crystal panel 100 of the display unit 7 can actually simultaneously display an image viewed from the driver's seat side as the first viewing direction and an image viewed from the passenger's seat side as the second viewing direction. . Furthermore, a flat panel display other than a liquid crystal panel, for example, an organic EL display panel, a plasma display panel, a cold cathode flat panel display, or the like may be used for the display unit 7 .

The control unit 200 distributes images, sounds, etc. from various sources (CD/MD player 201, radio receiver 202, TV receiver 203, DVD player 204, HD player 205, and navigation unit 206) to the distribution circuit 207. , if it is an image, it is distributed to the first image adjustment circuit 208 and the second image adjustment circuit 209 , and if it is a sound, it is distributed to the sound adjustment circuit 210 . Then, in the first and second image adjustment circuits 208 and 209 , the brightness, color tone, contrast, etc. are adjusted, and each adjusted image is displayed on the display unit 7 by the image output unit 211 . In addition, in the sound adjustment circuit 210, allocation to each speaker, volume sound, etc. are adjusted, and the adjusted sound is output from the speaker.

FIG. 7 is a block diagram showing an outline of the image output unit 211 . In the figure, 226 is a first writing circuit, 227 is a second writing circuit, and 228 is a VRAM (Video RAM: video memory).

The image output unit 211 includes, for example, as shown in FIG. For example, the first writing circuit 226 is based on the image data corresponding to the odd-numbered columns among the image data adjusted in the first image adjusting circuit 208 (that is, the image data for the first display image 8 in FIG. The writing circuit 227 writes the image data corresponding to the even-numbered columns (i.e., the image data for the second display image 9 in FIG. relevant area in VRAM228. Furthermore, the display panel driver 111 is a circuit for driving the liquid crystal panel 100 , and drives corresponding pixels of the liquid crystal panel 100 based on the image data held in the VRAM 228 (synthesized data of the first image data 3 and the second image data 4 ). In addition, since image data is written in the VRAM 228 in such a manner as to correspond to the composited image for multi-view display of the first image data 3 and the second image data 4, there may be only one driving circuit, and its operation may be limited. The operation is the same as that of the driving circuit of a general liquid crystal display device. In addition, as another configuration, it is conceivable to use a first display panel driving circuit and a second display panel that drive corresponding pixels of the liquid crystal panel 100 based on the respective image data without synthesizing the first image data 3 and the second image data 4 . Drive circuit.

Here, if an example of various sources shown in FIG. 6 is to be described, when the HD player 205 is selected, music data such as MP3 files and JPEG files stored on the hard disk (HD) are read out. Image data such as image data, map data for navigation, etc., menu display for selecting music data, image data, etc. can be displayed on the display unit 7 .

The navigation unit 206 includes a map information storage unit storing map information for navigation, and can obtain information from the VICS information receiving unit 212 and the GPS information receiving unit 213 to create and display an image for navigation operations. In addition, the television receiver 203 receives analog TV broadcast waves and digital TV broadcast waves from an antenna via a selector 214 .

FIG. 8 is a block diagram showing an outline of the control unit 200 . In the figure, 229 is an interface, 230 is a CPU, 231 is a storage unit, and 232 is a data storage unit.

The control unit 200 controls the distribution circuit 207 and various sources, and displays the selected two sources or one source. In addition, the control unit 200 displays on the display unit 7 an operation menu for controlling these various sources. Here, as shown in FIG. 8 , the control unit 200 includes a CPU 230 configured by a microprocessor or the like, and controls each unit, each circuit, and the like in the display device as a whole through an interface 229 . The CPU 230 is provided with a program storage unit 231 having a ROM storing various programs necessary for the operation of the display device, and a data storage unit 232 having a RAM storing various data. Furthermore, ROM, RAM, and the like may be built in the CPU, or may be installed externally for use. In addition, the ROM may be an electrically rewritable nonvolatile memory such as a flash memory.

The user can perform each of the above-mentioned operations by operating the touch panel 124 mounted on the surface of the display unit 7, switches provided around the display unit 7, or performing input operations such as voice recognition or selection operations using the operation unit 215. provenance control. In addition, an input or selection operation may be performed with the remote controller 217 via the remote control transmitting and receiving unit 216 . The control unit 200 performs control including control from various sources in accordance with operations of the touch panel 124 , the operation unit 215 , and the like. In addition, the control unit 200 is configured to be able to control the respective volumes and the like of the plurality of speakers 16 installed in the vehicle as shown in FIG. 2 using the sound adjustment circuit 210 . In addition, the control unit 200 performs control to store various setting information such as image quality setting information, programs, and vehicle information in the memory 218 .

FIG. 9 is a block diagram showing an outline of the memory 218 . In the figure, 233 is a first screen RAM, 234 is a second screen RAM, 235 is image quality setting information storage means, and 236 is an environment adjustment value storage means.

The memory 218 has, for example, as shown in FIG. 9 : a first screen RAM 233 and a second screen RAM 234 that can respectively write the image quality adjustment values of the first image and the second image set by the user; The image quality setting information storage unit 235 used for each image quality adjustment of the first image and the second image of the adjustment value; The value holding unit 236 is adjusted for the environment. The image quality setting information storage unit 235 and the environment adjustment value storage unit 236 are composed of an electrically rewritable nonvolatile memory such as a flash memory or a battery-backed volatile memory.

An image from, for example, a rear monitoring camera 220 connected to the external audio/image input unit 219 may also be displayed on the display unit 7 . Furthermore, in addition to the camera 220 for rear monitoring, a video camera, a game machine, etc. may be connected to the external audio/image input unit 219 .

The control unit 200 can change the output image, sound, etc. based on information detected by the brightness detection unit 221 (for example, a light switch of a vehicle, a light sensor, etc.), the occupant detection unit 222 (for example, a pressure sensor installed on a seat), etc. The setting of the positioning position, etc.

223 is a rear display unit provided for the rear seat of the vehicle, and the same image as that displayed on the display unit 7 can be displayed via the image output unit 211 , or either an image for the driver's seat or an image for the passenger seat can be displayed.

The control unit 200 performs charge display and the like from the ETC vehicle-mounted device 250 . In addition, the control unit 200 can also control the communication unit 225 for wireless connection with a mobile phone, etc., and perform related display.

Next, image interpolation processing in the display device will be described. The part that executes the image interpolation processing in the display device is the display control unit 5 in the conceptual diagram of FIG. 1 , and the first image adjustment circuit 208 and the second image adjustment circuit 209 in the block diagram of FIG. 6 . In brief description, an image interpolation device in which a portion related to image interpolation processing is particularly extracted will be described.

Preferred embodiments in the case where the image interpolation device of the present invention is mounted on a vehicle will be described in detail below with reference to the drawings. In addition, after describing the outline and features of the image interpolation device of the present invention, the image interpolation device of the first embodiment will be described below, and finally various modifications (embodiment 2) will be described as other embodiments.

Summary and Features

First, the outline and features of the image interpolation device of the present invention will be described. Fig. 10 is a block diagram showing the configuration of the image interpolation device of the first embodiment. As shown in the figure, this image interpolation device 310 is configured to be connected to an AV unit 320 and a navigation unit 330 .

Among them, the AV unit 320 is a DVD player that reads video signals and the like stored on a DVD (not shown) and outputs them to the image interpolation device 310 . Specifically, the image data of the DVD video is output to the image interpolation device 310 at the same time as a display request of the DVD video is made in accordance with an instruction from a vehicle occupant. Furthermore, the AV unit 320 is not limited to DVD, and may have functions such as a compact disk, a hard disk, a radio, and a television.

In addition, the navigation unit 330 is a device that provides route guidance based on predetermined route information set in advance and position information of the own vehicle. Specifically, a "navigation" image is created based on the planned route information of the vehicle set by the vehicle occupant (for example, the driver) and the position information obtained by the GPS receiver from the artificial satellite, and the resulting The image data of the “navigation” image is output to the image interpolation device 310 .

Thus, when the AV unit 320 and the navigation unit 330 are mounted on the vehicle, the DVD video output from the AV unit 320 and the navigation video output from the navigation unit 330 are displayed on the display unit 317 of the image interpolation device 310 . Furthermore, in the first embodiment, the resolution of the display unit 317 is set to 800×480, the resolution of the image data of the DVD video is set to 800×480, and the resolution of the image data of the navigation video is set to 800×480. 800×480.

At this time, when a display request is received from both the AV unit 320 and the navigation unit 330 in such a display unit 317 , two 800×480 images need to be displayed on the display unit 317 having a resolution of 800×480.

Therefore, if the respective videos are displayed in the 2-screen display mode and the 2-view display mode without overlapping, each of the image data of the DVD video and navigation video to be displayed needs to be converted to 1/2 horizontal resolution.

Among them, the 2-screen display method, as shown in FIG. 11A , divides the screen of the display unit 317 into left and right to display the DVD video v1 and the navigation video in such a way that the occupants on the driver's seat side and the passenger side's side can enjoy two images. The method of v2 is a method that can perform appropriate display when both the occupants on the driver's seat side and the passenger side's side want to enjoy the video of both parties.

In addition, the 2-view display method is a display method as shown in FIG. 11B , that is, a parallax optical device ( For example, through the slit vertically), let the viewer on the right side relative to the display unit 317 (that is, the passenger on the side of the driver’s seat) appreciate the navigation image v2, and let the viewer on the left side relative to the display unit 317 (that is, The occupant on the side of the front passenger seat) enjoys DVD video v1, which is suitable for preventing the occupant in the driver's seat from looking away while driving.

Furthermore, in the first embodiment, the image interpolation process is performed only on the image data of the navigation video. In this way, the reason for concentrating the processing object of the image interpolation processing only on the navigation image is that it is easy to cause such a situation: due to the resolution conversion of the image data of the navigation image, pixel defects such as characters, symbols, etc. The content causing the image cannot be understood. However, as another embodiment, of course, image interpolation processing may be performed on both the DVD video v1 and the navigation video v2.

Here, the image interpolation device 310 of the present invention calculates the feature value of the pixel located in the interpolation target area and the neighboring pixels relative to the pixel, based on the calculated feature value of the pixel located in the interpolation target area , has a main feature in the image interpolation process for determining the pixel value of the interpolation pixel, and by this image interpolation process, it is possible to suppress the deterioration of the image quality accompanying the resolution conversion of the image data.

To describe this main feature in detail, the image interpolation device 310 calculates the pixel located on the interpolation area and the pixels in the vicinity relative to the pixel in the original image data of the navigation image v2, as shown in FIG. 12 . The feature quantity of the pixel. Furthermore, in the first embodiment, in order to perform 1/2 horizontal resolution conversion, the interpolation target area is set to two dots of odd-numbered dots (dots) and even-numbered dots, and when determining the pixel value of the interpolation pixel The range of nearby pixels to be referred to is 1 bit to the right of the interpolation target area. In addition, the calculation of the feature quantity is performed for the respective components of the RGB digital signal.

The feature value is an index indicating how the pixel value of the pixel located in the interpolation target area is compared with the pixels located in other interpolation target areas and nearby pixels. The absolute value of the difference between the pixel value of the pixel of interest and the average value of the pixel values of the pixels located in the interpolation target area and the pixel values of nearby pixels is calculated. For example, if the feature value is large, it indicates a pixel that changes more rapidly than nearby pixels (that is, a pixel that characterizes an image), and if the feature value is small, it shows a pixel that changes less than nearby pixels.

Using the example in FIG. 12 for illustration, the image interpolation device 310 first obtains the pixel value "P1" of "pixel 1" located on the interpolation target area A for the "R" digital signal of the original RGB digital signal and " The feature value |P1-(P1+P2+P3)/3| of the pixel 1" is similarly calculated as the feature value |P2-(P1+P2+P3)/3| of the "pixel 2". Then, the features of "pixel 1" and "pixel 2" in the digital signals of "G" and "B" are calculated in the same way.

In addition, this image interpolation device 310 compares the feature quantities of "pixel 3" and "pixel 4" located on the interpolation target area B, and the feature quantities of "pixel 5" and "pixel 6" located on the interpolation target area C , and the feature quantities of "pixel m" and "pixel n" located on the interpolation target area N are also calculated in the same manner.

Next, since the image interpolation device 310 preferentially adopts the pixel value of the pixel that adds features to the image on the original image as the pixel value of the interpolation pixel, it determines the interpolation value based on the feature value of the pixel located in the interpolation target area. The pixel value of the pixel. Specifically, among the pixels located in the interpolation target region, the pixel value of the pixel whose feature value exceeds the threshold value is determined as the pixel value of the interpolation pixel.

In this way, by determining the pixel value of the pixel exceeding the appropriate threshold value as the pixel value of the interpolation pixel. By using the pixel value of the characteristic pixel as the pixel value of the interpolation pixel, it is possible to suppress image quality degradation accompanying resolution conversion of pixel data. Furthermore, in connection with this, by using the pixel values of the pixels that add features to the image on the original image without performing processing such as averaging or weighted averaging, it is possible to easily maintain the original image (that is, the original image before performing resolution conversion). image.

For example, as in the interpolation target region A, when the feature value |P1-(P1+P2+P3)/3| of "pixel 1" is greater than or equal to the threshold "THRESH", the pixel value of "pixel 1" is "P1" determines the pixel value to be an interpolation pixel (that is, the interpolation target area A). Furthermore, when the feature value of either "pixel 1" or "pixel 2" is greater than or equal to the threshold value, it is desirable to use the pixel value of the pixel with the larger feature value as the pixel value of the interpolation pixel.

Also, as in the interpolation target area C, when both the feature values of "Pixel 5" and "Pixel 6" are smaller than the threshold value "THRESH", the "Pixel 5" and "Pixel 5" located on the interpolation target area C are The pixel values "P5" and "P6" of "Pixel 6" each determine a pixel value to be an interpolation pixel (that is, an interpolation target region C).

Therefore, if the above-mentioned example of the prior art is used to describe, the pixel value of the interpolation pixel is determined by determining the pixel value of the pixel exceeding an appropriate threshold value, which is modeled after the pixel on which the feature is added to the image on the original image. For the pixel value, the pixel value of the pixel that adds features to the image in the original image is preferentially used as the pixel value of the interpolation pixel, instead of averaging multiple pixel data around the position of the interpolation pixel data by uniformly making or The weighted average interpolation data is made into interpolation data in which pixels to which features are added are blurred. As in the main feature described above, it is possible to suppress image quality degradation accompanying resolution conversion of image data.

Furthermore, in connection with this, by using the pixel values of the pixels that add features to the image in the original image without performing processing such as averaging or weighted average, the original image (that is, the original image before the resolution conversion) can be easily maintained. image.

Example 1

Next, the image interpolation device of the first embodiment will be described. Here, after the configuration of the image interpolation device according to the first embodiment has been described, various processing procedures of the image interpolation device will be described.

Configuration of image interpolation device

Fig. 10 is a block diagram showing the configuration of the image interpolation device of the first embodiment. As shown in the same figure, the image interpolation device 310 includes: an image data input unit 311; an image data input control unit 312; an adjustment amount calculation unit 313; an image interpolation processing unit 314; a resolution conversion processing unit 315; processing unit 316; display unit 317.

Among them, the image data input unit 311 is a processing unit that inputs the image data output from the AV unit 320 and/or the navigation unit 330 to the feature value calculation unit 313 according to an image data input instruction from the image data input control unit 312 . Furthermore, in the first embodiment, it is disclosed that a DVD video is input from the AV unit 320 (image resolution is set to 800×480), and a navigation video is input from the navigation unit 330 (similarly, the resolution is set to 800×480). the embodiment.

Image data input control unit 312 is a processing unit that controls the number of input systems of image data input from image data input unit 311 to feature value calculation unit 313 in response to a display request from AV unit 320 and/or navigation unit 330 .

For example, when a display request of a DVD video is received from the AV unit 320, an instruction is given to input image data of DVD video v1 to the image data input unit 311, and when a display request of a navigation video is received from the navigation unit 330, An instruction is given to input the image data of the navigation video v2 to the image data input unit 311 . In addition, when a DVD video display request and a navigation video display request are accepted from the AV unit 320 and the navigation unit 330 , an instruction is given to input image data of the DVD video v1 and the navigation video v2 from the image input unit 311 .

The feature value calculation unit 313 is a processing unit that calculates the feature value of a pixel located in the interpolation target area and its neighbor pixels with respect to the pixel in the vicinity of the pixel based on the image data input from the image data input unit 311 . Specifically, as shown in FIG. 12, first, for the digital signal "R" of the original RGB digital signal, the difference between the pixel value "P1" of "pixel 1" located in the area A to be interpolated and the value of the pixel value "P1" located in the area A to be interpolated is calculated. The absolute value of the difference between the average value of the pixel values "P1", "P2" of "Pixel 1" and "Pixel 2" and the average value of the pixel value "P3" of the nearby pixel "Pixel 3", calculates the feature of "Pixel 1" The quantity |P1-(P1+P2+P3)/3|, similarly calculates the feature quantity |P2-(P1+P2+P3)/3| of "pixel 2". Then, the feature quantities of "pixel 1" and "pixel 2" in the digital signals of "G" and "B" are calculated in the same way.

Furthermore, the feature amount calculation unit 313 calculates the feature amounts of "pixel 3" and "pixel 4" located in the interpolation target area B, and the feature amounts of "pixel 5" and "pixel 6" located in the interpolation target area C, The feature values of "pixel m" and "pixel n" located on the interpolation target region N are also calculated in the same manner. In addition, based on the above gist, the feature value calculation unit 313 and the image interpolation processing unit 314 process only the image data of the navigation video, but the image interpolation processing may be performed on both the DVD video v1 and the navigation video v2.

The image interpolation processing unit 314 determines the pixel value of the interpolation pixel based on the feature value of the pixel located in the interpolation target area. Specifically, among the pixels located in the interpolation target area, the pixel with the largest feature value calculated by the feature value calculation unit 313 is extracted, and if the feature value of the extracted pixel is greater than or equal to a threshold value, the pixel value of the pixel is determined. The pixel value to use as the interpolated pixel.

Using the example of the interpolation target region A shown in FIG. 2", the magnitude relationship of the feature value |P2-(P1+P2+P3)/3| is compared, and the pixel (for example, "pixel 1") with the largest feature value is extracted. Then, when the extracted feature value of "Pixel 1" is greater than or equal to the threshold value "THRESH", the pixel value "P1" of "Pixel 1" is determined as an interpolation pixel (that is, a pixel in the interpolation target area A) value.

In addition, as in the interpolation target area B, when the extracted feature value of "pixel 4" is smaller than the threshold value "THRESH", the pixel values of "pixel 3" and "pixel 4" located in the interpolation target area B are "P3" and "P4" each determine a pixel value to be an interpolation pixel (that is, the pixel target area B).

In this way, by extracting the pixel with the largest feature value among the pixels located in the interpolation target area, it is possible to extract pixels with a high probability of giving features to the original image from the interpolation target area, and it is possible to extract the pixels of the pixels that give the image features in the original image Values are used more preferentially as the pixel values of the interpolated pixels.

The resolution conversion processing unit 315 is a processing unit that performs resolution conversion on a plurality of pieces of image data on which interpolation pixels have been interpolated by the image interpolation processing unit 314 . For example, when the image data of the DVD video v1 and the image data of the navigation video v2 input from the image interpolation processing unit 314 are displayed on the display unit 317 in a two-view display mode, the RGB digital signal becomes as shown in FIG. Dot configuration like that.

Therefore, the resolution conversion processing unit 315 thins out the odd-numbered dots "G" in the image data of DVD video v1, and at the same time thins out the even-numbered dots "R" and "B" of the 1/2 horizontal resolution. transform.

Correspondingly, the resolution conversion processing unit 315 thins out the odd-numbered dots "R" and "B" in the image data of the navigation video v2, and at the same time thins out the even-numbered dots "G" for 1/2 level analysis. Image transformation.

In this manner, by performing resolution conversion on a plurality of pieces of image data interpolated with interpolation pixels by image interpolation processing, it is possible to perform resolution conversion while suppressing deterioration of image quality of the image data.

The display control processing unit 316 controls to display the array of image data whose resolution has been converted by the resolution conversion processing unit 315 in a predetermined display method (two-view display method in the first embodiment). processing department. Specifically, an arrangement replacement process of replacing the RGB digital signal arrangement of the DVD video v1 and the navigation video v2 subjected to resolution conversion by the resolution conversion processing unit 315 with the dot arrangement shown in FIG. 14 is performed (that is, The digital signals "R", "B", and "G" of the DVD image are arranged and replaced every other, and the digital signals "G", "R", and "B" of the navigation image are arranged and replaced every other processing) and display.

In the example shown in FIG. 14 , since G is off, R is on, and B is on for one point for a viewer who is located in the right direction with respect to the display unit 317, the viewer in the right direction with respect to the display unit 317 The viewer (the passenger on the driver's seat side) displays magenta which is the complementary color of "R"+"B".

The video pixel data generated by these processes is compared with the data shown in FIG. 15A in which the original pixels are simply expressed as pixel groups extracted from one of even-numbered pixels or odd-numbered pixels in one frame, as shown in FIG. 15B , since a high-value component indicating a high (large) variation between pixels remains, there is no large pixel degradation, and a certain degree of good visibility can be ensured.

In this way, by performing control so that a plurality of image data including at least one resolution-converted image data is arranged and displayed in a predetermined display format, multiple display formats can be displayed in one display format without providing a new configuration. A plurality of image data are displayed on each display unit.

The order of various processes

The procedure of various processes performed by the image interpolation device of the first embodiment will be described below. FIG. 16 is a flowchart showing the procedure of image interpolation processing. In this image interpolation process, when a DVD video display request and a navigation video display request are received from the AV unit 320 and the navigation device 330, if the setting of the display method related to these display requests is not an exclusive setting but two-screen display and In the coexistence display mode such as 2 view display, the process starts.

As shown in the same figure, when a request to display a DVD video and a display request for a navigation video are received from the AV unit 320 and the navigation device 330 (Yes in step S601), the image data input unit 311 follows the DVD video v1 and the navigation video. For each input system of v2, these image data are input to the feature value calculation unit 313 (step S602).

Then, the feature value calculating unit 313 sequentially calculates feature values of pixels located in the interpolation target region based on the image data input from the image data input unit 311 (step S603 ). Next, the image interpolation processing unit 314 extracts the pixel having the largest feature value calculated by the feature value calculation unit 313 among the pixels located in the interpolation target area (step S604 ).

Here, when the feature value of the extracted pixel is greater than or equal to the threshold (Yes in step S605), the image interpolation processing unit 314 determines the pixel value of the pixel as the pixel value of the interpolation pixel (step S606). On the other hand, when the feature value of the extracted pixel is smaller than the threshold (NO in step S605), the pixel values of the pixels located in the interpolation target area are determined as the pixel values of the interpolation pixels (step S607).

Then, when the pixel values of the interpolation pixels have been determined for all interpolation target regions (Yes in step S608), the image interpolation processing unit 314 generates image data reflecting the pixel values of each interpolation pixel (step S609 ). And, when the pixel value of the interpolation pixel has not been determined for all the interpolation target regions (NO in step S608), the above steps are repeated until the pixel value of the interpolation pixel is determined for all the interpolation target regions. Processing of S603-S607.

Next, the resolution conversion processing unit 315 executes 1/2 horizontal resolution conversion processing on each of the image data of the navigation video and the image data of the DVD video interpolated by the interpolation pixel by the image interpolation processing unit 314 (step S610).

Then, the display control processing unit 316 replaces the arrangement of the image data of the navigation video and the image data of the DVD video, which have been subjected to the 1/2 horizontal resolution conversion processing by the resolution conversion processing unit 315, into a predetermined display format and displays (step S611).

Finally, when one of the navigation image or the DVD image, or both of the navigation image and the DVD image are finished (affirmatively in step S612), the process ends; Negative), repeat the above steps S602 to S611.

As mentioned above, if the image interpolation device 310 of the present embodiment 1 is used, the pixel with the largest feature value among the pixels located in the interpolation target area is extracted, and if the feature value of the extracted pixel is greater than or equal to the threshold value, the pixel is The pixel value of is determined as the pixel value of the interpolation pixel. Therefore, it is possible to extract a pixel with a high probability of characterizing the image in the original image from the interpolation target area, and use the pixel value of the extracted pixel as the pixel value of the interpolation pixel. Using it more preferentially can more effectively suppress image quality degradation accompanying the resolution conversion of image data.

Example 2

Heretofore, the embodiments of the present invention have been described, but the present invention can also be implemented in various embodiments within the scope of the technical idea described in the scope of the above-mentioned patent application other than the above-mentioned first embodiment.

For example, in Embodiment 1, an embodiment in which the image interpolation processing of the present invention is performed when a plurality of display requests (that is, requests for display of DVD video and navigation video) are accepted, the present invention does not Limited to this, the present invention is equally applicable regardless of whether there are one display request or multiple display requests. In particular, even when there is only one display request, the present invention can be applied to image data that requires resolution conversion (for example, when a resolution conversion corresponding to a relatively small display unit such as a mobile phone is required). The image interpolation processing of the present invention can obtain higher effects.

In addition, in Embodiment 1, an embodiment was described in which, among the pixels located in the interpolation target area, the pixel having the largest feature value calculated by the feature value calculation unit 313 is extracted, and if the feature value of the extracted pixel is smaller than the threshold value , then the pixel values of the pixels located in the interpolation object area are respectively determined as the pixel values of the interpolation pixels, but the present invention is not limited thereto. The averaged pixel values of the pixels in the area are determined as the pixel values of the interpolation pixels.

Using the example in Fig. 17, as in the interpolation target area B, when the feature value of the extracted "pixel 4" is smaller than the threshold value "THRESH", the "pixel 3" located in the interpolation target area B is ” and “Pixel 4 ”, the averaged pixel value “(P3+P4)/2” is determined as the pixel value of the interpolation pixel (that is, the interpolation target area B).

In this way, among the pixels located in the interpolation target area, the pixel with the largest feature value calculated by the feature value calculation unit 313 is extracted, and if the feature value of the extracted pixel is smaller than the threshold value, the pixel located in the interpolation target area is The pixel value whose pixel value is averaged determines the pixel value as the interpolation pixel, and the overall image interpolation process can be performed when the brightness levels of adjacent pixels do not deviate greatly, and the associated image data can be effectively suppressed. Image quality degradation due to resolution conversion.

In addition, in the present invention, it is also possible to calculate the difference in pixel values between pixels located in the interpolation target area, and if the absolute value of the difference in pixel values between pixels in the interpolation target area is greater than or equal to a threshold value, then The averaged pixel values of the pixels in the interpolation target area are determined as the pixel values of the interpolation pixels.

For example, if the example in FIG. 18 is used to describe, the difference in pixel value between the pixels "Pixel 1" and "Pixel 2" located on the interpolation target area A (that is, "P2-P1") is calculated. If the absolute value of the difference in pixel values between pixels in the interpolation target area (i.e., |P1-P2|) is greater than or equal to the threshold "THRESH", the pixels "Pixel 1" and "Pixel 1" located in the interpolation target area A are The pixel value "(P2+P1)/2" obtained by averaging the pixel values of the pixel 2" is determined as the pixel value of the interpolation pixel. In addition, image interpolation processing is similarly performed on the interpolation target area B, the interpolation target area C...the interpolation target area N.

In this way, the difference in pixel values between pixels located in the interpolation target area is calculated, and if the absolute value of the difference in pixel values between pixels in the interpolation target area is greater than or equal to the threshold value, the The averaged pixel values determine the pixel values used as interpolation pixels, which can smooth locally large differences in brightness levels and effectively suppress image quality degradation associated with resolution conversion of image data.

Furthermore, in Embodiment 1, an example in which the video signal input to the image interpolation device 310 is a composite signal (RGB format) is described, but the present invention is not limited thereto. The present invention can be similarly used in the case of signals.

In addition, in each processing described in this embodiment, all or part of the processing described as being performed automatically can be performed manually, or all of the processing described as being performed manually can be performed automatically by a known method. or part of it. In addition, information including processing procedures, control procedures, specific names, various data, parameters, etc. (for example, resolution, resolution conversion rate, etc.) shown in the above text and drawings, unless otherwise specified can be changed arbitrarily.

In addition, each constituent element of each device shown in the figure is functional and conceptual, and does not necessarily have to be physically configured as shown in the figure. That is, the specific form of dispersing/integrating each device is not limited to the illustrated example, and all or part of them can be functionally or physically disperse/integrated in arbitrary units according to various loads, usage conditions, and the like. Furthermore, all or any part of each processing function performed in each device may be realized by a CPU and a program analyzed and executed by the CPU, or may be realized as hardware using wired logic.

In addition, in this embodiment, a 2-screen display method in which 2 screens are displayed on a single display, and a 2-view display method in which 2 different images are output in 2 directions are described as examples, but it can also be used as a display method for displaying 3 screens. The multi-screen display mode of one or more than three multi-screens, and the multi-directional display mode of outputting different images to three or more multiple directions are implemented.

In addition, in the present embodiment, a vehicle-mounted device is described as an example, but the application of the present invention is not limited thereto, and for example, it can be applied to a display device other than a vehicle-mounted device such as a household.

As described above, the image interpolation device and display device of the present invention are useful for image interpolation, and are particularly suitable for resolution conversion that maintains the characteristics of the original image.

Claims (4)

1. image interpolation device, the pixel value based near the pixel of the pixel that is positioned at the interpolation subject area and this pixel determines the picture interpolation of the pixel value of the inter polated pixel of interpolation on the interpolation subject area to handle, and it is characterized in that possessing:

Calculate the feature amount calculation unit of the characteristic quantity of this pixel according near the pixel of the pixel that is positioned at above-mentioned interpolation subject area and this pixel;

With above-mentioned characteristic quantity is the pixel interpolation processing unit that the pixel interpolation of the basis pixel value that determines above-mentioned inter polated pixel is handled;

Above-mentioned pixel interpolation processing unit, in the pixel that is arranged in above-mentioned interpolation subject area, extraction utilizes the pixel of the characteristic quantity maximum of above-mentioned feature amount calculation unit calculating, if the characteristic quantity of the pixel that should extract out is more than or equal to threshold value, then the pixel value of the pixel value of this pixel decision as above-mentioned inter polated pixel, perhaps, if the characteristic quantity of the pixel that should extract out is less than threshold value, then the pixel value to the pixel that is positioned at above-mentioned interpolation subject area has been carried out the pixel value of the pixel value decision of equalization as above-mentioned inter polated pixel.

2. image interpolation device as claimed in claim 1 is characterized in that: further possess to utilize the interpolation of above-mentioned picture interpolation processing unit the view data of inter polated pixel carry out the resolution changing processing unit that resolution changing is handled.

3. image interpolation device as claimed in claim 2, it is characterized in that: further possess indicative control unit, it is controlled in the following manner, arranges the display mode that replaces with regulation and shows comprising a plurality of view data that 1 above-mentioned resolution changing processing unit of usefulness carried out the view data that resolution changing handles at least.

4. display device is characterized in that possessing:

At a plurality of view directions each two dimensional image is presented at display unit on the single picture;

Calculate the feature amount calculation unit of the characteristic quantity of this pixel according near the pixel of the pixel of the interpolation subject area that is positioned at above-mentioned image and this pixel;

Based on above-mentioned characteristic quantity, the pixel interpolation processing unit of the pixel value of decision inter polated pixel;

Use pixel value generation interpolating image, make above-mentioned display unit show the indicative control unit of this interpolating image by the inter polated pixel of above-mentioned pixel interpolation processing unit decision;

Above-mentioned pixel interpolation processing unit, in the pixel that is arranged in above-mentioned interpolation subject area, extraction utilizes the pixel of the characteristic quantity maximum of above-mentioned feature amount calculation unit calculating, if the characteristic quantity of the pixel that should extract out is more than or equal to threshold value, then the pixel value of the pixel value of this pixel decision as above-mentioned inter polated pixel, perhaps, if the characteristic quantity of the pixel that should extract out is less than threshold value, then the pixel value to the pixel that is positioned at above-mentioned interpolation subject area has been carried out the pixel value of the pixel value decision of equalization as above-mentioned inter polated pixel.

Images