JP6834042B2 - Display device - Google Patents

Description

The present invention relates to a display device.

In recent years, display devices capable of displaying high-definition images such as 4K2K (4096 x 2160) and 8K4K (8192 x 4320) have been put into practical use. However, the transmission of high-definition image data requires a wide band, which increases the cost of the transmission system. Therefore, a method has been proposed in which the original high-definition image data (referred to as the whole image data) is divided into a plurality of partial image data and transmitted, and the partial image data is synthesized in the display device to reproduce the whole image data. According to this method, the cost of the transmission system can be reduced because a wide band is not required for transmission. In order to correctly configure the entire image data from the divided image data, it is necessary to correctly select the divided image data constituting the entire image data from the plurality of image data input to the display device. In a configuration in which this selection is made by a user operation, there is a problem that a user is required to perform a complicated operation when the number of divisions is large. As a configuration for automatically selecting the divided image data, there is a method of analyzing the input image data and determining the input image data satisfying a predetermined condition as the partial image data. Patent Document 1 discloses a method of counting the number of image data having the same synchronization signal frequency among a plurality of input image data and performing image composition based on the frequency having the largest number of image data. ..

Japanese Unexamined Patent Publication No. 2013-5226

The combination of the partial image data estimated by the method of Patent Document 1 is not always the combination of the partial image data constituting the entire image data. For example, image data A1, A2, and B having the same synchronization signal frequency are input, of which image data A1 and A2 are partial image data constituting the entire image data A, and image data B is the entire image. It is assumed that the image data is independent of the data A. In this case, in the method of Patent Document 1, there is a possibility that the image data B is also determined to be the partial image data constituting the entire image data A. Then, the size of the entire image data exceeds the size that can be displayed on the display device.

Therefore, an object of the present invention is to provide a technique for accurately determining partial image data constituting the entire image data among a plurality of image data input to a display device.

In order to achieve the above object, one of the display devices according to the present invention includes a display means for displaying an image, an input means for inputting a plurality of input image data, and the plurality of input image data. The display means has control means for controlling the display means so as to display a first image for the user to select one input image data used for displaying the image on the display means, and the display means displays. When the plurality of input image data includes a plurality of partial image data constituting the possible image data, the control means uses a combination of the first image and the input image data corresponding to the plurality of partial image data. The display means is controlled so as to display the second image for selection by the user.

In order to achieve the above object, one of the control methods according to the present invention is a control method of a display device having a display means for displaying an image, which includes an input step in which a plurality of input image data are input and an input step. A control step for controlling the display means so as to display a first image for the user to select one input image data used for displaying the image on the display means among the plurality of input image data. When the plurality of input image data includes a plurality of partial image data constituting the image data that can be displayed by the display means, in the control step, the first image and the plurality of partial image data are combined. The display means is controlled so that the second image for the user to select the combination of the corresponding input image data is also displayed.

According to the present invention, it is possible to accurately determine the partial image data constituting the entire image data among the plurality of image data input to the display device.

It is a figure for demonstrating a plurality of components having the display device 100 of Embodiments 1-3. It is a flowchart for demonstrating the process performed by the display device 100 in Embodiment 1. FIG. It is a figure for demonstrating an example of the format information of the input image data. It is a figure for demonstrating an example of a pattern table. It is a figure for demonstrating an example of the menu for selecting an image input part. It is a flowchart for demonstrating the process performed by the display device 100 in Embodiment 3. It is a figure for demonstrating the process of determining the difference of the pixel value of the adjacent pixel.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, the embodiments of the present invention are not limited to the following embodiments.

[Embodiment 1]
FIG. 1 is a diagram for explaining a plurality of components included in the display device 100 according to the first to third embodiments.
In the first embodiment, the case where the display device 100 operates as, for example, a projector will be described, but the display device 100 is not limited to the projector. When the display device 100 operates as a projector, the display device 100 can be configured as a single-panel projector or a three-panel projector. When the display device 100 operates as a projector, the display device 100 can be configured as a projector having a liquid crystal display or a projector having an organic EL (Electroluminescence) display. When the display device 100 operates as a projector, the display device 100 can also be configured as a projector having a MEMS (Micro Electro Mechanical Systems) shutter.

The control unit 101 controls the operation of each component constituting the display device 100. The control unit 101 is connected to other components by a bus, issues control instructions to the other components, and exchanges data with the other components.
The operation unit 102 receives an instruction from the user. By operating the operation unit 102, the user can input a desired instruction (command) to the display device 100. The power supply unit 103 controls the power supply to each component constituting the display device 100. The liquid crystal unit 104 is composed of one or three liquid crystal panels, and an image based on image data is formed. In the first embodiment, it is assumed that the number of pixels of the liquid crystal unit 104 is 3840 × 2160. Note that this number of pixels is an example, and the number of pixels of the liquid crystal panel is not limited to this.

The liquid crystal driving unit 105 drives the liquid crystal element of the liquid crystal panel of the liquid crystal unit 104 based on the image data input from the image processing unit 118 to form an image. The light source 106 supplies light to the liquid crystal unit 104. The projection optical system 107 projects the light transmitted through the liquid crystal unit 104 onto the screen. The light source control unit 108 controls the amount of light of the light source 106 and the like. The optical system control unit 109 controls the operation of the zoom lens and the focus lens of the projection optical system 107, and adjusts the zoom magnification and the focus.

The image input units 110 to 113 are image input interfaces for inputting a plurality of image data output from a PC, a DVD player, or the like. DVI (Digital Visual Interface) and HDMI (registered trademark) are examples of image input interfaces. When the image input interface is HDMI, control commands such as image processing may be input at the same time as the image data. In the first embodiment, it is assumed that the image input units 110 to 113 are HDMI. The image input units 110 to 113 correspond to HDMI1 to HDMI4 in the selection menu 300 (see FIG. 5) of the image input unit described later.
The image input units 110 to 113 include measurement circuits such as a frequency counter and a pulse counter, measure and acquire format information such as the timing of a synchronization signal of input image data, and store the measurement result in an internal register.

The display device 100 has a standard mode and a composite mode as display modes. In the standard mode, the display device 100 displays an image based on any one of the image data input from the image input units 110 to 113. In the compositing mode, the display device 100 displays an image based on the whole image data having a size larger than the partial image data, which is obtained by compositing a plurality of image data as the partial image data. The compositing mode is used, for example, for displaying a 4K image (3840 x 2160) by inputting four HD images (1920 × 1080) and synthesizing them. As a result, HD images can be used as the image input terminal and image transmission system, so 4K can be used while suppressing cost increases.
It can support the display of high-definition images such as 8K and 8K. In the first embodiment, for simplification of the description, the whole image data is obtained by synthesizing two or four partial image data in the compositing mode. The number of partial image data constituting the entire image data is not limited to this example. Further, as a method of arranging a plurality of partial image data when synthesizing the whole image data, a method such as a horizontal row, a vertical row, or a tile shape can be considered. The setting and instruction for switching the display mode and selecting the partial image data constituting the entire image data can be input to the display device 100 by the user while looking at the OSD (On Screen Display) menu or the like described later.

The USB (Universal Social Bus) interface 114 is an interface for connecting a USB device. By connecting an external device such as a pointing device, keyboard, or flash memory to the USB interface 114, various files such as control commands and image data can be input / output from the external device.
The card interface 115 can insert a card-type recording medium such as an SD card or a compact flash, and can input / output various files such as image data to the recording medium. The communication unit 116 is a communication interface such as a wired LAN or a wireless LAN, and transmits / receives various files such as image data and commands by connecting to an intranet or the Internet.

The internal memory 117 is a storage means composed of a semiconductor memory, a hard disk, or the like, and stores various information such as image data and user-set data. The file reproduction unit 133 processes files input from the various external interfaces described above, generates image data, and outputs the image data to the image processing unit 118. The file reproduction unit 133 performs a process of decoding the encoded file based on the instruction of the control unit 101. The image data input from the image input units 110 to 113 is directly transmitted to the image processing unit 118 without passing through the file reproduction unit 133.

The image processing unit 118 performs image processing on the image data input from the file reproduction unit 133 and the image input units 110 to 113 and the image data input from the control unit 101. The image processing performed by the image processing unit 118 includes, for example, a process of converting the number of pixels so as to match the image formation of the liquid crystal unit 104, and a process of doubling the number of frames of image data for AC driving of the liquid crystal panel. And so on. Here, the AC drive of the liquid crystal panel is a method of displaying by switching the direction of the voltage applied to the liquid crystal of the liquid crystal panel for each frame. This is a driving method that utilizes the property of a liquid crystal panel that can form an image regardless of whether the voltage applied to the liquid crystal is in the forward direction or the reverse direction. In this driving method, it is necessary to send one image for the forward direction and one image for the reverse direction to the liquid crystal driving unit 105, so the image processing unit 118 performs a process of doubling the number of frames of the image data.

The image processing unit 118 also measures format information and performs image analysis on the image data input from the image input units 110 to 113. The image processing unit 118 measures the timing of a synchronization signal or the like in the image data and stores it in an internal register that can be read by the control unit 101. In addition, the pixel value information of the image data is stored in the internal register.
The image processing unit 118 performs keystone correction on the image data. The keystone correction is a process of deforming the shape of image data in order to prevent the projected image from being distorted into a trapezoidal shape when the image is projected from an oblique direction with respect to the screen. In the keystone correction, the image processing unit 118 enlarges / reduces the input image data in the horizontal / vertical direction. As a result, the trapezoidal distortion of the projected image and the distortion of the image on the liquid crystal panel are offset, and the image having the correct aspect ratio is projected and displayed on the screen. The image processing unit 118 may automatically perform keystone correction based on the tilt angle of the display device 100 obtained by the tilt sensor 119, which will be described later, or the key input by the user operating the operation unit 102. The correction may be performed according to the stone correction command.

The tilt sensor 119 detects the tilt of the display device 100. The timer 120 detects the operating time of the display device 100 and the operating time of each component. The thermometer 121 measures the temperature of the light source 106 of the display device 100, the temperature of the liquid crystal unit 104, the outside air temperature, and the like. The infrared receiving units 122 and 123 receive an infrared signal from a remote controller or the like that transmits an instruction to the display device 100, and transmit a command to the control unit 101. The display device 100 of the first embodiment has a plurality of infrared receiving units of an infrared receiving unit 122 installed at the rear and an infrared receiving unit 123 installed at the front. The number of infrared receivers installed is not limited to this.

The focus detection unit 124 detects the distance between the display device 100 and the screen. The imaging unit 125 images the direction of the screen. The screen metering unit 126 measures the amount of light and the brightness of the light reflected by the screen. The display unit 128 displays the status of the display device 100, a warning, and the like. The display control unit 129 controls the display unit 128. The battery 130 supplies electric power when the display device 100 is carried and used. The power input unit 131 receives AC power from the outside, rectifies it to a predetermined voltage, and supplies it to the power supply unit 103.
The cooling unit 132 is composed of, for example, a heat sink and a fan, and cools the main body by releasing heat in the display device 100 to the outside. The RAM 134 is used as a deployment destination of a program stored in the internal memory 117 or as a frame memory for storing image data.

Next, the basic operation of the display device 100 will be described.
When the power ON instruction is input by the operation unit 102, the control unit 101 issues an instruction to the power supply unit 103 to supply electric power to each component, and puts each component in a standby state. Next, the control unit 101 instructs the light source control unit 108 to start light emission from the light source 106. Next, the control unit 101 acquires information on the distance between the screen and the display device 100 from the focus detection unit 124, and instructs the optical system control unit 109 to adjust the projection optical system 107. Based on the instruction from the control unit 101, the optical system control unit 109 operates the zoom lens and the focus lens of the projection optical system 107 so that the projected light is imaged on the screen.

In this way, the projection is ready. Next, the image processing unit 118 performs image processing on the image data input to the image input units 110 to 113 according to the display mode. For example, in the standard mode, the image processing unit 118 arranges any of the input image data in a frame in a predetermined layout and converts the number of pixels suitable for the liquid crystal unit 104. Further, the image processing unit 118 performs gamma correction, luminance unevenness correction, and keystone correction on the image data as needed. The liquid crystal driving unit 105 drives the liquid crystal unit 104 based on the image data corrected by the image processing unit 118, and an image is formed on the liquid crystal panel of the liquid crystal unit 104.

The image formed on the liquid crystal panel of the liquid crystal unit 104 is incident on the projection optical system 107 by the light emitted from the light source 106, and the image is projected on the screen by the projection optical system 107. During image projection, the control unit 101 detects the temperature of the light source 106 and the like with the thermometer 121, and operates the cooling unit 132 according to the temperature to cool the light source 106 and the like. The control unit 101 controls, for example, to operate the cooling unit 132 when the temperature of the light source becomes 40 degrees or higher.

When an instruction to turn off the power is input by the operation unit 102, the control unit 101 issues an instruction to each component to perform end processing. When the operation of each component is ready to be stopped, the power supply unit 103 sequentially stops the power supply to each component. The control unit 101 cools the display device 100 by operating the cooling unit 132 for a while after the operation of each component is stopped.

When the display mode is the composite mode, the image processing unit 118 uses the image input units 110 to 113.
The image data input to is synthesized based on the user's instruction or the determination processing result of the partial image data described later, and is displayed as one whole image. By operating the operation unit 102 while looking at the setting menu of the OSD or the like, the user can input which of the input image data is to be a combination of the partial image data constituting the entire image data. .. The image processing unit 118 synthesizes the entire image data based on the combination of the input image data specified by the user. The image processing unit 118 converts the entire image data obtained by synthesizing the input image data into a number of pixels suitable for the liquid crystal unit 104, and performs gamma correction, luminance unevenness correction, and keystone correction as necessary. Do. The liquid crystal driving unit 105 drives the liquid crystal unit 104 based on the overall image data corrected by the image processing unit 118, and an image is formed on the liquid crystal panel of the liquid crystal unit 104.
The image formed on the liquid crystal panel of the liquid crystal unit 104 is incident on the projection optical system 107 by the light emitted from the light source 106, and the image is projected on the screen by the projection optical system 107.

Next, with reference to FIGS. 2 and 3, a process of detecting a combination of partial image data constituting the entire image data among the image data input from the image input units 110 to 113 will be described.
FIG. 2 is a flowchart for explaining the process performed by the display device 100 in the first embodiment.
In the first embodiment, it is assumed that the process shown in FIG. 2 is performed by using a user instruction input from the operation unit 102 or the remote controller as a trigger. When the user inputs an instruction to execute this process from the operation unit 102, the control unit 101 starts the process of S101.

In S101, the control unit 101 instructs the image input units 110 to 113 to measure the format information of the input image data. In the first embodiment, the format information to be measured includes the number of pixels (Image Size) 202, the horizontal synchronization signal frequency (hSyncFreq) 203, the vertical synchronization signal frequency (vSyncFreq) 204, and the quantization clock (VSyncFreq) 204, as shown in FIG. Dclk) 205, scanning method 206, horizontal sync signal polarity (hPol) 207, vertical sync signal polarity (vPol) 208, total horizontal dot count (hTotal) 209, horizontal sync signal width (hSyncWidth) 210, horizontal back pouch. (HBp) 211, total number of vertical lines (vTotal) 212, vertical sync signal width (vSyncWith) 213, vertical back pouch (vBp) 214. The image input units 110 to 113 measure these information by a measuring circuit provided inside, and store the result in an internal register. The control unit 101 reads the measurement result via the bus and develops it in the RAM 134. Here, since the image data is input to the image input units 110 to 113, the control unit 101 accesses the image input units 110 to 113 and reads out the measurement result information.
FIG. 3 is a diagram for explaining an example of the measurement result 200 of the format information of the input image data. "1" to "4" of the image input unit number (Port) 201 correspond to the image input units 110 to 113, respectively.

In S102, the control unit 101 searches for input image data with matching format information based on the measurement result read in S101. The control unit 101 performs a comparison calculation for each element of the measurement result of the format information of the image input unit shown in FIG. 3, and searches for a combination of input image data in which the values of all the format information match. Here, an example of searching for a combination of input image data in which the values of all format information match is shown, but since it is assumed that some errors may be included in the measurement result due to jitter or the like, the difference is within a predetermined range. If it is within, it may be determined that it "matches". In the example of FIG. 3, since the format information of the input image data of the image input units 111 (Port 2) and 112 (Port 3) match, the combination of the image input unit number 2 and the input unit number 3 is used as the search result. It is output. These are candidates for the partial image data that constitutes the entire image data. The number of candidates for partial image data is 2. In S102, the control unit 101 proceeds to S103 when the number of candidates for partial image data is 2 or 4 (TRUE), and ends the process in other cases. In the example of FIG. 3, since the number of candidates for the partial image data is 2, the control unit 101 transitions to S103.

In S103, the control unit 101 refers to the pattern table 400 and compares it with the number of partial image data candidates detected in S102 and the format information. FIG. 4 shows an example of the pattern table 400 according to the first embodiment. The pattern table 400 shows information on the correspondence between the entire image data that can be displayed in the composite mode of the display device 100 and the combination of the partial image data that constitutes the entire image data. The total number of pixels (Full Image Size) 401 indicates the number of pixels (size) of the entire image data, and this number of pixels is the number of pixels that can be displayed by the display device 100 in the first embodiment. The number of inputs (input port) 402 is the number of partial image data constituting the entire image data (the number of divisions of the entire image data by the partial image data). The number of partial pixels (Partial Image Size) 403 indicates the number of pixels of the partial image data constituting the entire image data. The pattern table 400 is stored in the internal memory 117 in advance, and is read out to the RAM 134 by the control unit 101 when the display device 100 is started.

In S104, the control unit 101 determines whether the pattern table 400 has a combination of the format information of the partial image data candidates detected in S102 that matches the number of pixels 202 and the number of partial image data candidates. As a result, the control unit 101 determines whether or not there is a combination of partial image data constituting the entire image data having a size larger than the input image data among the plurality of input image data based on the measured format information. In the example of FIG. 3, the candidate partial image data is image data having 1920 × 2160 pixels input to the image input units 111 and 112, and the number of partial image data is 2. This matches the pattern in which the total number of pixels is 3840 × 2160 and the number of inputs is 2 in the pattern table 400. The number of pixels of the entire image data matches the number of pixels of the liquid crystal unit 104 of the display device 100 in the first embodiment, which is 3840 × 2160. It is assumed that the information on the number of pixels of the liquid crystal unit 104 is stored in the internal memory 117 in advance. In the pattern table 400, the control unit 101 compares the number of pixels of the partial image data candidate detected in S102 and the number of pixels of the entire image data according to the pattern matching the number of candidates with the number of pixels of the liquid crystal unit 104. When the total image data is the number of pixels that can be displayed by the liquid crystal unit 104, the control unit 101 transitions to S105.

In S105, the control unit 101 controls the image processing unit 118 to synthesize the image data input from the image input unit of the combination of the partial image data candidates detected in S102. As a result, the control unit 101 generates the entire image data by synthesizing the input image data determined to be a combination of the partial image data constituting the entire image data. When the liquid crystal driving unit 105 drives the liquid crystal unit 104 based on the synthesized overall image data, the image based on the overall image data is projected on the screen by the projection optical system 107.

In the first embodiment, the combination of the partial image data constituting the entire image data among the input image data is determined based on the format information of the measured input image data and the pattern table 400 stored in advance in the internal memory. The method is not limited to this. For example, the determination may be made based on the VIC (Video ID Code) defined by the CEA (Consumer Electricals Association) Standard included in the HDMI signal received by the image input units 110 to 113. Of the input image data, the image data having the same VIC may be determined as a candidate for the partial image data.

According to the first embodiment, it is possible to search for an appropriate combination of partial image data based on the measurement result of the format information of the input image data and the pattern table, synthesize the entire image data, and perform projection. As a result, it is possible to display the entire image data in which the partial image data is correctly combined, without the user having to select the image input unit into which the partial image data constituting the entire image data is input.

The measurement target of the format information of the input image data is not limited to that illustrated in FIG. Only a part of the format information illustrated in FIG. 3 may be used, or the frame rate, blanking period, etc. not illustrated in FIG. 3 may be further measured. Further, in S102 of the first embodiment, a combination of input image data in which the values of at least a part of the format information match may be determined as a combination candidate of the partial image data constituting the entire image data. As at least a part of the format information, for example, the number of pixels, the frame rate, the synchronization signal frequency, the blanking period, and the like can be exemplified.

In S104 of the first embodiment, the combination of the input image data that matches the measured format information is determined as the partial image data, and the entire image data obtained by synthesizing the partial image data can be displayed on the liquid crystal unit 104. It is judged whether it is an image of. As a result, for example, when the number of pixels of the liquid crystal unit 104 is 3840 × 2160 and the candidates for the partial image data are two input image data of 1920 × 2160 and 1920 × 2160, the correct combination of partial image data is obtained. Is determined. Here, the correct combination of partial image data means that the size of the entire image data composed of the combination of the partial image data is a size that can be displayed on the liquid crystal unit 104. When the candidates for the partial image data are the three input image data of 1920 × 1080, 1920 × 1080, and 1920 × 1080, it is determined that the combination of the partial image data is incorrect. This is because the total image data obtained by synthesizing the three input image data of 1920 × 1080, 1920 × 1080, and 1920 × 1080 is larger than the size that can be displayed on the liquid crystal unit 104.

[Embodiment 2]
In the first embodiment, an example is shown in which the combination of the partial image data constituting the entire image data is automatically determined based on the measurement result of the format information of the input image data and the pattern table, but the user can select the combination candidate of the partial image data. An example presented in will be described. In the second embodiment, the description of the parts common to the first embodiment will be omitted, and the parts different from the first embodiment will be mainly described.

Up to S104 of the flowchart shown in FIG. 2, the same as that of the first embodiment.
In S104, the control unit 101 determines whether the pattern table 400 has a combination of the format information of the partial image data candidates detected in S102 that matches the number of pixels 202 and the number of partial image data candidates. When there is a matching combination, the control unit 101 presents the information of the input image data (information of the image input unit) related to the combination to the user by the OSD menu. As a result, the control unit 101 presents the information of the input image data determined to be a combination of the partial image data constituting the entire image data to the user. The user can manually specify a combination of partial image data based on this presentation information. The operation unit 102 receives an instruction from the user to specify a combination of partial image data among the plurality of input image data.

FIG. 5A is a selection menu 300 of the image input unit in the standard mode before receiving an instruction from the operation unit 102 to execute the process shown in FIG. 2 by the user. In the standard mode, in the selection menu 300, any one of the image input units 110 to 113 (HDMI1 to 4) can be selected as the input unit of the image data to be displayed.
FIG. 5B is a selection menu 300 of the image input unit in the composition mode after receiving an instruction from the operation unit 102 to execute the process shown in FIG. 2 by the user. In the compositing mode, a selection item 301 indicating a combination candidate of the partial image data constituting the entire image data searched by the control unit 101 by the process of FIG. 2 is added to the selection menu 300.

In the example of FIG. 3, by the processing of S104, the control unit 101 determines that the combination of the image input unit 111 and the image input unit 112 (HDMI2 and HDMI3 in the selection menu 300) is a combination of the partial image data constituting the entire image data. To do. Based on this determination result, the control unit 101 generates a selection item 301 indicating the information of the combination in the selection menu 300 for the image processing unit 118, superimposes it on the display image as an OSD menu, and informs the user of the combination. Control to present. When the user inputs an instruction to select the selection item 301 by operating the operation unit 102, the control unit 101 inputs the image data input from the image input unit of the combination of the partial image data candidates detected in S102 to the image processing unit. Control to synthesize at 118. As a result, the control unit 101 synthesizes the input image data designated by the user as a combination of the partial image data to generate the entire image data. When the liquid crystal driving unit 105 drives the liquid crystal unit 104 based on the synthesized overall image data, the image based on the overall image data is projected on the screen by the projection optical system 107.

According to the second embodiment, an appropriate combination of partial image data is searched for based on the measurement result of the format information of the input image data and the pattern table, and the result is displayed to the user as a selection item 301 in the selection menu 300 of the image input unit. Presented. Based on the presented information, the user can easily select an image input unit in which the partial image data constituting the entire image data is input. This makes it possible to greatly simplify the operation of selecting an image input unit in which partial image data is input by the user.

In the second embodiment, an example of presenting an image input unit for inputting image data determined as a candidate for a combination of partial image data to a user by an OSD GUI has been described, but the method of presenting to the user is limited to this. Absent. Each image input unit is equipped with an indicator composed of an LED (Light Emitting Diode) or the like, and the LED of the image input unit corresponding to the candidate for the combination of partial image data is turned on to provide the user with information on the combination of partial image data. You may present it. Alternatively, information on candidates for the combination of partial image data may be displayed on the display unit 128.

[Embodiment 3]
In the third embodiment, when the image data in the same format as the partial image data constituting the whole image data and the image data independent of the whole image data is input from the image input unit, the partial image data A method of correctly determining the combination will be described. In the first and second embodiments, the partial image data constituting the entire image data is determined by comparing the measurement result of the format information with the pattern table. However, when the format information is the same as the partial image data but the image data that is not the partial image data constituting the whole image data is input, it is preferable that the image data can be accurately determined not to be the partial image data. ..

In the third embodiment, attention is paid to the difference in pixel values of pixels (referred to as adjacent pixels) at edges or joints adjacent to each other when two partial image data candidates are arranged vertically or horizontally in order to compose the entire image data. To do. When the difference between the pixel values of the adjacent pixels is small, it can be determined that one continuous image data is divided partial image data. Therefore, in the third embodiment, when the two input image data are arranged vertically or horizontally and the total sum of the absolute differences between the pixel values at the adjacent ends is smaller than the predetermined threshold value, the two input image data are the whole. It is determined that the image data is included in the combination of the partial image data constituting the image data.

FIG. 6 is a flowchart for explaining the process performed by the display device 100 in the third embodiment. The processing from S201 to S204 is the same as the processing from S101 to S104 in FIG. Here, the processing after S204 will be described.
In S204, when the pattern table 400 has a combination of the format information of the partial image data candidates detected in S202 that matches the number of pixels 202 and the number of partial image data candidates, the control unit 101 transitions to S205.

In S205, the control unit 101 performs a determination process of whether or not the sum of the difference absolute values of the pixel values at the adjacent ends of the partial image data candidates is smaller than the threshold value. In the first and second embodiments, the case where the number of pixels of the entire image data is 3840 × 2160 has been described as an example, but in the third embodiment, for the sake of simplicity, the 5 × 5 shown in FIGS. 7 (a) to 7 (d) The binary image data of the above will be described as an example. In the example of FIG. 7, the partial image data is 5 × 5, and the total image data synthesized by combining two images is 10 × 5.

FIG. 6B is a flowchart for explaining the determination process of the sum of the absolute values of the differences.
First, a case where the image data of FIG. 7A is input to the image input unit 111 and the image data of FIG. 7B is input to the image input unit 112 will be described.

In S301, the control unit 101 initializes the counter n for acquiring the difference between the pixel values of the adjacent pixels of the two input image data. The value of the counter n is stored in the RAM 134. The counter n means a line number for comparing the pixel values at the adjacent ends of the image of FIG. 7 (a) and the image of FIG. 7 (b) (n = 1 to 5).

In S302, the control unit 101 is one of the end portions of the image of FIG. 7 (a) input to the image input unit 111, which is adjacent to the image of FIG. 7 (b) input to the image input unit 112. The pixel value of pixel E: 1 of the line is read from the frame memory of the image processing unit 118. Since the pixel E: 1 of the image of FIG. 7A is white as shown, the gradation value 1 is read out.

In S303, the control unit 101 is one of the end portions of the image of FIG. 7 (b) input to the image input unit 112, which is adjacent to the image of FIG. 7 (a) input to the image input unit 111. The pixel value of pixel A: 1 of the line is read from the frame memory of the image processing unit 118. Since the pixel A: 1 of the image of FIG. 7B is white as shown, the gradation value 1 is read out.

In S304, the control unit 101 calculates the absolute difference between the pixel E: 1 pixel value of FIG. 7A and the pixel value of the pixel A: 1 of FIG. 7B read out in S302 and S303. .. Here, since the pixel value of each pixel is 1, the absolute difference value is 0. The control unit 101 stores the calculated difference absolute value of the pixel values of the adjacent pixels in the RAM 134. The control unit 101 similarly calculates the difference absolute value of the pixel values of the adjacent pixels for the subsequent lines and sums them. In FIGS. 7 (a) and 7 (b), as shown in the figure, the pixel values of the adjacent pixels of each line are the same, so that the sum of the absolute values of the differences is 0.
As described above, when the process of calculating the difference absolute value sum of FIG. 6B is completed, the control unit 101 transitions to S206 of FIG. 6A.

In S206, the control unit 101 determines whether the sum of the absolute values obtained in S205 is smaller than the threshold value. Here, the threshold value is set to 3. As described above, in the case of FIGS. 7 (a) and 7 (b), the sum of the absolute values of the differences is 0, which is smaller than the threshold value. This is because the input image data of FIGS. 7 (a) and 7 (b) has a small difference in pixel values at adjacent ends, and it is highly possible that the input image data is partial image data obtained by dividing one continuous image data. Means that. In this case, the control unit 101 transitions to S207.

In S207, the control unit 101 controls the image processing unit 118 to synthesize the image data input from the image input unit of the combination of the partial image data candidates detected in S202. When the liquid crystal driving unit 105 drives the liquid crystal unit 104 based on the synthesized overall image data, the image based on the overall image data is projected on the screen by the projection optical system 107.

Next, a case where the image data of FIG. 7 (c) is input to the image input unit 111 and the image data of FIG. 7 (d) is input to the image input unit 112 will be described. The processing after S302 in FIG. 6B, which is different from the above description, will be described.

In S302, the control unit 101 is one of the end portions of the image of FIG. 7 (c) input to the image input unit 111, which is adjacent to the image of FIG. 7 (d) input to the image input unit 112. The pixel value of pixel E: 1 of the line is read from the frame memory of the image processing unit 118. Since the pixel E: 1 of the image of FIG. 7C is white as shown, the gradation value 1 is read out.

In S303, the control unit 101 is one of the end portions of the image of FIG. 7 (d) input to the image input unit 112, which is adjacent to the image of FIG. 7 (c) input to the image input unit 111. The pixel value of pixel A: 1 of the line is read from the frame memory of the image processing unit 118. Since the pixel A: 1 of the image of FIG. 7D is black as shown, the gradation value 0 is read out.

In S304, the control unit 101 calculates the absolute difference between the pixel E: 1 pixel value of FIG. 7 (c) and the pixel value of the pixel A: 1 of FIG. 7 (d) read out in S302 and S303. .. Here, since the pixel E: 1 pixel value of FIG. 7 (c) is 1 and the pixel value of the pixel A: 1 of FIG. 7 (d) is 0, the absolute difference value is 1. The control unit 101 stores the calculated difference absolute value of the pixel values of the adjacent pixels in the RAM 134. The control unit 101 similarly calculates the difference absolute value of the pixel values of the adjacent pixels for the subsequent lines and sums them. In FIGS. 7 (c) and 7 (d), as shown in the figure, there is a difference in the pixel values of the adjacent pixels of each line, so that the sum of the absolute values of the differences is 5.
As described above, when the process of calculating the difference absolute value sum of FIG. 6B is completed, the control unit 101 transitions to S206 of FIG. 6A.

In S206, the control unit 101 determines whether the sum of the absolute values obtained in S205 is smaller than the threshold value. Here, the threshold value is set to 3. As described above, in the case of FIGS. 7 (c) and 7 (d), the sum of the absolute values of the differences is 5, which is equal to or greater than the threshold value. This means that the input image data of FIGS. 7 (c) and 7 (d) has a large difference in pixel values at adjacent ends and is not partial image data obtained by dividing one continuous image data. .. In this case, the processing of the flowchart of FIG. 6A ends.

According to the third embodiment, an appropriate combination candidate of the partial image data is searched based on the measurement result of the format information of the input image data and the pattern table. Further, by comparing the pixel values at the ends of the adjacent candidate image data, the combination of the partial image data can be determined more accurately. As a result, it is possible to display the entire image data in which the partial image data is correctly combined, without the user having to select the image input unit into which the partial image data constituting the entire image data is input.

[Embodiment 4]
The various functions, processes, and methods described in the first to third embodiments can also be realized by a personal computer, a microcomputer, a CPU (Central Processing Unit), or the like by using a program. Hereinafter, in the fourth embodiment, a personal computer, a microcomputer, a CPU, and the like are referred to as "computer X". Further, in the fourth embodiment, a program for controlling the computer X and for realizing various functions, processes, and methods described in the first to third embodiments is referred to as a "program Y".
The various functions, processes and methods described in the first to third embodiments are realized by the computer X executing the program Y. In this case, the program Y is supplied to the computer X via a computer-readable storage medium. The computer-readable storage medium according to the fourth embodiment includes at least one such as a hard disk device, a magnetic storage device, an optical storage device, a photomagnetic storage device, a memory card, a volatile memory, and a non-volatile memory. The computer-readable storage medium according to the fourth embodiment is a non-transitory (non-temporary) storage medium.

100: Display device, 101: Control unit, 104: Liquid crystal unit, 110: Image input unit, 111: Image input unit, 112: Image input unit, 113: Image input unit, 118: Image processing unit

Claims (17)

Display means for displaying images and
Input means for inputting multiple input image data and
A control means for controlling the display means so as to display a first image for the user to select one input image data used for displaying an image on the display means among the plurality of input image data.
Have,
When the plurality of input image data includes a plurality of partial image data constituting the image data that can be displayed by the display means, the control means controls the first image and the input images corresponding to the plurality of partial image data. A display device characterized in that the display means is controlled so as to display a second image for selecting a combination of data by the user. The control means is characterized in that it determines whether or not the plurality of input image data includes the plurality of partial image data based on the format information of each input image data including the number of pixels. The display device described in. The format information, frame rate, display device according to claim 2, characterized in that it comprises a synchronization signal frequency or blanking period. When a predetermined number of image data having the same number of pixels exists among the plurality of input image data, the control means determines that the plurality of input image data includes the plurality of partial image data. The display device according to any one of claims 1 to 3, which is characterized. The control means is a case where the difference between the pixel values at the ends adjacent to each other is smaller than the threshold value when the two input image data are arranged vertically or horizontally, and the plurality of input image data are the plurality of the input image data. According to any one of claims 1 to 4, when it is determined that the partial image data is included, it is further determined that the two input image data are included in the combination of the partial image data. The display device described. Further equipped with a reception means to accept user operations
When the first image and the second image are displayed, you can select the second image.
In response to the acceptance of the operation, the control means controls the display means so as to display an image based on the image data in which the plurality of partial image data corresponding to the selected second image are combined. The display device according to any one of claims 1 to 5, characterized in that. The display device according to any one of claims 1 to 6, wherein the input means is input with input image data in a format specified by HDMI. The display device according to any one of claims 1 to 7, wherein the display means includes a projection means for projecting an image on a screen. A control method for a display device having a display means for displaying an image.
Input steps in which multiple input image data are input, and
A control step for controlling the display means so as to display a first image for the user to select one input image data used for displaying an image on the display means among the plurality of input image data.
Have,
When the plurality of input image data includes a plurality of partial image data constituting the image data that can be displayed by the display means, in the control step, the first image and the input image corresponding to the plurality of partial image data A control method comprising controlling the display means so as to display a second image for selecting a combination of data by the user. 9. The control step is characterized in that it is determined whether or not the plurality of input image data includes the plurality of partial image data based on the format information of each input image data including the number of pixels. The control method described in. The control method according to claim 10, wherein the format information includes a frame rate, a synchronization signal frequency, or a blanking period. In the control step, when a predetermined number of image data having the same number of pixels exists among the plurality of input image data, it is determined that the plurality of input image data includes the plurality of partial image data. The control method according to any one of claims 9 to 11, wherein the control method is characterized. In the control step, when the two input image data are arranged vertically or horizontally, the difference between the pixel values at the adjacent ends is smaller than the threshold value, and the plurality of input image data are the plurality of input image data. According to any one of claims 9 to 12, when it is determined that the partial image data is included, it is further determined that the two input image data are included in the combination of the partial image data. The control method described. It also has a reception step to accept user operations,
When the first image and the second image are displayed, the control step corresponds to the selected second image in response to the acceptance of the user operation for selecting the second image. The control method according to any one of claims 9 to 13, wherein the display means is controlled so as to display an image based on image data in which a plurality of partial image data are combined. The control method according to any one of claims 9 to 14, wherein in the input step, input image data is input in a format defined by HDMI. The control method according to any one of claims 9 to 15, wherein the display means includes a projection means for projecting an image on a screen. A program for causing a computer to execute each step of the control method according to any one of claims 9 to 16.

Images