JP2006119728A - Composite image display - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve the workability of selecting a composite image by making it possible to easily compare a plurality of composite images.
By switching values of synthesis parameters, it is possible to synthesize a plurality of synthesized image data Dpm1 to Dpm3 having different synthesis results from the same image data Dp1 to Dp3. The plurality of composite image data Dpm1 to Dpm3 are displayed in the display areas A1 to A3 formed in the image comparison window WD3, respectively. Each display area A1 to A3 is provided with a control box CB, and a composite image displayed in the display area by enlarging / reducing or moving the operation frame CF displayed in the control box CB. The display magnification or display range of the data Dpm1 to Dpm3 can be adjusted.
[Selection] Figure 9

Description

  The present invention relates to a technique for displaying a composite image obtained by combining a plurality of original images on a screen.

  In recent years, with the widespread use of digital cameras (digital still cameras) and personal computers, it has become possible to variously process image data captured by digital cameras using a personal computer. As one of various processes, there is a panoramic image synthesis process for synthesizing a panoramic image based on a plurality of image data photographed by a digital camera.

  In this panoramic image synthesis process, a subject image is divided into a plurality of images so that a part of the image is overlapped by a digital camera, and the connection between adjacent image data is combined with the obtained plurality of images ( A panoramic image is generated by superimposing common portions. The content of such a panoramic image composition process is disclosed in Patent Document 1, for example.

JP 2000-90232 A

  By the way, image composition including the panoramic image composition is a relatively difficult technique, and a satisfactory composition result cannot always be obtained. In the panoramic image composition, inconsistency is likely to occur at the joining portion. For this reason, it has been necessary to create a large number of prototypes by changing the conditions of image composition in various ways. It is necessary to compare prototypes in order to select the optimal one from these prototypes, but it is difficult to easily compare the prototypes. After the image composition work is repeated many times and the prototype as a result of synthesis is temporarily stored in a storage device such as a hard disk, the data of each prototype can be dragged individually and displayed in separate windows. , Prototype comparison was not possible.

  In the field of correcting images, a user interface for comparing images is known to simultaneously display an original image and a corrected image in one window. Only a comparison with the corrected image was possible.

  The problem to be solved by the present invention is to improve the workability of selecting composite images by making it possible to easily compare a plurality of composite images.

  As means for solving at least a part of the problems described above, the following configuration is adopted.

The composite image display device of the present invention is
A composite image display device that displays on a screen a composite image obtained by combining a plurality of original images,
A composite image storage means for storing a plurality of composite images having the same original image but different composite results;
The gist of the present invention is to include a list display means for displaying a list of the plurality of synthesized images in an image comparison window formed on the screen.

  According to the composite image display device having the above configuration, a plurality of composite images having the same original image but different composite results are displayed in a list in the image comparison window. For this reason, a plurality of synthesized images can be easily compared. Therefore, the composite image can be selected with good workability.

  The list display means may include a display area forming means for forming a plurality of display areas in the image comparison window and an image display means for displaying the composite images in the formed display areas. Good.

  According to this configuration, the composite image can be arranged in an orderly manner by forming a plurality of display areas in advance.

  In the image display device in which the display area is formed, the image display unit may include a display magnification setting unit that determines the display of each composite image at the same display magnification.

  In order to compare multiple composite images, it is essential to be able to enlarge the composite image. However, according to the above configuration, multiple composite images are displayed at the same display magnification. Is easy.

  The display magnification setting means may include a display magnification changing means for changing the display magnification based on a command from an input device operated by an operator.

  According to this configuration, it is possible to enlarge or reduce a plurality of synthesized images while maintaining the same display magnification by an operation by the operator. For this reason, it is easy to compare the synthesized images.

  In the image display device in which the display area is formed, the image display unit may include a display range setting unit that determines the display of each composite image so that the display range for the entire composite image is the same.

  In order to compare a plurality of composite images, it is essential that the composite image can be enlarged. For this purpose, a part of the composite image is displayed in the display area. According to the above configuration, at that time, since each composite image displays the same display range with respect to the entire composite image, it is easy to compare the composite images.

  The display range setting means is a display range manual change means for changing the display range of the composite image based on a command from an input device operated by an operator in any one of the plurality of display areas. When the display range is changed by the display range changing unit, the display range in the display area other than the display area where the display range is changed is the same as the display range changed by the display range manual changing unit. The display range automatic changing means for changing to the position can be provided.

  According to this configuration, the operator can change other composite images to the same display range only by changing the display range of one composite image. For this reason, since the display range of each composite image is changed in conjunction with each other, the composite images can be easily compared.

  In the composite image display apparatus described above, the list display unit may display the plurality of original images in a list on an image comparison window in addition to the plurality of composite images.

  According to this configuration, since it is possible to perform comparison with the original image as well as a plurality of synthesized images, it is possible to select synthesized images with higher accuracy.

In the composite image display apparatus described above,
A synthesis parameter input means for inputting a value of a synthesis parameter necessary for synthesizing the plurality of original images based on a command from an input device operated by an operator;
Image synthesizing means for synthesizing the plurality of original images based on the value of the synthesis parameter input by the synthesis parameter input means;
Based on a command from an input device operated by an operator, a plurality of synthesis results obtained by the image synthesizing means are stored in the synthesized image storage means by switching values of synthesis parameters by the synthesis parameter input means. And a means for determining a composite image.

  According to this configuration, it is possible to easily prepare a plurality of synthesized images having the same original image but different synthesized results.

The composite image display method of the present invention includes:
A composite image display method for displaying a composite image obtained by combining a plurality of original images on a screen,
(A) a step of storing a plurality of synthesized images having the same original image but different synthesized results in a memory;
And (b) providing a list of the plurality of synthesized images in a window for image comparison formed on the screen.

The computer program of the present invention is:
A computer program for displaying a composite image obtained by combining a plurality of original images on a screen,
(A) a function of storing a plurality of synthesized images having the same original image but different synthesized results in a memory;
(B) A computer program for causing a computer to realize a function of displaying a list of the plurality of synthesized images in an image comparison window formed on the screen.

  According to the composite image display method and computer program of the present invention, a plurality of composite images can be easily compared and the composite images can be selected with good workability, similar to the composite image display apparatus of the present invention. There is an effect.

  The recording medium of the present invention is characterized by a computer-readable recording medium that records the computer program of the present invention. This recording medium has the same operation and effect as each computer program of the present invention.

  The present invention includes other aspects as follows. The 1st aspect is an aspect as a program supply apparatus which supplies the computer program of this invention via a communication path. In this first aspect, the above-described method and apparatus are realized by placing a computer program on a server or the like on a computer network, downloading a necessary program to a computer via a communication path, and executing the program. Can do.

The best mode for carrying out the present invention will be described based on examples. This embodiment will be described in the following order.
1. Device configuration:
2. Computer processing:
2-A. Overall processing:
2-B. Panorama image composition processing:
3. Action / Effect:
4). Other embodiments:

1. Device configuration:
FIG. 1 is an explanatory diagram showing a schematic configuration of a computer system to which an embodiment of the present invention is applied. The computer system of this embodiment mainly includes a personal computer 10 constituting the composite image display apparatus of the present invention, and includes a display 20, a keyboard 22, and a mouse 24 as peripheral devices. Furthermore, a digital camera 26, a CD drive 28, and a printer 29 are connected to the personal computer 10. The mouse 24 can be replaced with other pointing devices such as a trackball, a trackpad, and a tablet.

  The personal computer 10 includes a memory 13, a display image memory 14, a hard disk drive 15, an input control unit 16, a display control unit 17, an output control unit 18, and the like that are mutually connected by a bus 12 around a CPU 11 as a central processing unit. Is provided. The memory 13 stores various data and becomes a work area of the CPU 11. The display image memory 14 is a memory that temporarily stores image data of an image to be displayed on the display 20.

  The hard disk drive 15 stores an image synthesis program Pr as application software for synthesizing panoramic images. The hard disk drive 15 stores a plurality of image data Dpi (i = 1 to n, n is a positive integer) used for panoramic image synthesis. The image data Dpi is image data of a photographed image taken by the digital camera 26 and is stored in a predetermined area (for example, a holder called “film”) of the hard disk drive 15. The captured image is a color image.

  FIG. 2 is an explanatory diagram illustrating an example of a plurality of captured images captured by the digital camera 26. As shown in the drawing, the plurality of captured images are images obtained by dividing a landscape as a subject into a total of three in the horizontal direction so that part of the captured images overlap. That is, the first image P1, the second image P2, and the third image P3, which are a plurality of photographed images, are such that part of the photographed images overlap (hereinafter, the overlapping portions are referred to as “overlapping portions”). Each of which was shot while moving the shooting range to the right. The first to third images P1 to P3 are stored in the hard disk drive 15 as first to third image data Dp1 to Dp3 (see FIG. 1). Here, the plurality of photographed images are limited to those photographed from left to right in a horizontal row as described above.

  Returning to FIG. 1, the input control unit 16 is a control unit that captures input operations from the keyboard 22 and mouse 24, captures image data from the digital camera 26, and captures data from the CD drive 28. The display control unit 17 is a control unit that controls signal output to the display 20. The output control unit 18 is a control unit that controls printing on the printer 29.

  The image composition program Pr is originally stored in a CD-ROM (not shown) as a recording medium. By setting the CD-ROM in the CD drive 28 and starting a predetermined installation program, the image composition program Pr can be read from the CD-ROM and installed in the hard disk drive 15. When the CPU 11 executes this image composition program Pr, some of the various constituent requirements of the composite image display device of the present invention are realized.

  In FIG. 1, some of the above-described constituent requirements are indicated by functional blocks implemented in the CPU 11. That is, the CPU 11 includes the list display unit 31 as a function.

  The CPU 11 executes processing according to the image synthesis program Pr to connect the first to third image data Dp1 to Dp3 so as to synthesize a panoramic image. This panoramic image is stored in the memory as synthesized image data Dpm. 13 is temporarily stored. The image composition program Pr can also create a plurality of composite image data Dpm having different composition results from the same first to third image data Dp1 to Dp3 by switching the composition conditions. The memory 13 functions as a composite image storage unit 32 that stores the plurality of composite image data Dpm.

  The image synthesis program Pr is provided as a configuration stored in another portable recording medium (portable recording medium) such as a flexible disk, a magneto-optical disk, and an IC card in place of the CD-ROM. Can be. The image composition program Pr can also be provided via a network from a specific server connected to an external network. The network may be the Internet or a computer program obtained by downloading from a specific homepage. Alternatively, it may be a computer program supplied in the form of an email attachment.

2. Computer processing:
2-A. Overall processing:
The list display unit 31 described above is realized by the CPU 11 of the personal computer 10 executing the image composition program Pr. Further, the CPU 11 executes the image composition program Pr, thereby realizing a function of combining the composite image data Dpm from the first to third image data Dp1 to Dp3. The control process according to this image composition program Pr will be described in detail below.

  FIG. 3 is a flowchart showing the overall flow of this control process. This routine is started when an instruction to start the image composition program Pr is issued. As shown in the figure, when the process is started, the CPU 11 first performs a process of displaying an initial window WD1 on the CRT display 12 (step S100).

  FIG. 4 is an explanatory diagram showing the initial window WD1. As shown in the figure, in the processing menu column MN1 on the left side of the initial window WD1, three types of buttons BT1, BT2, BT3 of “input”, “composite”, and “save” are arranged in order downward, The operator clicks these buttons BT1 to BT3 with the mouse 24 in order, and synthesizes an image photographed by the digital camera 26 on the screen of the CRT display 12 and outputs it as a single panoramic image. You can proceed. That is, as shown in FIG. 3, after executing step 100, the CPU 11 takes in an operation command in which the buttons BT <b> 1 to BT <b> 3 are clicked by the mouse 24, and performs input processing, panoramic image synthesis processing, and storage corresponding to the operation command. Processing is executed in order (steps S200, S300, S400).

  The input process executed in step S200 captures a plurality of image data used for panoramic image synthesis. Here, the above-described image data Dpi (image data Dp1) captured by the digital camera 26 and stored in the hard disk drive 15 is used. ~ Dp3). The image data Dpi import operation is performed in response to an operation command in which the “open from file” button BT11 provided in the processing menu field MN2 on the upper side of the initial window WD1 shown in FIG. This is performed for each image data by specifying a file name. In addition, the “Open from Film” button BT12 provided in the processing menu column MN2 receives an operation command clicked by the mouse 24, and a plurality of image data are fetched collectively by designating a film name. You can also. Furthermore, it is also possible to adopt a configuration in which the digital camera 26 directly captures without going through the hard disk drive 15 once.

  The plurality of image data Dp1 to Dp3 captured as described above are stored in a predetermined area of the memory 13, and at the same time, as shown in FIG. 4, each image is displayed in the work field FDW of the initial window WD1. Thumbnail images of data Dp1 to Dp3 are displayed. “CIM0366”, “CIM0367”, and “CIM0368” displayed below the image data Dp1 to Dp3 are file names. The display of the image data Dp1 to Dp3 in the work field FDW is arranged in the order according to the file name.

  Returning to FIG. 3, the panoramic image synthesis process executed in step S300 is to combine a plurality of image data Dp1 to Dp3 input in step S200 to synthesize one panoramic image data. It will be described later.

  The saving process executed in step S400 saves the panorama image data created in step S300 as a file in an output destination such as the HDD 15 or the like. As a result, the panoramic image data is stored in a desired storage medium.

2-B. Panorama image composition processing:
The panoramic image synthesis process executed in step S300 will be described in detail below. When one panoramic image is to be synthesized from a plurality of image data Dp1 to Dp3, it is first necessary to examine in what arrangement the plurality of image data should be arranged. In this embodiment, as described above, since a plurality of captured images are captured from left to right in a horizontal row, the three image data Dp1 to Dp are connected in the order of the file names described above. You can see that they should be combined.

  In this panoramic image synthesis process, it is then necessary to obtain the positional relationship between the images to be joined. Here, it is performed using an image position relation calculation program incorporated in advance in the panoramic image composition software.

The image position relation calculation program basically includes the following procedure.
(1) Each of the two input images is converted to gray scale.
(2) A plurality of points (for example, 100 to 200) that are corners on the gray scale image are acquired.
(3) Regarding the points of one image, the points that may correspond in the other image are examined. Specifically, the local cross-correlation is calculated for all combinations of each point of one image and each point of the other image, and the calculated value is greater than a predetermined threshold. The combination of points becomes a combination of possibilities of matching.

(4) Processing is performed so that the combination of the points becomes one-to-one. If a certain point is a correct combination, there is a high possibility that a nearby point in the vicinity is also a correct combination. Using this feature, the correct combination of points is obtained based on how much the surrounding points indicate the matching degree of a certain combination of points.

  Actually, the calculation is performed after designating the connection direction of the two image data Dpi as the horizontal direction from left to right. As a result, since a one-to-one combination of points is obtained in (4), the positional relationship between the two image data Dpi to be joined using this information, that is, the first image data Dp1 and the second image data The positional relationship between Dp2 and the positional relationship between the second image data Dp2 and the third image data Dp3 can be obtained.

  Thereafter, in this panoramic image synthesis process, the overlapping portions are overlapped from the positional relationship between the two images obtained using the image positional relationship calculation program, so that the two images are combined in a natural connection. That is, the first image data Dp1 and the second image data Dp2 are combined so as to be connected in a natural connection, and the second image data Dp2 and the third image data Dp3 are connected in a natural connection. Synthesize to be connected.

  Next, an interface with the operator (what is called a “user interface”) in the panoramic image synthesis process executed in step S300 will be described. FIG. 5 is an explanatory view showing a window WD2 for “panoramic image composition”. This window WD2 is displayed on the display 20 prior to the panoramic image synthesis process. As shown in the drawing, the processing designation field FD1 on the left side of the window WD2 is provided with two check boxes CB1 and CB2 operated by a mouse operation by the operator and a [Create] button BT21. A check box CB1 for performing widening of superposition is for designating when it is desired to widen a superposition region to be superposed when two image data are joined at overlapping portions. The “Adjust brightness between images” check box CB2 is for specifying when the brightness between images to be joined is to be adjusted. The [Create] button BT21 is used to instruct the start of the image data Dpi composition processing.

  An array display field FD2 for displaying an array for joining a plurality of image data Dp1 to Dp3 is provided at the center of the window WD2 for “panoramic image composition”, and composition by joining is provided on the right side. A synthesis result display field FD3 for displaying the result is provided. The order of the arrangement of the image data Dp1 to Dp3 in the array display field FD2 can be changed by a drag and drop operation by the operator. A combined result thumbnail display field FD4 for displaying a combined result thumbnail is provided below the window WD2.

  In the panoramic image composition process executed in step S300, when the operator clicks the [Create] button BT21, the image data Dp1 to Dp3 as described above are joined together with the array displayed in the array display field FD2. Is executed. Then, the composite image data Dpm as a composite result by the joining is displayed in the composite result display field FD3 and is displayed as a thumbnail in the composite result thumbnail display field FD4.

  In this image composition program Pr, different composition results can be obtained even for the same image data Dp1 to Dp3 by checking or not checking the check boxes CB1 and CB2 provided in the “panoramic image composition” window WD2. Can be generated. In the panorama image synthesis process, various synthesis parameters such as a parameter indicating the width of the overlapping area to be superimposed and a parameter indicating the brightness of the image of the overlapping area are prepared. Since different values are set depending on whether or not the check boxes CB1 and CB2 are checked and image synthesis is performed based on the synthesis parameters, different synthesis results are obtained even for the same image data Dp1 to Dp3 as described above. Can be generated. The operator can sequentially create synthesis results with different synthesis parameter values by switching the check of the check boxes CB1 and CB2 by a mouse operation and then clicking the [Create] button BT21.

  In the example of FIG. 5, the synthesis result thumbnail display field FD4 displays three synthesis result thumbnails TH1 to TH3, but the first thumbnail TH1 is checked in both of the two check boxes CB1 and CB2. The second thumbnail TH2 is a case where only the [Perform overlapping spread] check box CB1 is checked, and the third thumbnail TH3 is [Image This is the case where only the “Adjust brightness between” check box CB2 is checked.

  Note that the synthesis result by the panoramic image synthesis process is displayed in the synthesis result display field FD3 and the synthesis result thumbnail display field FD4, but is also displayed in the initial window WD1.

  FIG. 6 is an explanatory diagram showing an initial window WD1 on which the synthesis result corresponding to FIG. 5 is displayed. As shown in the drawing, in the work field FDW, the first to third image data Dp1 to Dp3 as the original images of the image composition are displayed as in the case of FIG. Composite image data Dpm1 to Dpm3 respectively corresponding to the first thumbnails TH1 to TH3 are displayed.

  The operator can select each of the composite image data Dpm1 to Dpm3 by clicking on the composite image data Dpm1 to Dpm3 with the mouse 24 (hereinafter, the composite image data in the selected state is referred to as the composite image data in the selected state). This is called “selected composite image data”). In this state, when the [Viewer] button BTv provided below the processing menu column MN2 is clicked by the operator, an image comparison window is displayed.

  FIG. 7 is a flowchart showing image comparison window display processing. The image comparison window display process is started when an operation command for clicking the [viewer] button BTv with the mouse 24 is received. When the process is started, first, the CPU 11 performs a process of displaying the basic part of the image comparison window WD3 on the display 20 (step S510).

  FIG. 8 is an explanatory diagram showing a basic part of the image comparison window WD3. As shown in the figure, a processing menu column VMN is provided above the image comparison window WD3. The processing menu column VMN is provided with [Enlarge] and [Reduce] buttons BT31 and BT32. The function of both buttons BT31 and BT32 will be described later. A work field VFDW is provided below the process menu column VMN.

  Returning to FIG. 7, after execution of step S510, the CPU 11 performs a process of forming a predetermined number of display areas A1 to A4 with ruled lines in the work field VFDW (step S520). The “predetermined number” is determined by the number of selected combined image data, and when the number of selected combined image data is three as in this example, four display areas A1 to A4 are formed. That is, the number of display areas at least exceeding the number of selected composite image data is formed in a tile shape.

  Subsequently, the CPU 11 displays the selected composite image data Dpm1 to Dpm3 in order in the display areas A1 to A3 (step S530). Thereafter, the CPU 11 forms a control box in each display area, and displays a thumbnail of the selected composite image data displayed in the corresponding display area in each control box (steps S540 and S550).

  FIG. 9 is an explanatory diagram showing the image comparison window WD3 after the image comparison window display process is executed. As shown in the figure, selected composite image data Dpm1 to Dpm3 are displayed in the display areas A1 to A3, respectively, and a control box CB is provided on the upper left of the displayed display areas A1 to A3. The control box CB is not formed in the display area A4 where the selected composite image data is not displayed. In each control box CB, thumbnails of selected combined image data Dpm1 to Dpm3 displayed in the corresponding display areas A1 to A3 are displayed.

  Returning to FIG. 7, the CPU 11 adds the operation frame CF to the thumbnail displayed in step S550 (step S560). The operation frame CF is rectangular and indicates the display range of the selected composite image data Dpm1 to Dpm3 displayed in the corresponding display areas A1 to A3. As shown in FIG. 9, when the entire selected composite image data Dpm1 to Dpm3 is displayed, the operation frame CF is added to the entire circumference of the thumbnail. After execution of step S560, the CPU 11 ends the image comparison window display process. The process executed by the CPU 11 in accordance with the image comparison window display process corresponds to the list display unit 31 (see FIG. 1).

  As shown in FIGS. 10 and 11, the operation frame CF can be changed in size or its position. The size of the operation frame CF is changed by [Enlarge] and [Reduce] buttons BT31 and BT32.

  FIG. 10 is an explanatory diagram showing the image comparison window WD3 when the [Enlarge] button BT31 is clicked from the state of FIG. When the [Enlarge] button BT31 is clicked once, the operation frame CF is reduced at a predetermined rate, and the display range of the selected composite image data Dpm1 to Dpm3 displayed in the display areas A1 to A3 is a predetermined range. Enlarged at a rate. As described above, the reduction ratio of the operation frame CF so that the range of the thumbnail surrounded by the operation frame CF matches the display range of the selected composite image data Dpm1 to Dpm3 displayed in the display areas A1 to A3. The enlargement ratio of the selected composite image data Dpm1 to Dpm3 is determined. The reduction of the operation frame CF and the enlargement of the selected combined image data Dpm1 to Dpm3 are simultaneously performed on all display areas A1 to A3 where the selected combined image data Dpm1 to Dpm3 are displayed.

  Therefore, the operator clicks the [Enlarge] button BT31 one by one in order to enlarge and display all the selected composite image data Dpm1 to Dpm3 displayed in the image comparison window WD3 at a desired magnification. Can do.

  [Reduce] button BT32 performs the reverse operation of [Enlarge] button BT31. That is, when the [Reduce] button BT32 is clicked once, the operation frame CF is enlarged at a predetermined rate, and the display range of the selected composite image data Dpm1 to Dpm3 displayed in the display areas A1 to A3 is It is reduced at a predetermined rate. Therefore, the operator clicks the [Reduce] button BT31 one by one in order to reduce and display all the selected composite image data Dpm1 to Dpm3 displayed in the image comparison window WD3 at a desired magnification. Can do.

  FIG. 11 is an explanatory diagram showing the image comparison window WD3 when the operation frame CF is moved to the lower left from the state of FIG. The operator selects a desired one from the three display areas A1 to A3, and the operation frame CF in the control box CB formed in the selected display area A1 (in the illustrated example, A1 is selected). Is dragged using the mouse 24. By this dragging, the operation frame CF can be moved as intended by the operator within the thumbnail range. When the operation frame CF in the display area A1 is moved, the partial image of the thumbnail surrounded by the operation frame CF is changed. Accordingly, the display range of the selected composite image data Dpm1 displayed in the display area A1 is changed. , And change so as to coincide with the partial image. For example, as shown in the figure, when the operation frame CF is moved to the lower left of the thumbnail and the partial image of the thumbnail surrounded by the operation frame CF is in the lower left quarter range, it is displayed in the display area A1. The display range of the selected combined image data Dpm1 is also a lower left quarter range with respect to the whole.

  As described above, when the operator performs an operation on the operation frame CF in the display area A1, the operation frame CF added to the control box CB formed in the other display areas A2 and A3 is also interlocked. Moving. As a result, the display range of the selected composite image data Dpm2, Dpm3 displayed in the display areas A2, A3 also changes according to the position of the operation frame CF. Therefore, the operator moves all the positions displayed in the image comparison window WD3 by moving the position of the operation frame CF provided in any one of the display areas A1 to A3 using the mouse 24. The display range of the selected composite image data Dpm1 to Dpm3 can be moved in conjunction with each other.

  FIG. 12 is a flowchart showing a first interrupt process that is repeatedly executed every predetermined time when the image comparison window WD3 is displayed. The first interrupt process realizes the operation when the above-mentioned [Enlarge] and [Reduce] buttons BT31 and BT32 are clicked. When the process is started, the CPU 11 first determines whether or not the [enlarge] button BT31 is clicked (step S610). If it is determined that the button has been clicked, the CPU 11 sets the operation frames CF provided in all the display areas A1 to A3 where the composite image is displayed by a predetermined ratio (for example, 10%). At the same time, the display range of the selected composite image data Dpm1 to Dpm3 displayed in the display areas A1 to A3 is enlarged by a predetermined ratio (for example, 10%) (steps S620 and S630). The reduction ratio of the operation frame CF and the selected combined image data Dpm1 so that the range of the thumbnail surrounded by the operation frame CF matches the display range of the selected combined image data Dpm1 to Dpm3 displayed in the display areas A1 to A3. The expansion ratio of Dpm3 is the same.

  On the other hand, if it is determined in step S610 that the [enlarge] button BT31 has not been clicked, the CPU 11 proceeds to step S640 to determine whether or not the [reduced] button BT32 has been clicked. If it is determined that the button has been clicked, the CPU 11 sets the operation frames CF provided in all the display areas A1 to A3 where the composite image is displayed by a predetermined ratio (for example, 10%). While enlarging, the display range of the selected composite image data Dpm1 to Dpm3 displayed in the display areas A1 to A3 is reduced by a predetermined ratio (for example, 10%) (steps S650 and S660). The enlargement ratio of the operation frame CF and the selected combined image data Dpm1 so that the thumbnail range surrounded by the operation frame CF matches the display range of the selected combined image data Dpm1 to Dpm3 displayed in the display areas A1 to A3. The reduction ratio of Dpm3 is the same.

  After executing step S630 or S660, the process returns to “RETURN” to end the first interrupt process.

  FIG. 13 is a flowchart showing a second interrupt process that is repeatedly executed every predetermined time when the image comparison window WD3 is displayed. The second interrupt process realizes an operation when the operation frame CF is dragged by the mouse 24. When the process is started, the CPU 11 first determines whether or not the operation frame CF is dragged (step S710). If it is determined that the operation frame CF has been dragged, the following processing is executed.

  First, the CPU 11 performs a process of determining to which position in the thumbnail the operation frame CF has been moved by the drag (step S720). Specifically, the position of the partial image surrounded by the operation frame CF after dragging with respect to the whole thumbnail (hereinafter referred to as “movement position”) is determined. Next, the CPU 11 sets the display range of the selected composite image data displayed in the display area including the moved operation frame CF (hereinafter referred to as “selection display area”, A1 in the example of FIG. 11) of the operation frame CF. It changes so that it may correspond with the partial image contained in a movement position (step S730).

  Next, the CPU 11 displays a display area (hereinafter referred to as “non-selected display area” in the example of FIG. 11, A 2 and A 3) excluding the selected display area among the display areas A 1 to A 3 where the composite image is displayed. Are selected, and the operation frames CF provided in these display areas are moved to positions that coincide with the movement positions obtained in step S720 (step S740). Thereafter, the CPU 11 changes the display range of the selected combined image data displayed in each non-selected display area so as to coincide with the partial image included in the movement position in step S740 (step S750).

  After executing step S750, the process returns to “RETURN” to end the second interrupt process. On the other hand, if it is determined in step S710 that the operation frame CF is not dragged, the process returns to “RETURN” without executing steps S720 to S750, and the second interrupt process is temporarily terminated.

  The operator visually compares the composite image data Dpm1 to Dpm3 while operating the image comparison window WD3 that operates as described above, and is most excellent in the composite result. Select composite image data with excellent image quality. The operator stores the image name of the selected composite image data, and then switches the initial window WD1 to the active state. Next, the operator clicks a [Save] button BT3 provided in the initial window WD1, and performs a save process. At the time of this saving process, the operator clicks on the stored image name from the composite image data Dpm1 to Dpm3 displayed in the work field FDW of the initial window WD1 to select the selected state. Save the composite image data.

  Instead of the configuration in which the image name is stored and the process proceeds to the saving process as described above, the combined image data selected from the image comparison window WD3 may be saved.

3. Action / Effect:
According to the computer system of this embodiment configured as described above, a plurality of synthesized image data Dpm1 to Dpm3 having different synthesis results are synthesized from the same image data Dp1 to Dp3 by switching the values of the synthesis parameters. Furthermore, the composite image data Dpm1 to Dpm3 can be displayed in a list in the image comparison window WD3. For this reason, the plurality of composite image data Dpm1 to Dpm3 can be easily compared. Accordingly, the composite image data can be selected with good workability.

  In this embodiment, all the composite image data Dpm1 to Dpm3 to be compared can be enlarged and reduced at the same display magnification by simply operating the [Enlarge] and [Reduce] buttons BT31 and BT32. Therefore, since a plurality of composite image data can always be displayed at the same display magnification, the composite images can be compared more easily.

  Furthermore, in this embodiment, when one display range of the composite image data Dpm1 to Dpm3 to be compared is moved by a drag operation, the display range of the other composite image data can be moved in conjunction with the display range. Therefore, since a plurality of composite image data can always be displayed in the same display range, the composite images can be compared more easily.

4). Other embodiments:
The present invention is not limited to the above-described one embodiment or modification, and can be implemented in various modes without departing from the gist of the present invention. For example, the following modifications are possible. It is.

(1) In the above-described embodiment, the value of each synthesis parameter related to the width of the overlapping region and the brightness between images can be switched by the operation of the operator, so that the synthesis result can be obtained while the original image is the same. Although a plurality of different composite images can be formed, various composite parameters can be applied instead of the above two types. For example, it may be a composite parameter for determining whether the distortion correction is a pincushion type or a barrel type. Alternatively, the coordinates of the feature points (common points) of the two images when the two images are manually joined according to the operator's instruction can be used as the synthesis parameter. In short, it is a synthesis parameter that is necessary to synthesize a plurality of original images, and any value can be used as long as the value of the synthesis parameter can be changed based on a command from an input device operated by an operator. It may be a simple synthesis parameter.

(2) In the above-described embodiment, the plurality of composite image data Dp1 to Dp3 stored in the composite image storage unit 32 are combined by a combining process for generating a panoramic image by connecting the plurality of image data Dp1 to Dp3. However, instead of this, it may be synthesized by dynamic range expansion processing. Digital cameras have the disadvantage that the latitude (brightness and darkness that can be expressed) is narrow, but the dynamic range expansion process combines multiple photos taken by changing the exposure with the digital camera. As a result, an image having a smooth gradation from the dark part to the bright part can be generated. A plurality of synthesis results generated by this dynamic range expansion processing may be displayed in a list on an image comparison window formed on the screen. Further, the present invention is not limited to the dynamic range expansion process, and may be any process as long as it is a synthesis process for synthesizing a plurality of original images. The present invention uses the synthesis result of such a synthesis process for image comparison. A list is displayed in the window.

(3) In the embodiment, the list display unit 31 is configured to display a list of a plurality of composite image data Dpm1 to Dpm3. Instead, in addition to the composite image data Dpm1 to Dpm3, the plurality of elements The image data Dp1 to Dp3 may be displayed in a list on the image comparison window WD3. That is, before clicking the [Viewer] button BTv, the operator clicks one of the first to third image data Dp1 to Dp3 in addition to the composite image data Dpm1 to Dpm3 displayed in the work field FDW. As a result, the original image data can also be displayed in a list on the image comparison window WD3. According to this configuration, since the composite images can be compared with reference to the original image, the composite images can be selected with higher accuracy.

  The configuration (3) is more effective in the dynamic range expansion process described in (2). FIG. 14 is an explanatory diagram showing an image comparison window WD3X for comparing the composite image data generated by the dynamic range expansion process. As shown in the figure, the image comparison window WD3X has four display areas. In each display area, two image data Dp11 and Dp12, which are the original images, and a composite result of the two image data Dp11 and Dp12 are displayed. Two pieces of composite image data Dpm11 and Dpm12 are displayed. According to this configuration, it is highly effective to display the original image together with the composite image, and the operator can easily visually confirm how much the latitude of the composite image is expanded with respect to the original image. it can.

(4) In the above-described embodiment, all the composite image data Dpm1 to Dpm3 to be compared can be enlarged / reduced at the same display magnification by operating the [Expand] and [Reduction] buttons BT31 and BT32. Instead of this, instead of this, for one selected from a plurality of composite image data Dpm1 to Dpm3, the display magnification can be enlarged / reduced by an operation command from the input device by the operator, Other composite image data may be configured to be enlarged / reduced in conjunction with the enlarged / reduced composite image data. Also with this configuration, a plurality of composite image data can always be displayed at the same display magnification, so that comparison of composite images is easy.

(5) In the previous embodiment, a control box CB is provided in each display area, and the display magnification and display range of the display image (selected composite image data) can be adjusted by the operation frame CF provided in the control box CB. However, instead of providing the control box CB, an instruction from the operator can be directly transmitted to the display image. For example, the display magnification may be adjusted by clicking the display image and turning the mouse wheel, and the display area may be provided with scroll bars on the right side and the lower side, and the display range may be moved by the scroll bar. .

(6) In the above embodiment, the image data Dpi used for creating the panoramic image is taken by the digital camera 26. Instead of this, the image of the silver salt photograph obtained by using a color scanner or the like. It may be data. In short, any configuration may be used as long as a captured image obtained by capturing with some imaging device (for example, a video camera having a still image capturing function) is acquired. For example, instead of a device prepared in advance in a storage device such as the HDD 15, a device imported from the outside via a network may be used. Further, it is not always necessary to use color image data, and can be applied to monochrome image data.

It is explanatory drawing which shows schematic structure of the computer system to which one Example of this invention is applied. It is explanatory drawing which shows an example of the some picked-up image image | photographed with the digital camera. It is a flowchart which shows the whole flow of a control process. It is explanatory drawing which shows the initial window WD1. It is explanatory drawing which shows the window WD2 for a panorama image composition. FIG. 6 is an explanatory diagram showing an initial window WD1 on which a synthesis result corresponding to FIG. 5 is displayed. It is a flowchart which shows the window display process for image comparisons. It is explanatory drawing which shows the basic part of image comparison window WD3. It is explanatory drawing which shows window WD3 for image comparison after execution of the window display process for image comparison. FIG. 10 is an explanatory diagram showing an image comparison window WD3 when the [Enlarge] button BT31 is clicked from the state of FIG. FIG. 11 is an explanatory diagram showing an image comparison window WD3 when the operation frame CF is moved to the lower left from the state of FIG. It is a flowchart which shows the 1st interruption process repeatedly performed for every predetermined time at the time of the display of image comparison window WD3. It is a flowchart which shows the 2nd interruption process repeatedly performed for every predetermined time at the time of the display of image comparison window WD3. It is explanatory drawing which shows image comparison window WD3X for performing the comparison of the synthetic image data produced | generated by the dynamic range expansion process.

Explanation of symbols

10 ... Personal computer 11 ... CPU
12 ... Bus 13 ... Memory 14 ... Display image memory 15 ... Hard disk drive 16 ... Input control unit 17 ... Display control unit 18 ... Output control unit 20 ... Display 22 ... Keyboard 24 ... Mouse 26 ... Digital camera 28 ... CD drive 29 ... Printer 31 ... List display part 32 ... Composite image storage part Dp1-Dp3 ... Image data Dpm1 ~ Dpm3 ... Composite image data Pr ... Image composition program WD1 ... Initial window BT31 ... [Enlarge] button BT32 ... [Reduce] button WD2 ... Panorama image composition window BT21 ... [Create] button CB1, CB2 ... check box BTv ... [Viewer] button WD3 ... Image comparison window A1-A4 ... Display area CB ... Control box CF ... Operation frame WD3X. ..Image ratio Use window

Claims (14)

A composite image display device that displays on a screen a composite image obtained by combining a plurality of original images,
A composite image storage means for storing a plurality of composite images having the same original image but different composite results;
A composite image display device comprising: a list display unit configured to display a list of the plurality of composite images in an image comparison window formed on the screen. The composite image display device according to claim 1,
The list display means includes:
Display area forming means for forming a plurality of display areas in the image comparison window;
A composite image display device comprising: image display means for displaying the composite images in the formed display areas. The composite image display device according to claim 2,
The image display means includes
A composite image display device comprising display magnification setting means for determining the display of each composite image at the same display magnification. The composite image display device according to claim 3,
The display magnification setting means includes:
A composite image display device comprising display magnification changing means for changing the display magnification based on a command from an input device operated by an operator. The composite image display device according to claim 2,
The image display means includes
A composite image display device comprising display range setting means for determining the display of each composite image so that the display range for the entire composite image is the same. The composite image display device according to claim 5,
The display range setting means includes
In any one of the plurality of display areas, based on a command from an input device operated by an operator, display range manual changing means for changing the display range of the composite image;
When the display range is changed by the display range changing means, the display range in the display area other than the display area where the display range is changed is the same position as the display range changed by the display range manual changing means. A composite image display device comprising: a display range automatic change means for changing to The composite image display device according to claim 1, wherein
The list display means includes:
A composite image display device configured to display a list of the plurality of original images in addition to the plurality of composite images in an image comparison window. The composite image display device according to any one of claims 1 to 7,
A synthesis parameter input means for inputting a value of a synthesis parameter necessary for synthesizing the plurality of original images based on a command from an input device operated by an operator;
Image synthesizing means for synthesizing the plurality of original images based on the value of the synthesis parameter input by the synthesis parameter input means;
Based on a command from an input device operated by an operator, a plurality of synthesis results obtained by the image synthesizing means are stored in the synthesized image storage means by switching values of synthesis parameters by the synthesis parameter input means. A composite image display device comprising: a composite image and means for determining. A composite image display method for displaying a composite image obtained by combining a plurality of original images on a screen,
(A) a step of storing a plurality of synthesized images having the same original image but different synthesized results in a memory;
(B) A composite image display method comprising: displaying a list of the plurality of composite images in an image comparison window formed on the screen. A computer program for displaying a composite image obtained by combining a plurality of original images on a screen,
(A) a function of storing a plurality of synthesized images having the same original image but different synthesized results in a memory;
(B) A computer program for causing a computer to realize a function of displaying a list of the plurality of synthesized images in an image comparison window formed on the screen. A computer program according to claim 10,
The function (b) is
(B-1) a function of forming a plurality of display areas in the image comparison window;
(B-2) A computer program comprising: a function of displaying each composite image in each formed display area. A computer program according to claim 11,
The function (b-2) is
A computer program that has the function of determining the display of each composite image at the same display magnification. A computer program according to claim 11,
The function (b-2) is
A computer program having a function of determining the display of each composite image so that the display range for the entire composite image is the same.   A computer-readable recording medium on which the computer program according to any one of claims 10 to 13 is recorded.

Images