JP2005275979A - Image retrieving program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image retrieving program capable of retrieving a desired image with high accuracy from a group of retrieval images where images taken at a longitudinal position and images taken at a lateral position are mixed. <P>SOLUTION: The images respectively similar to a retrieval key image, an image obtained by turning the retrieval image by +90 degrees, and an image obtained by turning the retrieval key image by -90 degrees are retrieved from the group of retrieval images. Whereby the desired image can be retrieved with high accuracy even when the images taken at the longitudinal position and the images taken at the lateral position are mixed in the group of retrieval images. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image search program, and more particularly to an image search program for searching an image similar to a search key image from a search target image group in which an image shot in a vertical position and an image shot in a horizontal position are mixed.

Various methods have been proposed for searching for images similar in characteristics to the image to be searched (search key image) from the search target image group (for example, Patent Documents 1 and 2). Although these conventional image search methods have various differences in the feature values to be extracted, in general, feature values indicating the color, shape, texture structure, etc. representing the image features are extracted from the search key image to be searched. Similarly, the feature amount is extracted from the search target image group to be searched. Then, the similarity between both feature quantities is calculated for each search object, and the one with a high similarity is extracted as a similar image. At this time, in Patent Document 2, similar images can be searched in consideration of the difference in aspect ratio between the search key image and the search target image group.
JP 2003-91727 A JP 2003-122758 A

  By the way, when shooting with a digital camera, the photographer shoots with the camera held vertically or shoots horizontally according to the subject, but the recorded images are images taken with the camera held vertically. Even if it exists, it is recorded in the same state as an image taken by holding it sideways.

  Therefore, even if a conventional image search method is used to search for an image captured by a digital camera in which an image captured in the vertical position and an image captured in the horizontal position are mixed, the image captured in the vertical position is not detected. Because it is included, there was a drawback that it was not possible to search with high accuracy.

  The present invention has been made in view of such circumstances, and accurately retrieves a target image from a search target image group in which an image shot in a vertical position and an image shot in a horizontal position are mixed. An object of the present invention is to provide an image search program capable of

  In order to achieve the above object, the invention according to claim 1 is directed to a computer for searching an image similar to a search key image from a search target image group, an image input means for inputting a search key image, and the image input means. A first image search means for searching an image similar to the search key image input in the search target image group, and an image similar to an image obtained by rotating the search key image input by the image input means by +90 degrees Second image search means for searching from the image group; third image search means for searching for an image similar to an image obtained by rotating the search key image input by the image input means by -90 degrees from the search target image group; An image search program that functions as one image search means, an image output means that outputs an image searched by the second image search means, and the third image search means. Subjected to.

  According to the present invention, a search key image, an image obtained by rotating the search key image by +90 degrees, and an image similar to the image obtained by rotating the search key image by −90 degrees are searched from the search target image group. To do. As a result, even when an image shot in the vertical position and an image shot in the horizontal position are mixed in the search target image group, the target image can be searched with high accuracy.

  According to a second aspect of the present invention, in order to achieve the object, the image output means rotates the image searched by the second image search means by −90 degrees and outputs the third image. The image search program according to claim 1, wherein the image searched by the search means is rotated by +90 degrees and output.

  According to the present invention, an image searched as an image similar to an image obtained by rotating the search key image by −90 degrees is output after being rotated by +90 degrees, and similar to an image obtained by rotating the search key image by +90 degrees. An image retrieved as an image is output after being rotated by −90 degrees. As a result, the image taken at the vertical position is corrected to the vertical position and the result is output.

  According to a third aspect of the present invention, there is provided an image input means for inputting a search key image, the image input means for searching for an image similar to the search key image from the search target image group, and the image. A first image search unit that searches an image similar to the search key image input by the input unit from the search target image group, and a search that rotates an image similar to the search key image input by the image input unit by +90 degrees, respectively. Second image search means for searching from the target image group; third image search means for searching from the search target image group obtained by rotating images similar to the search key image input by the image input means by -90 degrees; An image search program characterized by functioning as one image search means, an image output means for outputting images searched by the second image search means and the third image search means. To provide a gram.

  According to the present invention, an image similar to the search key image input by the image input means is searched from the search target image group, the search target image group rotated by +90 degrees, and the search target image group rotated by -90 degrees. And search from. As a result, even when an image shot in the vertical position and an image shot in the horizontal position are mixed in the search target image group, the target image can be searched with high accuracy.

  According to a fourth aspect of the present invention, in order to achieve the object, the image output means rotates the image searched by the second image search means by -90 degrees and outputs the third image. 4. The image search program according to claim 3, wherein the image searched by the search means is output after being rotated by +90 degrees.

  According to the present invention, an image searched from a search target image group rotated by −90 degrees is output by being rotated by +90 degrees, and an image searched from a search target image group rotated by +90 degrees is − It is rotated 90 degrees and output. As a result, the image taken at the vertical position is corrected to the vertical position and the result is output.

  According to the image search program of the present invention, it is possible to accurately search for a target image from a search target image group in which an image shot at a vertical position and an image shot at a horizontal position are mixed.

  The best mode for carrying out an image search program according to the present invention will be described below with reference to the accompanying drawings.

  FIG. 1 is a block diagram showing a system configuration of a computer (personal computer) in which an image search process by an image search program according to the present invention is executed.

  The personal computer 10 is a commonly used type of computer. The computer 10 executes an image search program according to the present invention, and controls the entire system. Are stored in the RAM 14, the operating system (OS), the image search program according to the present invention, various application programs, the hard disk drive (HDD) 16 for storing image data, etc., and the CD-ROM. A CD-ROM drive 18 for reading stored data, a display device 20 for displaying calculation results and image data in the CPU 12, a keyboard for inputting commands and numerical values, an input device 22 such as a mouse, a server and a network To communicate through It includes a modem 24 or the like, which are connected to each other by a bus 26.

  FIG. 2 is a diagram showing an embodiment of the main window of the image search program according to the present invention. When the image search program according to the present invention is activated, this main window is displayed on the display device 20. .

  The main window mainly includes a “search key image designation area” for designating a search key image, a “search target designation area” for designating a place where a search target image group to be searched is stored, and a search A “search result display area” for displaying the results and a “search start button” for instructing execution of the search are configured.

  The search key image designation area includes a “search key image display unit” for displaying the search key image and a “search key image selection unit” for selecting the search key image. The selected image is displayed as a search key image on the search key image display unit.

  The search key image selection unit includes a “storage location input unit” for designating a location (folder) in which the search key image is stored. When a specific location (folder) is input to the storage location input unit, A list of image files stored in the input location (folder) is displayed in the “stored file display section”. When an arbitrary image file is selected from the image files displayed on the stored file display unit (clicked with the mouse pointer), the selected image is input to the “search key image input unit”. Displayed on the search key image display section. The image displayed on the search key image display unit is set as the search key image.

  In the example shown in FIG. 2, “MyPicture” is designated as the location where the search key image is stored, and the image file “DSCF0001” is selected as the search key image.

  The search target designation area includes a “search location input unit” for designating a location where the search target image group is stored, and the location (folder) input in this search location input unit is set as the search location. The

  The example shown in FIG. 2 shows a case where a folder with a folder name “Portrait” stored in the D drive is designated as a search target.

  The search result display area has a “thumbnail display button” and a “detail display button” that specify the display format. Clicking the thumbnail display button with the mouse pointer displays the searched image in the thumbnail display format. The output is displayed in the display area. On the other hand, when the detail display button is clicked with the mouse pointer, the searched image is displayed in the detail display format (file name, folder name indicating the storage location, file type, file size, shooting date, image size, etc.). The detailed information is displayed in the search result display area.

  Now, when you specify the search key image and search location in the main window and click the search start button with the mouse pointer, an image similar in characteristics to the specified search key image is searched from the specified search location. The The image search processing procedure will be described below with reference to the flowchart shown in FIG.

  First, an image similar to the search key image is searched from the designated search location, that is, the image group (search target image group) stored in the designated search location (step S10). It is determined from the search result whether a similar image has been searched (step S11). If a similar image is not searched, the process proceeds to step 13. If a similar image is searched, the searched image is displayed on the search result display unit (step S12).

  Next, an image obtained by rotating the search key image by +90 degrees is generated, and an image similar to the image is searched from the search target image group (step S13). It is determined from the search result whether a similar image has been searched (step S14). If a similar image has not been searched, the process proceeds to step 16. If a similar image has been searched, the searched image is displayed on the search result display unit (step S15).

  Next, an image obtained by rotating the search key image by −90 degrees is generated, and an image similar to the image is searched from the search target image group (step S16). It is determined from the search result whether or not a similar image has been searched (step S17). If a similar image is not searched, the process is terminated. If a similar image is searched, the searched image is displayed on the search result display unit (step S18).

  Thus, in addition to searching for an image similar to the search key image itself, an image similar to the image obtained by rotating the search key image by +90 degrees and the image obtained by rotating the search key image by −90 degrees are also searched. Even when an image captured in the vertical position and an image captured in the horizontal position are mixed in the search target image group, the target image can be detected with high accuracy.

  As a similar image search method, a known method is used. For example, a feature amount indicating a color, a shape, a texture structure, or the like indicating a feature of an image is extracted from a search key image, and a search target image group is extracted. Similarly, the feature amount is extracted for each image, and an image having a high similarity to the feature amount of the extracted search key image is extracted from the search target image group.

  In the present embodiment, an image having a high degree of similarity with the feature amount extracted from the search key image itself is searched from the designated search location, and the search key image is generated by rotating the search key image by +90 degrees, and the search key image An image having a high similarity to the feature amount extracted from the image generated by rotating -90 degrees is searched from the designated search location.

  As described above, the searched image is displayed in the search result display unit. At this time, if thumbnail display is selected, the searched image is displayed in the thumbnail display format as shown in FIG. When output and displayed in the search result display area and the detailed display format is selected, the searched image is output and displayed in the search result display area in the detailed display format as shown in FIG.

  By the way, as shown in FIG. 2, when displaying in the thumbnail display format, if the searched image is displayed as it is, the image photographed in the vertical position is displayed in a state rotated by +90 degrees or -90 degrees.

  Therefore, as shown in FIG. 5, for an image searched as an image similar to an image obtained by rotating the search key image by +90 degrees, the image is rotated by -90 degrees and displayed in the search result display area. For an image searched as an image similar to an image rotated by 90 degrees, it is preferable to rotate it by +90 degrees and display it in the search result display area.

  FIG. 6 is a flowchart illustrating a processing procedure when the retrieved vertical position image is displayed in the vertical position.

  First, an image similar to the search key image is searched from the search target image group (step S20). It is determined from the search result whether a similar image has been searched (step S21). If a similar image is not searched, the process proceeds to step 23. If a similar image is searched, the searched image is displayed on the search result display unit as it is (step S22).

  Next, an image obtained by rotating the search key image by +90 degrees is generated, and an image similar to the image is searched from the search target image group (step S23). It is determined from the search result whether a similar image has been searched (step S24). If a similar image has not been searched, the process proceeds to step 26. If a similar image has been searched, the searched image is rotated by -90 degrees and displayed on the search result display unit (step S25).

  Next, an image obtained by rotating the search key image by −90 degrees is generated, and an image similar to the image is searched from the search target image group (step S26). It is determined from the search result whether a similar image has been searched (step S27). If a similar image has not been searched, the process ends. If a similar image has been searched, the searched image is rotated by +90 degrees and displayed on the search result display unit (step S28).

  As described above, for an image searched as an image similar to an image obtained by rotating the search key image by +90 degrees, the search key image is rotated by −90 degrees and displayed in the search result display area, and the search key image is rotated by −90 degrees. With respect to an image searched as an image similar to the image, by rotating it by +90 degrees and displaying it in the search result display area, as shown in FIG. 5, the vertically shot image is displayed in the vertical position, and the image is displayed. It becomes possible to confirm easily.

  When the thumbnail or file name (in the detailed display format) displayed in the search result display area is clicked with the mouse pointer, the image browsing program is launched in a separate window, and the image of the selected thumbnail or file name is displayed on the display device 20. Shall be displayed.

  Next, a second embodiment of the image search program according to the present invention will be described. In the above embodiment, an image similar to the search key image itself is searched, and an image similar to an image obtained by rotating the search key image by +90 degrees and −90 degrees is searched. In the embodiment, an image is searched by rotating the search target side. Hereinafter, the procedure of the image search process of the second embodiment will be described. Note that the search key image and the search location designation method are the same as those in the above-described embodiment.

  FIG. 7 is a flowchart illustrating a procedure of image search processing of the image search program according to the second embodiment.

  First, an image similar to the search key image is searched from the designated search location, that is, the image group (search target image group) stored in the designated search location (step S30). It is determined from the search result whether a similar image has been searched (step S31). If a similar image is not searched, the process proceeds to step 33. If a similar image is searched, the searched image is displayed on the search result display unit (step S32).

  Next, an image similar to the search key image is searched from the search target image group rotated by +90 degrees (step S33). It is determined from the search result whether a similar image has been searched (step S34). If a similar image has not been searched, the process proceeds to step 36. If a similar image has been searched, the searched image is displayed on the search result display unit (step S35).

  Next, an image similar to the search key image is searched from the search target image group rotated by −90 degrees (step S36). It is determined from the search result whether or not a similar image has been searched (step S37). If a similar image has not been searched, the process is terminated. If a similar image has been searched, the searched image is displayed on the search result display unit (step S38).

  Thus, in addition to searching for an image similar to the search key image from the search target image group as it is, search is also performed from the search target image group rotated by +90 degrees and the search target image group rotated by -90 degrees. As a result, as in the above-described embodiment, the target image can be obtained even when the image captured in the vertical position and the image captured in the horizontal position are mixed in the search target image group. It can be detected with high accuracy.

  In this case as well, the searched image is displayed on the search result display unit. When thumbnail display is selected as the display format, the searched image is output and displayed in the search result display area in the thumbnail display format (see FIG. 2). When the detailed display format is selected, The searched image is output and displayed in the search result display area in the detailed display format.

  Further, when displaying in the thumbnail display format, it is preferable to display the image taken in the vertical position in a state rotated by +90 degrees or −90 degrees as in the above embodiment. That is, for an image searched from the search target image group rotated by +90 degrees, an image searched from the search target image group rotated by -90 degrees and displayed in the search result display area and rotated by -90 degrees is displayed. , Rotated by +90 degrees and displayed in the search result display area (see FIG. 5).

  FIG. 8 is a flowchart showing a processing procedure in a case where an image shot in the vertical position is displayed in the vertical position.

  First, an image similar to the search key image is searched from the search target image group (step S40). It is determined from the search result whether a similar image has been searched (step S41). If a similar image is not searched, the process proceeds to step 43. If a similar image is searched, the searched image is displayed as it is on the search result display unit (step S42).

  Next, an image similar to the search key image is searched from the search target image group rotated by +90 degrees (step S43). It is determined from the search result whether or not a similar image has been searched (step S44). If a similar image is not searched, the process proceeds to step 46. If a similar image is searched, the searched image is rotated by -90 degrees and displayed on the search result display unit (step S45).

  Next, an image similar to the search key image is searched from the search target image group rotated by −90 degrees (step S46). It is determined from the search result whether or not a similar image has been searched (step S47). If a similar image has not been searched, the process ends. If a similar image has been searched, the searched image is rotated by +90 degrees and displayed on the search result display unit (step S48).

  As described above, the images retrieved from the search target image group rotated by +90 degrees are displayed in the search result display area after being rotated by -90 degrees, and each of the search target image groups rotated by -90 degrees is displayed. With respect to the image searched from inside, by rotating it by +90 degrees and displaying it in the search result display area, as shown in FIG. 5, the image taken in the vertical position is displayed in the vertical position, and the image can be easily confirmed. Will be able to.

  As described above, according to the image search program of the present embodiment, even in the case where an image captured in the vertical position and an image captured in the horizontal position are mixed in the search target image group, The target image can be searched with high accuracy.

  The display form of the main window shown in this embodiment is an example of the image search program according to the present invention, and the input form of the search key image and the input form of the search target image group adopt other display forms. Also good. Further, the result display form is not limited to the form of the above-described embodiment. For example, the result may be displayed in another window.

  Further, although cases have been described with the present embodiment as examples where the present invention is executed by a personal computer, the present invention can also be executed by a computer incorporated in a digital camera, an image reproduction device, or the like. Thereby, the image search according to the present invention can be performed also in these devices.

Block diagram showing system configuration of computer Figure showing the main window of the image search program (thumbnail display format) Flowchart showing image search processing procedure Figure showing the main window of the image search program (detailed display format) Figure showing the main window of the image search program (thumbnail display format) The flowchart which shows the procedure of the process in the case of displaying the searched vertical position image vertically. Flowchart showing image search processing procedure The flowchart which shows the procedure of the process in the case of displaying the searched vertical position image vertically.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... Personal computer, 12 ... Central processing unit (CPU), 14 ... RAM, 16 ... Hard disk drive (HDD), 18 ... CD-ROM drive, 20 ... Display device, 22 ... Input device, 24 ... Modem, 26 ... Bus

Claims (4)

In order to search an image similar to the search key image from the search target image group,
Image input means for inputting a search key image,
First image search means for searching an image similar to the search key image input by the image input means from a search target image group;
Second image search means for searching an image similar to an image obtained by rotating the search key image input by the image input means by +90 degrees from a search target image group;
Third image search means for searching an image similar to an image obtained by rotating the search key image input by the image input means by -90 degrees from a search target image group;
Image output means for outputting the images searched by the first image search means, the second image search means and the third image search means;
An image search program characterized by functioning as   The image output means rotates the image searched by the second image search means by −90 degrees and outputs the image searched by the third image search means by rotating by +90 degrees. The image search program according to claim 1. In order to search an image similar to the search key image from the search target image group,
Image input means for inputting a search key image,
First image search means for searching an image similar to the search key image input by the image input means from a search target image group;
Second image search means for searching from a search target image group obtained by rotating images similar to the search key image input by the image input means by +90 degrees,
Third image search means for searching from search target image groups obtained by rotating images similar to the search key image input by the image input means by -90 degrees,
Image output means for outputting the images searched by the first image search means, the second image search means and the third image search means;
An image search program characterized by functioning as   The image output means rotates the image searched by the second image search means by −90 degrees and outputs the image searched by the third image search means by rotating by +90 degrees. The image search program according to claim 3.

Images