JP2012160950A - Image processing device, imaging device, and display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the problem of facing some inconveniences when generating plural crop image files from one photographed image and trying to sequentially reproduce them by a slide show function or the like, such as unnatural display due to an arrangement different from the original relative relation between subjects when arranging and displaying them in order from the left depending on a designated crop order.SOLUTION: In order to solve the problem, an image processing device comprises: a setting unit that sets plural crop areas for an original image; a crop image generation unit that cuts out the respective plural crop areas set by the setting unit from the original image to generate plural crop images; and an information addition unit that associates position information representing mutual positional relation with at least one of the plural crop images generated by the crop image generation unit.

Description

  The present invention relates to an image processing device, an imaging device, and a display device.

A crop technique is known in which a plurality of areas are cut out from a single photographed image and each is converted into an image file. With the recent increase in the number of pixels in digital cameras, even if the number of pixels of the original image is sufficient, even cropped images can be enjoyed.
[Prior art documents]
[Patent Literature]
[Patent Document 1] Japanese Patent Application Laid-Open No. 2005-175683

  When a plurality of crop image files are generated from a single photographed image, there are some inconveniences when these are sequentially played back by a slide show function or the like. For example, when crop images are generated for each subject from continuously captured original images and are reproduced one by one, when displayed in time series, subject A of original image 1, subject B, original image 2 The subject A, the same subject B, and the like are displayed in a rapidly changing manner. On the other hand, when displaying for each related subject, only subject A is displayed, such as subject A of original image 1 and subject A of original image 2, followed by subject B of original image 1, subject B of original image 2, Thus, only the subject B is displayed. In this case, the relationship with the passage of time is lost, causing the viewer to feel uncomfortable. In addition, even if images cropped from the original image taken at the same time are displayed at the same time, depending on the specified crop order, for example, if they are displayed in order from the left, they are arranged differently from the relative relationship of the subject. As a result, the display becomes unnatural. In particular, if the relative relationship is not maintained when displaying cropped images having overlapping portions, fragments of the same subject image are displayed discretely on the display screen, which is very unsightly for the viewer.

  In order to solve the above problem, an image processing apparatus according to a first aspect of the present invention includes a setting unit that sets a plurality of crop areas for an original image, and a plurality of crops set by the setting unit from the original image. A crop image generation unit that cuts out each of the regions and generates a plurality of crop images, and information addition that associates position information indicating a mutual positional relationship with at least one of the plurality of crop images generated by the crop image generation unit A part.

  In order to solve the above problem, an imaging device according to a second aspect of the present invention is an imaging device as the image processing device according to the first aspect, and the setting unit includes a plurality of setting units before generating an original image by photographing. Set the crop area.

  In order to solve the above problems, a display device according to a third aspect of the present invention is a display device that displays a plurality of crop images generated by the imaging device according to the second aspect, and is added by an information adding unit. A display control unit that arranges and simultaneously displays a plurality of cropped images cropped from the same original image based on the position information.

  It should be noted that the above summary of the invention does not enumerate all the necessary features of the present invention. In addition, a sub-combination of these feature groups can also be an invention.

1 is a system configuration diagram of a camera according to an embodiment. It is a rear view of the camera which displays a crop area setting screen. It is a figure which shows the folder structure of the original image file and crop image file which are recorded on a recording medium. It is a figure which shows the file structure of a crop image file. It is a figure which shows a mode that a crop area | region follows the movement of a to-be-photographed object. It is an operation | movement flowchart until a crop image file is produced | generated. 1 is an external view of a liquid crystal display according to the present embodiment. It is a block diagram of a liquid crystal display. A case where the relative relationship between crop images is maintained and displayed is shown. The case where enlarged display is performed while maintaining the relative relationship between cropped images is shown. The case where it displays without maintaining the relative position of a crop image is shown. The case where a focus adjustment area | region is arrange | positioned in the center of an image display area is shown. The case where three persons are shown as subjects in the original image is shown. The case where three crop images are displayed simultaneously is shown.

  Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. In addition, not all the combinations of features described in the embodiments are essential for the solving means of the invention.

  FIG. 1 is a system configuration diagram of a camera 10 according to the present embodiment. The camera 10 includes an optical system 20. The optical system 20 mainly includes a zoom lens 21, a focus lens 22, a correction lens unit 23, a lens shutter 24, and the like. The subject image enters the optical system 20 along the optical axis 11 and forms an image on the imaging surface of the image sensor 31.

  The imaging element 31 is an element that photoelectrically converts an optical image that is a subject image that is transmitted through the optical system 20 and is, for example, a CCD or CMOS sensor. The subject image photoelectrically converted by the image sensor 31 is converted from an analog signal to a digital signal by the A / D converter 32. The charge readout control of the image sensor 31 and the conversion control of the A / D converter 32 are synchronized by a clock signal supplied from a timing generator 34 that has received synchronization control from the memory controller 33.

  The subject image converted into the digital signal is sequentially processed as image data. The image data converted into a digital signal by the A / D converter is temporarily stored in the internal memory 35 under the control of the memory control unit 33. The internal memory 35 is a random access memory that can be read and written at high speed, and for example, a DRAM, an SRAM or the like is used. The internal memory 35 serves as a buffer memory that waits for the order of image processing when image data is continuously generated at high speed in continuous shooting and moving image shooting. In addition, the image processing unit 36 also serves as a work memory in image processing and compression processing. Furthermore, it also has a role of temporarily storing image data processed for a predetermined purpose. Therefore, the internal memory 35 has a sufficient memory capacity corresponding to these roles. The memory control unit 33 controls how much memory capacity is allocated to what work. Specific image data storage processing in the internal memory 35 will be described later.

  The image processing unit 36 converts the image data into an image file according to a predetermined image format in accordance with the set shooting mode and an instruction from the user. For example, when a JPEG file is generated as a still image, image processing such as color conversion processing, gamma processing, and white balance processing is performed, and then adaptive discrete cosine conversion is performed to perform compression processing. Also, when an MPEG file is generated as a moving image, intra-frame coding and inter-frame coding are applied to a frame image as a continuous still image generated by reducing the number of pixels to a compression process. Do. In addition, the image processing unit 36 performs a crop process for cutting out a partial area from the image data and generating another image file. Specific crop processing will be described later.

  The still image file and the moving image file processed by the image processing unit 36 are recorded on the recording medium 60 from the internal memory 35 via the recording medium IF 37 under the control of the memory control unit 33. The recording medium 60 is a non-volatile memory that is configured by a flash memory or the like and is detachable from the camera 10. However, the recording medium 60 is not limited to a removable type, and may be a recording medium such as an SSD built in the camera 10. At this time, the still image file and the moving image file recorded on the recording medium 60 are output to the outside via a wired USB, a wireless LAN, or the like.

  The image data processed by the image processing unit 36 generates display image data in parallel with the image data processed for recording. The display image data is image data with a small number of pixels, which has been thinned out by copying image data processed for recording. The generated image data for display is converted into an analog signal by the D / A converter 39 synchronized with the clock signal from the timing generator 34 under the control of the display controller 38 and displayed on the display unit 40. . Regardless of whether recording is performed or not, if image data for sequential display is generated and displayed on the display unit 40, a live view function can be realized. In addition, various menu items relating to various settings of the camera 10 can be displayed on the display unit 40 with or without displaying an image.

  The camera 10 is directly or indirectly controlled by the system control unit 41 including each element in the image processing described above. The system control unit 41 includes a system memory 42. The system memory 42 is an electrically erasable / recordable non-volatile memory, and is composed of, for example, an EEPROM (registered trademark). The system memory 42 records constants, variables, programs, and the like necessary for the operation of the camera 10 so that they are not lost even when the camera 10 is not operating. The system control unit 41 appropriately expands constants, variables, programs, and the like in the internal memory 35 and uses them for controlling the camera 10.

  The zoom lens 21, the focus lens 22, the correction lens unit 23, and the lens shutter 24 that constitute the optical system 20 are respectively controlled by the system control unit 41 under the overall control of the zoom control unit 43, the focus control unit 44, and the image stabilization drive control. Controlled by the unit 45 and the exposure control unit 46. The zoom control unit 43 drives the zoom lens 21 according to a user instruction to change the angle of view of the subject image. The focus control unit 44 controls the focus lens 22 so that the subject image in a specific area is focused on the light receiving surface of the image sensor 31 based on the contrast AF information using continuously acquired image data. To drive.

  The image stabilization drive control unit 45 includes a position detection sensor that detects the position of the correction lens of the correction lens unit 23 and a shake detection sensor that detects a shake applied to the camera 10. The image stabilization drive control unit 45 drives the correction lens in consideration of the output of the position detection sensor so as to cancel out the shake of the camera 10 detected from the shake detection sensor. Thereby, the subject image maintains a stable image formation state on the light receiving surface of the image sensor 31. The exposure control unit 46 drives the lens shutter 24 based on the exposure value obtained by analyzing the image data processed by the image processing unit 36 by the system control unit 41, and adjusts the aperture and shutter speed of the incident subject image. To do. In the case of moving image shooting or the like, when acquiring image data of each frame, the shutter speed can be adjusted by controlling the charge readout timing of the image sensor 31.

  Although the camera 10 includes a plurality of operation members 47 that receive operations from the user, the system control unit 41 detects that these operation members 47 have been operated, and executes an operation corresponding to the operation. Further, the camera 10 includes a release switch 48 as a kind of the operation member 47. The release switch 48 is composed of push buttons that can be detected in two steps in the push-down direction, and the system control unit 41 detects AF, AE, etc., which are shooting preparation operations by detecting SW1 that is the first-step push. The subject image acquisition operation by the image sensor 31 is executed by detecting SW2 that is the second-stage depression.

  The camera 10 receives power supply from the power supply 61. The power supply control unit 49 communicates with the power supply 61 to detect remaining power and monitor power supply. The power source 61 includes a secondary battery, a household AC power source, and the like.

  FIG. 2 is a rear view of the camera 10 that displays a crop area setting screen for setting a crop area. In addition to the display unit 40 described above, a plurality of operation members 47 are provided on the back surface of the camera 10. Specifically, a mode switch 51 used for switching modes such as a shooting mode, a metering mode, and an AF mode, a playback switch 52 for playing back a shot image file, a menu switch 53 for displaying various setting items, and a shot image. An erase switch 54 for erasing is provided. Furthermore, a cross switch 55 used for moving the displayed setting item and the like, and an OK switch 56 for executing the selected function are provided. The cross switch 55 also has a rotation function, and is used for an image display frame advance instruction and the like. A zoom switch 57 is also provided for adjusting the angle of view by driving the zoom lens 21. The zoom switch 57 is a seesaw switch, and is used for an enlargement / reduction instruction when an image file is reproduced. Further, a touch panel sensor 58 is provided on the display unit 40 so as to detect a photographer's finger contact and realize a function corresponding to the contact position.

  The photographer can call up a crop area setting screen for setting a crop area by operating the menu switch 53 during live view display. On the crop area setting screen, the current subject image is displayed in live view, and the crop area setting is accepted from the photographer.

  For normal shooting, image data is generated at the angle of view displayed in live view. That is, the entire output from the effective pixels of the image sensor 31 is processed as one image data. On the other hand, in shooting with a crop area set, the set area is cut out from the angle of view displayed in the live view, and image data is generated in the cut out area. That is, a part of the output of the effective pixel of the image sensor 31 is processed as one image data. However, in this embodiment, a plurality of crop areas are set and output as crop images for an original image that is processed as a single image data from all the effective pixels of the image sensor 31. Moreover, the crop areas are allowed to overlap each other. Therefore, crop image generation is not the charge readout method of the crop area at the time of output of the image sensor, but once all effective pixels are read out, the image data is generated and cut out and processed by the trimming method in the image processing. Is preferred.

  The figure shows a situation where two crop areas are designated by the photographer. The photographer touches two places on the image displayed in the live view to generate a rectangle represented by a broken line. The touch by the photographer is recognized by the touch panel sensor 58, and the coordinate information is input to the system control unit 41. The photographer touches the OK area 101 to confirm the generated rectangular area as the crop area. When it is desired to redo the generation of the rectangle, the cancel area 102 is touched. If another crop area is to be generated, this operation is repeated. The crop areas set in this way are numbered in the order set, and are displayed superimposed on the crop area. In the figure, a first crop area 103 and a second crop area 104 are displayed. The area can be set in the same manner by using not only the touch panel sensor 58 but also the cross switch 55 and the OK switch 56.

  The camera 10 has a face detection function for detecting a human face from a subject image. When a human face is detected in the subject image displayed in the live view, a face detection frame 105 is displayed so as to surround the detected face. When the system control unit 41 detects a human face, the system control unit 41 may display a frame of a certain size including the detected face as a default crop area so that the photographer can shape the default frame. Alternatively, when the photographer does not perform specific crop area setting, a plurality of crop areas may be automatically set by surrounding the detected faces.

  When a plurality of crop areas are set in this way and a shooting operation is performed, an original image file and a crop image file are generated and recorded on the recording medium 60. Depending on the prior settings, recording of the original image file can be omitted. FIG. 3 is a diagram showing the folder structure of the original image file and the crop image file recorded on the recording medium 60.

  Under the DCIM folder that stores the image file generated by the camera 10 and the related file, an ORG folder that is incremented from 100 and numbered is sequentially generated. The ORG folder is a folder for storing original image files, and 200 original image files are stored in one folder. Therefore, every time 200 original image files are stored, the next ORG folder is generated. For example, if 200 original image files are stored in the 100 ORG folder, the 101 ORG folder is generated when the next 201 original image file is generated, and the 201 original image file is stored in the 101 ORG folder. The The original image file stored in the ORG file is given a file name by a 4-digit character string, a 4-digit number, and an extension representing the image format. For example, DSCN0001. Named as JPG, the 4-digit number is incremented sequentially to distinguish it from other original image files.

  When the crop image file is generated, a CRP folder is generated under the DCIM folder in parallel with the ORG folder. The CRP folder is a folder for storing a crop image file, and a folder name is generated by giving the same numeric string as the ORG folder for storing a corresponding original image file. The crop image file stored in the CRP folder conforms to the file name of the corresponding original image file. Specifically, a 4-digit character string representing the cropped image, a 4-digit number assigned to the original image file, a number assigned in the order set as the crop area, and an extension representing the image format are combined. And a file name is assigned. For example, the original image DSCN0002. When two crop image files are generated from JPG, RSCN0002_01. JPG and RSCN0002_02. Named as JPG.

  Since the crop image file is generated when a crop area is set and shooting is performed, the crop image file does not exist corresponding to all original image files. Therefore, a CRP folder is generated only when a crop image file is generated. Therefore, when there is no crop image file corresponding to the original image file, there may be no corresponding CRP folder of a numeric string. In the example of FIG. 3, the original image file is recorded even when the crop area is set. However, when the original image file is not generated, the crop image file is represented by the number of the original image file. A number string may be generated by incrementing without depending on the string.

  Next, the file structure of the crop image file will be described. FIG. 4 is a diagram showing the file structure of a crop image file.

  A crop image file is a file whose main elements are main image data that is compressed image data itself, reduced and resized thumbnail image data used for temporary display, and tag information that is related information of the main image data. It has a structure. When the JPG file format is adopted as the file format of the crop image file, the tag information is defined as EXIF information.

  As shown, the tag information is classified for each category and various information is described. The main information is described below.

  Image information is described in the file information category. Specifically, the number of dots in the x direction and the y direction of the main image data and the number of bits that are the number of colors of each dot are described. The shooting date and time are described in the shooting information category. The crop image files generated from the same original image are marked with the same shooting date and time.

  In the crop information category, first, the file name of the original image file is described. From this information, even if the file name of the clip image file is changed, the crop image file and the original image file can be associated with each other as long as the file name of the original image file is not changed.

  The crop information category further describes the number of cropped image files that are cropped from the original image. By reading this information, the system control unit 41 can recognize the number of files to be read when simultaneously displaying a plurality of crop images as described later.

  The crop information category further describes the crop number of the crop image file. The crop number is a number assigned in the order in which the crop area is set as described above, and although it appears in the file name, it is also described as tag information. The crop number represents a priority order among a plurality of crop images generated from the same original image. The smaller the number, the higher the priority order. The default order is the order in which the crop areas are set. However, the photographer may arbitrarily change the order later, or the crop area including the focus detection area and the face image that matches the registered face information. You may change suitably on the basis of the area | region etc. which contain.

  In the category of crop information, file names of other crop image files generated from the same original image are further described. If the file name of another crop image file is changed later, it can be used to search for a related crop image file if the file name is corrected to the changed file name.

  In the crop information category, original image information corresponding to the crop image file is further described. Similar to the image information of the cropped image, the original image information describes the number of dots in the x direction and the y direction of the main image data in the original image file, and the number of bits that are the number of colors of each dot.

  The category of crop information further describes anti-original image coordinate information indicating where the crop image was cut out from the main image. Specifically, the dot at the upper left vertex of the original image is the coordinate origin (0, 0), the right direction is the x plus direction, the lower direction is the y plus direction, each dot is represented, and the upper left corner of the cropped image The vertex dot is described by what coordinate value is represented with respect to this original image coordinate system. The cropped image in the example shown in the figure generates a cropped image from the original image consisting of 4368 dots x 2912 dots by cutting out the area of 2020 dots x 1624 dots with the (340, 1160) dot in the original image coordinate system as the upper left vertex. You can see that

  In the crop information category, the center coordinates of the focus detection area in the original image are further described. Although specifically described later, the display format can be changed depending on whether or not the coordinates are included in the cropped image.

  In the category of image recognition information, the number of faces detected by face detection in the cropped image and the registration identification code of the face information when it is determined that the detected face matches the registered face information are described. Yes. Similarly, the number of faces detected by face detection in the original image and the registration identification code of the face information when it is determined that the detected face matches the registered face information are described.

  Since each of a plurality of crop image files generated from the same original image has the tag information as described above, the system control unit 41 recognizes which crop image files are generated from the same original image. And the relative positional relationship between the images relative to the original image can be recognized.

  It should be noted that the generation of the same original image and the relative positional relationship between the crop images are not limited to the above description format, and various formats are possible. For example, instead of describing the crop information in each crop image file, for example, it is related to the tag information of the crop image file having the highest priority among the crop image files generated from the same original image. A format in which the information of the crop image is described together is conceivable. In this case, instead of expressing the cutout position with respect to the original image coordinate system, the coordinate system based on any one crop image, for example, the crop image of the crop image file that collectively describes the crop information is used as a reference. The cropping position of each crop coordinate may be expressed with respect to the coordinate system. In this case, depending on the cropped image, there may be a coordinate value represented by a negative numerical value.

  As another format, a related file in which the crop information of the crop image file is collected may be generated independently of the crop image file. The related file manages, for example, a pair of link information to the related file and crop information as in a DPOF file format in which print information of related image files are collectively described. Specifically, a plurality of crop image files generated from the same original image file are collected, and each of the above-described crop information is described so as to link to the corresponding crop image file. The system control unit 41 can recognize which crop image files are generated from the same original image by referring to the related file, and the relative image to the original image between the images can be recognized. The positional relationship can be recognized.

  Note that the tag information of the original image file may also describe file information and crop information of the crop image file generated from its own image. With this configuration, the crop image file can be searched based on the original image file, and the original image and the crop image can be displayed in a format described later.

  As shown in FIG. 2, once the crop area is set, the crop area setting is maintained when shooting is continuously performed. In particular, when the subject moves, it is possible to automatically follow the crop region in accordance with the movement of the subject while maintaining the size of the crop region. FIG. 5 is a diagram illustrating how the crop area follows the movement of the subject.

  For example, consider the first crop area 103 set based on the face detection frame 105 and the second crop area 104 additionally set by the photographer. Since the face of a person as a subject can be detected by face detection as described above, the system control unit 41 can cause the face detection frame 105 to follow the face of the person by continuously performing face detection. Since the first crop area 103 is set based on the face detection frame 105, for example, if a relative coordinate value is calculated with respect to the center coordinate of the face detection frame 105, the first crop area 103 is indirectly set. The movement of the subject person can be followed.

  When the moving subject is included in the second crop area 104 additionally set by the photographer, the system control unit 41 calculates the moving vector in the area from the images before and after being acquired, and thereby the subject. Can be calculated. If the second crop area 104 is moved in accordance with the amount of movement, the second crop area 104 can follow the moving subject. According to FIG. 5, it is assumed that the subject in the second crop area 104 is once hidden by the subject in the first crop area 103 during the transition from (a) to (b). If the movement vector per unit time of the moving subject included in the area 104 is calculated, the second crop area 104 can be continuously moved.

  With this configuration, the system control unit 41 sequentially sets the relative positional relationship of the plurality of crop areas with respect to the original images that are continuously captured and generated according to the subject image for each original image. Since it can be changed, it is possible to save the trouble of setting a crop area each time shooting is performed. The crop image generated by automatically following the crop area in this way can be expected to always capture the subject accurately, so it is natural for the viewer, especially when displayed continuously after shooting. You can enjoy the change.

  Next, processing until a crop image file is generated by the camera 10 will be described. FIG. 6 is an operation flowchart until a crop image file is generated. For example, the photographer starts the shooting operation flow by turning on the power of the camera 10 and executing live view display by the display unit 40.

  In step S101, the system control unit 41 receives a crop area setting according to the procedure described with reference to FIG. In step S <b> 102, upon receiving an instruction from the photographer that the crop area setting has been completed, the system control unit 41 waits until the photographer issues a photographing instruction by operating the release switch 48. If a crop area is additionally set, the process returns to step S101.

  When the release switch 48 is operated by the photographer, a photographing operation is performed in step S103. In the photographing operation, the system control unit 41 operates the lens shutter 24 by the exposure control unit 46 according to the determined exposure value, and guides the subject light flux to the image sensor 31. In step S <b> 104, the photoelectrically converted image signal is processed by the image processing unit 36, and all output from the effective pixels of the image sensor 31 is generated as one image data. The system control unit 41 temporarily stores the image data generated in this way as original image data in the internal memory 35, and cuts out image data corresponding to the crop area set in step S101 to generate crop image data. The cropped cropped image data is subjected to compression processing by the image processing unit 36, and is converted into a cropped image file after the tag information is added by the system control unit 41. The system control unit 41 repeats this process for the plurality of crop areas set in step S101.

  In step S106, the system control unit 41 determines whether the photographer is set to leave the original image data. If the setting is not to be left, the system control unit 41 proceeds to step S107 and stores the original stored in the internal memory 35. Erase the image data. In step S108, the crop image file generated in step S105 is recorded on the recording medium 60. If it is a setting to leave, the process directly proceeds to step S108, and the system control unit 41 converts the original image data into the original image file by the image processing unit 36, and then records it on the recording medium 60 together with the crop image file generated in step S105. To do.

  In step S108, it is determined whether there is an instruction to continuously shoot, and if the shooting instruction has ended, a series of shooting operations are ended. If the shooting instruction is continued, the process proceeds to step S110, and as described with reference to FIG. 5, the crop area is updated following the subject for each crop area, and the process returns to the shooting operation in step S103 again.

  In the above description, the case where the crop area is set before shooting has been described. Of course, the crop image file may be generated after the generation of the original image file. When the crop image file is generated afterwards, the system control unit 41 causes the display unit 40 to display the original image, and the photographer sequentially sets a crop area for the displayed image. When the crop area setting is completed, the system control unit 41 uses the image processing unit 36 to generate a corresponding crop image file. In this case, for a plurality of original image files photographed in succession, using the face detection and movement vector method as described above, a crop area once set is obtained with respect to continuous original images. It can also be moved following the movement of the subject.

  The cropped image file generated as described above can be displayed by switching to the playback mode by operating the playback switch 52. In particular, as described above, the crop image file describes which crop image file was generated from the same original image and the relative positional relationship between the crop images. The display can be executed with various variations. Various display modes with variations can be executed on the display unit of the camera 10 as well, but the same display can be executed on a display device that does not have a photographing function.

  FIG. 7 is an external view of a liquid crystal display 71 which is an example of a display device. The display as a display device is not limited to the liquid crystal display 71 but may be a plasma display, an organic EL display, a projector, or the like.

  As shown in FIG. 7, the liquid crystal display 71 includes a display main body 72 and a remote controller 73 operated by an observer as main components. The remote controller 73 includes a plurality of operation members, and includes, for example, a cross switch 74 used for moving displayed setting items and the like, and an OK switch 75 for executing a selected function. The cross switch 74 also has a rotation function, and is used for an image display frame advance instruction and the like. When a crop image file is generated afterwards, a crop area is set by operating these operation members. In addition, the viewer selects an arbitrary display form from various display forms to be described later. These operation commands are transmitted to the display main body 72 by, for example, infrared communication.

  The display main body 72 includes a slot 76 for receiving the image recording medium 60 in which the original image file and the crop image file are stored. Importing an image file from the outside is not limited to the detachable image recording medium 60 but can be realized by a communication means using a LAN or the like.

  The read original image and cropped image are displayed in an image display area 78 of the display screen 77 in accordance with a display format described later. At the same time, the information display area 79 displays, for example, the original image file name. Note that the image file to be captured is not limited to the image file generated by the camera 10, and may be any image file as long as the relative positional relationship between the cropped images is described as described above. Further, when the crop image file is generated afterward on the liquid crystal display 71, any image file may be used as long as it conforms to a supported file format.

  FIG. 8 is a block diagram of the liquid crystal display 71. The remote controller 73 includes a remote control unit 81 that controls the remote controller 73, an operation reception unit 82 that receives an instruction from the viewer by inputting an operation member, and a remote control transmission unit 83 that transmits an operation command signal of the observer to the display main body 72. Prepare.

  The display main body 72 includes a display control unit 84 that controls the display main body 72, a remote control reception unit 85 that receives an operation command signal from the remote control transmission unit 83, and an IF 86 that captures an image file from the image recording medium 60. In addition to a program for operating the liquid crystal display 71, a system memory 88 that is a storage device that stores various adjustment values and setting values, and an internal memory 89 in which a program stored in the system memory 88 is expanded. The internal memory 89 also serves as a working memory.

  The image processing control unit 87 expands the original image file delivered from the display control unit 84 to generate a display format image signal, and develops a plurality of crop image files delivered from the display control unit 84, An image signal for simultaneous display is generated while adjusting the relative position between the cropped images. In addition, when a crop image file is generated afterwards, a file conversion process for performing a compression process or the like on the crop image is executed. The image signal generated by the image processing control unit 87 is transferred to the display control unit 90, and a predetermined information display is superimposed and displayed.

  The liquid crystal display 71 can arrange and display a plurality of cropped images cropped from the same original image at the same time. There can be various variations in the arrangement of the cropped images. Therefore, if the crop image file describes which crop image file was generated from the same original image and the relative positional relationship between the crop images, what kind of display format can be displayed? Is described below.

  FIG. 9 shows a case where display is performed while maintaining the relative relationship between the cropped images. The figure shows a state in which two images, a first crop image 113 and a second crop image 114, are displayed as crop images. The display control unit 84 can grasp the relative positional relationship between the first crop image 113 and the second crop image 114 from the tag information, for example, so that the relative positional relationship with the image display region 78 is maintained. Determine the position to arrange. Here, the positions of the first crop image 113 and the second crop image 114 are determined based on the case where the original image 115 is displayed in the full image display area 78. Therefore, when the original image 115 is not displayed, for example, the cropped image is displayed on a black background. Also, the crop number 116 and the file name 117 can be displayed adjacent to the crop image. Of course, other information accompanying the cropped image may be displayed in an adjacent area of each cropped image.

  The viewer can display the original image 115 by operating the remote controller 73. At this time, by performing image processing such as displaying the original image 115 lightly, the clip image can be made to stand out while allowing the viewer to visually recognize the original image as a whole image.

  FIG. 10 shows a case where enlarged display is performed while maintaining the relative relationship between the cropped images. For example, when two sheets of the first crop image 113 and the second crop image 114 are arranged while maintaining a relative positional relationship with each other, it is assumed that the rectangle is inscribed therein, and the image display area is displayed when the rectangle is enlarged. These cropped images are enlarged at a magnification such that 78 and at least one of the upper and lower sides and the left and right sides touch each other. Then, it is possible to greatly appreciate the cropped image in which the relative relationship is maintained by using the image display area 78 to the maximum. The enlargement of the cropped image may be performed automatically by the display control unit 84 by the above-described method, or may be performed stepwise by receiving an operation of the viewer's remote control 73.

  FIG. 11 shows a case where display is performed without maintaining the relative position of the cropped image with respect to the original image. For example, as shown in FIG. At this time, since the display control unit 84 knows the relative positional relationship with each other, for example, only the coordinates in the x direction of the first crop image 113 and the second crop image 114 are compared, and either image is left. You may decide whether to display. Considering the shape of the image display area 78 and the shape of each cropped image as well as the relative positional relationship between the cropped images, it is determined whether to juxtapose in the left-right direction or juxtapose in the vertical direction. Also good. For example, if all of the cropped images are horizontally long, they are juxtaposed in the vertical direction with respect to the image display area 78 regardless of the relative positional relationship with each other.

  The first crop image 113 and the second crop image 114 shown in the figure have portions that overlap each other, but when there are portions that overlap between the crop images in this way, the relative positional relationship is maintained. It can be said that display is preferable. Therefore, the display control unit 84 may permit the display by changing the relative positional relationship only when it is determined that there is no overlapping area between the cropped images to be displayed.

  In addition, the arrangement can be changed using the shooting information at the time of shooting the original image described in the tag information of the original image file or the tag information of the crop image file. For example, referring to the focal length information of the zoom lens 21, the distance between the cropped images is set larger than the actual relationship when captured at a wide angle, and the distance between the cropped images is set when captured at a telephoto position. Make it shorter than the actual relationship. By displaying in this way, it is possible to perform display that emphasizes perspective.

  FIG. 12 shows a case where the focus detection area 118 is arranged at the center of the image display area 78. As described above, the center coordinates of the focus detection area 118 in the original image are described as the focus point information in the tag information of the crop image file. Therefore, the display control unit 84 reads out the focus point information from the tag information, and arranges and displays the crop image including the focus point so as to be the center of the image display area 78. In particular, the focus point may be displayed so as to coincide with the center of the image display area 78. By displaying in this way, the main subject that the photographer wanted to focus on can be viewed at the center of the image display area 78.

  Of course, even three or more cropped images can be simultaneously displayed in various variations. FIG. 13 shows a case where three people are shown as subjects in the original image 119. The crop areas are set based on the face areas 120, 121, and 122 detected by the face detection function, and are formed into crop image files as a first crop image 123, a second crop image 124, and a third crop image 125, respectively. In particular, the center coordinates of the face area 120 on which focus detection has been performed are described in the tag information of the crop image file as a focus point.

  FIG. 14 shows a case where three crop images generated in this way are displayed simultaneously. When the first crop image 123, the second crop image 124, and the third crop image 125 generated in this way are displayed at the same time, the two-dimensional directional relationship is maintained, and each is enlarged to the image display area 78. On the other hand, it can be displayed in full. At this time, the first crop image 123 that is a crop image including the focus point may be displayed larger than the second crop image 124 and the third crop image 125. Displaying in this way makes it easier to visually recognize the facial expression of a person.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

  The order of execution of each process such as operations, procedures, steps, and stages in the apparatus, system, program, and method shown in the claims, the description, and the drawings is particularly “before” or “prior to”. It should be noted that the output can be realized in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the description, and the drawings, even if it is described using “first”, “next”, etc. for convenience, it means that it is essential to carry out in this order. It is not a thing.

DESCRIPTION OF SYMBOLS 10 Camera, 11 Optical axis, 20 Optical system, 21 Zoom lens, 22 Focus lens, 23 Correction lens unit, 24 Lens shutter, 31 Image sensor, 32 A / D converter, 33 Memory control part, 34 Timing generation part, 35 Internal memory, 36 Image processing unit, 37 Recording medium IF, 38 Display control unit, 39 D / A converter, 40 Display unit, 41 System control unit, 42 System memory, 43 Zoom control unit, 44 Focus control unit, 45 Prevention Vibration drive control unit, 46 Exposure control unit, 47 Operation member, 48 Release switch, 49 Power supply control unit, 51 Mode switch, 52 Playback switch, 53 Menu switch, 54 Erase switch, 55 Cross switch, 56 OK switch, 57 Zoom switch 58 touch panel sensor, 60 records Medium, 61 Power supply, 71 Liquid crystal display, 72 Display main body, 73 Remote control, 74 Cross switch, 75 OK switch, 76 slot, 77 Display screen, 78 Image display area, 79 Information display area, 81 Remote control unit, 82 Operation accepting unit 83 Remote control transmission unit 84 Display control unit 85 Remote control reception unit 86 IF, 87 Image processing control unit 88 System memory 89 Internal memory 90 Display control unit 101 OK region 102 Cancel region 103 First crop Area, 104 second crop area, 105 face detection frame, 113 first crop image, 114 second crop image, 115 original image, 116 crop number, 117 file name, 118 focus detection area, 119 original image, 120, 121, 122 face area, 123 first crop image, 124 second crop image, 125 third crop image

Claims (17)

A setting section for setting a plurality of crop areas for the original image;
A crop image generation unit that cuts out each of the plurality of crop areas set by the setting unit from the original image and generates a plurality of crop images;
An image processing apparatus comprising: an information addition unit that associates position information representing a mutual positional relationship with at least one of the plurality of crop images generated by the crop image generation unit.   The image processing apparatus according to claim 1, wherein the information adding unit records the position information in meta information of each of the plurality of crop images.   The image processing apparatus according to claim 1, wherein the information adding unit generates a related file representing the position information as a separate file from the plurality of cropped images.   The image processing apparatus according to claim 1, wherein the information adding unit records the position information on the original image.   5. The image processing according to claim 1, wherein the information adding unit adds, to each of the plurality of crop images, a tag representing the original image and crop coordinates with respect to a coordinate system of the original image. apparatus.   The information addition unit adds a tag representing another crop image cropped from the original image and a crop coordinate with respect to a reference coordinate system to each of the plurality of crop images as the position information. The image processing apparatus according to any one of the above.   The image processing apparatus according to claim 6, wherein the reference coordinate system is a coordinate system of the original image.   The image processing apparatus according to claim 6, wherein the reference coordinate system is one coordinate system of the plurality of cropped images. The image processing device according to any one of claims 1 to 8 is an imaging device,
The setting unit is an image pickup apparatus that sets the plurality of crop areas before generating the original image by shooting.   10. The setting unit sequentially changes the relative positional relationship of the plurality of crop areas with respect to the original images continuously photographed and generated according to the subject image for each original image. The imaging device described. A display device that displays the plurality of cropped images generated by the image processing device according to any one of claims 1 to 8 or the imaging device according to claim 9 or 10,
A display device comprising: a display control unit that arranges and simultaneously displays the plurality of cropped images cropped from the same original image based on the position information added by the information adding unit.   The display device according to claim 11, wherein the display control unit performs enlarged display while maintaining a mutual positional relationship between the plurality of crop images based on the position information.   The display device according to claim 11 or 12, wherein when the display control unit determines that there is no overlapping region in the plurality of crop images based on the position information, the display control unit changes the mutual positional relationship to display.   The display control unit displays the original image by superimposing the plurality of crop images in a display mode different from a display mode of the plurality of crop images when the original image exists. The display device according to any one of the above. It has an operation part,
The display device according to claim 11, wherein, when the original image exists, the display control unit detects that the operation unit has been operated and displays the original image. When the original image is generated by the imaging device and holds shooting information,
The display device according to claim 11, wherein the display control unit changes an arrangement of the plurality of cropped images based on the shooting information.   The display device according to claim 16, wherein the display control unit reads focus point information as the photographing information, and displays the crop image including the focus point among the plurality of crop images.

Images