JP6423612B2 - Information device, image processing method, and program - Google Patents

Description

  The present invention relates to an information device, an image processing method, and a program for imaging a subject and generating image data of the subject.

  2. Description of the Related Art In recent years, there has been known a technique capable of capturing a star trajectory by performing comparatively bright combination processing on images sequentially generated while capturing a star in an imaging apparatus such as a digital camera (Patent Document 1). reference).

JP2013-62740A

  However, in the above-described Patent Document 1, only one function in photographing is expanded, and the sensitivity of the user cannot be reflected on the photographed image. For this reason, the technique which can reflect a user's sensitivity to the image | photographed image was desired.

  The present invention has been made in view of the above, and an object of the present invention is to provide an information device, an image processing method, and a program that can reflect a user's sensitivity to an image to be captured.

  In order to solve the above-described problems and achieve the object, an information device according to the present invention captures an image of a predetermined visual field and generates image data of the visual field, and the image generated by the imaging unit An extraction unit that generates extraction data obtained by extracting a region including a specific component from an image corresponding to image data, the extraction data generated by the extraction unit, and a timing different from the timing at which the extraction unit generates the extraction data And an image composition unit that generates composite image data obtained by combining the image data generated by the imaging unit.

  The image processing method according to the present invention is an image processing method executed by an information device, imaging an image of a predetermined visual field, and generating image data of the visual field, and the image processing method generated in the imaging step An extraction step for generating an extraction data obtained by extracting a region including a specific component from an image corresponding to the image data, the extraction data generated in the extraction step, and a timing at which the extraction data is generated in the extraction step An image synthesis step of generating synthesized image data obtained by synthesizing the image data generated in the imaging step at a timing.

  In addition, the program according to the present invention captures a predetermined visual field area on an information device, generates an image data of the visual field area, and specifies a specific image from an image corresponding to the image data generated in the imaging step. An extraction step for generating extraction data obtained by extracting a region including a component; the extraction data generated in the extraction step; and the image generated in the imaging step at a timing different from a timing at which the extraction data is generated in the extraction step. And an image synthesis step for generating synthesized image data obtained by synthesizing the data.

  According to the present invention, there is an effect that a user's sensitivity can be reflected on a captured image.

FIG. 1 is a perspective view showing a configuration of a side facing a subject of an imaging apparatus according to an embodiment of the present invention. FIG. 2 is a perspective view showing the configuration of the side facing the photographer of the imaging apparatus according to the embodiment of the present invention. FIG. 3 is a block diagram showing a functional configuration of the imaging apparatus according to the embodiment of the present invention. FIG. 4 is a flowchart showing an outline of processing executed by the imaging apparatus according to the embodiment of the present invention. FIG. 5 is a diagram illustrating an example of an image displayed on the display unit of the imaging apparatus according to the embodiment of the present invention. FIG. 6 is a diagram schematically illustrating the relationship between the position and luminance in the live view image corresponding to the live view image data generated by the imaging unit of the imaging apparatus according to the embodiment of the present invention. FIG. 7 is a diagram schematically illustrating the relationship between the position and the luminance in the extracted image corresponding to the extracted data generated by the extraction unit of the imaging apparatus according to the embodiment of the present invention. FIG. 8 is a diagram schematically illustrating a relationship between the position and the luminance in the extracted image after the extraction unit of the imaging device according to the embodiment of the present invention removes the luminance of the bright area in the extracted image. . FIG. 9 is a diagram illustrating a relationship between a position and luminance in a live view image corresponding to image data generated by the imaging unit of the imaging apparatus according to the embodiment of the present invention. FIG. 10 is a diagram illustrating the relationship between the position and the luminance in the composite image corresponding to the composite image data generated by the image composition unit of the imaging apparatus according to the embodiment of the present invention. FIG. 11 is a flowchart showing an outline of the decoration position changing process of FIG. FIG. 12 is a diagram schematically illustrating another example of the extraction data generation method according to the modification of the embodiment of the present invention.

  DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments for carrying out the present invention (hereinafter referred to as “embodiments”) will be described with reference to the drawings. In the following description, an imaging apparatus will be described as an example of information equipment. The present invention is not limited to the following embodiments. In the description of the drawings, the same portions are denoted by the same reference numerals for description.

  FIG. 1 is a perspective view showing a configuration of a side (front side) facing an object of an imaging apparatus according to an embodiment of the present invention. FIG. 2 is a perspective view showing a configuration of a side (back side) facing the photographer of the imaging apparatus according to the embodiment of the present invention. FIG. 3 is a block diagram showing a functional configuration of the imaging apparatus according to the present invention.

[Configuration of imaging device]
The imaging device 1 illustrated in FIG. 1 includes an imaging unit 2, an input unit 3, an operation ring 34, a recording unit 4, a display unit 5, a touch panel 6, and a control unit 7.

  Under the control of the control unit 7, the imaging unit 2 continuously captures a predetermined visual field region and generates a plurality of temporally continuous image data. The imaging unit 2 includes at least a plurality of lenses, and receives an optical system 21 that forms a subject image, a lens barrel 22 that houses the optical system 21, and a subject image that is formed by the optical system 21. And an image sensor 23 that generates image data by performing photoelectric conversion. The image sensor 23 is configured using a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor), or the like.

  The input unit 3 receives input of instruction signals for instructing various operations of the imaging device 1. The input unit 3 is a power switch 31 that receives an input of an instruction signal for turning on or off the power of the imaging apparatus 1, a release switch 32 that receives an input of a release signal that instructs shooting, and a mode for switching various modes of the imaging apparatus 1. The switch 33 includes an operation ring 34 that is provided in the lens barrel 22 so as to be rotatable about the optical axis O <b> 1 of the optical system 21 and that receives input of instruction signals for instructing various operations of the imaging apparatus 1.

  The recording unit 4 receives image data input via the control unit 7, information being processed by the imaging apparatus 1, various programs for operating the imaging apparatus 1, the program according to the present embodiment, and the execution of the program Records various data used. The recording unit 4 is configured using an SDRAM (Synchronous Dynamic Random Access Memory), a flash memory, a recording medium, and the like. The recording unit 4 includes an image data recording unit 41 that records image data, an extraction data recording unit 42 that records decoration image data as extraction data used when decorating a corresponding image, and a program recording that records various programs. Part 43.

  The display unit 5 displays an image corresponding to the image data generated by the imaging unit 2 under the control of the control unit 7. Here, for image display, confirmation display for displaying image data immediately after photographing for a predetermined time (for example, 1 second), reproduction display for reproducing image data recorded in the recording unit 4, and imaging unit 2 are continuously performed. Live view image display for sequentially displaying live view images corresponding to the image data to be generated. The display unit 5 is configured using a display panel made of liquid crystal or organic EL (Electro Luminescence), a drive driver, and the like. In addition, the display unit 5 appropriately displays operation information of the imaging device 1 and information related to photographing under the control of the control unit 7.

  The touch panel 6 is provided so as to overlap the display area of the display unit 5, detects a contact position (touch position) of an object from the outside, and receives an input of a position signal corresponding to the detected contact position.

  The control unit 7 comprehensively controls the operation of the imaging apparatus 1 by giving instructions to each unit constituting the imaging apparatus 1 and transferring data. The control unit 7 is configured using a CPU (Central Processing Unit).

  Here, a detailed configuration of the control unit 7 will be described. The control unit 7 includes at least an image acquisition unit 71, an extraction unit 72, an image composition unit 73, and a display control unit 74.

  The image acquisition unit 71 controls the imaging unit 2 and acquires image data from the imaging unit 2. When the release signal is input from the release switch 32, the image acquisition unit 71 causes the imaging unit 2 to perform shooting. Further, the image acquisition unit 71 controls the imaging unit 2 to cause the imaging unit 2 to continuously generate image data, sequentially acquire the image data, and to the extraction unit 72, the image composition unit 73, and the display control unit 74. Output.

  The extraction unit 72 extracts a region including a specific component from the image corresponding to the image data generated by the imaging unit 2 input via the image acquisition unit 71 to generate extraction data. The data is output to any of the recording unit 42, the image composition unit 73, and the display control unit 74. Here, the region including a specific component is one of a region including a predetermined luminance component, a region including a predetermined color, and a region including a geometric pattern. Further, the extraction unit 72 selects a region including the specific component from the image corresponding to the image data generated by the imaging unit 2 based on a selection signal for selecting the region including the specific component received from the input unit 3. Extract and generate extracted data. Specifically, the extraction unit 72 changes the region including the value of a specific component from the image corresponding to the image data generated by the imaging unit 2 based on the rotation direction and the rotation amount of the operation ring 34 and extracts the extracted data. Is generated.

  The image combining unit 73 generates combined image data obtained by combining the extracted data generated by the extracting unit 72 and the image data generated by the imaging unit 2 at a timing different from the timing at which the extracting unit 72 generates the extracted data. The composite image data is output to the display control unit 74. In addition, the image composition unit 73 sequentially performs composite bright composition processing along the time series on the image data continuously generated by the imaging unit 2 and the extraction data generated by the extraction unit 72, thereby continuously combining the composite image data. To generate.

  The display control unit 74 controls the display mode of the display unit 5. Specifically, the display control unit 74 causes the display unit 5 to display an image corresponding to the image data generated by the imaging unit 2. Further, the display control unit 74 causes the display unit 5 to display a composite image corresponding to the composite image data generated by the image composition unit 73. In addition, the display control unit 74 causes the display unit 5 to display an extracted image corresponding to the extracted data generated by the extracting unit 72.

[Processing of Imaging Device 1]
Next, processing executed by the above-described imaging device 1 will be described. FIG. 4 is a flowchart illustrating an outline of processing executed by the imaging apparatus 1.

  As shown in FIG. 4, first, a case where a shooting mode is set in the imaging apparatus 1 (step S <b> 101: Yes) will be described. In this case, the display control unit 74 causes the display unit 5 to display a live view image corresponding to the image data generated by the imaging unit 2 (step S102). Specifically, as illustrated in FIG. 5, the display control unit 74 causes the display unit 5 to display a live view image W1 corresponding to the image data generated by the imaging unit 2. At this time, the display control unit 74 causes the display unit 5 to display the extracted icon A1 and the decoration icon A2 on the live view image W1. The extraction icon A1 receives an input of an instruction signal that causes the extraction unit 72 to extract a specific component from the live view image W1 and generate extracted data. The decoration icon A2 receives an input of an instruction signal for generating composite image data by combining the extracted data recorded in the extracted data recording unit 42 by the image combining unit 73 and the image data generated by the imaging unit 2.

  Subsequently, when the shooting parameter of the imaging device 1 is changed by operating the operation ring 34 (step S103: Yes), the control unit 7 changes the shooting parameter of the imaging device 1 (step S104). Here, the shooting parameters are focal length, aperture value, shutter speed, ISO sensitivity, white balance, saturation, hue, and focus position. After step S104, the imaging apparatus 1 proceeds to step S105 described later. On the other hand, when the operation ring 34 is not operated and the shooting parameters of the imaging device 1 are not changed (step S103: No), the imaging device 1 proceeds to step S105 described later.

  Subsequently, when the extraction icon A1 is selected via the touch panel 6 (step S105: Yes), when there is a dial operation on the operation ring 34 (step S106: Yes), the imaging apparatus 1 performs step S107 described later. Migrate to

  Subsequently, the control unit 7 determines whether or not the operation of the operation ring 34 is an odd number of times (step S107). Specifically, the control unit 7 determines whether or not the operation of the operation ring 34 is an odd number based on the operation information indicating the number of operations of the operation ring 34 recorded in the recording unit 4. When the control unit 7 determines that the number of operations of the operation ring 34 is an odd number (step S107: Yes), the imaging device 1 proceeds to step S108 described later. On the other hand, when the control unit 7 determines that the number of operations of the operation ring 34 is not an odd number (step S107: No), the imaging device 1 proceeds to step S109.

  In step S <b> 108, the extraction unit 72 removes the luminance of the dark area as a specific component in the live view image based on the rotation amount of the operation ring 34 and generates extraction data. Here, the dark area is an area having a luminance value set according to the rotation amount of the operation ring 34 from the minimum luminance value (0).

  FIG. 6 is a diagram schematically illustrating the relationship between the position and the luminance in the live view image W1 generated by the imaging unit 2. FIG. 7 is a diagram schematically showing the relationship between the position and luminance in the extracted image W2 corresponding to the extracted data generated by the extracting unit 72. As shown in FIG. In FIG. 6B and FIG. 7B, the horizontal axis indicates the image position of the straight line L1, and the vertical axis indicates the luminance. A curve C1 indicates the luminance corresponding to the position of the straight line L1. In the following, in order to simplify the description, the luminance distribution of each pixel on the straight line L1 of the live view image W1 will be described as an example. However, the extraction unit 72 applies to each horizontal line of the live view image W1. The extracted data may be generated by scanning the luminance to remove the luminance in the dark area.

  As illustrated in FIGS. 6 and 7, the extraction unit 72 generates extraction data by removing the luminance of the dark region LD in the live view image W <b> 1 based on the rotation amount of the operation ring 34. Specifically, when the number of operations of the operation ring 34 is an odd number, the extraction unit 72 selects the dark area LD on the live view image W1. Thereafter, the extraction unit 72 changes the range (dynamic lens) of the dark region LD on the live view image W1 based on the rotation amount of the operation ring 34, and then removes the luminance of the dark region LD to generate extraction data. (FIG. 6 → FIG. 7). For example, as shown in FIGS. 6B and 7B, the extraction unit 72 removes the luminance of the dark area LD in the width of the face F1 of the subject and generates extraction data. As a result, the area of the subject's face F1 becomes black (FIG. 6 (a) → FIG. 7 (a)). In FIGS. 6 and 7, the extraction unit 72 generates the extraction data by removing the luminance. However, for example, the extraction data may be generated by removing the saturation and the color.

  In step S <b> 109, the extraction unit 72 generates extraction data by removing the brightness of the bright area in the live view image based on the rotation amount of the operation ring 34. Here, the bright area is an area having a luminance value set according to the rotation amount of the operation ring 34 from the maximum luminance value.

  FIG. 8 is a diagram schematically showing the relationship between the position and the luminance in the extracted image W3 after the extracting unit 72 removes the luminance of the bright area in the extracted image W2. In FIG. 8B, the horizontal axis indicates the image position of the straight line L1 on the extracted image W3, and the vertical axis indicates the luminance.

  As illustrated in FIGS. 7 and 8, the extraction unit 72 generates extraction data by removing the brightness of the bright area in the extraction image W <b> 2 based on the rotation amount of the operation ring 34. Specifically, when the number of operations of the operation ring 34 is an even number, the extraction unit 72 selects the bright area LB on the live view image W1. Thereafter, based on the rotation amount of the operation ring 34, the extraction unit 72 changes the area of the bright area LB on the extracted image W2 to remove the luminance of the bright area LB to generate extraction data (FIG. 7). (Fig. 8). For example, as illustrated in FIGS. 7B and 8B, the extraction unit 72 removes the luminance of the bright area LB other than the face F1 of the subject. As a result, the background area becomes black (FIG. 7A → FIG. 8A). In FIG. 8, in order to simplify the description, the extraction unit 72 removes the brightness of the bright part region LB of the straight line L1, but the bright part region LB of each horizontal line of the extracted image W2 is removed. Extraction data is generated by removing luminance. The extraction unit 72 removes the brightness of the bright area LB after removing the brightness of the dark area LD, but removes the brightness of the dark area LD after removing the brightness of the bright area LB. Data may be generated.

  If there is a release signal from the release switch 32 after step S108 or after step S109 (step S110: Yes), the imaging unit 2 determines whether the current shooting parameter (including the contents of step S108 or step S109 described above) is present. The photographed extracted data or image data is recorded in the extracted data recording unit 42 as decoration image data (step S111). In the following, the extracted data is referred to as decorative image data, and the extracted image is referred to as a decorative image.

  Subsequently, the display control unit 74 causes the display unit 5 to display a decoration image corresponding to the decoration image data photographed by the imaging unit 2 as a photographing result (step S112). In this case, the display control unit 74 causes the display unit 5 to display, for example, a decoration image W3 illustrated in FIG. Thereby, the user can grasp | ascertain the image (template) reflecting his sensitivity.

  Thereafter, when the power switch 31 is operated and the power of the imaging device 1 is turned off (step S113: Yes), the imaging device 1 ends the process. On the other hand, when the power switch 31 is not operated and the power supply of the imaging device 1 is not turned off (step S113: No), the imaging device 1 returns to step S101 described above.

  In step S106, when there is no dial operation of the operation ring 34 (step S106: No), the imaging device 1 proceeds to step S113 described later.

  In step S110, when there is no release signal from the release switch 32 (step S110: No), the imaging device 1 proceeds to step S113.

  In step S105, when the extraction icon A1 is not selected via the touch panel 6 (step S105: No), when the decoration icon A2 is selected (step S114: Yes), the display control unit 74 records the extracted data. A plurality of decoration images corresponding to the plurality of decoration image data recorded in the unit 42 are displayed on the display unit 5 (step S115).

  Subsequently, when there is a dial operation on the operation ring 34 (step S116: Yes), the image composition unit 73 selects a decoration image displayed on the display unit 5 based on the rotation amount of the operation ring 34 (step S117). ), The image composition unit 73 generates composite image data obtained by combining the decoration image data (extraction data) of the decoration image selected based on the rotation amount of the operation ring 34 and the live view image data generated by the imaging unit 2. (Step S118).

  FIG. 9 is a diagram illustrating the relationship between the position and the luminance in the live view image corresponding to the image data generated by the imaging unit 2. FIG. 10 is a diagram illustrating the relationship between the position and the luminance in the composite image corresponding to the composite image data generated by the image composition unit 73. 9B and 10B, the horizontal axis indicates the position of the straight line L1 on the image, and the vertical axis indicates the luminance. In FIG. 9B, a curve C2 indicates the luminance corresponding to the position of the straight line L1 on the live view image W10. Further, in FIG. 10B, the curve C3 indicates the luminance corresponding to the position of the straight line L1 on the composite image W11.

  As shown in FIGS. 8 to 10, the image composition unit 73 performs a comparatively bright composition process on the live view image W <b> 10 (see FIG. 9) and the decoration image W <b> 3 (see FIG. 8) corresponding to the decoration image data. As a result, a composite image W11 corresponding to the composite image data is generated. Specifically, the image composition unit 73 compares the brightness of each pixel at the same coordinate (pixel address) in each of the live view image W10 and the decoration image W3, and uses the brightness of the higher brightness pixel as the brightness of the composite image. Use. For example, the image composition unit 73 compares the brightness of pixels having the same coordinates of the straight line L1 on the live view image W10 and the straight line L1 on the decoration image W3, and uses a pixel with high brightness as the brightness (signal value) of the composite image. Use. That is, as shown in FIG. 10B, the image composition unit 73 uses the brightness of the pixel of the subject face F2 on the live view image W10 by performing the comparatively bright composition process, and also uses the brightness of the subject face F2. The synthesized image W11 is generated by using the brightness of the pixels of the decorative image W3 except for the area. In FIGS. 8 and 9, the image composition unit 73 performs the comparatively bright composition process for each pixel having the same coordinates on the straight lines L1 of the live view image W10 and the decoration image W3. The comparatively bright combination processing may be performed for each pixel having the same coordinate on the horizontal line of each decoration image W3 to generate the combined image data.

  After step S118, the display control unit 74 causes the display unit 5 to display a composite image corresponding to the composite image data generated by the image composition unit 73 (step S119). Specifically, as illustrated in FIG. 10A, the display control unit 74 causes the display unit 5 to display a composite image W <b> 11 corresponding to the composite image data generated by the image composition unit 73. Thereby, the user can visually recognize the live view image in a state where the decoration image W3 is superimposed on the live view image W10. In this case, the user can adjust the position of the subject in the decoration image W3 (see FIG. 8) by operating the imaging device 1. Further, when increasing the ratio of the live view image W10 in the composite image W11, the user increases the brightness (luminance) of the live view image W10 by operating the input unit 3 and increasing the exposure value of the imaging device 1. . As a result, the image composition unit 73 uses the brightness of the pixel of the live view image W10 because the brightness of the pixel of the live view image W10 is higher than the brightness of the pixel of the decoration image W3 when performing the comparative bright composition process. Thus, the composite image data can be generated.

  Subsequently, when there is a touch on the decoration area on the composite image W11 displayed on the display unit 5 (step S120: Yes), the imaging apparatus 1 changes the position of the decoration image on the composite image W11. A change process is executed (step S121).

  FIG. 11 is a flowchart showing an outline of the decoration position changing process in step S121. As shown in FIG. 11, when the touch on the decoration area on the composite image W11 displayed on the display unit 5 is a slide operation in which the touch position continuously changes while maintaining the touch (Yes in step S201), the image The composition unit 73 changes the position of the decoration image W3 according to the slide operation (step S202). In this case, the image composition unit 73 generates composite image data again by performing comparatively bright composition processing on the decoration image data after the position of the decoration image W3 is changed and the live view image. As a result, an image that further reflects the user's sensitivity can be taken. After step S202, the imaging apparatus 1 returns to the main routine in FIG.

  In step S201, when the touch on the decoration area on the composite image W11 displayed by the display unit 5 is not a slide operation (step S201: No), the imaging device 1 proceeds to step S203.

  Subsequently, when the touch on the decoration area on the composite image W11 displayed on the display unit 5 is a pinch operation for expanding or reducing the distance between the two touch positions (step S203: Yes), the image composition unit 73 Based on the pinch operation, the decoration area is enlarged or reduced (step S204). In this case, the image composition unit 73 generates composite image data again by performing comparatively bright composition processing on the decoration image data obtained by enlarging or reducing the decoration region and the live view image. After step S204, the imaging apparatus 1 returns to the main routine in FIG.

  In step S203, when the touch on the decoration area on the composite image W11 displayed by the display unit 5 is not a pinch operation (step S203: No), the imaging device 1 proceeds to step S205.

  When there is a dial operation on the operation ring 34 (step S205: Yes), the image composition unit 73 changes the composition ratio between the live view image W10 and the decoration image W3 based on the rotation amount and the rotation direction of the operation ring 34. (Step S206). Specifically, when the rotation direction of the operation ring 34 is clockwise, the image composition unit 73 reduces the composition ratio of the decoration image W3 based on the rotation amount of the operation ring 34, while the rotation direction of the operation ring 34 is In the case of counterclockwise rotation, the composition ratio of the live view image W10 is reduced based on the rotation amount of the operation ring 34. In this case, the image composition unit 73 changes the ratio in the comparative light / dark composition process by multiplying the luminance of each pixel of the decoration image W3 or the live view image W10 by a predetermined ratio based on the rotation amount of the operation ring 34. . After step S206, the imaging apparatus 1 returns to the main routine in FIG.

  In step S205, when there is no dial operation of the operation ring 34 (step S205: No), the imaging apparatus 1 returns to the main routine of FIG.

Returning to FIG. 4, the description of step S122 and subsequent steps will be continued.
In step S122, when a release signal is input from the release switch 32 (step S122: Yes), the imaging apparatus 1 causes the imaging unit 2 to perform imaging, and the image composition unit 73 generates image data generated by the imaging unit 2. The combined image data obtained by combining the decorative image data and the decoration image data is recorded in the image data recording unit 41 (step S123). After step S123, the imaging device 1 proceeds to step S113.

  In step S114, when the decoration icon A2 is not selected (step S114: No), the imaging device 1 proceeds to step S122.

  In step S116, when there is no dial operation of the operation ring 34 (step S116: No), the imaging device 1 proceeds to step S122.

  In step S120, when there is no touch on the decoration area on the composite image W11 displayed by the display unit 5 (step S120: No9, the imaging apparatus 1 proceeds to step S122).

  If no release signal is input from the release switch 32 in step S122 (step S122: No), the imaging apparatus 1 proceeds to step S113.

  Next, when the shooting mode is not set in the imaging device 1 (step S101: No), when the playback mode is set in the imaging device 1 (step S122: Yes), the display control unit 74 displays the image data. Image data is acquired from the recording unit 41, and an image corresponding to the acquired image data is displayed on the display unit 5 (step S123).

  Subsequently, when an instruction to change the image displayed on the display unit 5 is given via the input unit 3 (step S124: Yes), the imaging device 1 proceeds to step S123. On the other hand, when the change of the image reproduced by the display unit 5 is not instructed via the input unit 3 (step S124: No), the imaging device 1 proceeds to step S113.

  In step S122, when the reproduction mode is not set for the imaging apparatus 1 (step S122: No), the imaging apparatus 1 proceeds to step S113.

  According to the embodiment of the present invention described above, the image synthesizing unit 73 is generated by the imaging unit 2 at a timing different from the extracted data generated by the extracting unit 72 and the timing at which the extracting unit 72 generates the extracted data. Therefore, the user's sensibility can be reflected in the captured image.

  Further, according to the embodiment of the present invention, the display control unit 74 causes the display unit 5 to display the extracted image corresponding to the extracted data generated by the extracting unit 72, so that the user can intuitively view the desired decoration image. Can be grasped.

  Further, according to the embodiment of the present invention, the image composition unit 73 selects from the image data continuously generated by the imaging unit 2 and the plurality of extraction data recorded by the extraction data recording unit 42 by the operation ring 34. Composite image data is generated by sequentially synthesizing the extracted data along a time series, and the display control unit 74 displays a composite image corresponding to the composite image data continuously generated by the image composition unit 73 in real time. Since it is displayed on the display unit 5 as a live view image, the user can take a picture while grasping the degree of composition.

  In the above-described embodiment of the present invention, the extraction unit 72 generates extracted data as decoration image data by removing a region including a specific component of the image corresponding to the image data generated by the imaging unit 2. However, the extracted data may be generated when the user draws a desired picture via the touch panel 6, for example.

  FIG. 12 is a diagram schematically illustrating another example of the extraction data generation method according to the modification of the embodiment of the present invention.

  As illustrated in FIG. 12, the display control unit 74 displays the locus of the touch operation according to the position signal input from the touch panel 6. Further, the display control unit 74 causes the display unit 5 to display the fill icon A10, the gradation icon A11, and the brush icon A12. The fill icon A10 receives an input of an instruction signal for filling a figure formed according to a touch operation locus with a specified color. The gradation icon A11 accepts an input of an instruction signal for displaying the inside of a figure formed according to the touch operation locus with gradation of a designated color. The brush icon A12 receives an input of an instruction signal that displays a color on the locus of the touch operation. Thereby, the user can generate extraction data reflecting his / her sensitivity by drawing a desired picture on the display screen of the display unit 5 via the touch panel 6. In this case, the control unit 7 records the extracted data generated by the user in the extracted data recording unit 42.

  In an embodiment of the present invention, the extraction unit 72 generates extracted data as decoration image data by removing a region including a specific component of an image corresponding to the image data generated by the imaging unit 2. However, the extracted data may be generated by extracting a region having a geometric pattern as a specific component from the image corresponding to the image data generated by the imaging unit 2. Specifically, the extraction unit 72 is configured such that the imaging unit 2 is a textile pattern, for example, a lattice pattern, flowers or vegetables, regularly changing figures (stars, hearts, dots), and cloths or blocks that have characters. When a subject having a geometric pattern is imaged, the extracted data may be generated by extracting a textile pattern from an image corresponding to the image data generated by the imaging unit 2. In this case, the extraction unit 72 performs, for example, a contrast binarization process on the image data generated by the imaging unit 2, and then a region within a contour that changes regularly or a region within a contour that is continuously connected. To extract and generate extracted data. As a result, the decoration image of the textile pattern can be combined with the live view image, and an artistic image reflecting the user's sensitivity can be taken.

(Other embodiments)
In addition to a digital single-lens reflex camera, the imaging apparatus according to the present invention is also applicable to, for example, digital cameras that can be equipped with accessories and the like, digital video cameras, and electronic devices such as mobile phones and tablet mobile devices having imaging functions can do.

  The program to be executed by the information apparatus according to the present invention is file data in an installable format or executable format, and is a CD-ROM, flexible disk (FD), CD-R, DVD (Digital Versatile Disk), USB medium. And recorded on a computer-readable recording medium such as a flash memory.

  The program to be executed by the information device according to the present invention may be configured to be provided by being stored on a computer connected to a network such as the Internet and downloaded via the network. Furthermore, the program to be executed by the information device according to the present invention may be provided or distributed via a network such as the Internet.

  In the description of the flowchart in the present specification, the context of the processing between steps is clearly indicated using expressions such as “first”, “after”, “follow”, etc., in order to implement the present invention. The order of processing required is not uniquely determined by their representation. That is, the order of processing in the flowcharts described in this specification can be changed within a consistent range.

  As described above, the present invention can include various embodiments not described herein, and various design changes and the like can be made within the scope of the technical idea specified by the claims. Is possible.

  1: Imaging device 2: Imaging unit 3: Input unit 4: Recording unit 5: Display unit 6: Touch panel 7: Control unit 21: Optical system 22: Lens barrel 23: Imaging device 31: Power switch 32: Release switch 33: Mode switch 34: Operation ring 41: Image data recording unit 42: Extracted data recording unit 43: Program recording unit 71: Image acquisition unit 72: Extraction unit 73: Image composition unit 74: Display control unit

Claims (9)

An imaging unit that images a predetermined visual field and generates image data of the visual field;
An extraction unit for generating extraction data extracted by removing the luminance of a region including a specific component from an image corresponding to the image data generated by the imaging unit;
The extracted data generated by the extraction unit is compared with the image data generated by the imaging unit at a timing different from the timing at which the extraction unit generates the extracted data, and the luminance of the higher luminance pixel is synthesized. An image compositing unit that generates composite image data synthesized using the brightness of the image;
An information device characterized by comprising: A display unit capable of displaying an image corresponding to the image data generated by the imaging unit;
A display control unit that causes the display unit to display an extraction image corresponding to the extraction data generated by the extraction unit;
The information device according to claim 1, further comprising: The imaging unit continuously generates the image data,
The image composition unit continuously generates the composite image data in which the image data continuously generated by the imaging unit and the extracted data are sequentially combined along a time series,
The information according to claim 2, wherein the display control unit causes the display unit to sequentially display a composite image corresponding to the composite image data continuously generated by the image synthesis unit in a time series. machine. A touch panel that is provided so as to overlap the display area of the display unit, detects a contact position of an object from the outside, and receives an input of a position signal corresponding to the contact position;
The image synthesizing unit generates the synthesized image data by changing the position or size of the extracted image in the synthesized image displayed by the display unit in response to a signal received by the touch panel. The information device according to claim 3, wherein The imaging unit
An optical system for forming a subject image;
A lens barrel that houses the optical system;
An operation ring that is provided in the lens barrel so as to be rotatable about the optical axis of the optical system, and that receives an input of a selection signal for selecting a region including the specific component;
Have
5. The extraction unit according to claim 1, wherein the extraction unit generates the extraction data by changing a value of the specific component based on a rotation amount and a rotation direction of the operation ring. Information equipment described.   The said image composition part produces | generates the said synthesized image data by changing the ratio of the said image data and the said extraction data based on the rotation amount and rotation direction of the said operation ring. Information equipment.   The region including the specific component is any one of a region including a predetermined luminance component, a region including a predetermined color component, and a region including a geometric pattern. Information equipment as described in one. An image processing method executed by an information device,
An imaging step of imaging a predetermined visual field and generating image data of the visual field;
An extraction step for generating extraction data extracted by removing the luminance of a region including a specific component from the image corresponding to the image data generated in the imaging step;
The extracted data generated in the extracting step is compared with the image data generated in the imaging step at a timing different from the timing at which the extracted data is generated in the extracting step, and the luminance of the pixel having the higher luminance is synthesized. An image synthesis step for generating synthesized image data synthesized using the luminance of the image;
An image processing method comprising: For information equipment,
An imaging step of imaging a predetermined visual field and generating image data of the visual field;
An extraction step for generating extraction data extracted by removing the luminance of a region including a specific component from the image corresponding to the image data generated in the imaging step;
The extracted data generated in the extracting step is compared with the image data generated in the imaging step at a timing different from the timing at which the extracted data is generated in the extracting step, and the luminance of the pixel having the higher luminance is synthesized. An image synthesis step for generating synthesized image data synthesized using the luminance of the image;
A program characterized by having executed.