JP5641911B2 - Image processing apparatus, control method thereof, and control program - Google Patents

Description

  The present invention relates to an image processing apparatus used in an imaging apparatus such as an electronic still camera, a control method thereof, and a control program.

  2. Description of the Related Art Conventionally, in an imaging apparatus such as an electronic still camera, by tilting a lens with respect to an optical axis, the imaging surface is tilted with respect to a light receiving surface of an imaging element such as a CCD, and only a part of a subject image is imaged. The light receiving surface is focused on.

  By using the above method, it is possible to focus on only a specific part of the subject image and intentionally blur other parts. This allows you to see the actual landscape as a diorama. Usually, the specific part is uniform in the horizontal or vertical direction of the screen. It should be noted that a dedicated lens needs to be used when performing such shooting.

  On the other hand, the same effect can be obtained by subjecting an image taken using a normal lens to a blur process on the top and bottom or the left and right of the image by image processing without using a dedicated lens.

  As a technique for performing blurring processing by image processing, for example, a subject image is separated into a main subject portion region and a region other than the main subject portion according to an AF (autofocus) evaluation value, and a region other than the main subject portion is blurred. There is something that is to be processed. Here, when the position of the zoom lens is changed, the blurring amount in the blurring process is changed.

JP 2009-212899 A

  By the way, in the method described in Patent Document 1, it is necessary to separate the subject image into a main subject portion region and a region other than the main subject portion. This complicates the processing required for separation, and takes time for processing. That is, there is a problem that not only the blurring process is complicated, but also the blurring process takes time.

  Furthermore, a dedicated electronic component or the like is required to execute the separation process, resulting in an increase in the cost of the image processing apparatus.

  Accordingly, an object of the present invention is to provide an image processing apparatus capable of performing blurring processing in a short time without complicating blurring processing, a control method thereof, and a control program.

  Another object of the present invention is to provide an image processing apparatus capable of performing blurring processing without increasing the cost, a control method thereof, and a control program.

In order to achieve the above object, an image processing apparatus according to the present invention processes image data obtained as a result of forming a subject image on an image sensor and applies a blur process to a specific portion of the image data to obtain blurred image data. In the image processing apparatus for obtaining the blur, the specific portion is blurred according to at least one of a focal length of the photographing lens, a focusing distance between the photographing lens and the subject, and an aperture value that restricts the amount of light incident on the imaging device A setting means for setting a blur width that defines a boundary portion between the specific part and the part other than the specific part, and a blur degree in the specific part by the blur degree and the blur width set by the setting means. And changing the range of the boundary portion between the specific portion and the portion other than the specific portion to perform the blur processing. Possess the door, said processing control means, when used as a parameter blurring the focal length, as well as strong blur degree in the specific portion in accordance with the relevant focal length is shortened, widen the range of the boundary portion It is characterized by that.

The control method according to the present invention controls an image processing apparatus that processes image data obtained as a result of forming a subject image on an image sensor and performs blur processing on a specific portion of the image data to obtain blurred image data. In this control method, the blurring degree of the specific portion is set according to at least one of a focal length of the photographing lens, a focusing distance between the photographing lens and the subject, and an aperture value that restricts the amount of light incident on the imaging element. A setting step for setting a blur width that defines a boundary portion between the specific portion and a portion other than the specific portion; and a blur degree in the specific portion is changed according to a blur degree and a blur width set by the setting step. And processing control for performing the blur processing by changing a range of a boundary portion between the specific portion and a portion other than the specific portion. Possess a step, in the processing control step, when used as a parameter blurring the focal length, as well as strong blur degree in the specific portion in accordance with the relevant focal length becomes shorter, wider range of the boundary portion characterized in that it.

The control program according to the present invention controls an image processing apparatus that processes image data obtained as a result of forming a subject image on an image sensor and performs blur processing on a specific portion of the image data to obtain blurred image data. In the control program, at least one of the aperture value for limiting the focal length of the photographic lens, the focal length of the photographic lens and the subject, and the amount of light incident on the image sensor is stored in the computer provided in the image processing apparatus. The blurring degree of the specific part is set in accordance with the setting step, the blurring level defining the boundary part between the specific part and the non-specific part is set, and the blurring degree and the blurring set by the setting step are set. The degree of blur in the specific part is changed according to the width, and the specific part and the part other than the specific part Change the range of the boundary portion, wherein to execute a processing control step for performing blur processing, in the processing control step, when used as a parameter blurring the focal length, with the corresponding focal length is shortened The degree of blur in the specific part is increased, and the range of the boundary part is widened .

  According to the present invention, there is an effect that the blurring process can be performed in a short time without complicating the blurring process and cost can be reduced.

It is a block diagram which shows an example of the imaging device with which the image processing apparatus by embodiment of this invention was used. 3 is a flowchart for explaining the operation of the camera shown in FIG. 1. 3 is a flowchart for explaining in detail the zoom processing shown in FIG. 2. FIG. 3 is a flowchart for explaining in detail an AF process for main photographing shown in FIG. 2. FIG. 3 is a flowchart for explaining in detail an AE process for main photographing shown in FIG. 2. 3 is a flowchart for explaining in detail the main photographing process shown in FIG. 2. 7 is a flowchart for explaining in detail the image processing shown in FIG. 6. FIG. 8 is a flowchart for explaining in detail the reduction ratio / trimming width setting process shown in FIG. 7. FIG. FIG. 2A is a diagram illustrating an example of the effect of blurring processing in the camera shown in FIG. 1, and FIG. 4A is a diagram illustrating the effect of blurring processing when the focal length is long and the aperture is small when the focusing distance is close; ) Is a diagram showing the relationship between the image corresponding to (a) and the degree of blur, (c) is a diagram showing the effect of blurring processing when the aperture is large when the focal length is short and the focusing distance is long, and (d). FIG. 6 is a diagram illustrating a relationship between an image corresponding to (c) and a degree of blur.

  Hereinafter, an example of an imaging apparatus using an image processing apparatus according to an embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram illustrating an example of an imaging apparatus using an image processing apparatus according to an embodiment of the present invention. Here, an electronic still camera (hereinafter simply referred to as a camera) will be described as an example of the imaging apparatus, but the present invention can be similarly applied to an imaging apparatus such as a video camera.

  With reference to FIG. 1, the illustrated camera has a focus lens 101, and the focus lens 101 focuses an object image on an imaging device described later. The focus lens 101 is driven by a focus lens drive motor 102.

  Further, the camera has a zoom lens 103, and the focal length of a photographing lens (not shown) is changed by the zoom lens 103. The zoom lens 103 is driven by a zoom lens driving motor 104. The amount of light incident on the image sensor is limited by the diaphragm 105, and the diaphragm 105 is driven by the diaphragm drive motor 106.

  A subject image is formed as an optical image on the image sensor 107, and the image sensor 107 converts the optical image into an electrical signal (analog image signal) and outputs the signal. The analog image signal is converted into a digital image signal by the A / D converter 108 and supplied to the image processor 109. The image processor 109 performs predetermined image processing on the digital image signal to generate image data. The image data is temporarily stored in the buffer memory 110.

  The camera has a system control CPU (hereinafter simply referred to as CPU) 111, which controls the camera by executing a shooting sequence and the like. A program executed by the CPU 111 is stored in the program memory 112. When the CPU 111 performs processing according to the program stored in the program memory 112, it writes various necessary data to the work memory 113 and reads various data from the work memory 113.

  An image is displayed on the image display unit 114 under the control of the CPU 111. As illustrated, the CPU 111 is connected with a shooting preparation switch (SW1) 115, a shooting processing instruction switch (SW2) 116, and a zoom switch (SW) 117.

  The shooting preparation switch 115 is a switch for instructing the CPU 111 to prepare for shooting such as autofocus (AF) and automatic exposure control (hereinafter referred to as AE). The photographing process instruction switch 116 is a switch for instructing the CPU 111 to perform photographing processes such as main exposure and recording operation after the operation of the photographing preparation instruction switch 115. The zoom switch 117 is a switch for instructing the CPU 111 to start and stop the zoom operation. The zoom SW 117 has a tele switch and a wide switch.

  FIG. 2 is a flowchart for explaining the operation of the camera shown in FIG.

  With reference to FIG. 1 and FIG. 2, first, the CPU 111 monitors the state of the shooting preparation switch 115 to determine whether or not the shooting preparation switch 115 is on (step S201). If the shooting preparation switch 115 is not ON (NO in step S201), the CPU 111 controls the zoom lens driving motor 104 according to the procedure described later to drive the zoom lens 103 to change the focal length of the shooting lens (zoom processing). : Step S202).

  Subsequently, the CPU 111 controls the aperture driving motor 106 and the shutter speed, and performs an AE operation so that the brightness of the image displayed on the image display unit 114 becomes appropriate (step 203). Then, the CPU 111 performs an auto white balance (AWB) operation so that an image displayed on the image display unit 114 has an appropriate color balance regardless of the color temperature of the light source (step S204).

  Further, the CPU 11 controls the image processor 109 to perform a predetermined process on the image signal obtained as a result of reading from the image sensor 107 and display it as an image on the image display unit 114 (step S205: EVF process). ). Then, the CPU 111 returns to step S201.

  If the shooting preparation switch 115 is ON in step S201 (YES in step S201), the CPU 111 controls the focus lens driving motor 102 to drive the focus lens 101 according to a procedure described later, and performs the main shooting AF process. This is performed (step S206). Subsequently, the CPU 111 performs a main photographing AE process according to a procedure described later (step S207).

  The CPU 111 monitors the state of the photographing processing instruction switch 116 and determines whether or not the photographing instruction switch 116 is ON (step S208). If photographing process instruction switch 116 is not ON (NO in step S208), CPU 111 stands by.

  On the other hand, when shooting process instruction switch 116 is ON (YES in step S208), CPU 111 performs a main shooting process according to a procedure described later (step S209). Then, the CPU 111 returns to step S201.

  FIG. 3 is a flowchart for explaining in detail the zoom process (step S202) shown in FIG.

  Referring to FIGS. 1 and 3, when zoom processing is started, CPU 111 determines whether or not zoom SW 117 is ON (step S301). Here, the zoom SW 117 being ON means a state in which one of the Tele or Wide switches is ON.

  If zoom SW 117 is ON (YES in step S301), CPU 111 determines whether or not the zoom driving flag is TRUE (step S302). In the initialization process (not shown), the CPU 111 sets the zoom driving flag as FALSE (false) in the work memory 113.

  If the zoom driving flag is not TRUE (NO in step S302), that is, if the zoom driving flag is FALSE, the CPU 111 determines whether or not the Tele switch of the zoom SW 117 is ON (step S303). .

  If the Tele switch of the zoom SW 117 is ON (YES in Step S303), the CPU 111 controls the zoom lens driving motor 104 to drive the zoom lens 103 in the Tele direction (Step S304), and then the CPU 111. Changes the zoom driving flag to TRUE, stores it in the work memory 113 (step S305), and returns to step S203 (FIG. 2).

  On the other hand, if the Tele switch of the zoom SW 117 is not ON (NO in step S303), the CPU 111 controls the zoom lens driving motor 104 to drive the zoom lens 103 in the wide direction (step S306). Thereafter, the CPU 111 proceeds to step S305, changes the zoom driving flag to TRUE, and stores it in the work memory 113.

  If the zoom driving flag is TRUE in step S302 (YES in step S302), the CPU 111 determines whether or not the zoom lens 103 has reached the tele end or the wide end (step S307).

  When zoom lens 103 reaches the Tele end or Wide end (YES in step S307), CPU 111 controls zoom lens drive motor 104 to stop zoom lens 103 (step S308). Then, the CPU 111 stores the focal length in the work memory 113 by stopping the zoom lens 103 (step S309). Here, based on the lens design data, the CPU 111 converts the physical position within the movable range of the zoom lens 103 into a focal length to obtain the focal length. Subsequently, the CPU 111 stores the zoom driving flag as FALSE in the work memory 113 (step S310), and proceeds to step S203 (FIG. 2).

  If the zoom lens 103 has not reached the Tele end or the Wide end in step S307 (NO in step S307), the CPU 111 proceeds to step S203 (FIG. 2).

  If the zoom SW 117 is not ON in step S301 described above (NO in step S301), the CPU 111 determines whether or not the zoom driving flag is TRUE (step S311). If the zoom driving flag is TURE (YES in step S311), the CPU 111 proceeds to step S308 and stops the zoom lens 103.

  On the other hand, if the zoom driving flag is not TURE (NO in step S311), the CPU 111 proceeds to step S203 (FIG. 2).

  FIG. 4 is a flowchart for explaining in detail the main photographing AF process (step S206) shown in FIG.

  Referring to FIGS. 1 and 4, when the main photographing AF process is started, the CPU 111 controls the focus lens driving motor 102 to move the focus lens 101 to a predetermined scan start position (also referred to as a drive start position). (Step S401). Here, it is assumed that the scan start position is the infinite end of the focusable range.

  The analog video signal (image signal) read from the image sensor 107 is converted into a digital image signal by the A / D converter 108 and supplied to the image processor 109. The image processor 109 extracts a high-frequency component of the luminance signal included in the digital image signal and gives it to the CPU 111 as a focus evaluation value. The CPU 111 stores the focus evaluation value in the work memory 113 (step S402: acquisition of focus evaluation value).

  At this time, the CPU 111 acquires the current position of the focus lens 101 and stores it in the work memory 113 (step S403). In the illustrated example, a stepping motor is used as the focus lens drive motor 102, and when the CPU 111 drives the focus lens 101, the CPU 111 counts drive pulses applied to the focus lens drive motor to obtain the current position of the focus lens 101. This current position is stored in the work memory 113 in association with the focus evaluation value.

  Next, the CPU 111 checks whether or not the current position of the focus lens 101 is a predetermined scan end position (also referred to as a drive end position) (step S404). Here, the scan end position is assumed to be the closest end of the focusable range.

  If the current position of the focus lens 101 is not the scan end position (NO in step S404), the CPU 111 controls the focus lens drive motor 102 to move the focus lens 101 by a predetermined amount toward the scan end position (step S405). ). Then, the CPU 111 returns to step S <b> 402 and acquires the focus evaluation value again at the position of the focus lens 102.

  On the other hand, when the current position of focus lens 101 is the scan end position (YES in step S404), CPU 111 extracts the maximum focus evaluation value as a peak value from the focus evaluation values obtained as described above (step S404). S406).

  That is, the CPU 111 drives the focus lens 102 by a predetermined amount from the scan start position to the scan end position, and obtains a focus evaluation value every time the focus lens is moved by a predetermined amount. Then, the CPU 111 sets the maximum focus evaluation value among the plurality of focus evaluation values obtained in this way as a peak value.

  Subsequently, the CPU 111 searches the work memory 113 and extracts a position corresponding to the peak value from the current position of the focus lens 101 stored in step S403. Then, the CPU 111 sets the position corresponding to the peak value as the focus lens position of the peak value (also simply referred to as the peak position) (step S407).

  Next, the CPU 111 converts the peak position into the distance from the camera (that is, the photographing lens) to the subject, that is, the focal distance based on the lens design data, and stores it in the work memory 113 (step S408). Subsequently, the CPU 111 controls the focus lens driving motor 102 to move the focus lens 101 to the peak position (step S409). Then, the CPU 111 proceeds to step S207 shown in FIG.

  In the above description, the processing from step S401 to S405 is called scanning.

  FIG. 5 is a flowchart for explaining in detail the main photographing AE process (step S207) shown in FIG.

  Referring to FIG. 1 and FIG. 5, when the main photographing AE process is started, the CPU 111 opens the shutter to expose the image sensor 107 (step S501). Subsequently, an analog image signal is read from the image sensor 107 under the control of the CPU 111 (step S502: image data reading). The analog image signal is converted into a digital image signal by the A / D converter 108 (step S503), and is supplied to the image processor 109.

  The image processor 109 calculates subject brightness according to the digital image signal under the control of the CPU 111 to obtain subject brightness data (step S504). This subject luminance data is given to the CPU 111, and the CPU 111 determines the F value of the aperture 105 according to the subject luminance data (step S505). Then, the CPU 111 drives the diaphragm 105 by controlling the diaphragm drive motor 106 so that the determined F value of the diaphragm is obtained.

  Subsequently, the CPU 111 stores the aperture F value determined as described above in the work memory 113 (step S506). Further, the CPU 111 sets a shutter speed according to the subject luminance data (step S507). Then, the CPU 111 sets a gain for setting the luminance level of the image signal to a predetermined magnification according to the subject luminance data (step S508). Thereafter, the CPU 111 proceeds to step S208 shown in FIG.

  FIG. 6 is a flowchart for explaining in detail the main photographing process (step S209) shown in FIG.

  Referring to FIGS. 1 and 6, when the main photographing process is started, CPU 111 opens the shutter and exposes image sensor 107 (step S601). Subsequently, an analog image signal is read from the image sensor 107 under the control of the CPU 111 (step S602), and the analog image signal is converted into a digital image signal by the A / D converter 108 (step S603).

  The digital image signal is supplied to the image processor 109. Under the control of the CPU 111, the image processor 109 performs image processing on the digital image signal as described later to obtain image data (step S604).

  Subsequently, the image processor 109 compresses the image data according to a format such as JPEG (step S605), and then records the compressed image data on a recording medium (not shown) (step S606). Then, the CPU 111 returns to step S201 shown in FIG.

  FIG. 7 is a flowchart for explaining in detail the image processing (step S604) shown in FIG.

  Referring to FIGS. 1 and 7, when image processing is started, CPU 111 sets a reduction rate and a trimming width relating to image data in image processing processor 109 as described later (step S701). Subsequently, the image processor temporarily stores a copy of the digital image signal as original image data in the buffer memory 110 (step S702).

  Next, the image processor 109 reduces the original image data in accordance with the set reduction ratio to obtain reduced image data (step S703). Then, the image processor 109 enlarges the reduced image data to the original size to obtain enlarged image data (step S704). At this time, the image related to the enlarged image data becomes a blurred image compared to the image related to the original image data before reduction.

  Subsequently, the image processor 109 trims the enlarged image data obtained by the enlargement process according to the set trimming width, leaving the upper and lower sides or the left and right sides (step S705). Then, the image processor 109 synthesizes the trimmed image data obtained as a result of the trimming with the copy of the original image data stored in the buffer memory 110 to obtain composite image data (step S706).

  At this time, the image processor 109 performs a smooth synthesis at the boundary between the trimmed image data and the original image data, thereby making the boundary inconspicuous. Then, the image processor 109 proceeds to step S605 shown in FIG.

  In this way, blurred image data is obtained by temporarily reducing and then enlarging the image data. Further, trimming is performed while leaving the top and bottom or the left and right of the blurred image data, and the resultant image data is synthesized with the original image data to obtain image data that is blurred in the top and bottom or the left and right.

  FIG. 8 is a flowchart for explaining in detail the reduction ratio / trimming width setting process (step S701) shown in FIG.

  Referring to FIGS. 1 and 8, when the reduction ratio / trimming width setting process is started, CPU 111 checks whether or not the focal length described in FIG. 3 is greater than a predetermined focal length (first predetermined value). (Step S801). If the focal length is greater than the first predetermined value (YES in step S801), the CPU 111 sets the reduction factor RA (reduction rate related to the focal length) used for calculating the reduction rate to the first reduction factor (ra1). (Step S802). Then, the CPU 111 sets the trimming width coefficient WA (trimming width related to the focal length) used for calculation of the trimming width to the first trimming width coefficient (wa1) (step S803).

  On the other hand, when the focal length is equal to or shorter than the first predetermined value (NO in step S801), CPU 111 sets the reduction coefficient RA used for calculating the reduction ratio to the second reduction coefficient (ra2) (step S804). Then, the CPU 111 sets the trimming width coefficient WA used for calculation of the trimming width to the second trimming width coefficient (wa2) (step S805).

  In the illustrated example, there is a relationship of ra1 <ra2 and wa1 <wa2. In other words, when the focal length is less than or equal to a predetermined value (when the focal length is on the Wide side), by increasing the blurring effect by image processing, the depth of field becomes deeper and the optical blur is weakened. Make up. Similarly, the blur width is increased.

  Subsequently, the CPU 111 checks whether or not the focusing distance described with reference to FIG. 4 is greater than a predetermined focusing distance (second predetermined value) (step S806). If the in-focus distance is greater than the second predetermined value (YES in step S806), the CPU 111 uses the reduction coefficient RB (reduction ratio related to the in-focus distance) used for calculating the reduction ratio as the third reduction coefficient (rb1). (Step S807). Then, the CPU 111 sets the trimming width coefficient WB (trimming width related to the in-focus distance) used for calculation of the trimming width to the third trimming width coefficient (wb1) (step S808).

  On the other hand, when the in-focus distance is equal to or smaller than the second predetermined value (NO in step S806), CPU 111 sets the reduction coefficient RB used for calculation of the reduction ratio to the fourth reduction coefficient (rb2) (step S809). . Then, the CPU 111 sets the trimming width coefficient WB used for the calculation of the trimming width to the fourth trimming width coefficient (wb2) (step S810).

  Here, there is a relationship of rb1> rb2 and wb1> wb2. In other words, when the in-focus distance is greater than a predetermined value (when the in-focus distance is on the far side), the blurring effect by image processing is further increased by the amount of depth of field that becomes deeper and the optical blur is reduced. To make up for it. Similarly, the blur width is increased.

  Subsequently, the CPU 111 checks whether or not the aperture value described in FIG. 5 is larger than a predetermined aperture value (third predetermined value) (step S811). If the aperture value is larger than the third predetermined value (YES in step S811), the CPU 111 sets the reduction factor RC (reduction rate related to the aperture value) used for calculating the reduction rate to the fifth reduction factor (rc1). (Step S812). Then, the CPU 111 sets the trimming width coefficient WC (trimming width related to the aperture value) used for calculation of the trimming width to the fifth trimming width coefficient (wc1) (step S813).

  On the other hand, if the aperture value is equal to or smaller than the third predetermined value (NO in step S811), CPU 111 sets the reduction coefficient RC used for calculation of the reduction ratio to the sixth reduction coefficient (rc2) (step S814). Then, the CPU 111 sets the trimming width coefficient WC used for calculation of the trimming width to the sixth trimming width coefficient (wc2) (step S815).

  Here, there is a relationship of rc1> rc2 and wc1> wc2. In other words, when the aperture value is larger than the predetermined value (when the aperture value is further reduced), the depth of field becomes deeper and the optical blur is reduced, so that the blurring effect by image processing is made stronger to compensate for it. To do. Similarly, the blur width is increased.

  Next, the CPU 111 calculates the reduction rate R of the image data using the following equation (1) (step S816).

R = RA × RB × RC (1)
In this way, the CPU 111 obtains a reduction ratio that takes into account all of the focal length, the focusing distance, and the aperture value, and sets it in the image processor 109 as described above. Then, the image processor 109 performs a reduction process of the image data (original image data) according to the reduction ratio R.

  Subsequently, the CPU 111 calculates the trimming width W of the image data using the following equation (2) (step S817).

W = WA × WB × WC (2)
As described above, the CPU 111 obtains the trimming width W including all of the focal length, the focusing distance, and the aperture value, and sets the trimming width W in the image processor 109 as described above. Then, the image processor 109 performs a trimming process on the image data according to the trimming width W.

  After the reduction ratio R and the trimming width W are set as described above, the process proceeds to step S702 shown in FIG.

  As described with reference to FIG. 8, when the reduction ratio R and the trimming width W are set and image synthesis is performed, the depth of field increases due to the focal length, the focusing distance, and the aperture value. When the blur effect is small, the blurring process is strong. As a result, the blur width becomes wide and an effective blurred image can be obtained.

  Also, if the depth of field is deep, the blurring process is weakened and the blur width is also narrowed, so that an image using optical blur can be obtained.

  In the above-described example, the reduction ratio and the trimming width of the image data are set according to the focal length, the focusing distance, and the aperture value. However, at least one of the focal length, the focusing distance, and the aperture value is set. Even if one is used as a blurring parameter and the reduction ratio and trimming width of the image data are set according to this ridiculous parameter, the blurring process can be performed in the same manner.

  FIG. 9 is a diagram showing an example of the effect of the blurring process in the camera shown in FIG. FIG. 9A is a diagram illustrating the effect of the blurring process when the focal length is long and the aperture is small when the focusing distance is short (that is, when the depth of field is shallow). FIG. 9B is a diagram showing the relationship between the image corresponding to FIG. 9A and the degree of blur. FIG. 9C is a diagram showing the effect of the blurring process when the focal length is short and the focusing distance is long and the aperture is large (that is, when the depth of field is deep). FIG. 9D is a diagram showing the relationship between the image corresponding to FIG. 9C and the degree of blur.

  In the synthesized image shown in FIG. 9A, an image portion 901 (a portion other than the specific portion) corresponding to the original image data and an image portion 902 (specific portion) subjected to the blurring process are gently in the boundary portion 903. They are synthesized (mixed) (see FIG. 9B). That is, at the boundary portion 903 that defines the portion other than the specific portion and the specific portion, the composite image is gently combined.

  That is, as shown in FIG. 9B, when the vertical axis is the vertical direction of the image and the horizontal axis is the degree of blur, the boundary portion 903 has a gentle blur (that is, in the vertical direction of the image, The degree of blur gradually increases.) As shown in the figure, when the depth of field is shallow, the degree of blur is reduced and the blur width is also reduced.

  In the composite image shown in FIG. 9C, an image portion 904 (a portion other than the specific portion) corresponding to the original image data and a blurred image portion 905 (the specific portion) are It is synthesized (mixed) more gently than the example shown in FIG. 9A (see FIG. 9D).

  That is, as shown in FIG. 9D, when the vertical axis is the vertical direction of the image and the horizontal axis is the degree of blur, the boundary portion 906 has a gentler blur degree than the example shown in FIG. 9B. growing. As shown in the figure, when the depth of field is deep, the degree of blur is increased and the blur width is increased.

  In the example shown in FIG. 9, the blurring process is performed in the vertical direction of the image, that is, the vertical direction of the image. However, the blurring process may be performed in the horizontal direction of the image, that is, the horizontal direction of the image. . When shooting with the camera held vertically, it is effective to perform blurring processing in the horizontal direction of the image.

  Further, even when the focus and exposure are manually adjusted without using AF and AE, the processing may be performed as described above according to the focus distance and the aperture value. Furthermore, the present invention may be applied not only to the actual captured image but also to an image obtained by the EVF process before actual imaging described in step S205 in FIG.

  As described above, according to the camera according to the present embodiment, according to at least one of the focal length, the focusing distance, and the aperture value, that is, according to the degree of blurring by the optical system located in the preceding stage of the image sensor. The blur level and blur width in image processing are changed. As a result, an excellent blurring process can be performed on the image. And when performing the blurring process, the separation process of the main subject and the other parts is unnecessary, so not only can the blurring process be performed at high speed, but also a configuration for performing the separation process is unnecessary. Cost reduction can be achieved.

  As is apparent from the above description, in FIG. 1, the CPU 111 functions as a setting unit, and the CPU 111 and the image processing processor 109 function as a processing control unit.

  As mentioned above, although this invention was demonstrated based on embodiment, this invention is not limited to these embodiment, Various forms of the range which does not deviate from the summary of this invention are also contained in this invention. .

  For example, the function of the above embodiment may be used as a control method, and this control method may be executed by the image processing apparatus. In addition, a control program having the functions of the above-described embodiments may be executed by a computer provided in the image processing apparatus.

  At this time, the control method and the control program have at least a setting step and a process control step. The control program is recorded on a computer-readable recording medium, for example.

  The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various recording media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program. It is a process to be executed.

DESCRIPTION OF SYMBOLS 101 Focus lens 103 Zoom lens 105 Diaphragm 107 Image pick-up element 109 Image processor 111 CPU for system control
115 Shooting Preparation Instruction Switch 116 Shooting Process Instruction Switch 117 Zoom Switch

Claims (7)

In an image processing apparatus that processes image data obtained as a result of forming a subject image on an image sensor and performs blur processing on a specific portion of the image data to obtain blurred image data.
The blurring degree of the specific portion is set according to at least one of a focal length of the photographing lens, a focusing distance between the photographing lens and a subject, and an aperture value that restricts a light amount incident on the imaging element, and A setting means for setting a blur width that defines a boundary portion between the specific portion and a portion other than the specific portion;
The blurring degree and the blurring width set by the setting unit change the blurring degree in the specific part, and change the range of the boundary part between the specific part and the part other than the specific part to perform the blurring process. possess and process control means,
When the focal length is used as a blurring parameter, the processing control unit increases the degree of blur in the specific portion and widens the range of the boundary portion as the focal length decreases. Image processing device. The processing control means, when using the in-focus distance as a blurring parameter, increases the degree of blurring in the specific part as the in-focus distance increases and widens the range of the boundary part. The image processing apparatus according to claim 1. When the aperture value is used as a blurring parameter, the processing control means increases the degree of blur in the specific portion and increases the range of the boundary portion as the aperture value increases. The image processing apparatus according to claim 1 or 2 . In an image processing apparatus that processes image data obtained as a result of forming a subject image on an image sensor and performs blur processing on a specific portion of the image data to obtain blurred image data.
The blurring degree of the specific portion is set according to at least one of a focal length of the photographing lens, a focusing distance between the photographing lens and a subject, and an aperture value that restricts a light amount incident on the imaging element, and A setting means for setting a blur width that defines a boundary portion between the specific portion and a portion other than the specific portion;
The blurring degree and the blurring width set by the setting unit change the blurring degree in the specific part, and change the range of the boundary part between the specific part and the part other than the specific part to perform the blurring process. Processing control means,
The processing control means, when using the in-focus distance as a blurring parameter, increases the degree of blurring in the specific part as the in-focus distance increases and widens the range of the boundary part. An image processing apparatus. In an image processing apparatus that processes image data obtained as a result of forming a subject image on an image sensor and performs blur processing on a specific portion of the image data to obtain blurred image data.
The blurring degree of the specific portion is set according to at least one of a focal length of the photographing lens, a focusing distance between the photographing lens and a subject, and an aperture value that restricts a light amount incident on the imaging element, and A setting means for setting a blur width that defines a boundary portion between the specific portion and a portion other than the specific portion;
The blurring degree and the blurring width set by the setting unit change the blurring degree in the specific part, and change the range of the boundary part between the specific part and the part other than the specific part to perform the blurring process. Processing control means,
When the aperture value is used as a blurring parameter, the processing control means increases the degree of blur in the specific portion and increases the range of the boundary portion as the aperture value increases. An image processing apparatus. In a control method for controlling an image processing apparatus that obtains blurred image data by processing image data obtained as a result of forming a subject image on an image sensor and performing blur processing on a specific portion of the image data.
The blurring degree of the specific portion is set according to at least one of a focal length of the photographing lens, a focusing distance between the photographing lens and a subject, and an aperture value that restricts a light amount incident on the imaging element, and A setting step for setting a blur width that defines a boundary portion between the specific portion and a portion other than the specific portion;
The blurring degree and the blurring width set in the setting step change the blurring degree in the specific part, and change the range of the boundary part between the specific part and the part other than the specific part to perform the blurring process. possess and process control step,
In the processing control step, when the focal length is used as a blurring parameter, the degree of blur in the specific portion is increased and the range of the boundary portion is increased as the focal length becomes shorter. Control method. In a control program for controlling an image processing apparatus that obtains blurred image data by processing image data obtained as a result of forming a subject image on an image sensor and performing blur processing on a specific portion of the image data.
In the computer provided in the image processing apparatus,
The blurring degree of the specific portion is set according to at least one of a focal length of the photographing lens, a focusing distance between the photographing lens and a subject, and an aperture value that restricts a light amount incident on the imaging element, and A setting step for setting a blur width that defines a boundary portion between the specific portion and a portion other than the specific portion;
The blurring degree and the blurring width set in the setting step change the blurring degree in the specific part, and change the range of the boundary part between the specific part and the part other than the specific part to perform the blurring process. Process control steps ,
In the processing control step, when the focal length is used as a blurring parameter, the degree of blur in the specific portion is increased and the range of the boundary portion is increased as the focal length becomes shorter. Control program.

Images