CN107465851A - Image depth of field measuring method and image extracting device - Google Patents

Abstract

The invention provides an image depth of field measuring method and an image extracting device, wherein the image depth of field measuring method comprises the following steps: extracting a first image by using a first optical lens and extracting a second image by using a second optical lens; obtaining first area depth information of each image area by using the difference between the first image and the second image; the horizontal direction image intensity and the vertical direction image intensity of the first area depth information of each image area are calculated to determine to select the first area depth information or the second area depth information as the adopted area depth information. The method obtains preliminary image depth of field information through the two optical lenses, and obtains the other image depth of field information by matching with the phase detection pixel group of the image extracted by one optical lens so as to compensate the image depth of field error caused by the scene with the same arrangement direction as the two optical lenses in the photographed environment in the preliminary image depth of field information.

Description

Image depth measurement method and image extraction device

technical field

The invention relates to the technical field of image optics, in particular to an image depth-of-field measurement method and an image extraction device.

Background technique

In recent years, with the evolution of the electronic industry and the vigorous development of industrial technology, the design and development of various electronic devices are gradually moving towards portable and easy-to-carry directions, so that users can use them anytime, anywhere for mobile business, entertainment or leisure. use. For example, various image capture devices are widely used in various fields, such as smart phones, wearable electronic devices, aerial photography devices and other electronic devices, which have the advantages of small size and easy portability, allowing users to Take out and extract and store images at any time when there is a need for use, or upload them to the Internet through the mobile network, which not only has important commercial value, but also adds color to the daily life of the general public. With the improvement of the quality of life, people have more demands for images, especially hope that the obtained images have higher imaging quality or more imaging effects.

For example, please refer to FIG. 1 , which is a schematic diagram of the appearance and structure of an existing smart phone. The smart phone 9 is provided with two optical lenses 91, 92 arranged horizontally, and since the two optical lenses 91, 92 can take pictures of the same use environment at different angles, by using the two optical lenses 91, 92 respectively, 92, the two extracted images are analyzed and calculated to obtain a stereoscopic image with depth information. At present, manufacturers such as HTC (HTC), Sony (SONY), LG (LG), and Huawei all produce smart phones 9 similar to those shown in FIG. 1 with dual optical lenses 91, 92. 92 The technology for obtaining the depth of field information is known to those skilled in the art, and will not be repeated here.

However, the method of obtaining the depth of field information by shooting the same use environment with two optical lenses 91, 92 has the defect of insufficient precision, because if there are two scenes in the use environment that are arranged in the same direction as the two optical lenses, That is, the two scenes are also arranged horizontally relative to the smart phone 9, and the depth of field of the two scenes is not easy to be judged, resulting in errors in the obtained depth of field information. Therefore, there is room for improvement in existing methods for obtaining depth information of images.

Contents of the invention

An object of the present invention is to provide an image capture device, in particular to an image capture device using the above image depth measurement method.

In a preferred embodiment, the present invention provides a method for measuring the depth of field of an image, including:

(a) using a first optical lens to extract a first image and utilizing a second optical lens to extract a second image; wherein, the first image has a plurality of phase detection pixel groups and is divided into a plurality of image regions;

(b) using the difference between the first image and the second image to obtain a first area depth information of each image area;

(c) determining whether to select the first area depth of field information or a second area depth of field information as an adopted one by calculating a horizontal direction image intensity and a vertical direction image intensity of the first area field depth information of each of the image areas Area depth of field information; wherein, the second area depth of field information is obtained through at least part of the phase detection pixel groups in the plurality of phase detection pixel groups.

In a preferred embodiment, the present invention also provides an image extraction device, comprising:

a first optical lens;

a second optical lens;

A first sensing element, which senses the light beam passing through the first optical lens and incident on the first sensing element to obtain a first image, and the first image is divided into a plurality of image areas; wherein, the The first sensing element includes a plurality of phase detection unit groups, so that the first image has a plurality of phase detection pixel groups respectively corresponding to the plurality of phase detection unit groups;

a second sensing element, which senses the light beam passing through the second optical lens and incident on the second sensing element to obtain a second image;

A computing module, connected to the first sensing element and the second sensing element, which uses the difference between the first image and the second image to obtain a first area field depth information of each image area, and calculates A horizontal direction image intensity and a vertical direction image intensity of the first region depth of field information of each of the image regions determine to select the first region depth of field information or a second region depth of field information as a adopted region depth of field information; wherein , the second area depth information is obtained by at least part of the phase detection pixel groups in the plurality of phase detection pixel groups.

An object of the present invention is to provide a method for measuring image depth of field. In addition to obtaining preliminary image depth of field information through two optical lenses, the image depth of field measurement method also assists in matching the phase detection pixel group of the image extracted from one of the optical lenses. The obtained other image depth information is used to supplement the image depth error in the preliminary image depth information caused by the scene being shot in the same direction as the arrangement direction of the two optical lenses.

Description of drawings

FIG. 1 is a schematic diagram of an appearance structure of an existing smart phone.

FIG. 2 is a schematic block diagram of a preferred embodiment of the image capture device of the present invention.

FIG. 3 is a better conceptual diagram of a first sensing element of the image capture device shown in FIG. 2 .

FIG. 4 is a flow chart of a preferred method of the image depth measurement method of the present invention.

FIG. 5A is a better conceptual diagram of the first image obtained in step S1 of FIG. 4 .

FIG. 5B is a better conceptual diagram of the second image obtained in step S1 of FIG. 4 .

FIG. 6 is a flow chart of a preferred method for obtaining the second area depth information of any image area of the first image in step S3 of FIG. 4 .

FIG. 7A is a better conceptual diagram of the first image shown in FIG. 6 .

FIG. 7B is a better conceptual diagram of the second image shown in FIG. 6 .

FIG. 8 is a schematic block diagram of a computing module of the image capture device shown in FIG. 2 in a preferred embodiment.

Explanation of reference signs:

1 Image extraction device 2 Image

4Second Image 9Smartphone

11 The first optical lens 12 The first sensing element

13 The second optical lens 14 The second sensing element

15 Operation module 21 Image area

22 phase detection pixel group 31 first image

32Second image 41Image area

91 optical lens 92 optical lens

121 phase detection unit group 151 image segmentation unit

152 Computing unit 221 First light incident part

222 second light incident part 311 first image block

321 second image block 322 ₁ test block

322 _m test block 323 ₁ test block

323 _n test block 1211 first incident light phase detection unit

1212 Center position of the second incident light phase detection unit P1

P2 ₁ center position P2 _m center position

P3 ₁ center position P3 _n center position

S1 step S2 step

S3 step

detailed description

First, the composition of the image capture device of the present invention will be described. Please refer to FIG. 2 and FIG. 3 , FIG. 2 is a schematic block diagram of a preferred embodiment of the image capture device of the present invention, and FIG. 3 is a schematic diagram of a better concept of the first sensing element of the image capture device shown in FIG. 2 . The image extraction device 1 includes a first optical lens 11, a first sensing element 12, a second optical lens 13, a second sensing element 14, and a computing module 15. The arrangement direction of the first optical lens 11 and the second optical lens 13 is arranged horizontally, and the first sensing element 12 senses the light beam passing through the first optical lens 11 and incident on the first sensing element 12 to obtain the first image, while the second sensing element 14 senses the light beam passing through the second optical lens 13 and The light beam incident to the second sensing element 14 is used to obtain a second image.

Wherein, the first sensing element 12 includes a plurality of phase detection unit groups 121, and each phase detection unit group 121 includes a first incident light phase detection unit 1211 and a second light incident phase detection unit 1211 vertically arranged. The incident light phase detection unit 1212, and the computing module 15 is connected to the first sensing element 12 and the second sensing element 14, so it can receive the first image and the first image from the first sensing element 12 and the second sensing element 14 respectively. Second image.

Next, it will be described how the image capture device measures the image depth of field. Please refer to FIGS. 4 to 5B. FIG. 4 is a flow chart of a preferred method of the image depth measurement method of the present invention. FIG. 5A is a schematic diagram of a preferred concept of the first image obtained in step S1 in FIG. 4, and FIG. 5B It is a schematic diagram of a better concept of the second image obtained in step S1 in FIG. 4 . The image depth measurement method includes steps S1 to S3 . Steps S1 to S3 are described in detail below.

Step S1, when the image capture device 1 is about to take a picture, the first sensing element 12 senses the light beam passing through the first optical lens 11 and incident on the first sensing element 12 to obtain a first image 2, and passes through the first sensing element 12 The second sensing element 14 senses the light beam that passes through the second optical lens 13 and enters the second sensing element 14 to obtain a second image 4; wherein, the first image 2 can be divided into a plurality of image areas, and each image The region includes at least one pixel, and in order to clearly illustrate the present invention, FIG. 5A only marks one image region 21 among the plurality of image regions in the first image 2 . In addition, the second image 4 can also be divided into multiple image regions. Similarly, in order to clearly illustrate the present invention, FIG. 5B only marks one image region 41 among the plurality of image regions in the second image 4, and the image region 41 Corresponds to the image area 21 .

Furthermore, since the first sensing element 12 is provided with a plurality of phase detection unit groups 121, the obtained first image 2 also has a plurality of phase detection pixels respectively corresponding to the plurality of phase detection unit groups 121. group 22, and each phase detection pixel group 22 includes a first light incident portion 221 corresponding to the first light incident phase detection unit 1211 and a second light incident portion 222 corresponding to the second light incident phase detection unit 1212, It is shown in Figure 5A.

In this preferred embodiment, the first light incident portion 221 and the second light incident portion 222 are respectively an upper light incident portion and a lower light incident portion, and the first light incident portion 221 and the second light incident portion 222 are located at the same pixels, but it is not limited to this in practical application. For example, the design can also be changed so that the first light incident part 221 and the second light incident part 222 are respectively the bottom light incident pixel and the top light incident pixel, and the design can also be changed to the second light incident pixel. The first light incident portion 221 and the second light incident portion 222 are respectively located in different pixels.

Step S2 , calculating the difference between the first image 2 and the second image 4 through the computing module 15 to obtain the first area depth information of each image area. Taking FIG. 5A and FIG. 5 as an example, since the image area 21 of the first image 2 corresponds to the image area 41 of the second image 4, the difference between the image area 21 and the image area 41 can be obtained by calculating the difference between the image area 21 and the image area 41 through the calculation module. The first area depth information of the image area 21 of an image 2, of course, the first area depth information of other image areas can also be obtained similarly.

In this preferred embodiment, the difference between the first image and the second image is obtained by calculating the peak signal-to-noise ratio (PSNR); wherein, the peak signal-to-noise ratio is an objective criterion for judging the similarity of the two images, The higher the peak signal-to-noise ratio, the smaller the image phase difference. However, the above is only an example, and the practical application is not limited thereto. For example, the difference between the first image and the second image can also be obtained by a ZNCC method. In addition, how to obtain the depth information of the first region of each image region through the difference between the first image and the second image, and how to obtain the first image and the second image through the peak signal-to-noise ratio or normalized correlation method The differences are well known to those skilled in the art, and will not be repeated here.

Step S3, calculating a horizontal direction image intensity and a vertical direction image intensity of the first area depth information of each image area of the first image 2 through the computing module 15, and deciding to select the first area of each image area according to the calculation result. The area depth of field information or the second area depth of field information is the adopted area depth of field information of the image area; wherein, the second area depth of field information of each image area passes through at least part of the plurality of phase detection pixel groups 22 of the first image 2 Phase detection pixel groups are obtained. The adopted regional depth information of all image regions of the first image 2 obtained through step S3 can be combined into the global depth information of the first image 2 .

Further, when the horizontal image intensity of the first area depth information of any image area of the first image 2 is greater than the vertical image intensity, it means that the vertical image information of the image area is less, and because the second image area of the image area The two-area depth information is obtained through at least part of the phase detection pixel groups 22 of the first image 2, and the first light incident portion 221 and the second light incident portion 222 of each phase detection pixel group 22 are vertically arranged, so the The second area depth information of the image area has more vertical image information, so the computing module 15 selects the second area depth information of the image area as the adopted area depth information of the image area to make up for the original vertical image information Fewer flaws. On the contrary, when the vertical image intensity of the first area depth information of any image area of the first image 2 is greater than the horizontal image intensity, it means that the image area already has enough vertical image information, so the computing module 15 directly uses The first area depth of field information of the image area is adopted area depth of field information of the image area.

In this preferred embodiment, the image intensity in the horizontal direction and the image intensity in the vertical direction of the first area depth information of any image area of the first image 2 are obtained through a mask opterators. Specifically, the image intensity in the horizontal direction is obtained by a Prewitt operator f _x , and the image intensity in the vertical direction is obtained by another Prewitt operator f _y ,

in,

However, the above is only an embodiment, and the method of obtaining the image intensity in the horizontal direction and the image intensity in the vertical direction is not limited thereto. In addition, regarding the above-mentioned mask opterators, such as obtaining the image intensity in the horizontal direction and the image intensity in the vertical direction through the Brewitt operator, the specific implementation method is known to those skilled in the art, and will not be repeated here. be repeated.

Next, it will be described how the second area depth information of any image area in the first image 2 is obtained through the phase detection pixel group 22 in the first image 2 . Please refer to FIGS. 6 to 8. FIG. 6 is a flow chart of a preferred method for obtaining the field depth information of any image area of the first image in step S3 in FIG. 4, and FIG. 7A is the first A better conceptual schematic diagram of the image, FIG. 7B is a better conceptual schematic diagram of the second image shown in FIG. 6 , and FIG. 8 is a block schematic diagram of a preferred embodiment of the computing module of the image extraction device shown in FIG. 2 .

In this preferred embodiment, the computing module 15 of the image capture device 1 includes an image segmentation unit 151 and a computing unit 152, and the image segmentation unit 151 is used to gather a plurality of first incident light portions 221 in the first image 2 to form A first image 31 and a plurality of second incident light portions 222 in the first image 2 are collected to form a second image 32 , as shown in FIG. 7A and FIG. 7B . Wherein, the first image 31 has a plurality of first image blocks respectively corresponding to a plurality of image regions of the first image 2, and the second image 32 has a plurality of image blocks respectively corresponding to the plurality of image regions of the first image 2. A plurality of second image blocks, and in order to clearly illustrate the present invention, FIG. 7A only marks a first image block 311 in the first image 31 in the first image block, and it corresponds to the one marked in FIG. 5A , and FIG. 7B only marks one second image block 321 among the plurality of second image blocks in the second image 32, and it corresponds to the image area 21 marked in FIG. 5A.

Next, the computing unit 152 receives the first image 31 and the second image 32 from the image segmentation unit 151, and obtains the image phase difference between each first image block and the corresponding second image block and The image phase difference between each first image block and multiple test blocks is respectively obtained, and the second image of the corresponding image area on the first image 2 is obtained through the image phase difference among the multiple image phase differences that is the smallest. Area depth information; wherein, a plurality of test blocks partially overlap or are adjacent to corresponding second image blocks.

The image area 21 shown in FIG. 5A , the first image block 311 shown in FIG. 7A , and the second image block 321 shown in FIG. 7B are taken as examples below for illustration. The computing unit 152 is used to respectively obtain the image phase difference between the first image block 311 and the corresponding second image block 321 and to respectively obtain the first image block 311 and a plurality of test blocks 322 ₁ , 322 ₂ . . . 322 _m , 323 ₁ , 323 ₂ ... 323 _n image phase difference E2 ₁ , E2 ₂ ... E2 _m , E3 ₁ , E3 ₂ ... E3 _n ; wherein, a plurality of test blocks 322 ₁ , 322 ₂ ... 322 _m , 323 ₁ , 323 ₂ . . . 323 _n are respectively partially overlapped or adjacent to the corresponding second image block 321 in a horizontal direction.

In this preferred embodiment, the central positions P2 ₁ ... of some test blocks 322 ₁ , 322 ₂ ... 322 _m among the plurality of test blocks 322 ₁ , 322 ₂ ... 322 _m , 323 ₁ , 323 ₂ ... 323 _n P2 _m is located on the left side of the center _of the _second image block ₃₂₁ , and the center positions _{P3 1} . , and the second image block 321 and a plurality of test blocks 322 ₁ , 322 ₂ ... 322 _m , 323 ₁ , 323 ₂ ... 323 _n have the same size; and, the above is only an embodiment, and multiple test blocks The selection of blocks 322 ₁ , 322 ₂ . . . 322 _m , _{323 1} , 323 ₂ . For example, the design can be modified such that a plurality of test blocks are respectively partially overlapped or adjacent to the corresponding second image block in a vertical direction.

In particular, the focused area in the first image 2 is the reference point of the image depth of field. If the image area 21 of the first image 2 is the focused area, the distance between the first image block 311 and the second image block 321 The image phase difference E1 between the first image block 311 and the second image block 321 should approach zero, and if the image phase difference E1 between the first image block 311 and the second image block 321 is not approaching zero, it represents the image area 21 of the first image 2 It is not a focused area. At this time, the images between the second image block 321 and a plurality of test blocks 322 ₁ , 322 ₂ ... 322 _m , 323 ₁ , 323 ₂ ... 323 _n and the first image block 311 The position of the block with the smallest phase difference represents the relative relationship between the image area 21 of the first image 2 and the focused area, and further the field depth information of the second area of the image area 21 can be obtained.

In this preferred embodiment, the depth information of the second area is expressed in series of -m...-2, -1, 0, 1, 2...n, for example, when the image between the first image block 311 When the block with the smallest phase difference is the test block 322 _m , the field depth information of the second area of the image area 21 is represented by -m, and the block with the smallest image phase difference with the first image block 311 is the test block 322 When ₂ , the field depth information of the second area of the image area 21 is represented by -2. When the block with the smallest image phase difference with the first image block 311 is the second image block 321, the second area of the image area 21 The depth of field information is represented by 0. When the block with the smallest image phase difference with the first image block 311 is the test block 3231, the depth of field information of the second area of the image area 21 is represented by ₁ . When the block with the smallest image phase difference between the blocks 311 is the test block 323 _n , the second area field depth information of the image area 21 is represented by n, when the block with the smallest image phase difference between the first image block 311 is When the test block is another test block, the field depth information of the second area of the image area 21 is similarly represented. However, the expression manner of the depth information of the second region is not limited to the expression in series.

Moreover, in this preferred embodiment, the image phase difference E1 between the first image block 311 and the corresponding second image block 321 and the multiple test blocks 322 ₁ , 322 ₂ ... 322 _{m The} image phase differences E2 ₁ , E2 ₂ . _{. . E2 m , E3 1 ,} E3 ₂ . Generally speaking, the peak signal-to-noise ratio is an objective criterion for judging the similarity of two images, and the higher the peak signal-to-noise ratio, the smaller the image phase difference, which is known to those skilled in the art, and here is No further details will be given.

In addition, in practical application, the standard for evaluating image phase difference is not limited to peak signal-to-noise ratio, and those skilled in the art can also make any equivalent modification design according to actual application requirements. For example, the image phase difference E1 between the first image block 311 and the corresponding second image block 321 and the multiple test blocks 322 ₁ , 322 ₂ . . . 322 _m , 323 ₁ , 323 ₂ The image phase differences E2 ₁ , E2 ₂ . _{. . E2 m , E3 1} , E3 ₂ . Likewise, the normalized correlation method is known to those skilled in the art, so it will not be repeated here.

Further, the computing unit 152 obtains the image phase difference E1 between the first image block 311 and the corresponding second image block 321 and the multi-phase difference E1 by calculating the peak signal-to-noise ratio or de-meaning normalized correlation method. After the image phase difference E2 ₁ , E2 ₂ ... E2 _m , E3 ₁ , E3 ₂ ... E3 _n among the test blocks 322 ₁ , 322 ₂ ... 322 _m , 323 ₁ , 323 ₂ ... 323 _n , through multiple images _The image phase difference _among the phase differences _{E2 1} , _{E2 2} . Second area depth information of the image area 21 of the first image 2 .

Similarly, the depth of field information of the second area of each other image area in the first image 2 can also be obtained through the first image block corresponding to the image area on the first image 31 and the corresponding area on the second image 31. The second image block of the region is obtained through the method described above. However, the above is only an embodiment, and the method for obtaining the second region field depth information of each image region 21 through at least part of the phase detection pixel groups 22 in the first image 2 is not as shown in FIG. 6 shown as a limit.

According to the above description, it can be seen that the image extraction device and the image depth measurement method of the present invention not only obtain the preliminary image depth information through two optical lenses, but also assist in matching the phase detection pixel group of the image extracted from one of the optical lenses. The other image depth information is used to make up for the image depth error in the preliminary image depth information caused by the scene being shot in the same direction as the arrangement direction of the two optical lenses. It should be added that if the image depth information is only obtained through a single optical lens and the phase detection pixel group of the extracted image, the effect will be ineffective due to insufficient brightness of the shooting environment or a smooth area (that is, an area with low contrast). The above-mentioned defects can be overcome by using the image extraction device and the image depth-of-field measurement method of this case.

Of course, the above are only examples, and those skilled in the art can also make any equivalent design changes according to actual application requirements. For example, the design can be changed so that the arrangement direction of the first optical lens 11 and the second optical lens 13 of the image capture device 12 shown in FIG. 2 is vertically arranged, and each phase detection unit group of the first sensing element 12 The first incident light phase detection unit 1211 and the second incident light phase detection unit 1212 of 121 are horizontally arranged, that is, corresponding to the first light incident part 221 of the first incident light phase detection unit 1211 and corresponding to the second incident light phase detection unit 1211 The second light incident part 222 of the optical phase detection unit 1212 is respectively a left light incident pixel and a right light incident pixel, or is a right light incident pixel and a left light incident pixel respectively, therefore, in step S3 described in FIG. The modified design is that when the horizontal image intensity of the first area depth information of any image area of the first image 2 is greater than the vertical image intensity, the computing module 15 directly uses the first area depth information of the image area as the image The adopted regional field depth information of the region, and when the vertical direction image strength of the first region field depth information of any image region of the first image 2 is greater than the horizontal direction image strength, the computing module 15 selects the second region of the image region The depth of field information is the adopted area depth of field information of the image area.

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the claims of the present invention. Therefore, all other equivalent changes or modifications that do not deviate from the disclosed spirit of the present invention should be included in the scope of this case. within the claims.

Claims (20)

1. An image depth of field measurement method, comprising:

(a) extracting a first image by using a first optical lens and extracting a second image by using a second optical lens; the first image is provided with a plurality of phase detection pixel groups and is divided into a plurality of image areas;

(b) obtaining a first region depth information of each image region by using the difference between the first image and the second image;

(c) determining to select the first area depth of field information or the second area depth of field information as adopted area depth of field information by calculating a horizontal direction image intensity and a vertical direction image intensity of the first area depth of field information of each image area; wherein the second regional depth information is obtained by at least some of the plurality of phase detection pixel sets.

2. The method of claim 1, wherein in the step (b), the difference between the first image and the second image is obtained by calculating a peak signal-to-noise ratio (SNR), or the difference between the first image and the second image is obtained by a de-averaging normalized correlation method.

3. The method according to claim 1, wherein each of the phase detection pixel sets includes a first light incident portion and a second light incident portion, and an arrangement direction of the first optical lens and the second optical lens is perpendicular to an arrangement direction of the first light incident portion and the second light incident portion.

4. The method according to claim 3, wherein the first optical lens and the second optical lens are arranged horizontally, and in the step (c), when the horizontal image intensity of the first area depth information of any one of the image areas is greater than the vertical image intensity, the corresponding second area depth information is selected as the adopted area depth information, and when the horizontal image intensity of the first area depth information of any one of the image areas is less than the vertical image intensity, the first area depth information is selected as the adopted area depth information.

5. The method according to claim 3, wherein the first optical lens and the second optical lens are arranged vertically, and in the step (c), when the horizontal image intensity of the first area depth information of any one of the image areas is greater than the vertical image intensity, the first area depth information is selected as the adopted area depth information, and when the horizontal image intensity of the first area depth information of any one of the image areas is less than the vertical image intensity, the corresponding second area depth information is selected as the adopted area depth information.

6. The method according to claim 1, wherein in the step (c), the horizontal image intensity and the vertical image intensity of the first region depth information of each image region are obtained by a masking operation.

7. The method of claim 6, wherein the horizontal image intensity is measured by a Brillouin operator f_xObtained by passing the image intensity in the vertical direction through another Brillouin operator f_yAnd obtaining; wherein,

<mrow> <msub> <mi>f</mi> <mi>x</mi> </msub> <mo>=</mo> <mtable> <mtr> <mtd> <mrow> <mo>-</mo> <mn>1</mn> </mrow> </mtd> <mtd> <mn>0</mn> </mtd> <mtd> <mn>1</mn> </mtd> </mtr> <mtr> <mtd> <mrow> <mo>-</mo> <mn>1</mn> </mrow> </mtd> <mtd> <mn>0</mn> </mtd> <mtd> <mn>1</mn> </mtd> </mtr> <mtr> <mtd> <mrow> <mo>-</mo> <mn>1</mn> </mrow> </mtd> <mtd> <mn>0</mn> </mtd> <mtd> <mn>1</mn> </mtd> </mtr> </mtable> <mo>,</mo> <msub> <mi>f</mi> <mi>y</mi> </msub> <mo>=</mo> <mtable> <mtr> <mtd> <mn>1</mn> </mtd> <mtd> <mn>1</mn> </mtd> <mtd> <mn>1</mn> </mtd> </mtr> <mtr> <mtd> <mn>0</mn> </mtd> <mtd> <mn>0</mn> </mtd> <mtd> <mn>0</mn> </mtd> </mtr> <mtr> <mtd> <mrow> <mo>-</mo> <mn>1</mn> </mrow> </mtd> <mtd> <mrow> <mo>-</mo> <mn>1</mn> </mrow> </mtd> <mtd> <mrow> <mo>-</mo> <mn>1</mn> </mrow> </mtd> </mtr> </mtable> <mo>.</mo> </mrow>

8. the method according to claim 1, wherein each of the phase detection pixel sets includes a first light incident portion and a second light incident portion, and the step of obtaining the depth information of any one of the image areas includes:

the plurality of first light incoming parts are gathered to form a first image and the plurality of second light incoming parts are gathered to form a second image; the first image has a first image block corresponding to any image area, and the second image has a second image block corresponding to any image area; and

obtaining an image phase difference between the first image block and the second image block and between the first image block and a plurality of test blocks, and obtaining the second area depth of field information of any image area according to the minimum image phase difference in the image phase differences; the plurality of test blocks are respectively partially overlapped or adjacent to the second image block.

9. The image depth-of-field measurement method of claim 8, wherein the image phase difference is obtained by calculating a peak signal-to-noise ratio or the image phase difference is obtained by a de-averaging normalized correlation method.

10. The method according to claim 8, wherein the first light incident portion and the second light incident portion are an upper light incident portion and a lower light incident portion, respectively, or the first light incident portion and the second light incident portion are a left light incident portion and a right light incident portion, respectively.

11. An image capturing device, comprising:

a first optical lens;

a second optical lens;

a first sensing element which senses a light beam passing through the first optical lens and incident to the first sensing element to obtain a first image, and the first image is divided into a plurality of image areas; the first sensing element comprises a plurality of phase detection unit groups, so that a plurality of phase detection pixel groups respectively corresponding to the phase detection unit groups are arranged in the first image;

a second sensing element for sensing the light beam passing through the second optical lens and incident to the second sensing element to obtain a second image;

the operation module is connected with the first sensing element and the second sensing element, obtains first area depth of field information of each image area by utilizing the difference between the first image and the second image, and determines to select the first area depth of field information or the second area depth of field information as adopted area depth of field information by calculating the horizontal direction image intensity and the vertical direction image intensity of the first area depth of field information of each image area; wherein the second regional depth information is obtained by at least some of the plurality of phase detection pixel sets.

12. The image capturing device of claim 11, wherein the computing module obtains the difference between the first image and the second image by calculating a peak signal-to-noise ratio, or obtains the difference between the first image and the second image by a de-averaging normalized correlation method.

13. The image capturing device as claimed in claim 11, wherein each of the phase detecting pixel sets includes a first light incident portion and a second light incident portion, and an arrangement direction of the first optical lens and the second optical lens is perpendicular to an arrangement direction of the first light incident portion and the second light incident portion.

14. The image capturing device as claimed in claim 13, wherein the first optical lens and the second optical lens are arranged horizontally, and when the horizontal image intensity of the first area depth information of any one of the image areas is greater than the vertical image intensity, the computing module selects the corresponding second area depth information as the adopted area depth information, and when the horizontal image intensity of the first area depth information of any one of the image areas is less than the vertical image intensity, the computing module selects the first area depth information as the adopted area depth information.

15. The image capturing device as claimed in claim 13, wherein the first optical lens and the second optical lens are arranged vertically, and when the horizontal image intensity of the first area depth information of any one of the image areas is greater than the vertical image intensity, the computing module selects the first area depth information as the adopted area depth information, and when the horizontal image intensity of the first area depth information of any one of the image areas is less than the vertical image intensity, the computing module selects the corresponding second area depth information as the adopted area depth information.

16. The image capturing device as claimed in claim 13, wherein the computing module obtains the horizontal image intensity and the vertical image intensity of the first region depth information of each of the image regions through a masking operation.

17. The image capturing device of claim 16, wherein the computing module utilizes a Brillowster operator f_xObtaining the image intensity in the horizontal direction, and passing through another Brillouin operator f_yObtaining the image intensity in the vertical direction; wherein,

<mrow> <msub> <mi>f</mi> <mi>x</mi> </msub> <mo>=</mo> <mtable> <mtr> <mtd> <mrow> <mo>-</mo> <mn>1</mn> </mrow> </mtd> <mtd> <mn>0</mn> </mtd> <mtd> <mn>1</mn> </mtd> </mtr> <mtr> <mtd> <mrow> <mo>-</mo> <mn>1</mn> </mrow> </mtd> <mtd> <mn>0</mn> </mtd> <mtd> <mn>1</mn> </mtd> </mtr> <mtr> <mtd> <mrow> <mo>-</mo> <mn>1</mn> </mrow> </mtd> <mtd> <mn>0</mn> </mtd> <mtd> <mn>1</mn> </mtd> </mtr> </mtable> <mo>,</mo> <msub> <mi>f</mi> <mi>y</mi> </msub> <mo>=</mo> <mtable> <mtr> <mtd> <mn>1</mn> </mtd> <mtd> <mn>1</mn> </mtd> <mtd> <mn>1</mn> </mtd> </mtr> <mtr> <mtd> <mn>0</mn> </mtd> <mtd> <mn>0</mn> </mtd> <mtd> <mn>0</mn> </mtd> </mtr> <mtr> <mtd> <mrow> <mo>-</mo> <mn>1</mn> </mrow> </mtd> <mtd> <mrow> <mo>-</mo> <mn>1</mn> </mrow> </mtd> <mtd> <mrow> <mo>-</mo> <mn>1</mn> </mrow> </mtd> </mtr> </mtable> <mo>.</mo> </mrow>

18. the image capturing device as claimed in claim 11, wherein each of the phase detection pixel sets includes a first light incident portion and a second light incident portion, and the computing module includes:

an image dividing unit for collecting the first light incident parts to form a first image and collecting the second light incident parts to form a second image; the first image has a plurality of first image blocks respectively corresponding to the plurality of image areas, and the second image has a plurality of second image blocks respectively corresponding to the plurality of image areas; and

an arithmetic unit connected to the image segmentation unit for obtaining an image phase difference between any one of the first image blocks and the corresponding second image block and between the first image block and the plurality of test blocks, and obtaining depth information of the corresponding second area of the image area according to one of the plurality of image phase differences which is the smallest in image phase difference; the plurality of test blocks are respectively partially overlapped or adjacent to the corresponding second image block.

19. The image capturing device of claim 18, wherein the computing unit obtains the image phase difference by calculating a peak signal-to-noise ratio or obtains the image phase difference by a de-averaging normalized correlation method.

20. The image capturing device as claimed in claim 18, wherein the first light incident portion and the second light incident portion are an upper light incident portion and a lower light incident portion, respectively, or the first light incident portion and the second light incident portion are a left light incident portion and a right light incident portion, respectively.