CN112929574A - Method for improving image quality of camera under screen, camera module and mobile terminal - Google Patents
Method for improving image quality of camera under screen, camera module and mobile terminal Download PDFInfo
- Publication number
- CN112929574A CN112929574A CN201911244276.3A CN201911244276A CN112929574A CN 112929574 A CN112929574 A CN 112929574A CN 201911244276 A CN201911244276 A CN 201911244276A CN 112929574 A CN112929574 A CN 112929574A
- Authority
- CN
- China
- Prior art keywords
- camera
- image sensor
- image
- shutter speed
- shake
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 31
- 230000035945 sensitivity Effects 0.000 claims abstract description 34
- 238000001514 detection method Methods 0.000 claims description 16
- 230000003287 optical effect Effects 0.000 claims description 13
- 230000015572 biosynthetic process Effects 0.000 claims description 5
- 238000003786 synthesis reaction Methods 0.000 claims description 5
- 230000002194 synthesizing effect Effects 0.000 claims description 2
- 230000009286 beneficial effect Effects 0.000 abstract description 2
- 239000002131 composite material Substances 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 239000003086 colorant Substances 0.000 description 3
- 230000003247 decreasing effect Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000014509 gene expression Effects 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000013475 authorization Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000000725 suspension Substances 0.000 description 1
- 238000002834 transmittance Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/71—Circuitry for evaluating the brightness variation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
The disclosure relates to the technical field of cameras, in particular to a method for improving the image quality of a camera under a screen, a camera module and a mobile terminal. A method for improving the image quality of an off-screen camera under a screen comprises the following steps: detecting the ambient light brightness of the environment where the camera is located; shooting a first image at a shutter speed corresponding to the ambient light brightness, the aperture value and the sensitivity of an image sensor by using a first camera with the aperture value of a lens being more than a preset value; capturing a second image as a black-and-white image at a shutter speed corresponding to the ambient light brightness, the aperture value, and a sensitivity of an image sensor using a second camera; and compositing the first image and the second image to form a composite image. The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects: according to the method for improving the image quality of the off-screen camera, the camera module and the mobile terminal, the brightness of the off-screen camera can be improved, the quality of the image quality shot by the off-screen camera can be improved, and high-quality image quality is realized.
Description
Technical Field
The present disclosure relates to the field of camera technologies, and in particular, to a method for improving image quality of an off-screen camera, a camera module, and a mobile terminal.
Background
The camera on the mobile terminal provides great convenience for a user to take pictures. In the present day that various technologies of mobile terminals, such as mobile phones, are rapidly developed, users have increasingly high demands for cameras, and for example, it is desired to capture high image quality similar to the effect captured by professional cameras. Meanwhile, the mobile phone has high requirements on the appearance, such as a large screen, beautiful appearance and the like.
Therefore, all mobile phone merchants develop mobile phones with full-screen, even double-sided screen, surround screen and the like. However, since the screen occupies almost the entire space on the surface of the mobile phone, it causes great difficulty in disposing many functional elements such as a camera. For example, in a mobile phone in the related art, a notch is formed on a screen, and a camera is disposed in the notch, but the notch cannot realize a full-screen, and also affects the appearance of the mobile phone.
In order to improve the appearance of the mobile phone and realize a full-screen, the camera can be arranged below the screen, the camera cannot be seen from the appearance, and the requirements of a user are met.
However, due to the shielding of the screen, light is prevented from entering the camera, so that the quality of a shot photo is reduced, and meanwhile, due to the influence of the color, the resolution and the like of the screen, the image collected by the camera is blurred, too dark, color cast, dazzling and the like.
In order to solve the above problems, it is common to reduce the number of pixels of the screen at the position where the camera is disposed, or to remove the polarizing plate between the camera and the screen, or to adopt both of the above solutions.
However, if the number of pixels of the screen at the installation position of the camera is reduced, it is easy to see that the display difference between the screen at the installation position of the camera and the surrounding screen due to the pixel difference affects the display effect of the entire screen.
If the polaroid between the lens and the screen is removed, the reflecting effect is obvious, and the display effect under high light such as sunlight is influenced.
Disclosure of Invention
In order to overcome the problems in the related art, the present disclosure provides a method for improving the image quality of an off-screen camera, a camera module, and a mobile terminal.
According to an aspect of the embodiments of the present disclosure, there is provided a method for improving image quality of an off-screen camera, the camera being disposed under a screen, the method including:
detecting the ambient light brightness of the environment where the camera is located;
shooting a first image at a shutter speed corresponding to the ambient light brightness, the aperture value and the sensitivity of an image sensor by using a first camera with the aperture value of a lens being more than a preset value;
capturing a second image as a black-and-white image at a shutter speed corresponding to the ambient light brightness, the aperture value, and a sensitivity of an image sensor using a second camera; and
the first image and the second image are synthesized to form a synthesized image.
In one embodiment, the capturing a first image with a shutter speed corresponding to the ambient light brightness, the aperture value, and the sensitivity of an image sensor using a first camera in which the aperture value of a lens is a preset value or more includes:
determining a theoretical shutter speed according to the detected ambient light brightness and the aperture value and the sensitivity of an image sensor;
and extending the determined theoretical shutter speed to a set shutter speed, and shooting the first image at the actually set shutter speed.
In one embodiment, the capturing a second image as a black-and-white image using a second camera at a shutter speed corresponding to the ambient light brightness, the aperture value, and a sensitivity of an image sensor includes:
determining a theoretical shutter speed according to the detected ambient light brightness, the aperture value and the sensitivity of an image sensor;
and prolonging the determined theoretical shutter speed to a set shutter speed, and shooting the second image at the actually set shutter speed.
In one embodiment, the method further comprises:
detecting the shake of at least one camera of the first camera and the second camera, and calculating the direction, amplitude and frequency of the shake;
moving at least one of the first camera and the second camera in a direction opposite to the direction of the shake with the same amplitude and the same frequency.
In one embodiment, the first camera comprises an image sensor; the image sensor satisfies at least one of the following conditions: the unit pixel size is 1.28 μm or more, and the multi-pixel synthesis equivalent pixel size is 1.60 μm or more and the number of pixels of the image sensor is 20MP or more.
In one embodiment, in the image sensor, a plurality of unit pixels are combined into one pixel group; each of the unit pixels receives a light signal of one color; the light signals received by the pixel group include red, green, and blue light signals.
In one embodiment, the optical signals received by the group of pixels further comprise at least one of a white light signal and a yellow light signal.
In one embodiment, the second camera includes a black and white image sensor.
In one embodiment, a light homogenizing sheet is arranged on the black-and-white image sensor.
In one embodiment, the aperture value of the lens is F1.6 or less.
According to another aspect of the embodiments of the present disclosure, there is provided a camera module for a mobile terminal, the camera being disposed below a screen of the mobile terminal, the camera module including: a first camera for capturing a first image, the first camera comprising: the first lens is provided with an aperture value more than a preset value; a first image sensor receiving light from the first lens and having a light sensing filter; a second camera for taking a second image, the second camera comprising: a second lens; and a second image sensor receiving light from the second lens and having a black and white image sensor; and the processor is used for detecting the ambient light brightness of the environment where the camera module is located, adjusting the shutter speed of at least one camera in the first camera and the second camera at the shutter speed corresponding to the ambient light brightness, the aperture value and the sensitivity of an image sensor, and synthesizing the first image and the second image.
In one embodiment, the camera module further comprises: the first detection module is used for detecting the ambient light brightness and sending the ambient light brightness to the processor; and the shutter control module drives the shutters of the first camera and the second camera according to the shutter speed set by the processor based on the ambient light brightness, the aperture value and the sensitivity of the image sensor.
In one embodiment, the camera module further comprises: an anti-shake device that detects shake of at least one of the first camera and the second camera, and calculates a direction, amplitude, and frequency of the shake; moving at least one of the first image sensor and the second image sensor in a direction opposite to the direction of the shaking with the same amplitude and the same frequency.
In one embodiment, the anti-shake apparatus includes: the second detection module is used for detecting the shake of at least one camera in the first camera and the second camera and calculating the direction, amplitude and frequency of the shake; a driving module moving at least one of the first image sensor and the second image sensor in a direction opposite to the direction of the shaking with the same amplitude and the same frequency.
In one embodiment, the anti-shake apparatus includes a second detection module and a driving module; the second detection module detects the jitter of at least one camera in the first camera and the second camera and sends information related to the jitter to the processor; the processor calculating a direction, amplitude and frequency of the jitter based on the received jitter related information; the driving module moves at least one of the first image sensor and the second image sensor in a direction opposite to the direction of the shake with the same amplitude and the same frequency based on the direction, amplitude, and frequency of the shake calculated by the processor.
In one embodiment, the first image sensor includes a plurality of pixel groups, each of the pixel groups including a plurality of unit pixels, the plurality of unit pixels constituting a square array; each unit pixel is attached with an optical filter; the pixel group comprises unit pixels attached with red filters and unit pixels attached with blue filters.
In one embodiment, the pixel group further includes a unit pixel to which a green filter is attached.
In one embodiment, the pixel group further includes a unit pixel to which a transparent filter, a white filter, or a yellow filter is attached.
In one embodiment, a light homogenizing sheet is arranged on the black-and-white image sensor.
According to another aspect of the embodiments of the present disclosure, there is provided a mobile terminal including: a screen; the camera module is the camera module in any one embodiment of the second aspect or the second aspect; the camera module is arranged below the screen.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:
according to the method for improving the image quality of the off-screen camera, the camera module and the mobile terminal, the brightness of the off-screen camera can be improved, the quality of the image quality shot by the off-screen camera can be improved, and high-quality image quality is realized.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
Fig. 1 is a block diagram illustrating a structure of a camera module according to an exemplary embodiment of the present disclosure.
Fig. 2 is a block diagram illustrating a structure of a camera module according to an exemplary embodiment of the present disclosure.
Fig. 3 is a block diagram illustrating a structure of a camera module according to an exemplary embodiment of the present disclosure.
Fig. 4 is a flowchart illustrating a method of improving image quality of an off-screen camera according to an exemplary embodiment of the present disclosure.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the invention, as detailed in the appended claims.
It should be noted that, although the expressions "first", "second", etc. are used herein to describe different modules, steps, data, etc. of the embodiments of the present disclosure, the expressions "first", "second", etc. are merely used to distinguish between different modules, steps, data, etc. and do not indicate a particular order or degree of importance. Indeed, the terms "first," "second," and the like are fully interchangeable.
In order to better understand the side key fixing module according to the present disclosure, preferred embodiments of the side key fixing module according to the present disclosure will be further described below with reference to the accompanying drawings. The terms "center", "longitudinal", "lateral", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc. indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, and are only for convenience in describing the present embodiment and simplifying the description, but do not indicate or imply that the devices or elements referred to must have a specific orientation, be constructed and operated in a specific orientation, and thus are not to be construed as limiting the scope of the present embodiment, and like reference numerals indicate the same type of structure.
Fig. 1 is a block diagram illustrating a structure of a camera module according to an exemplary embodiment of the present disclosure.
According to an aspect of the embodiments of the present disclosure, there is provided a camera module for a mobile terminal, the camera being disposed below a screen of the mobile terminal, and referring to fig. 1, the camera module 100 includes: a first camera 10, a second camera 20, and a processor 30.
The first camera 10 is used for taking a first image, the first camera 10 includes: a first lens 11 and a first image sensor 12.
The aperture value of the first lens 11 is greater than a predetermined value.
And a first image sensor 12 receiving light from the first lens 11 and having a photosensitive filter.
The first image sensor 12 is attached with at least one of a transparent filter, a white filter, or a yellow filter.
The second camera 20 is used for taking a second image, and the second camera 20 includes a second lens 21 and a second image sensor 22.
The second image sensor 22 receives light from the second lens 21 and has a black and white image sensor.
The processor 30 detects the ambient light brightness of the environment where the camera module 100 is located, adjusts the shutter speed of at least one of the first camera and the second camera at a shutter speed corresponding to the ambient light brightness, the aperture value and the sensitivity of the image sensor, and synthesizes the first image and the second image.
One image is respectively shot through the two cameras, and then the two images are overlapped to form a picture, so that the light incoming quantity is effectively increased. In general, cameras of mobile phones are all fixed-aperture lenses with F2.0 or less, and the aperture of the first lens 11 of the first camera 10 is enlarged to F1.6, thereby effectively increasing the amount of light entering. As an example, the aperture of the second lens 21 may be similarly enlarged to F1.6, further increasing the amount of light entering.
The first image sensor 12 is provided with a photosensitive filter to photograph a color image, and therefore, the first camera 11 is used to photograph a color image. The transparent filter, the white filter, or the yellow filter is disposed on the first image sensor 12, which can increase the amount of light entering and can also homogenize the light.
The two images are taken and then combined to effectively increase the amount of light entering, and the number of pixels of the picture is increased to improve the picture quality.
Fig. 2 is a block diagram illustrating a structure of a camera module according to an exemplary embodiment of the present disclosure.
In one embodiment, referring to fig. 2, the camera module 100 further includes: a first detection module 40 and a shutter control module 50. The first detecting module 40 is configured to detect the ambient light brightness and send the ambient light brightness to the processor 30. The shutter control module 50 drives the shutters of the first camera 10 and the second camera 20 according to the shutter speed set by the processor 30 based on the shutter speed corresponding to the ambient light brightness, the aperture value, and the sensitivity of the image sensor.
The ambient light brightness is detected by the first detection module 40 and sent to the processor 30, and the processor 30 drives the shutters of the first camera 10 and the second camera 20 according to the received ambient light brightness, the aperture value, and the shutter speed set by the sensitivity of the image sensor.
The photographic exposure has reciprocity among three factors, namely aperture size, shutter speed and sensitivity, and for a camera with constant values of both sensitivity and aperture (F1.6), the shutter speed can be determined according to the brightness of ambient light. On this basis, in order to obtain a larger amount of light entering, the shutter open time, that is, the shutter speed, can be appropriately extended. In the present embodiment, the shutter open time is 1/10 seconds to 1/4 seconds, which is 3 times or more the shutter speed of 1/30 seconds in a normal camera, and therefore the amount of light entering is 3 times or more the normal camera.
Fig. 3 is a block diagram illustrating a structure of a camera module according to an exemplary embodiment of the present disclosure.
In one embodiment, referring to fig. 3, the camera module 100 further includes: and an anti-shake apparatus 60 that detects shake of at least one of the first camera 10 and the second camera 20, and calculates a direction, amplitude, and frequency of the shake. At least one of the first image sensor 12 and the second image sensor 22 is moved with the same amplitude and the same frequency in a direction opposite to the direction of the shaking.
In one embodiment, the anti-shake apparatus includes: a second detection module 61 and a driving module 62, wherein the second detection module 61 detects the shake of at least one camera of the first camera 10 and the second camera 20, and calculates the direction, amplitude and frequency of the shake. A driving module for moving at least one of the first image sensor 12 and the second image sensor 22 in a direction opposite to the direction of the shaking with the same amplitude and the same frequency
When shooting, the camera shakes due to slight shaking of the human body, especially the hands, and the shot pictures can generate dynamic blurring. In general, there are two anti-shake methods, one is lens anti-shake, and the other is image sensor anti-shake. The two anti-shake principles are the same, namely the shake direction, the shake amplitude and the shake frequency of the camera are detected, and the opposite shake with the same shake amplitude and the same shake frequency is obtained through calculation, so that the shake of the camera is counteracted. The anti-shake device drives the lens to move reversely, and the anti-shake device drives the image sensor to move reversely.
In this embodiment, taking a camera of a mobile phone as an example, the camera is disposed below a screen and drives a lens to shake, which may cause the lens to collide with the screen, thereby damaging the screen or the lens. On the other hand, the lens is in a suspension state on the mobile phone, the lens is driven to shake, the relative position of the lens and the screen pixel structure is easily deviated, the original correspondence is damaged, and the influences of uncontrollable diffraction and the like are caused.
Therefore, the driving image sensor dither is adopted in the present embodiment. The image sensor is electrically connected with the flexible printed circuit board, when the image sensor is driven, the circuit connection is easily influenced, and the image sensor can be driven to shake by adopting a driving mechanism with an authorization notice number of CN209151244U, so that the influence of the shake on the image sensor circuit is effectively solved, and the details are not repeated.
In one embodiment, the anti-shake apparatus 60 includes a second detection module 61 and a driving module 62. The second detection module 61 detects a shake of at least one of the first camera 10 and the second camera 20, and transmits information related to the shake to the processor 30. The processor 30 calculates the direction, amplitude and frequency of the jitter based on the received jitter-related information. The driving module 62 moves at least one of the first image sensor 12 and the second image sensor 22 in a direction opposite to the direction of the shake with the same amplitude and the same frequency based on the direction, amplitude, and frequency of the shake calculated by the processor 62.
The difference between this embodiment and the previous embodiment is that in the previous embodiment, the direction, amplitude and frequency of the jitter are calculated by the second detection module 61. In the present embodiment, the second detection module 61 detects a shake of at least one of the first camera 10 and the second camera 20, and sends information related to the shake to the processor 30. The processor 30 calculates the direction, amplitude and frequency of the jitter based on the received jitter-related information. Both modes can play an effective anti-shaking effect.
In one embodiment, the first image sensor 11 includes a plurality of pixel groups, each of which includes a plurality of unit pixels constituting a square array. And each unit pixel is attached with an optical filter. The pixel group comprises unit pixels attached with red filters and unit pixels attached with blue filters.
The form of the array formed by the plurality of unit pixels may be 4 or 9 unit pixel arrays, and other forms may also be adopted, for example, 2x2,3x3,4x4,5x5 or more, in which, in any form, the filter is added to the image sensor in the form of bayer array, for example, 4 unit pixels form a square pixel (hereinafter, 4 unit pixels are taken as an example), and the filters of one color are respectively disposed on the 4 unit pixels, for example, from left to right, and from top to bottom, respectively, in the form of arrangement of cyan and magenta.
In one embodiment, the pixel group further includes a unit pixel to which a green filter is attached.
Green is the most sensitive color to human eyes, and therefore, in order to make the photographed picture conform to the habit of human eyes, two green filters are disposed on 4 unit pixels to transmit more green light.
On the first image sensor, on the basis of a traditional Bayer array optical filter arrangement mode, at least one green optical filter is replaced by a transparent, white or yellow optical filter, so that the capacity of light received by the first image sensor is effectively improved, namely the sensitivity is improved, and the image quality is improved. For example, in the RGBW/RGBC/RCCB/RWWB/RYYB array system, where R is Red (Red), G is Green (Green), B is blue (Bl μ e), and Red, Green and blue are three primary colors of light, light of each color in proportion to 1/3 is combined to form White light, 3 unit pixels out of 4 unit pixels in one pixel group are occupied, and a White filter (W, White), a Clear filter (C, Clear) or a Yellow filter (Y, Yellow) may be disposed in the remaining unit pixels, so that the amount of light entering is effectively increased without affecting the light signals of the respective color lights received by the image sensor.
In one embodiment, the pixel group further includes a unit pixel to which a transparent filter, a white filter, or a yellow filter is attached.
In order to increase the amount of light entering, at least one of the two green filters in the 4 unit pixels is replaced with a transparent, white, or yellow filter, increasing the amount of light entering the image sensor.
In each color light, the green light has the strongest transmittance, so that although the red and blue filters intelligently transmit the red and blue light, when the light transmits through the white filter, the transparent filter or the yellow filter, the green light transmission ratio is much larger than that of the red and blue light, therefore, the two green filters are replaced by the white filter, the transparent filter or the yellow filter, and the green light signal received by the image sensor is not influenced, and for example, an array mode of RCCB/RWWB/RYYB can be adopted.
In one embodiment, a light homogenizing sheet is arranged on the black-and-white image sensor.
Each unit pixel of the image sensor can receive light waves and sense different wavelengths of the light waves, but the colors cannot be distinguished, so that only black and white photos can be taken if no filter is arranged on the image sensor. In an image sensor without a filter, each unit pixel can receive white light obtained by mixing light of different colors, and the image sensor can receive light signals to the maximum extent.
The transparent or white filter disposed on the second image sensor 22 can almost neglect the blocking of light, but after the light passes through the transparent or white filter, the direct light becomes scattered light, effectively playing a role of uniformly receiving the light signal by the image sensor.
Fig. 4 is a flowchart illustrating a method of improving image quality of an off-screen camera according to an exemplary embodiment of the present disclosure.
According to an aspect of the embodiments of the present disclosure, there is provided a method of improving image quality of an off-screen camera, which may be a method of improving image quality of an off-screen camera that may be installed in various mobile terminals. The mobile terminal can be a mobile phone, a tablet computer, a notebook computer, a personal digital assistant and the like. In the following description, a mobile phone is taken as an example, but the present disclosure is not limited thereto.
Referring to fig. 4, the camera is disposed below the screen, and the method for improving the image quality of the camera under the screen includes:
in step S100, detecting an ambient light brightness of an environment where the camera is located;
in step S200, a first camera having a lens aperture value greater than a preset value is used to capture a first image at a shutter speed corresponding to the ambient light brightness, the aperture value, and a sensitivity of an image sensor;
capturing a second image as a black-and-white image at a shutter speed corresponding to the ambient light brightness, the aperture value, and a sensitivity of an image sensor using a second camera in step S300; and
in step S400, the first image and the second image are synthesized to form a synthesized image.
The amount of light entering is effectively increased by the large aperture of the preset value of the first lens of the first camera, and in the embodiment, F1.6 can be adopted as the aperture. A first image is captured based on the detected ambient light brightness according to the aperture value and the fixed sensitivity. In the same manner, the second image is captured through the second lens of the second camera, and then the first image and the second image are synthesized to form a synthesized image, so that the brightness of the off-screen camera can be improved, the quality of the image captured by the off-screen camera can be improved, and high-quality image quality can be realized.
In one embodiment, the capturing a first image with a shutter speed corresponding to the ambient light brightness, the aperture value, and the sensitivity of an image sensor using a first camera in which the aperture value of a lens is a preset value or more includes:
determining a theoretical shutter speed according to the detected ambient light brightness, the aperture value and the sensitivity of an image sensor;
and extending the determined theoretical shutter speed to a set shutter speed, and shooting the first image at the actually set shutter speed.
In the present embodiment, the camera module is disposed below the screen, and in order that the screen does not affect the amount of light entering, the shutter opening time is extended. The actual shutter speed is extended from the theoretical shutter speed by, for example, 2 times or more, and a shutter speed of 3 times or more can be used.
In one embodiment, the capturing a second image as a black-and-white image using a second camera at a shutter speed corresponding to the ambient light brightness, the aperture value, and a sensitivity of an image sensor includes:
determining a theoretical shutter speed according to the detected ambient light brightness, the aperture value and the sensitivity of an image sensor;
and prolonging the determined theoretical shutter speed to a set shutter speed, and shooting the second image at the actually set shutter speed.
The shooting method of the second image is the same as that of the first image, and is not described herein again.
In one embodiment, the method further comprises:
detecting the shake of at least one camera of the first camera and the second camera, and calculating the direction, amplitude and frequency of the shake;
moving at least one of the first camera and the second camera in a direction opposite to the direction of the shake with the same amplitude and the same frequency.
In one embodiment, the first camera comprises an image sensor; the image sensor satisfies at least one of the following conditions: the unit pixel size is 1.28 μm or more, and the multi-pixel synthesis equivalent pixel size is 1.60 μm or more and the number of pixels of the image sensor is 20MP or more.
The number of pixels and the size of the unit pixel of the image sensor are one of the factors determining the image quality of a photo, and under the condition that the size of the image sensor is fixed, the higher the number of pixels is, the finer the image quality is, and the better the imaging is. However, if the number of pixels is increased, the area of the unit pixel is decreased, and if the number of pixels is simply sought, the area of the unit pixel is decreased to a certain extent, and then the light signal cannot be received sufficiently, which may result in a decrease in image quality.
Similarly, simply increasing the area of a unit pixel inevitably reduces the number of pixels and reduces the gradation of an image without changing the size of the image sensor, which also affects the image quality. Therefore, the pixels of the image sensor need to increase the number of pixels on the basis of ensuring that the area of the unit pixel can sufficiently receive the optical signal, so as to obtain an image with optimal imaging quality.
The area of the unit pixel of the first image sensor is enlarged, the diagonal length of the unit pixel is 1.28 μm or more in this embodiment, so that each unit pixel can sufficiently receive the optical signal, or the multi-pixel synthesis equivalent pixel size is 1.60 μm or more, and the multi-pixel synthesis of one combined pixel is equivalent to the enlargement of the area of the unit pixel, for example, in an embodiment in which four unit pixels are combined into one combined pixel, the four unit pixels are used as one unit pixel as a whole, and the size of the equivalent pixel is increased to 1.6 μm, that is, the whole size of the four unit pixels is 1.6 μm, so that the size of the combined pixel is enlarged, and the image quality is effectively improved in the same way as the enlargement of the unit pixel size. Or the number of pixels of the first image sensor is increased, in this embodiment, the number of pixels is equal to or greater than 20MP, so that the first image sensor as a whole can sufficiently receive the light signal, and the image quality can be effectively improved.
The sensitivity is the sensitivity of the image sensor to light, and the increased sensitivity can improve the ability of the image sensor to receive light in a low-light environment.
In one embodiment, in the image sensor, a plurality of unit pixels are combined into one pixel group; each of the unit pixels receives a light signal of one color; the light signals received by the pixel group include a red light signal and a blue light signal.
In one embodiment, the optical signals received by the group of pixels further comprise at least one of a white light signal and a yellow light signal.
In one embodiment, the second camera includes a black and white image sensor.
In one embodiment, a light homogenizing sheet is arranged on the black-and-white image sensor.
According to another aspect of the embodiments of the present disclosure, there is provided a mobile terminal including: a screen; the camera module is the camera module in any one embodiment of the first aspect or the first aspect; the camera module is arranged below the screen.
The camera module at least comprising the first camera and the second camera is applied to the mobile terminal, such as a mobile phone, and the camera module is arranged below the screen, so that the brightness of the camera under the screen can be improved, the quality of the image quality shot by the camera under the screen can be improved, and the high-quality image quality can be realized.
Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
It will be understood that the invention is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.
Claims (20)
1. A method for improving image quality of an off-screen camera is characterized in that the off-screen camera is arranged below a screen of a mobile terminal and is provided with a first camera and a second camera, and the method comprises the following steps:
detecting the ambient light brightness of the environment where the under-screen camera is located;
shooting a first image at a shutter speed corresponding to the ambient light brightness, the aperture value and the sensitivity of an image sensor by using a first camera with the aperture value of a lens being more than a preset value;
capturing a second image as a black-and-white image using a second camera at a shutter speed corresponding to the ambient light brightness, the aperture value, and a sensitivity of an image sensor of the camera; and
the first image and the second image are synthesized to form a synthesized image.
2. The method of claim 1, wherein capturing the first image with a shutter speed corresponding to the ambient light level, the aperture value, and a sensitivity of an image sensor using the first camera with the lens aperture value greater than a predetermined value comprises:
determining a theoretical shutter speed according to the detected ambient light brightness, the aperture value and the sensitivity of an image sensor;
and extending the determined theoretical shutter speed to a set shutter speed, and shooting the first image at the set shutter speed.
3. The method according to claim 1, wherein the capturing a second image as a black-and-white image using a second camera at a shutter speed corresponding to the ambient light brightness, the aperture value, and a sensitivity of an image sensor comprises:
determining a theoretical shutter speed according to the detected ambient light brightness, the aperture value and the sensitivity of an image sensor;
and prolonging the determined theoretical shutter speed to a set shutter speed, and shooting the second image at the set shutter speed.
4. The method of claim 2, further comprising:
detecting the shake of at least one camera of the first camera and the second camera, and calculating the direction, amplitude and frequency of the shake;
moving at least one of the first camera and the second camera in a direction opposite to the direction of the shake with the same amplitude and the same frequency.
5. The method of claim 1,
the first camera comprises an image sensor;
the image sensor satisfies at least one of the following conditions:
the unit pixel size is 1.28 μm or more, and the multi-pixel synthesis equivalent pixel size is 1.60 μm or more and the number of pixels of the image sensor is 20MP or more.
6. The method of claim 5,
in the image sensor, a plurality of unit pixels are combined into a pixel group;
each of the unit pixels receives a light signal of one color;
the light signals received by the pixel group include red, green, and blue light signals.
7. The method of claim 6,
the optical signals received by the pixel group further include at least one of a white optical signal and a yellow optical signal.
8. The method of claim 1,
the second camera includes a black and white image sensor.
9. The method of claim 8,
and the black-and-white image sensor is provided with a light homogenizing sheet.
10. The method of claim 1,
the aperture value of the lens is F1.6 or less.
11. The utility model provides a camera module for mobile terminal, its characterized in that, the camera set up in mobile terminal's screen below, the camera module includes:
a first camera for capturing a first image, the first camera comprising:
the first lens is provided with an aperture value more than a preset value;
a first image sensor receiving light from the first lens and having a light sensing filter;
a second camera for taking a second image, the second camera comprising:
a second lens; and
a second image sensor receiving light from the second lens and having a black and white image sensor;
and the processor is used for detecting the ambient light brightness of the environment where the camera module is located, adjusting the shutter speed of at least one camera in the first camera and the second camera at the shutter speed corresponding to the ambient light brightness, the aperture value and the sensitivity of an image sensor, and synthesizing the first image and the second image.
12. The camera module of claim 11, further comprising:
the first detection module is used for detecting the ambient light brightness and sending the ambient light brightness to the processor;
and the shutter control module drives the shutters of the first camera and the second camera according to the shutter speed set by the processor based on the ambient light brightness, the aperture value and the sensitivity of the image sensor.
13. The camera module of claim 11, further comprising:
an anti-shake device that detects shake of at least one of the first camera and the second camera, and calculates a direction, amplitude, and frequency of the shake; moving at least one of the first image sensor and the second image sensor in a direction opposite to the direction of the shaking with the same amplitude and the same frequency.
14. The camera module of claim 13, wherein the anti-shake apparatus comprises:
the second detection module is used for detecting the shake of at least one camera in the first camera and the second camera and calculating the direction, amplitude and frequency of the shake;
a driving module moving at least one of the first image sensor and the second image sensor in a direction opposite to the direction of the shaking with the same amplitude and the same frequency.
15. The camera module of claim 13,
the anti-shake device comprises a second detection module and a driving module;
the second detection module detects the jitter of at least one camera in the first camera and the second camera and sends information related to the jitter to the processor;
the processor calculating a direction, amplitude and frequency of the jitter based on the received jitter related information;
the driving module moves at least one of the first image sensor and the second image sensor in a direction opposite to the direction of the shake with the same amplitude and the same frequency based on the direction, amplitude, and frequency of the shake calculated by the processor.
16. The camera module of claim 11,
the first image sensor includes a plurality of pixel groups, each of the pixel groups including a plurality of unit pixels, the plurality of unit pixels constituting a square array;
each unit pixel is attached with an optical filter;
the pixel group comprises unit pixels attached with red filters and unit pixels attached with blue filters.
17. The camera module of claim 16,
the pixel group further comprises unit pixels attached with green filters.
18. The camera module of claim 16,
the pixel group further comprises unit pixels attached with transparent filters, white filters or yellow filters.
19. The camera module of claim 11,
and the black-and-white image sensor is provided with a light homogenizing sheet.
20. A mobile terminal, characterized in that the mobile terminal comprises:
a screen; and
a camera module according to any one of claims 11 to 19; the camera module is arranged below the screen.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911244276.3A CN112929574A (en) | 2019-12-06 | 2019-12-06 | Method for improving image quality of camera under screen, camera module and mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911244276.3A CN112929574A (en) | 2019-12-06 | 2019-12-06 | Method for improving image quality of camera under screen, camera module and mobile terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112929574A true CN112929574A (en) | 2021-06-08 |
Family
ID=76161838
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911244276.3A Pending CN112929574A (en) | 2019-12-06 | 2019-12-06 | Method for improving image quality of camera under screen, camera module and mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112929574A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023063608A1 (en) * | 2021-10-12 | 2023-04-20 | 삼성전자 주식회사 | Method for providing image and electronic device supporting same |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130307935A1 (en) * | 2011-02-01 | 2013-11-21 | National University Of Singapore | Imaging system and method |
| CN105141853A (en) * | 2015-08-18 | 2015-12-09 | 联想(北京)有限公司 | Image processing method and electronic device |
| CN106488107A (en) * | 2015-08-31 | 2017-03-08 | 宇龙计算机通信科技(深圳)有限公司 | A kind of image combining method based on dual camera and device |
| CN107734214A (en) * | 2016-08-10 | 2018-02-23 | 宁波舜宇光电信息有限公司 | With the multi-cam module of different size aperture and its application |
| CN107995396A (en) * | 2017-12-14 | 2018-05-04 | 信利光电股份有限公司 | A kind of dual camera module and terminal |
| CN109996002A (en) * | 2019-03-29 | 2019-07-09 | 联想(北京)有限公司 | A kind of method and electronic equipment |
-
2019
- 2019-12-06 CN CN201911244276.3A patent/CN112929574A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130307935A1 (en) * | 2011-02-01 | 2013-11-21 | National University Of Singapore | Imaging system and method |
| CN105141853A (en) * | 2015-08-18 | 2015-12-09 | 联想(北京)有限公司 | Image processing method and electronic device |
| CN106488107A (en) * | 2015-08-31 | 2017-03-08 | 宇龙计算机通信科技(深圳)有限公司 | A kind of image combining method based on dual camera and device |
| CN107734214A (en) * | 2016-08-10 | 2018-02-23 | 宁波舜宇光电信息有限公司 | With the multi-cam module of different size aperture and its application |
| CN107995396A (en) * | 2017-12-14 | 2018-05-04 | 信利光电股份有限公司 | A kind of dual camera module and terminal |
| CN109996002A (en) * | 2019-03-29 | 2019-07-09 | 联想(北京)有限公司 | A kind of method and electronic equipment |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023063608A1 (en) * | 2021-10-12 | 2023-04-20 | 삼성전자 주식회사 | Method for providing image and electronic device supporting same |
| US12184990B2 (en) | 2021-10-12 | 2024-12-31 | Samsung Electronics Co., Ltd. | Method for providing image and electronic device supporting the same |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11716538B2 (en) | Methods and apparatus for use with multiple optical chains | |
| US10205862B2 (en) | Methods and apparatus relating to a camera including multiple optical chains | |
| US10101566B2 (en) | Camera methods and apparatus using optical chain modules which alter the direction of received light | |
| US9736365B2 (en) | Zoom related methods and apparatus | |
| US20080030601A1 (en) | Digital camera module | |
| US20080122946A1 (en) | Apparatus and method of recovering high pixel image | |
| US20070237511A1 (en) | Image sensor, imaging device and imaging method | |
| CN112929574A (en) | Method for improving image quality of camera under screen, camera module and mobile terminal | |
| JP4083356B2 (en) | Imaging apparatus and imaging apparatus system | |
| JP2010109578A (en) | Imaging apparatus and liquid crystal display | |
| TW202422122A (en) | Image sensing module capable of being thinned by reducing the relative distances between image sensors and lens units due to the image sensor only sensing a part of color light and only needing a small amount of light input | |
| TW202143697A (en) | Mobile terminal, method for acquiring image, and computer-readable storage medium | |
| EP3061235A1 (en) | Methods and apparatus for use with multiple optical chains | |
| JPH0993497A (en) | Image processing unit and method | |
| KR20100071553A (en) | Camera module for mobile terminal | |
| JPH09181981A (en) | Image pickup device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210608 |
|
| RJ01 | Rejection of invention patent application after publication |