CN105959543B - It is a kind of to remove reflective filming apparatus and method - Google Patents
It is a kind of to remove reflective filming apparatus and method Download PDFInfo
- Publication number
- CN105959543B CN105959543B CN201610338320.7A CN201610338320A CN105959543B CN 105959543 B CN105959543 B CN 105959543B CN 201610338320 A CN201610338320 A CN 201610338320A CN 105959543 B CN105959543 B CN 105959543B
- Authority
- CN
- China
- Prior art keywords
- color
- image
- shielded
- area
- target shooting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 41
- 230000008439 repair process Effects 0.000 claims abstract description 7
- 238000009432 framing Methods 0.000 claims description 16
- 238000005516 engineering process Methods 0.000 abstract description 2
- 239000011521 glass Substances 0.000 description 56
- 238000012545 processing Methods 0.000 description 13
- 238000010586 diagram Methods 0.000 description 9
- 230000008569 process Effects 0.000 description 9
- 238000004891 communication Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 6
- 230000006837 decompression Effects 0.000 description 5
- 238000006243 chemical reaction Methods 0.000 description 4
- 230000006835 compression Effects 0.000 description 4
- 238000007906 compression Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 238000010521 absorption reaction Methods 0.000 description 3
- 238000003384 imaging method Methods 0.000 description 3
- 230000005236 sound signal Effects 0.000 description 3
- 238000009966 trimming Methods 0.000 description 3
- 230000000903 blocking effect Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000009825 accumulation Methods 0.000 description 1
- 239000003990 capacitor Substances 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 238000007493 shaping process Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000001629 suppression Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 239000010409 thin film Substances 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Studio Devices (AREA)
Abstract
Reflective filming apparatus and method are removed the invention discloses a kind of, belongs to field of photographing technology.The reflective filming apparatus of the removal includes: shooting module, for shooting photo；Picture recognition module, the retroreflective regions that two pictures of the mutual dislocation that content is identical in the photo for identification but the light intensity depth is different surround；Image repair module removes retroreflective regions for being repaired the photo by the error image that retroreflective regions influence by repairing nomography.The present invention removes and generates invalid reflective, to intentionally get final photo presentation user really scene under scene of taking pictures, and filters out the scene that user is not intended to, and improves photographic quality.
Description
Technical Field
The invention relates to the technical field of photographing, in particular to a photographing device and method for removing reflected light.
Background
The mobile phone has become an indispensable personal object, and with the development of mobile phone photographing technology and the characteristic of portability, the mobile phone is almost the first choice for people to take pictures in daily life, and can help people to record life anytime and anywhere in life.
However, when people take pictures of scenes and objects behind glass through the glass, the quality of the pictures is often deteriorated because the reflection of the glass appears in the final picture. For example, when a user takes a picture of an exhibit or a commodity in a glass show window, sits on a bus for travel to take a picture of a landscape outside a window, and takes a picture of an outside scene in a sightseeing tower, the glass reflects an object on the side of the photographer due to the reflection principle of the glass and is finally captured by a camera, and the generated picture has an invalid picture-taking object on the side of the photographer reflected on the glass besides an effective picture-taking object on the back of the glass, so that the quality of the final picture is reduced.
Disclosure of Invention
In order to solve the existing technical problems, the invention provides a shooting device and a shooting method for removing reflected light, which are used for removing invalid reflected light generated in a shooting scene, so that the final picture presents the scene really expected by a user, the scene not expected by the user is filtered, and the picture quality is improved.
In order to achieve the purpose, the technical scheme of the invention is realized as follows:
the invention provides a shooting device for removing reflected light, which comprises: the device comprises a shooting module, an image recognition module and an image restoration module; wherein,
the shooting module is used for shooting a photo;
the image identification module is used for identifying a light reflection area formed by two staggered images with the same content but different light intensity in the photo;
the image restoration module is used for restoring the error image of the photo affected by the light reflection area through a map restoration algorithm and removing the light reflection area.
Optionally, the apparatus further includes:
and the shooting judging module is used for judging whether a transparent object exists in front of the shot during framing.
Optionally, the shooting judging module determines whether a transparent object exists in front of the shot by judging that two images with the same content and different light intensities and staggered with each other appear in the viewing frame.
Optionally, the method further includes:
and the signal receiving module is used for receiving a selection signal, and the selection signal is used for determining whether a transparent object exists in front of the shot during framing.
Optionally, the image repairing algorithm used by the image repairing module is as follows: when the same color area of the target shooting object is shielded by the image part of the non-target shooting object, the color of the unshielded part of the area with the same color of the target shooting object is picked up to repair the wrong color of the shielded part; when the areas with the same color of the target shooting object are completely shielded by the images of the non-target shooting objects, the areas with the same color, which are closest to the target shooting objects and are partially shielded, are identified, the shielded color difference and the non-shielded color difference are compared, the color of the shielding layer is identified, and then the color obtained by subtracting the color of the shielding layer from the color areas which are completely shielded is calculated through the color value superposition principle to obtain the correct target shooting object image.
The invention also provides a shooting method for removing reflected light, which comprises the following steps:
taking a picture;
identifying a light reflecting area surrounded by two images which have the same content but different light intensity and are staggered with each other in the picture;
and repairing the error image of the photo affected by the light reflecting area through a map repairing algorithm, and removing the light reflecting area.
Optionally, the shooting method for removing reflected light includes the steps of:
and judging whether a transparent object exists in front of the shot during framing.
Optionally, the shooting method for removing reflected light further includes:
whether a transparent object exists in front of the shot is determined by judging that two images which have the same content and different light intensities and are staggered with each other appear in the viewfinder.
Optionally, the shooting method for removing reflected light includes the steps of:
and receiving a selection signal, wherein the selection signal is used for determining whether a transparent object exists in front of the shot or not during framing.
Optionally, the map trimming algorithm in the shooting method for removing the reflected light is as follows: when the same color area of the target shooting object is shielded by the image part of the non-target shooting object, the color of the unshielded part of the area with the same color of the target shooting object is picked up to repair the wrong color of the shielded part; when the areas with the same color of the target shooting object are completely shielded by the images of the non-target shooting objects, the areas with the same color, which are closest to the target shooting objects and are partially shielded, are identified, the shielded color difference and the non-shielded color difference are compared, the color of the shielding layer is identified, and then the color obtained by subtracting the color of the shielding layer from the color areas which are completely shielded is calculated through the color value superposition principle to obtain the correct target shooting object image.
Compared with the prior art, the invention has the following advantages:
according to the shooting device and the shooting method for removing the reflected light, provided by the invention, invalid reflected light generated in a shooting scene is removed, so that the final picture presents the scene really expected by a user, the scene not expected by the user is filtered, and the picture quality is improved.
Drawings
Fig. 1 is a schematic hardware configuration diagram of an alternative mobile terminal implementing various embodiments of the present invention;
FIG. 2 is a block diagram of the electrical structure of the camera of FIG. 1;
fig. 3 is a block diagram illustrating a structure of a reflection-removing photographing apparatus according to an embodiment of the present invention;
fig. 4a, 4b, and 4c are diagrams of a shooting process for removing reflection in a first embodiment of the present invention;
fig. 5 is a block diagram illustrating a structure of a reflection-removed photographing apparatus according to a second embodiment of the present invention;
fig. 6 is a flowchart of a shooting method for removing reflections according to a third embodiment of the present invention;
fig. 7 is a flowchart of a shooting method for removing reflections according to a fourth embodiment of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments.
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The mobile terminal may be implemented in various forms. For example, the terminal described in the present invention may include a mobile terminal such as a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a navigation device, and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, it will be understood by those skilled in the art that the configuration according to the embodiment of the present invention can be applied to a fixed type terminal in addition to elements particularly used for moving purposes.
Fig. 1 is a schematic hardware configuration of a mobile terminal implementing various embodiments of the present invention.
The mobile terminal 100 may include a wireless communication unit 110, an a/V (audio/video) input unit 120, a user input unit 130, an output unit 150, a memory 160, an interface unit 170, a controller 180, and a power supply unit 190, and the like. Fig. 1 illustrates a mobile terminal having various components, but it is to be understood that not all illustrated components are required to be implemented. More or fewer components may alternatively be implemented. Elements of the mobile terminal will be described in detail below.
The wireless communication unit 110 typically includes one or more components that allow radio communication between the mobile terminal 100 and a wireless communication system or network.
The a/V input unit 120 is used to receive an audio or video signal. The a/V input unit 120 may include a camera 121 and a microphone 122, and the camera 121 processes image data of still pictures or video obtained by an image capturing apparatus in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 151. The image frames processed by the cameras 121 may be stored in the memory 160 (or other storage medium) or transmitted via the wireless communication unit 110, and two or more cameras 121 may be provided according to the construction of the mobile terminal. The microphone 122 may receive sounds (audio data) via the microphone in a phone call mode, a recording mode, a voice recognition mode, or the like, and can process such sounds into audio data. The processed audio (voice) data may be converted into a format output transmittable to a mobile communication base station via the mobile communication module 112 in case of a phone call mode. The microphone 122 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting audio signals.
The user input unit 130 may generate key input data according to a command input by a user to control various operations of the mobile terminal. The user input unit 130 allows a user to input various types of information, and may include a keyboard, dome sheet, touch pad (e.g., a touch-sensitive member that detects changes in resistance, pressure, capacitance, and the like due to being touched), scroll wheel, joystick, and the like. In particular, when the touch pad is superimposed on the display unit 151 in the form of a layer, a touch screen may be formed.
The interface unit 170 serves as an interface through which at least one external device is connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The identification module may store various information for authenticating a user using the mobile terminal 100 and may include a User Identity Module (UIM), a Subscriber Identity Module (SIM), a Universal Subscriber Identity Module (USIM), and the like. In addition, a device having an identification module (hereinafter, referred to as an "identification device") may take the form of a smart card, and thus, the identification device may be connected with the mobile terminal 100 via a port or other connection means. The interface unit 170 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal and the external device.
In addition, when the mobile terminal 100 is connected with an external cradle, the interface unit 170 may serve as a path through which power is supplied from the cradle to the mobile terminal 100 or may serve as a path through which various command signals input from the cradle are transmitted to the mobile terminal. Various command signals or power input from the cradle may be used as signals for recognizing whether the mobile terminal is accurately mounted on the cradle. The output unit 150 is configured to provide output signals (e.g., audio signals, video signals, alarm signals, vibration signals, etc.) in a visual, audio, and/or tactile manner. The output unit 150 may include a display unit 151 and the like.
The display unit 151 may display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display unit 151 may display a User Interface (UI) or a Graphical User Interface (GUI) for communicating with a call or other communication (e.g., text messaging, multimedia file downloading, etc.). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 151 may display a captured image and/or a received image, a UI or GUI showing a video or an image and related functions, and the like.
Meanwhile, when the display unit 151 and the touch pad are overlapped with each other in the form of a layer to form a touch screen, the display unit 151 may serve as an input device and an output device. The display unit 151 may include at least one of a Liquid Crystal Display (LCD), a thin film transistor LCD (TFT-LCD), an Organic Light Emitting Diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like. Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as transparent displays, and a typical transparent display may be, for example, a TOLED (transparent organic light emitting diode) display or the like. Depending on the particular desired implementation, the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown). The touch screen may be used to detect a touch input pressure as well as a touch input position and a touch input area.
The memory 160 may store software programs and the like for processing and controlling operations performed by the controller 180, or may temporarily store data (e.g., a phonebook, messages, still images, videos, and the like) that has been or will be output. Also, the memory 160 may store data regarding various ways of vibration and audio signals output when a touch is applied to the touch screen.
The memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card-type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, and the like. Also, the mobile terminal 100 may cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.
The controller 180 generally controls the overall operation of the mobile terminal. For example, the controller 180 performs control and processing related to voice calls, data communications, video calls, and the like. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.
The power supply unit 190 receives external power or internal power and provides appropriate power required to operate various elements and components under the control of the controller 180.
The various embodiments described herein may be implemented in a computer-readable medium using, for example, computer software, hardware, or any combination thereof. For a hardware implementation, the embodiments described herein may be implemented using at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a processor, a controller, a microcontroller, a microprocessor, an electronic unit designed to perform the functions described herein, and in some cases, such embodiments may be implemented in the controller 180. For a software implementation, the implementation such as a process or a function may be implemented with a separate software module that allows performing at least one function or operation. The software codes may be implemented by software applications (or programs) written in any suitable programming language, which may be stored in the memory 160 and executed by the controller 180.
Up to this point, mobile terminals have been described in terms of their functionality. Hereinafter, a slide-type mobile terminal among various types of mobile terminals, such as a folder-type, bar-type, swing-type, slide-type mobile terminal, and the like, will be described as an example for the sake of brevity. Accordingly, the present invention can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.
Referring to fig. 2, fig. 2 is a block diagram of an electrical structure of the camera of fig. 1.
The photographing lens 1211 is composed of a plurality of optical lenses for forming an object image, and is a single focus lens or a zoom lens. The photographing lens 1211 is movable in the optical axis direction under the control of the lens driver 1221, and the lens driver 1221 controls the focal position of the photographing lens 1211 in accordance with a control signal from the lens driving control circuit 1222. The lens drive control circuit 1222 performs drive control of the lens driver 1221 in accordance with a control command from the microcomputer 1217.
An image pickup device 1212 is disposed on the optical axis of the photographing lens 1211 near the position of the object image formed by the photographing lens 1211. The image pickup device 1212 is used to pick up an image of an object and acquire picked-up image data. Photodiodes constituting each pixel are two-dimensionally arranged in a matrix on the image pickup device 1212. Each photodiode generates a photoelectric conversion current corresponding to the amount of received light, and the photoelectric conversion current is charged by a capacitor connected to each photodiode. A bayer RGB color filter is disposed on the front surface of each pixel.
The image pickup device 1212 is connected to an image pickup circuit 1213, and the image pickup circuit 1213 performs charge accumulation control and image signal reading control in the image pickup device 1212, performs waveform shaping after reducing reset noise for the read image signal (analog image signal), and further performs gain improvement or the like so as to obtain an appropriate signal level.
The imaging circuit 1213 is connected to an a/D converter 1214, and the a/D converter 1214 performs analog-to-digital conversion on the analog image signal and outputs a digital image signal (hereinafter referred to as image data) to the bus 1227.
The bus 1227 is a transfer path for transferring various data read out or generated inside the camera. The a/D converter 1214 described above is connected to the bus 1227, and further connected to an image processor 1215, a JPEG processor 1216, a microcomputer 1217, an SDRAM (Synchronous Dynamic random access memory) 1218, a memory interface (hereinafter referred to as memory I/F)1219, and an LCD (Liquid Crystal Display) driver 1220.
The image processor 1215 performs various image processing such as OB subtraction processing, white balance adjustment, color matrix operation, gamma conversion, color difference signal processing, noise removal processing, synchronization processing, and edge processing on image data output from the image pickup device 1212. The JPEG processor 1216 compresses the image data read out from the SDRAM1218 in a JPEG compression method when recording the image data in the recording medium 1225. The JPEG processor 1216 decompresses JPEG image data for image reproduction display. When decompression is performed, a file recorded in the recording medium 1225 is read out, decompression processing is performed in the JPEG processor 1216, and the decompressed image data is temporarily stored in the DRAM1218 and displayed on the LCD 1226. In the present embodiment, the JPEG system is used as the image compression/decompression system, but the compression/decompression system is not limited to this, and other compression/decompression systems such as MPEG, TIFF, and h.264 may be used.
The microcomputer 1217 functions as a control unit of the entire camera, and collectively controls various processing sequences of the camera. The microcomputer 1217 is connected to an operation unit 1223 and a flash memory 1224.
The operation unit 1223 includes, but is not limited to, physical keys or virtual keys, which may be various input buttons such as a power button, a photographing key, an editing key, a moving image button, a reproduction button, a menu button, a cross key, an OK button, a delete button, and an enlargement button, and various operation controls such as various input keys, and detects operation states of these operation controls.
The detection result is output to the microcomputer 1217. A touch panel is provided on the front surface of the LCD1226 as a display, and a touch position of the user is detected and output to the microcomputer 1217. The microcomputer 1217 executes various processing sequences corresponding to the user's operation according to the detection result of the operation position from the operation unit 1223.
The flash memory 1224 stores programs for executing various processing sequences of the microcomputer 1217. The microcomputer 1217 controls the entire camera according to the program. The flash memory 1224 stores various adjustment values of the camera, and the microcomputer 1217 reads the adjustment values and controls the camera in accordance with the adjustment values.
The SDRAM1218 is an electrically rewritable volatile memory for temporarily storing image data and the like. The SDRAM1218 temporarily stores the image data output from the a/D converter 1214 and the image data processed by the image processor 1215, JPEG processor 1216, and the like.
The memory interface 1219 is connected to the recording medium 1225, and performs control for writing and reading image data and data such as a file header added to the image data to and from the recording medium 1225. The recording medium 1225 is, for example, a recording medium such as a memory card that can be attached to and detached from the camera body, but is not limited to this, and may be a hard disk or the like that is built in the camera body.
The LCD driver 1210 is connected to the LCD1226, stores the image data processed by the image processor 1215 in the SDRAM1218, reads the image data stored in the SDRAM1218 and displays the image data on the LCD1226 when display is required, or stores the image data compressed by the JPEG processor 1216 in the SDRAM1218 and reads the image data compressed by the JPEG processor 1216 when display is required
The compressed image data in the SDRAM1218 is decompressed again, and the decompressed image data is displayed on the LCD 1226.
The LCD1226 is disposed on the back surface of the camera body and displays an image. LCD1226LCD), however, various display panels (LCD1226) such as organic EL may be used, but not limited thereto, and various display panels such as organic EL may be used.
Based on the hardware structure of the mobile terminal and the electrical structure schematic diagram of the camera, the invention provides various embodiments of the photographing method.
Example one
The embodiment of the invention provides a shooting device for removing reflected light. Fig. 3 is a block diagram illustrating a structure of a reflection-removed photographing apparatus according to an embodiment of the present invention. The embodiment is exemplified by applying the reflection-removed photographing apparatus to a mobile terminal. The imaging device for removing reflected light can be realized by software, hardware or a combination of the software and the hardware to be all or part of the terminal, and comprises:
a photographing module 31 for photographing a photograph;
the image identification module 32 is used for identifying a light reflection area formed by two staggered images with the same content but different light intensity in the photo;
and the image repairing module 33 is configured to repair an error image of the photo affected by the light reflection area through a map repairing algorithm, and remove the light reflection area.
Fig. 4a, 4b, and 4c illustrate a process of taking a photo to remove reflection.
Fig. 4a shows a positional relationship among the mobile phone, the target object "AAA", the non-target object "B", and the glass during shooting.
FIG. 4b shows an object "AAA" captured through the glass by the camera lens of the cell phone, shown in the camera viewfinder; the non-target shot object B on the same side of the photographer is reflected by two surfaces of the glass, and reflected images of two positions which are staggered with each other are captured by a camera lens and presented in a shooting view frame. One of them is a reflected image of a non-target subject generated on the side of the glass close to the photographer, indicated as "B" in green in fig. 4B, and the other is a reflected image of a non-target subject generated on the side of the glass far from the photographer, indicated as "B" in red in fig. 4B. When the red "B" in fig. 4B is generated, the light is reflected by the surface of the glass far from the photographer and then emitted by the surface of the glass close to the photographer once, and the absorption effect of the glass on the light is added, the light intensity of the red "B" is lower than that of the green "B", and the reflected images of the non-target photographed object on the glass are two staggered images with the same content but different light intensities.
Fig. 4c is the effect achieved by "B" identifying and removing the red and green reflected images of the non-target photographic subject.
According to the scheme, the problem of invalid reflection generated in a photographing scene is solved by removing the light reflection area, so that the final picture presents the scene which the user really wants to obtain, the scene which the user does not want is filtered, and the picture quality and the user satisfaction are improved.
Example two
In the first embodiment, the device judges whether glass exists in front of shooting during framing by adding a shooting judging module and a signal receiving module. Referring to fig. 5, a block diagram of a camera for removing reflections according to another embodiment of the present invention is shown. The embodiment is exemplified by applying the reflection-removed photographing apparatus to a mobile terminal. The imaging device for removing reflected light can be realized by software, hardware or a combination of the software and the hardware to be all or part of the terminal, and comprises:
a photographing module 31 for photographing a photograph;
the image identification module 32 is used for identifying a light reflection area formed by two staggered images with the same content but different light intensity in the photo;
and the image repairing module 33 is configured to repair an error image of the photo affected by the light reflection area through a map repairing algorithm, and remove the light reflection area.
And a shooting judging module 34 for judging whether a transparent object exists in front of the shot during framing. The shooting judging module determines whether glass exists in front of shooting by judging two images which have the same content but different light intensities and are staggered with each other in the viewing frame.
And a signal receiving module 35, configured to receive the selection signal and determine whether there is glass in front of the shot during framing.
After the equipment enters a framing working state, within 5 seconds before photographing, two staggered images with the same content and different light intensities appear during each framing of the viewfinder, and then the equipment judges that glass exists in the front. The step is to avoid the problem that two overlapped same objects shot when no glass exists are misread as the reflection of the glass by the equipment, and the accuracy is improved. If the front glass is not detected according to the method, the normal shooting process is started.
If the glass exists in the front of the shot object, but the shooting judging module does not judge the glass correctly, the signal receiving module can be used for manually setting the glass existing in the front of the shot object.
The camera device of getting rid of reflection of light that this embodiment provided shoots the place ahead through automatic judgement whether glass or manual setting shoot the place ahead and have glass, shoots the same object of two superpositions when avoiding not having glass and is read by equipment mistake for the problem of glass's reflection, has improved the shooting precision.
EXAMPLE III
Referring to fig. 6, a flowchart of a reflection removing photographing method according to an embodiment of the present invention is shown. The method comprises the following steps:
step s60, taking a picture using the mobile terminal;
when the mobile terminal takes a picture, the generated image includes a target photographic subject "AAA", a non-target photographic subject "B" caused by glass reflection, as shown in fig. 4B.
Step s61, identifying two staggered light-reflecting areas with the same content but different light intensity in the photo;
the non-target shot object B on the same side of the photographer is reflected by two surfaces of the glass, and reflected images of two positions which are staggered with each other are captured by a camera lens and presented in a shooting view frame. One of them is a reflected image of a non-target subject generated on the side of the glass close to the photographer, indicated as "B" in green in fig. 4B, and the other is a reflected image of a non-target subject generated on the side of the glass far from the photographer, indicated as "B" in red in fig. 4B. When the red "B" in fig. 4B is generated, the light is reflected by the surface of the glass far from the photographer and then emitted by the surface of the glass close to the photographer once, and the absorption effect of the glass on the light is added, the light intensity of the red "B" is lower than that of the green "B", and the reflected images of the non-target photographed object on the glass are two staggered images with the same content but different light intensities.
Step s62, repairing the error image of the photo affected by the light reflection area through a trimming algorithm, and removing the light reflection area;
the algorithm is as follows:
if the area of the same color of the target shooting object is blocked by the image part of the non-target shooting object in the generated picture, the error color of the blocked part is repaired by picking up the color of the unblocked part of the area of the same color of the target shooting object through the equipment;
if the same color area of the target object is completely blocked by the image of the non-target object in the generated picture, the device identifies the same color area which is closest to the target object and is partially blocked, and the color of the blocking layer is identified by comparing the difference between the blocked color and the non-blocked color. And calculating the color of the completely shielded color area minus the color of the shielding layer by using a color value superposition principle, namely obtaining the correct target shot object image.
In summary, the shooting method for removing the reflected light provided by the embodiment solves the problem of invalid reflection generated in a shooting scene by removing the light reflection region, so that the final picture presents a scene really desired by a user, the scene not desired by the user is filtered, and the picture quality and the user satisfaction are improved.
Example four
Referring to fig. 7, a flowchart of a reflection removing photographing method according to an embodiment of the present invention is shown. The method comprises the following steps:
in step s70, it is determined whether or not there is glass in front of the shot during framing.
After the equipment enters a framing working state, within 5 seconds before photographing, two images which have the same content and different light intensities and are staggered with each other appear during each framing of the viewfinder, the equipment judges that glass exists in the front, and the shooting process of removing reflected light is started. And if no glass is detected in front according to the method, entering a normal shooting process.
In step s71, if the determination is not correct, the user manually sets whether or not there is glass in front. The photographer determines whether glass exists in front according to the shooting site, and if the result of judging whether glass exists in front according to the shooting site by the photographer is different from the result of judging whether glass exists in front automatically by the equipment, the photographer can manually set whether glass exists in front.
Step s72, taking a picture using the mobile terminal;
when the mobile terminal takes a picture, the generated image includes a target photographic subject "AAA", a non-target photographic subject "B" caused by glass reflection, as shown in fig. 4B.
Step s73, identifying two staggered light-reflecting areas with the same content but different light intensity in the photo;
the non-target shot object B on the same side of the photographer is reflected by two surfaces of the glass, and reflected images of two positions which are staggered with each other are captured by a camera lens and presented in a shooting view frame. One of them is a reflected image of a non-target subject generated on the side of the glass close to the photographer, indicated as "B" in green in fig. 4B, and the other is a reflected image of a non-target subject generated on the side of the glass far from the photographer, indicated as "B" in red in fig. 4B. When the red "B" in fig. 4B is generated, the light is reflected by the surface of the glass far from the photographer and then emitted by the surface of the glass close to the photographer once, and the absorption effect of the glass on the light is added, the light intensity of the red "B" is lower than that of the green "B", and the reflected images of the non-target photographed object on the glass are two staggered images with the same content but different light intensities.
Step s74, repairing the error image of the photo affected by the light reflection area through a trimming algorithm, and removing the light reflection area;
the algorithm is as follows:
if the area of the same color of the target shooting object is blocked by the image part of the non-target shooting object in the generated picture, the error color of the blocked part is repaired by picking up the color of the unblocked part of the area of the same color of the target shooting object through the equipment;
if the same color area of the target object is completely blocked by the image of the non-target object in the generated picture, the device identifies the same color area which is closest to the target object and is partially blocked, and the color of the blocking layer is identified by comparing the difference between the blocked color and the non-blocked color. And calculating the color of the completely shielded color area minus the color of the shielding layer by using a color value superposition principle, namely obtaining the correct target shot object image.
The shooting method for removing the reflected light provided by the embodiment has the advantages that whether the front is shot by the automatic judgment or not or whether the front is shot by the manual setting or not is avoided, the problem that two overlapped same objects are shot by the equipment when no glass exists is solved, and the shooting accuracy is improved.
The mobile terminal according to the embodiments of the present disclosure is not limited to its construction and application of the method, but the whole or a part of the embodiments can be selectively combined to be constructed in various modifications.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.
Claims (6)
1. A camera device for removing reflected light, the device comprising:
the shooting module is used for shooting a picture;
the image identification module is used for identifying a light reflecting area formed by two staggered images with the same content but different light intensity in the photo;
the image repairing module is used for repairing an error image of the photo affected by the light reflecting area through a repairing algorithm, and the repairing algorithm used by the image repairing module is as follows: when the same color area of the target shooting object is shielded by the image part of the non-target shooting object, the color of the unshielded part of the area with the same color of the target shooting object is picked up to repair the wrong color of the shielded part; when the areas with the same color of the target shooting object are completely shielded by the images of the non-target shooting objects, identifying the area with the same color, which is closest to the target shooting object and is partially shielded, comparing the difference between the shielded color and the non-shielded color, identifying the color of the shielding layer, calculating the color obtained by subtracting the color of the shielding layer from the color area which is completely shielded by using a color value superposition principle to obtain a correct target shooting object image, and removing the light reflecting area;
the device, still include:
and the shooting judging module is used for judging whether a transparent object exists in front of the shot during framing.
2. The apparatus of claim 1, wherein the photographing determination module determines whether there is a transparent object in front of the photographing by determining that two images with the same content but different light intensities are misaligned with each other appear in the viewfinder.
3. The apparatus of claim 1, further comprising:
and the signal receiving module is used for receiving a selection signal, and the selection signal is used for determining whether a transparent object exists in front of the shot during framing.
4. A shooting method of removing a reflected light, the method comprising:
taking a picture;
identifying a light reflecting area surrounded by two images which have the same content but different light intensity and are staggered with each other in the picture;
repairing an error image of the photo affected by the light reflection area through a map repairing algorithm, wherein the map repairing algorithm comprises the following steps: when the same color area of the target shooting object is shielded by the image part of the non-target shooting object, the color of the unshielded part of the area with the same color of the target shooting object is picked up to repair the wrong color of the shielded part; when the areas with the same color of the target shooting object are completely shielded by the images of the non-target shooting objects, identifying the area with the same color, which is closest to the target shooting object and is partially shielded, comparing the difference between the shielded color and the non-shielded color, identifying the color of the shielding layer, calculating the color obtained by subtracting the color of the shielding layer from the color area which is completely shielded by using a color value superposition principle to obtain a correct target shooting object image, and removing the light reflecting area;
the shooting method for removing reflected light comprises the following steps:
and judging whether a transparent object exists in front of the shot during framing.
5. The method according to claim 4, wherein the reflection removing photographing method further comprises:
whether a transparent object exists in front of the shot is determined by judging that two images which have the same content and different light intensities and are staggered with each other appear in the viewfinder.
6. The method according to claim 4, wherein the reflection removing photographing method comprises the steps of:
and receiving a selection signal, wherein the selection signal is used for determining whether a transparent object exists in front of the shot or not during framing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610338320.7A CN105959543B (en) | 2016-05-19 | 2016-05-19 | It is a kind of to remove reflective filming apparatus and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610338320.7A CN105959543B (en) | 2016-05-19 | 2016-05-19 | It is a kind of to remove reflective filming apparatus and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105959543A CN105959543A (en) | 2016-09-21 |
| CN105959543B true CN105959543B (en) | 2019-04-30 |
Family
ID=56909228
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610338320.7A Active CN105959543B (en) | 2016-05-19 | 2016-05-19 | It is a kind of to remove reflective filming apparatus and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105959543B (en) |
Families Citing this family (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106791433B (en) * | 2017-01-18 | 2018-10-19 | 维沃移动通信有限公司 | A kind of image processing method and electronic equipment |
| CN106911896B (en) * | 2017-02-28 | 2020-09-01 | 努比亚技术有限公司 | Image processing device and method |
| CN108564540B (en) * | 2018-03-05 | 2020-07-17 | Oppo广东移动通信有限公司 | Image processing method and device for removing lens reflection in image and terminal equipment |
| CN108566516B (en) * | 2018-05-14 | 2020-07-31 | Oppo广东移动通信有限公司 | Image processing method, device, storage medium and mobile terminal |
| CN108551552B (en) * | 2018-05-14 | 2020-09-01 | Oppo广东移动通信有限公司 | Image processing method, device, storage medium and mobile terminal |
| CN110166684B (en) | 2018-06-29 | 2021-09-17 | 腾讯科技（深圳）有限公司 | Image processing method, image processing device, computer readable medium and electronic equipment |
| CN110086990B (en) * | 2019-04-28 | 2021-01-12 | 深圳回收宝科技有限公司 | Terminal photographing method and device, portable terminal and storage medium |
| CN110930323B (en) * | 2019-11-07 | 2023-09-12 | 华为技术有限公司 | Method and device for removing reflection of image |
| CN111062857B (en) * | 2019-11-25 | 2024-03-19 | 上海芯歌智能科技有限公司 | System and method for eliminating reflected light of 3D contour camera |
| CN110855897B (en) * | 2019-12-20 | 2021-10-15 | 维沃移动通信有限公司 | Image capturing method, device, electronic device and storage medium |
| EP4050555A1 (en) * | 2021-02-25 | 2022-08-31 | Beijing Xiaomi Mobile Software Co., Ltd. | Method for removing image artifacts and device |
| CN113691791B (en) * | 2021-09-17 | 2023-10-03 | 青岛海信激光显示股份有限公司 | Laser projection device and display method of projection image thereof |
| CN115793225B (en) * | 2023-01-10 | 2023-05-30 | 南京木木西里科技有限公司 | Image acquisition reflection elimination adjusting device and system thereof |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6859565B2 (en) * | 2001-04-11 | 2005-02-22 | Hewlett-Packard Development Company, L.P. | Method and apparatus for the removal of flash artifacts |
| CN102324102B (en) * | 2011-10-08 | 2014-04-16 | 北京航空航天大学 | Method for automatically filling structure information and texture information of hole area of image scene |
| CN103247036B (en) * | 2012-02-10 | 2016-05-18 | 株式会社理光 | Many exposure images fusion method and device |
| CN103826065B (en) * | 2013-12-12 | 2017-07-21 | 小米科技有限责任公司 | A kind of image processing method and device |
| CN104134195B (en) * | 2014-08-01 | 2017-02-15 | 西安电子科技大学 | Image restoration method based on geometric sparsity of blocks |
| CN104537633B (en) * | 2014-12-18 | 2017-07-11 | 河南师范大学 | A kind of method that utilization image fusion technology eliminates the anti-shadow of image |
| CN104599251B (en) * | 2015-01-28 | 2017-07-28 | 武汉大学 | A kind of absolute occlusion area method for repairing and mending of true orthophoto and system |
| CN205080348U (en) * | 2015-10-31 | 2016-03-09 | 王亚迪 | Camera lens shading ring |
| CN105574830B (en) * | 2016-02-04 | 2020-02-21 | 沈阳工业大学 | Low-quality image enhancement method under extreme weather conditions |
-
2016
- 2016-05-19 CN CN201610338320.7A patent/CN105959543B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN105959543A (en) | 2016-09-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105959543B (en) | It is a kind of to remove reflective filming apparatus and method | |
| CN105430295B (en) | Image processing apparatus and method | |
| CN105791701B (en) | Image capturing device and method | |
| WO2017107629A1 (en) | Mobile terminal, data transmission system and shooting method of mobile terminal | |
| US10516860B2 (en) | Image processing method, storage medium, and terminal | |
| CN105100481A (en) | Shooting method and apparatus, and mobile terminal | |
| CN110430357B (en) | An image capturing method and electronic device | |
| CN105430263A (en) | Long-exposure panoramic image photographing device and method | |
| CN114092364A (en) | Image processing method and related equipment | |
| CN105407295B (en) | Mobile terminal filming apparatus and method | |
| CN105120164B (en) | The processing means of continuous photo and method | |
| CN106603917A (en) | Shooting device and method | |
| CN104751488B (en) | Photographing method for moving track of moving object and terminal equipment | |
| CN105513021B (en) | Image denoising device and method | |
| CN105245777A (en) | Method and device for generating video image | |
| CN104660903A (en) | Shooting method and shooting device | |
| CN105472246A (en) | Photographing device and method | |
| CN105744170A (en) | Picture photographing device and method | |
| CN106385579A (en) | Camera detection device, method and multi-camera terminal | |
| CN105611264B (en) | A kind of auto white balance method and device | |
| CN105163035A (en) | Mobile terminal shooting system and mobile terminal shooting method | |
| CN107071277B (en) | Optical drawing shooting device and method and mobile terminal | |
| CN105763810A (en) | Photographing device and method based on human eyes | |
| CN105357441B (en) | A kind of image-pickup method and mobile terminal | |
| CN108156392B (en) | Shooting method, terminal and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |