CN110266960B - Preview image processing method, processing device, camera device and readable storage medium - Google Patents
Preview image processing method, processing device, camera device and readable storage medium Download PDFInfo
- Publication number
- CN110266960B CN110266960B CN201910652667.2A CN201910652667A CN110266960B CN 110266960 B CN110266960 B CN 110266960B CN 201910652667 A CN201910652667 A CN 201910652667A CN 110266960 B CN110266960 B CN 110266960B
- Authority
- CN
- China
- Prior art keywords
- preview image
- processed
- preview
- camera
- moving speed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
- H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
- H04N23/632—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Studio Devices (AREA)
- Image Analysis (AREA)
Abstract
The application provides a preview picture processing method, a processing device, an image pickup device and a readable storage medium. The method is applied to the camera device and comprises the following steps: acquiring a reference preview picture acquired by the camera device, wherein the reference preview picture comprises a shooting main body; determining position information of a shooting background in the reference preview picture; determining a relative movement speed of the photographic subject with respect to the image pickup device; if the relative movement speed is smaller than a first threshold value, when a preview picture to be processed subsequently acquired by the camera device is acquired, if the time interval between the acquisition of the preview picture to be processed and the acquisition of the reference preview picture is smaller than a first preset time interval, blurring an image area indicated by the position information in the preview picture to be processed. The method and the device can realize blurring processing of the preview picture on the premise of avoiding overlarge data processing amount of the camera device.
Description
Technical Field
The present application relates to the field of image processing, and in particular, to a preview screen processing method, a preview screen processing apparatus, an image capturing apparatus, and a computer-readable storage medium.
Background
At present, when a preview screen is captured by using a camera device (such as a smart phone), it is sometimes desirable to display an effect of blurring a background in the preview screen. Currently, the commonly used background blurring method is: a photographic subject in an image is detected to acquire positional information of the photographic subject, and then blurring is performed on an image area other than the photographic subject.
The frame rate of the preview image collected by the camera device is about 24 frames/s, so that if the camera device performs background blurring processing on each frame of the preview image, the data processing amount of the camera device is undoubtedly increased, and the camera device generates heat or is jammed, and other adverse phenomena occur.
Disclosure of Invention
In view of this, embodiments of the present application provide a preview screen processing method, a preview screen processing apparatus, an image capturing apparatus, and a computer readable storage medium, which can implement blurring processing on a preview screen on the premise of avoiding an excessive data processing amount of the image capturing apparatus.
A first aspect of an embodiment of the present application provides a preview screen processing method, which is applied to an image capturing apparatus, and includes:
acquiring a reference preview picture acquired by the camera device, wherein the reference preview picture comprises a shooting main body acquired by the camera device;
determining position information of a shooting background in the reference preview picture, wherein the shooting background is an image area except the shooting subject in the reference preview picture;
determining a relative movement speed of the photographic subject with respect to the imaging device;
if the relative moving speed is less than a first threshold value, then:
when a to-be-processed preview picture acquired by the camera device is acquired, if the time interval between the acquisition of the to-be-processed preview picture and the acquisition of the reference preview picture is smaller than a first preset time interval, blurring an image area indicated by the position information in the to-be-processed preview picture to obtain a processed preview picture, wherein the to-be-processed preview picture is the preview picture acquired after the camera device acquires the reference preview picture.
A second aspect of the embodiments of the present application provides a preview screen processing apparatus applied to an image pickup apparatus, the preview screen processing apparatus including:
the reference acquisition module is used for acquiring a reference preview picture acquired by the camera device, and the reference preview picture comprises a shooting main body acquired by the camera device;
a background position module, configured to determine position information of a shooting background in the reference preview screen, where the shooting background is an image area of the reference preview screen other than the shooting subject;
a relative movement determining module for determining a relative movement speed of the photographic subject with respect to the image pickup device;
and a first blurring processing module, configured to perform blurring processing on an image area indicated by the position information in the to-be-processed preview picture to obtain a processed preview picture if the relative movement speed is smaller than a first threshold value, when the to-be-processed preview picture acquired by the camera device is acquired, and if a time interval between the acquisition of the to-be-processed preview picture and the acquisition of the reference preview picture is smaller than a first preset time interval, where the to-be-processed preview picture is a preview picture acquired after the camera device acquires the reference preview picture.
A third aspect of the embodiments of the present application provides an image capturing apparatus, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the method for processing a preview screen according to the first aspect when executing the computer program.
A fourth aspect of the embodiments of the present application provides a computer-readable storage medium, which stores a computer program, and the computer program, when executed by a processor, implements the steps of the preview screen processing method according to the first aspect.
A fifth aspect of the present application provides a computer program product comprising a computer program which, when executed by one or more processors, implements the steps of the method for processing a preview screen according to the first aspect as described above.
Therefore, the application provides a preview picture processing method applied to an image pickup device, and the method comprises the steps of firstly, acquiring a reference preview picture containing a shooting subject, and determining the position information of a shooting background in the reference preview picture; then, each time a to-be-processed preview screen to be subsequently acquired is acquired, if the relative movement speed between the main shooting body and the imaging device is small and the acquisition time interval is smaller than a first preset time interval, it means that the position of the shooting background in the to-be-processed preview screen is approximately consistent with the position of the reference preview screen, and therefore, the to-be-processed preview screen to be subsequently acquired is blurred directly by using the previously determined position information of the shooting background in the reference preview screen. In general, the preview picture to be processed, whose acquisition time interval from the reference preview picture is smaller than the first preset time interval, is often a continuous multi-frame preview picture adjacent to the reference preview picture, so that in the method provided by the present application, only the position information of the shooting background (i.e. the shooting background position information in the reference preview picture) needs to be detected once, and the position information can be repeatedly used for blurring the subsequent multi-frame preview picture to be processed, thereby avoiding the step of detecting the shooting background in each frame of the preview picture to be processed.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed for the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
Fig. 1 is a schematic flow chart illustrating an implementation of a preview screen processing method according to an embodiment of the present application;
fig. 2 is a schematic diagram of a specific application scenario provided in an embodiment of the present application;
fig. 3 is a schematic flow chart illustrating an implementation of another preview screen processing method according to a second embodiment of the present application;
fig. 4 is a schematic structural diagram of a preview screen processing apparatus according to a third embodiment of the present application;
fig. 5 is a schematic structural diagram of an image pickup apparatus according to a fourth embodiment of the present application.
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.
The preview screen processing method provided by the embodiment of the application can be applied to an image pickup device, and the image pickup device includes, but is not limited to: smart phones, tablet computers, notebooks, smart wearable devices, desktop computers, and the like.
It will be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It should be further understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.
As used in this specification and the appended claims, the term "if" may be interpreted contextually as "when", "upon" or "in response to a determination" or "in response to a detection". Similarly, the phrase "if it is determined" or "if a [ described condition or event ] is detected" may be interpreted contextually to mean "upon determining" or "in response to determining" or "upon detecting [ described condition or event ]" or "in response to detecting [ described condition or event ]".
In addition, in the description of the present application, the terms "first", "second", and the like are used only for distinguishing the description, and are not intended to indicate or imply relative importance.
In order to explain the technical solution described in the present application, the following description will be given by way of specific examples.
Example one
Referring to fig. 1, a preview screen processing method provided in an embodiment of the present application is described below, where the preview screen processing method includes:
in step S101, a reference preview screen acquired by the imaging device is acquired, where the reference preview screen includes a subject acquired by the imaging device;
in the embodiment of the present application, the reference preview screen is a preview screen including a main body, and the reference preview screen may be a first frame preview screen captured by the imaging device or an nth frame preview screen captured at a certain time point by the imaging device, where N ≠ 1.
In this embodiment of the application, when the reference preview screen is not determined, when the image capturing apparatus acquires a certain frame of preview screen (for example, after a camera is turned on, a first frame of preview screen is acquired), it is necessary to first determine whether a shooting subject exists in the preview screen, and if the shooting subject is determined, directly determine the preview screen as the reference preview screen. The method for determining whether the shooting subject exists in the preview picture may be: detecting the shooting subject by using a pre-trained target detection model to determine whether the shooting subject exists; or prompting the user to select the shooting subject in the preview picture, if the user selects a part of image area of the preview picture, determining the selected image area as the shooting subject, and if the user does not select any image area, determining that no shooting subject exists.
In step S102, position information of a capturing background in the reference preview screen, the capturing background being an image area of the reference preview screen other than the subject;
in the embodiment of the present application, if the target detection model can also detect the position information of the photographic subject, the position information of the photographic background can be determined according to the position information of the photographic subject detected by the target detection model; alternatively, the position information of the imaging background is determined by selecting the imaging subject in the reference preview screen by the user.
In step S103, a relative movement speed of the imaging subject with respect to the imaging device is determined;
the "relative movement speed" in this step may be determined by a user, for example, the user may visually observe the relative movement speed between the main body and the image pickup apparatus and then inform the image pickup apparatus by voice or text.
Alternatively, the image pickup apparatus estimates the relative movement speed from the acquired multi-frame preview screen, and specifically, the step S103 may include the steps of:
s1031, acquiring a reference preview picture acquired by the camera before acquiring the reference preview picture;
s1032 specifies a relative movement speed of the subject with respect to the imaging apparatus based on the positions of the subject in the reference preview screen and the reference preview screen, respectively.
That is, the imaging apparatus may calculate the relative movement speed of the photographic subject with respect to the imaging apparatus based on the reference preview screen captured by the imaging apparatus, the reference preview screen before the reference preview screen, the reference preview screen 1 adjacent to the reference preview screen, the reference preview screen 2 before the reference preview screen 1 and adjacent to the reference preview screen 1. Specifically, a certain point X on the imaging subject may be selected, the relative movement speed 1 of the point X with respect to the imaging apparatus may be calculated based on the positions of the point X on the reference preview screen, the reference preview screen 1, and the time interval between the reference preview screen and the reference preview screen 1, and similarly, the relative movement speed 2 of the point X with respect to the imaging apparatus may be calculated again based on the positions of the point X on the reference preview screen 1 and the reference preview screen 2, and the time interval between the reference preview screen 1 and the reference preview screen 2, and then the relative movement speed 1 and the relative movement speed 2 may be averaged to obtain the "relative movement speed of the imaging subject with respect to the imaging apparatus" in step S103. In addition, in order to measure the motion states of different parts in the photographic subject more accurately, a plurality of points on the photographic subject may be selected, that is, in addition to the X point, the Y point may be selected, and the final relative movement speed of the photographic subject with respect to the imaging device may be determined by an average (or weighted average) of the relative movement speed of the X point and the relative movement speed of the Y point.
In step S104, if the relative movement speed is smaller than a first threshold, when a to-be-processed preview image acquired by the imaging device is acquired, if a time interval between the acquisition of the to-be-processed preview image and the acquisition of the reference preview image is smaller than a first preset time interval, blurring an image area indicated by the position information in the to-be-processed preview image to obtain a processed preview image, where the to-be-processed preview image is a preview image acquired after the imaging device acquires the reference preview image;
in this embodiment of the application, if the "relative movement speed" determined in step S103 is relatively small, once the image capturing device acquires the to-be-processed preview picture, the following process is executed:
if the time interval between the acquisition of the preview picture to be processed and the acquisition of the reference preview picture is small, the position of the shooting subject in the preview picture to be processed and the position of the shooting subject in the reference preview picture do not change greatly to a certain extent, and the shooting background in the preview picture to be processed can be blurred by directly utilizing the previously determined position information of the shooting background.
In the first embodiment of the present application, in step S104, if the relative moving speed is less than the first threshold, every time the image capturing device acquires a to-be-processed preview picture, it is determined whether the acquisition time interval between the to-be-processed preview picture and the reference preview picture reaches the first preset time interval, until the image capturing device terminates the acquisition of the preview picture. Furthermore, those skilled in the art will understand that "when a occurs, then B is performed" as described herein does not mean that a occurs at the same time as B is performed, which may be slightly different in time.
In order to make the technical solution in the first embodiment of the present application clearly understood by those skilled in the art, the following description uses fig. 2.
As shown in fig. 2, 10 frames of preview pictures continuously acquired by the image capturing device are shown, wherein the 1 st frame is a reference preview picture, each frame subsequently acquired by the image capturing device is assumed to be a preview picture to be processed, and the acquisition time interval of every two adjacent preview pictures acquired by the image capturing device is assumed to be t.
As shown in fig. 2, the reference preview screen includes a diamond-shaped subject whose position in the preview screen 1 has moved from the region a to the region B (i.e., the subject's position in the reference preview screen is the region a shown in gray, and the subject's position in the preview screen 1 is the region B), the subject's position in the preview screen 2 has moved from the region a to the region C (i.e., the subject's position in the reference preview screen is the region a shown in gray, and the subject's position in the preview screen 2 is the region C), the subject's position in the preview screen 9 has moved from the region a to the region D (i.e., the subject's position in the reference preview screen is the region a shown in gray, and the subject's position in the preview screen 9 is the region D), and if it is determined that the relative movement speed of the subject with respect to the imaging apparatus is smaller than the first threshold value, and the first preset time interval is 10t, according to the technical solution in the first embodiment of the present application, when the preview picture 1 is captured, the image area outside the gray diamond-shaped area a is directly blurred, when the preview picture 2 is captured, the image area outside the gray diamond-shaped area a is directly blurred … …, and when the 9 th preview picture 9 after the reference preview picture is captured, the image area outside the gray diamond-shaped area a is also directly blurred. Therefore, the position information of the shooting background in the reference preview picture can be utilized to perform blurring processing on the subsequent preview pictures to be processed of multiple frames, and detection of the position information of the shooting background in each frame of preview pictures to be processed is avoided.
Therefore, in an embodiment of the present application, a preview screen processing method applied to an image capturing apparatus is provided, where first, a reference preview screen including a shooting subject is obtained, and position information of a shooting background in the reference preview screen is determined; then, each time a to-be-processed preview screen to be subsequently acquired is acquired, if the relative movement speed between the main shooting body and the imaging device is small and the acquisition time interval is smaller than a first preset time interval, it means that the position of the shooting background in the to-be-processed preview screen is approximately consistent with the position of the reference preview screen, and therefore, the to-be-processed preview screen to be subsequently acquired is blurred directly by using the previously determined position information of the shooting background in the reference preview screen. In general, the preview picture to be processed, whose acquisition time interval from the reference preview picture is smaller than the first preset time interval, is often a continuous multi-frame preview picture adjacent to the reference preview picture, and therefore, in the method provided by the present application, only the position information of the shooting background (i.e. the shooting background position information in the reference preview picture) needs to be determined once, and the position information can be repeatedly used for blurring the subsequent multi-frame preview picture to be processed, thereby avoiding the step of detecting the shooting background in each frame of the preview picture to be processed.
Example two
Referring to fig. 3, another preview screen processing method provided in the second embodiment of the present application is described below, where the preview screen processing method includes:
in step S201, a reference preview image acquired by the imaging device is acquired, where the reference preview image includes a subject acquired by the imaging device;
in step S202, position information of a capturing background in the reference preview screen, the capturing background being an image area of the reference preview screen other than the subject;
in step S203, determining a relative movement speed of the imaging subject with respect to the imaging device;
in the second embodiment of the present application, the specific implementation manners of the steps S201 to S203 are the same as the specific implementation manners of the steps S101 to S103 in the first embodiment, and specific reference may be made to the description of the first embodiment, which is not repeated herein.
In step S204, if the relative movement speed is less than a first threshold, determining a movement speed of the imaging device, and determining a movement speed of the imaging subject based on the relative movement speed and the movement speed of the imaging device;
in the embodiment of the present application, the moving speed of the image capturing apparatus may be determined according to a sensor mounted on the image capturing apparatus, and the moving speed of the photographic subject may be determined according to the relative moving speed determined in step S203, so as to determine how to process the subsequent preview screen to be processed according to the moving speed of the image capturing apparatus and the moving speed of the photographic subject.
In step S205, it is determined whether the moving speed of the image capturing apparatus is less than a second threshold, and whether the moving speed of the image capturing apparatus is less than a third threshold, if so, the subsequent step S206 is performed, otherwise, the subsequent step S207 is performed;
in step S206, when acquiring a to-be-processed preview screen acquired after the imaging device acquires the reference preview screen, if a time interval during which the imaging device acquires the to-be-processed preview screen is less than a second preset time interval, replacing the to-be-processed preview screen with an image obtained by blurring a shooting background in the reference preview screen, where the shooting background is an image area of the reference preview screen other than the shooting subject;
that is, if the determination result in step S205 is positive, it is described that the relative movement speed of the main imaging body and the imaging apparatus is small, and the movement of the main imaging body and the imaging apparatus is slow, that is, in this case, both of them are considered to be in a substantially stationary state, and therefore, the acquired preview screen should be not greatly different from the reference preview screen for a certain period of time after the acquisition of the reference preview screen, and therefore, the preview screen acquired for the certain period of time can be directly replaced with the image obtained by blurring the captured background in the reference preview screen.
In the second embodiment of the present application, the second predetermined time interval may be a fixed value, for example, fixed to 20 ms; alternatively, the second predetermined time interval may be a value determined according to the moving speed of the image capturing device and the moving speed of the subject after step S205 is executed and before step S206 is executed, for example, if the moving speed of the image capturing device and the moving speed of the subject are both very small, the second predetermined time interval may be set to a longer value.
In step S207, when a to-be-processed preview image acquired by the imaging device is acquired, if a time interval between the acquisition of the to-be-processed preview image and the acquisition of the reference preview image is smaller than a first preset time interval, blurring an image area indicated by the position information in the to-be-processed preview image to obtain a processed preview image, where the to-be-processed preview image is a preview image acquired by the imaging device after the acquisition of the reference preview image;
in the second embodiment of the present application, if the determination result in the step S205 is negative, the step S206 is executed, that is, when a preview screen whose time interval from the reference preview screen is smaller than the first preset time interval is collected, the preview screen to be processed is blurred by directly using the position information of the shooting background that is determined before. The specific processing procedure can be referred to the description of step S104 in the first embodiment, and the description of fig. 2.
Those skilled in the art will readily understand that in the second embodiment of the present application, when the image capturing apparatus executes step S206, the image capturing apparatus continuously acquires the preview picture to be processed, and each time the preview picture to be processed is acquired, it is determined whether the acquisition time interval with the reference preview picture reaches the second preset time interval, that is, the image capturing apparatus continuously and cyclically executes step S206 until the image capturing apparatus terminates the acquisition of the preview picture. Similarly, the image capturing apparatus will continue to loop to execute step S207 until the image capturing apparatus terminates the capturing of the preview picture.
In the second technical solution provided in the embodiment of the present application, if both the main shooting body and the image capturing apparatus are in a static state, the subsequent preview picture to be processed can be directly replaced with the same frame picture (i.e., a picture obtained by blurring the background of the reference preview picture). As will be readily understood by those skilled in the art, in the technical solution provided in the second embodiment of the present application, if the main shooting body and the image capturing apparatus are both in an almost static state, and when the image capturing apparatus performs blurring processing on a plurality of frames of to-be-processed preview pictures to be subsequently collected, only one blurring operation and a plurality of image replacement operations need to be performed on the reference preview picture, and in the first embodiment, background blurring processing needs to be performed on each to-be-processed preview picture.
Therefore, as described above, the second technical solution in the present application can further reduce the data processing load of the imaging apparatus to a certain extent compared to the first embodiment.
In the execution of step S206, when the interval between the acquisition time and the time for acquiring the reference preview screen reaches the second preset time interval, the following steps may be executed:
updating the reference preview picture, and updating the reference preview picture into a currently acquired preview picture to be processed;
updating the main subject, updating the main subject to be the main subject in the updated reference preview screen, blurring the shooting background in the updated reference preview screen, wherein the shooting background in the updated reference preview screen is the image area except the main subject in the updated reference preview screen, and then returning to execute step S203.
That is, once the acquisition time interval between the current reference preview picture and the current reference preview picture is not less than the second preset time interval, the reference preview picture is updated, the current preview picture to be processed is updated to the reference preview picture, then the image area of the reference preview picture except the shooting subject is blurred, and the step S203 is executed again until the image capturing device finishes the acquisition operation of the preview picture.
Similarly, in the execution of step S206, when the interval between the acquisition time and the time for acquiring the reference preview screen reaches the first preset time interval, the following steps may be executed:
updating the reference preview picture, and updating the reference preview picture into the preview picture to be processed;
updating the main subject, updating the main subject to be the main subject in the updated reference preview picture, blurring the shooting background in the updated reference preview picture, wherein the shooting background in the updated reference preview picture is the image area except the main subject in the updated reference preview picture, and then returning to execute step 203.
In addition, in the second embodiment of the present application, if the second preset time interval is smaller than the first preset time interval, in the execution process of step S206, when the interval between the acquisition time and the time for acquiring the reference preview screen reaches the second preset time interval, the following steps may be executed:
if the acquisition time interval is smaller than the first preset time interval, blurring an image area indicated by the position information in the preview picture to be processed to obtain a processed preview picture;
if the acquisition time interval is greater than or equal to the first preset time interval, updating the reference preview picture, and updating the reference preview picture into the preview picture to be processed;
updating the main subject, updating the main subject to be the main subject in the updated reference preview picture, blurring the shooting background in the updated reference preview picture, wherein the shooting background in the updated reference preview picture is the image area except the main subject in the updated reference preview picture, and then returning to execute step 203.
That is, in the execution process of step S206, when a to-be-processed preview picture is acquired, if the time interval between the to-be-processed preview picture and the reference preview picture reaches the second preset time interval and is smaller than the first preset time interval, the to-be-processed preview picture acquired currently is blurred according to the position information determined in step S202, and if the time interval between the to-be-processed preview picture and the reference preview picture reaches the first preset time interval, the current reference preview picture is updated.
Furthermore, in the second embodiment of the present application, after step S203, the following steps may be further performed:
if the relative movement speed is greater than or equal to the first threshold, determining the movement speed of the imaging device, and determining the movement speed of the imaging subject according to the relative movement speed and the movement speed of the imaging device;
if the moving speed of the image pickup device is less than a fourth threshold value and the moving speed of the shooting subject is less than a fifth threshold value, then:
when the to-be-processed preview picture acquired after the camera device acquires the reference preview picture is acquired, if the time interval between the acquisition of the to-be-processed preview picture and the acquisition of the reference preview picture by the camera device is less than a third preset time interval, blurring an image area indicated by the position information in the to-be-processed preview picture to obtain a processed preview picture.
That is, if the relative moving speed of the two is relatively high, the respective moving speeds of the two are further determined, and if both the two are relatively slow, the positions of the shooting background and the shooting background in the acquired preview picture to be processed do not change much in a subsequent period of time, so that the current preview picture to be processed is blurred by directly using the previously determined position information.
Further, if it is determined that the moving speed of the image pickup apparatus is greater than or equal to the fourth threshold and the moving speed of the photographic subject is greater than or equal to the fifth threshold, the following operations are performed:
updating the reference preview picture, and updating the reference preview picture into the preview picture to be processed;
updating the main subject, updating the main subject to be the main subject in the updated reference preview picture, blurring the shooting background in the updated reference preview picture, wherein the shooting background in the updated reference preview picture is the image area except the main subject in the updated reference preview picture, and then returning to execute step 203.
It should be understood that, the size of the serial number of each step in the foregoing method embodiments does not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application. Furthermore, it should be understood by those skilled in the art that the phrase "when a occurs, then B is performed" in the method embodiments of the present application does not mean that a occurs at the same time as B is performed, but may be slightly different in time.
EXAMPLE III
The third embodiment of the application provides a preview picture processing device applied to an image pickup device. For convenience of explanation, only the portions related to the present application are shown, and as shown in fig. 4, the preview screen processing apparatus 300 includes:
a reference obtaining module 301, configured to obtain a reference preview picture acquired by the image capturing apparatus, where the reference preview picture includes a shooting subject acquired by the image capturing apparatus;
a background position module 302, configured to determine position information of a shooting background in the reference preview picture, where the shooting background is an image area in the reference preview picture except for the shooting subject;
a relative movement determination module 303 configured to determine a relative movement speed of the photographic subject with respect to the imaging apparatus;
a first blurring processing module 304, configured to perform blurring processing on an image area indicated by the position information in the to-be-processed preview picture to obtain a processed preview picture if the relative moving speed is smaller than a first threshold value, when the to-be-processed preview picture acquired by the image pickup device is acquired, and if a time interval between the acquisition of the to-be-processed preview picture and the acquisition of the reference preview picture is smaller than a first preset time interval, where the to-be-processed preview picture is a preview picture acquired after the image pickup device acquires the reference preview picture.
Optionally, the preview screen processing apparatus 300 further includes:
the first speed determining module is used for determining the moving speed of the camera device and determining the moving speed of the shooting subject according to the relative moving speed and the moving speed of the camera device;
the speed judging module is used for judging whether the moving speed of the camera device is smaller than a second threshold value or not and judging whether the moving speed of the shooting main body is smaller than a third threshold value or not;
accordingly, the first blurring processing module 304 is specifically configured to:
if the relative movement speed is smaller than a first threshold value and the judgment result of the speed judgment module is negative, when a to-be-processed preview picture acquired by the camera device is acquired, if the time interval between the acquisition of the to-be-processed preview picture and the acquisition of the reference preview picture is smaller than a first preset time interval, blurring an image area indicated by the position information in the to-be-processed preview picture to obtain a processed preview picture;
accordingly, the preview screen processing apparatus 300 further includes:
and the replacing module is used for replacing the preview picture to be processed with an image after blurring a shooting background in the reference preview picture if the time interval between the acquisition of the preview picture to be processed by the camera device and the acquisition of the reference preview picture is less than a second preset time interval when the acquired preview picture to be processed after the acquisition of the reference preview picture by the camera device is acquired if the relative movement speed is less than a first threshold value and the judgment result of the speed judging module is positive, wherein the shooting background is an image area except for the shooting main body in the reference preview picture.
Alternatively, the preview screen processing apparatus 300 includes:
a second speed determination module, configured to determine a moving speed of the image capturing apparatus if the relative moving speed is greater than or equal to the first threshold, and determine the moving speed of the image capturing apparatus according to the relative moving speed and the moving speed of the image capturing apparatus;
and the second blurring processing module is configured to perform blurring processing on an image area indicated by the position information in the preview picture to be processed to obtain a processed preview picture if a time interval between the capturing of the preview picture to be processed and the capturing of the reference preview picture by the camera device is smaller than a third preset time interval when the acquired preview picture to be processed after the capturing of the reference preview picture by the camera device is acquired and the movement speed of the shooting subject is smaller than a fifth threshold.
Optionally, the first blurring processing module 304 includes:
the reference updating unit is used for updating the reference preview picture and updating the reference preview picture into the preview picture to be processed if the relative movement speed is smaller than a first threshold value and the time interval between the acquisition of the preview picture to be processed and the acquisition of the reference preview picture is larger than or equal to a first preset time interval when the preview picture to be processed acquired by the camera device is acquired;
a subject updating unit configured to update the photographic subject, update the photographic subject to a photographic subject in the updated reference preview screen, and blur a photographic background in the updated reference preview screen, where the photographic background in the updated reference preview screen is an image area other than the photographic subject in the updated reference preview screen;
a return trigger unit configured to trigger the relative movement determination module to execute the step of determining the relative movement speed of the photographic subject with respect to the image pickup apparatus.
Optionally, the relative movement determining module 303 includes:
a reference frame acquiring unit, configured to acquire a reference preview picture acquired by the camera before acquiring the reference preview picture;
a relative speed determination unit configured to determine a relative movement speed of the photographic subject with respect to the image pickup apparatus based on positions of the photographic subject in the reference preview screen and the reference preview screen, respectively.
It should be noted that, for the information interaction, execution process, and other contents between the above-mentioned devices/units, the specific functions and technical effects thereof are based on the same concept as those of the embodiment of the method of the present application, and specific reference may be made to the part of the embodiment of the method, which is not described herein again.
Example four
Fig. 4 is a schematic diagram of an image pickup apparatus according to a fourth embodiment of the present application. As shown in fig. 4, the image pickup apparatus 400 of this embodiment includes: a processor 401, a memory 402 and a computer program 403 stored in the memory 402 and executable on the processor 401. The steps in the various method embodiments described above are implemented when the processor 401 executes the computer program 403 described above. Alternatively, the processor 401 implements the functions of the modules/units in the device embodiments when executing the computer program 403.
Illustratively, the computer program 403 may be divided into one or more modules/units, which are stored in the memory 402 and executed by the processor 401 to complete the present application. The one or more modules/units may be a series of computer program instruction segments capable of performing specific functions, which are used to describe the execution process of the computer program 403 in the image capturing apparatus 400. For example, the computer program 403 may be divided into a reference obtaining module, a background position module, a relative movement determining module, and a first blurring processing module, and the specific functions of the modules are as follows:
acquiring a reference preview picture acquired by the camera device, wherein the reference preview picture comprises a shooting main body acquired by the camera device;
determining position information of a shooting background in the reference preview picture, wherein the shooting background is an image area except the shooting subject in the reference preview picture;
determining a relative movement speed of the photographic subject with respect to the imaging device;
if the relative moving speed is less than a first threshold value, then:
when a to-be-processed preview picture acquired by the camera device is acquired, if the time interval between the acquisition of the to-be-processed preview picture and the acquisition of the reference preview picture is smaller than a first preset time interval, blurring an image area indicated by the position information in the to-be-processed preview picture to obtain a processed preview picture, wherein the to-be-processed preview picture is the preview picture acquired after the camera device acquires the reference preview picture.
The camera device may include, but is not limited to, a processor 401 and a memory 402. Those skilled in the art will appreciate that fig. 4 is merely an example of the camera 400, and does not constitute a limitation of the camera 400, and may include more or less components than those shown, or combine some of the components, or different components, for example, the camera may further include input and output devices, network access devices, buses, etc.
The Processor 401 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory 402 may be an internal storage unit of the image capturing apparatus 400, such as a hard disk or a memory of the image capturing apparatus 400. The memory 402 may be an external storage device of the image capturing apparatus 400, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), or the like, provided in the image capturing apparatus 400. Further, the memory 402 may include both an internal storage unit and an external storage device of the image capturing apparatus 400. The memory 402 is used to store the computer program and other programs and data required by the imaging device. The memory 402 may also be used to temporarily store data that has been output or is to be output.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned functions may be distributed as different functional units and modules according to needs, that is, the internal structure of the apparatus may be divided into different functional units or modules to implement all or part of the above-mentioned functions. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working processes of the units and modules in the system may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus/camera apparatus and method may be implemented in other ways. For example, the above-described embodiments of the apparatus/camera apparatus are merely illustrative, and for example, the division of the above modules or units is only a logical division, and there may be other divisions when actually implementing, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated modules/units described above, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, all or part of the processes in the above method embodiments may be implemented by a computer program, which may be stored in a computer readable storage medium and executed by a processor, so as to implement the steps of the above method embodiments. The computer program includes computer program code, and the computer program code may be in a source code form, an object code form, an executable file or some intermediate form. The computer readable medium may include: any entity or device capable of carrying the above-mentioned computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signal, telecommunication signal, software distribution medium, etc. It should be noted that the computer readable medium described above may include content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media that does not include electrical carrier signals and telecommunications signals in accordance with legislation and patent practice.
The above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present application and are intended to be included within the scope of the present application.
Claims (8)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910652667.2A CN110266960B (en) | 2019-07-19 | 2019-07-19 | Preview image processing method, processing device, camera device and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910652667.2A CN110266960B (en) | 2019-07-19 | 2019-07-19 | Preview image processing method, processing device, camera device and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110266960A CN110266960A (en) | 2019-09-20 |
| CN110266960B true CN110266960B (en) | 2021-03-26 |
Family
ID=67927143
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910652667.2A Expired - Fee Related CN110266960B (en) | 2019-07-19 | 2019-07-19 | Preview image processing method, processing device, camera device and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110266960B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108093158A (en) * | 2017-11-30 | 2018-05-29 | 广东欧珀移动通信有限公司 | Image blurring processing method and device and mobile device |
| EP3480784A1 (en) * | 2017-11-01 | 2019-05-08 | Guangdong Oppo Mobile Telecommunications Corp., Ltd | Image processing method, and device |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105049695A (en) * | 2015-07-07 | 2015-11-11 | 广东欧珀移动通信有限公司 | Video recording method and device |
| CN105204850B (en) * | 2015-08-31 | 2019-05-17 | 深圳市金立通信设备有限公司 | A kind of image processing method and terminal |
| CN106327448A (en) * | 2016-08-31 | 2017-01-11 | 上海交通大学 | Picture stylization processing method based on deep learning |
| CN107909539A (en) * | 2017-10-23 | 2018-04-13 | 深圳天珑无线科技有限公司 | Image background weakening method, terminal and computer-readable recording medium |
| CN107820019B (en) * | 2017-11-30 | 2020-03-06 | Oppo广东移动通信有限公司 | Virtual image acquisition method, device and device |
| CN107948519B (en) * | 2017-11-30 | 2020-03-27 | Oppo广东移动通信有限公司 | Image processing method, device and equipment |
| CN107948517B (en) * | 2017-11-30 | 2020-05-15 | Oppo广东移动通信有限公司 | Preview image blur processing method, device and device |
| CN107948514B (en) * | 2017-11-30 | 2019-07-19 | Oppo广东移动通信有限公司 | Image blurring processing method and device, mobile device and computer storage medium |
-
2019
- 2019-07-19 CN CN201910652667.2A patent/CN110266960B/en not_active Expired - Fee Related
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3480784A1 (en) * | 2017-11-01 | 2019-05-08 | Guangdong Oppo Mobile Telecommunications Corp., Ltd | Image processing method, and device |
| CN108093158A (en) * | 2017-11-30 | 2018-05-29 | 广东欧珀移动通信有限公司 | Image blurring processing method and device and mobile device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110266960A (en) | 2019-09-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111726533B (en) | Image processing method, image processing device, mobile terminal and computer readable storage medium | |
| CN108737739B (en) | Preview picture acquisition method, preview picture acquisition device and electronic equipment | |
| CN107172345B (en) | Image processing method and terminal | |
| CN108845861B (en) | Implementation method and device for virtual camera | |
| CN109005368B (en) | A method for generating high dynamic range image, mobile terminal and storage medium | |
| CN109215037B (en) | Target image segmentation method, device and terminal device | |
| CN107395997A (en) | A kind of image pickup method and mobile terminal | |
| CN107302666A (en) | Photographic method, mobile terminal and computer-readable recording medium | |
| CN110084765B (en) | An image processing method, an image processing device and a terminal device | |
| CN109005367B (en) | High dynamic range image generation method, mobile terminal and storage medium | |
| JP6401855B2 (en) | Method and apparatus for setting background of UI control, and terminal | |
| CN110717452B (en) | Image recognition method, device, terminal and computer readable storage medium | |
| CN108776800B (en) | Image processing method, mobile terminal and computer readable storage medium | |
| US20150281585A1 (en) | Apparatus Responsive To At Least Zoom-In User Input, A Method And A Computer Program | |
| CN105763813A (en) | A photographing method, device and intelligent terminal | |
| CN105391940B (en) | A kind of image recommendation method and device | |
| CN108833781A (en) | Image preview method, device, terminal and computer-readable storage medium | |
| CN105744164B (en) | A kind of mobile terminal photographic method and system | |
| EP3617990B1 (en) | Picture processing method and apparatus, computer readable storage medium, and electronic device | |
| CN106231200A (en) | A kind of photographic method and device | |
| CN108156368A (en) | A kind of image processing method, terminal and computer readable storage medium | |
| CN106357978B (en) | Image output method, device and terminal | |
| CN110166696B (en) | Photographing method, photographing device, terminal equipment and computer-readable storage medium | |
| CN112188097A (en) | Photographing method, photographing apparatus, terminal device, and computer-readable storage medium | |
| CN107395983B (en) | Image processing method, mobile terminal and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20210326 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |