[go: up one dir, main page]

CN111292354B - False detection suppression method and electronic equipment - Google Patents

False detection suppression method and electronic equipment Download PDF

Info

Publication number
CN111292354B
CN111292354B CN202010075685.1A CN202010075685A CN111292354B CN 111292354 B CN111292354 B CN 111292354B CN 202010075685 A CN202010075685 A CN 202010075685A CN 111292354 B CN111292354 B CN 111292354B
Authority
CN
China
Prior art keywords
mvi
target
mvot
image
threshold value
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010075685.1A
Other languages
Chinese (zh)
Other versions
CN111292354A (en
Inventor
杨硕
王嗣舜
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Priority to CN202010075685.1A priority Critical patent/CN111292354B/en
Publication of CN111292354A publication Critical patent/CN111292354A/en
Application granted granted Critical
Publication of CN111292354B publication Critical patent/CN111292354B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/20Analysis of motion
    • G06T7/246Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20172Image enhancement details
    • G06T2207/20201Motion blur correction
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20172Image enhancement details
    • G06T2207/20208High dynamic range [HDR] image processing

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Studio Devices (AREA)
  • Television Systems (AREA)

Abstract

The embodiment of the invention provides a false detection suppression method and electronic equipment, which relate to the technical field of communication and are used for solving the problem of poor synthesized image effect caused by false detection of leaves slightly swinging in a highlight area as a motion area in a scene of multi-frame image synthesis. The method comprises the following steps: m motion vector images MVI corresponding to a source image and a target image are acquired, wherein the source image is one frame of image in K continuous images acquired by electronic equipment, and the target image is any frame of image except the source image in the K continuous images; determining whether an image area corresponding to the target MVI is a false detection area or not based on the motion vector overflow number MVOT and the motion vector distribution density MVDD of the target MVI; wherein the target MVI is any one MVI among the M MVIs, M and K are positive integers, and K is larger than 1.

Description

False detection suppression method and electronic equipment
Technical Field
The embodiment of the invention relates to the technical field of communication, in particular to a false detection suppression method and electronic equipment.
Background
With the widespread use of photography, more and more specialized functions are integrated into electronic devices, such as high-dynamic range (HDR), multi-frame noise reduction, and multi-resolution imaging.
At present, the professional function is mainly to collect and synthesize multi-frame images. In the process of synthesizing the multi-frame images, as moving objects exist in the multi-frame images, the moving object estimation and the motion compensation are needed during the synthesis. When more leaves exist in a shooting scene, the leaves slightly swing, so that the leaves slightly swing are erroneously detected as a motion area, and the phenomenon of 'burning' or 'burning' can be generated if the leaves in a highlight area are subjected to motion compensation at present, namely, large-piece blurring can be generated, so that the effect of a finally synthesized image is poor.
Disclosure of Invention
The embodiment of the invention provides a false detection suppression method and electronic equipment, which can solve the problem of poor effect of a synthesized image due to false detection of leaves slightly swinging in a highlight area as a motion area in a scene synthesized by multiple frames of images.
In order to solve the technical problems, the embodiment of the invention is realized as follows:
in a first aspect, an embodiment of the present invention provides a false detection suppression method, including: m motion vector images (motion vector image, MVI) corresponding to a source image and a target image are acquired, wherein the source image is one frame of image in K continuous images acquired by electronic equipment, and the target image is any frame of image except the source image in the K continuous images; determining whether an image region corresponding to the target MVI is a false detection region based on the motion vector overflow number (motion vector over threshold, MVOT) and the motion vector distribution density (motion vector distribution density, MVDD) of the target MVI; wherein the target MVI is any one MVI among the M MVIs, M and K are positive integers, and K is larger than 1.
In a second aspect, an embodiment of the present invention further provides an electronic device, including: an acquisition module and a determination module; the acquisition module acquires M MVIs corresponding to a source image and a target image, wherein the source image is one frame of image in K continuous images acquired by electronic equipment, and the target image is any frame of image except the source image in the K continuous images; the determining module is used for determining whether the image area corresponding to the target MVI is a false detection area or not based on the MVOT and the MVDD of the target MVI; wherein the target MVI is any one MVI among the M MVIs, M and K are positive integers, and K is larger than 1.
In a third aspect, an embodiment of the present invention provides an electronic device, including a processor, a memory, and a computer program stored on the memory and executable on the processor, where the computer program implements the steps of the false detection suppression method according to the first aspect when executed by the processor.
In a fourth aspect, embodiments of the present invention provide a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the false detection suppression method according to the first aspect.
In the embodiment of the invention, the electronic equipment can acquire M MVIs corresponding to the source image and the target image, wherein the source image is one frame of image in the K continuous images, the target image is any frame of image except the source image in the K frame of image, and the electronic equipment determines whether the image area corresponding to the target MVI is the false detection area of the highlight leaf according to the overflow number of the motion vector and the distribution density of the motion vector of the target MVI. In other words, in the process of synthesizing the acquired multi-frame images in the scenes of high dynamic range imaging, multi-frame noise reduction, super-resolution imaging and the like, the electronic device can determine the motion characteristics and distribution density characteristics of the moving object according to the motion vector diagram corresponding to the target image close to the source image after the multi-frame images are subjected to motion estimation, so as to determine whether the moving object is a slightly jittered object, whether the moving object is a slightly jittered leaf, a slightly fluctuating water surface, slightly moving sand and the like, if the moving object is a slightly jittered leaf, a slightly fluctuating water surface, slightly moving sand and the like, the areas in the images can be determined to be the motion areas detected by mistake, and accordingly, corresponding image processing can be performed on the erroneously detected areas, for example, if the moving object obtained by motion estimation is a slightly jittered leaf, the slightly jittered leaf of the highlight area is not subjected to motion compensation processing, thus the problem that the effect of the synthesized image is poor due to the fact that the highlight leaf is detected by mistake as the moving object is subjected to motion compensation can be avoided, the accuracy of motion detection is improved, and the image processing is better effect is obtained.
Drawings
FIG. 1 is a schematic diagram of a possible operating system according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart of a false detection suppression method according to an embodiment of the present invention;
fig. 3 is a schematic diagram of correspondence between MVI sizes and threshold values according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a pixel offset direction according to an embodiment of the present invention;
FIG. 5 is a diagram of motion vector distribution characteristics according to an embodiment of the present invention;
FIG. 6 is a second flowchart of a false detection suppression method according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;
FIG. 8 is a second schematic diagram of an electronic device according to an embodiment of the present invention;
FIG. 9 is a third schematic diagram of an electronic device according to an embodiment of the present invention;
fig. 10 is a schematic hardware diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
In this context "/" means "or" for example, a/B may mean a or B; "and/or" herein is merely an association relationship describing an association object, and means that three relationships may exist, for example, a and/or B may mean: a exists alone, A and B exist together, and B exists alone. "plurality" means two or more than two.
The terms first and second and the like in the description and in the claims, are used for distinguishing between different objects and not necessarily for describing a particular sequential or chronological order of the objects. For example, the first threshold and the second threshold, etc., are used to distinguish between different thresholds, and are not used to describe a particular order of thresholds.
It should be noted that, in the embodiments of the present invention, words such as "exemplary" or "such as" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "e.g." in an embodiment should not be taken as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete fashion.
The electronic device in the embodiment of the invention can be an electronic device with an operating system. The operating system may be an Android operating system, an ios operating system, or other possible operating systems, and the embodiment of the present invention is not limited specifically.
The software environment to which the false detection suppression method provided by the embodiment of the present invention is applied is described below by taking the operating system shown in fig. 1 as an example.
Fig. 1 is a schematic diagram of a possible architecture of an operating system according to an embodiment of the present invention. In fig. 1, the architecture of the operating system includes 4 layers, respectively: an application program layer, an application program framework layer, a system runtime layer and a kernel layer (specifically, a Linux kernel layer).
The application layer includes various applications (including system applications and third party applications) in the operating system.
The application framework layer is a framework of applications, and developers can develop some applications based on the application framework layer while adhering to the development principle of the framework of the applications.
The system runtime layer includes libraries (also referred to as system libraries) and an operating system runtime environment. Libraries mainly provide various resources required by the operating system. The operating system runtime environment is used to provide a software environment for the operating system.
The kernel layer is an operating system layer of the operating system, and belongs to the bottommost layer of the operating system software layer. The kernel layer provides core system services and hardware-related drivers for the operating system based on the Linux kernel.
Taking the operating system shown in fig. 1 as an example, in the embodiment of the present invention, a developer may develop a software program for implementing the false detection suppression method provided in the embodiment of the present invention based on the system architecture of the operating system shown in fig. 1, so that the false detection suppression method may be operated based on the operating system shown in fig. 1. Namely, the processor or the electronic device can implement the false detection suppression method provided by the embodiment of the invention by running the software program in the operating system.
The false detection suppression method provided by the embodiment of the invention can be applied to the scenes of high dynamic range imaging, multi-frame noise reduction, super-resolution imaging and the like, and can be used for generating the phenomena of 'burning' and 'burning' of the area where the highlight leaves are located in the finally synthesized image of the multi-frame image if the leaves which slightly shake are detected as moving objects in the process of synthesizing the acquired multi-frame image, and the phenomena of generating large-piece blurring in the synthesized image can be caused if the image area where the highlight leaves are located is subjected to motion compensation after motion estimation. According to the false detection suppression method provided by the embodiment of the invention, after the motion estimation is carried out on a plurality of images, the motion characteristics and the distribution density characteristics of the motion object determined by the motion estimation can be obtained according to the motion vector diagram of the target image, which corresponds to the source image, so that whether the motion object is a slightly-jittered leaf, a slightly-fluctuating water surface, slightly-moving sand and the like can be determined, if the motion object is a slightly-jittered leaf, a slightly-fluctuating water surface, slightly-moving sand and the like are determined, the areas in the images can be determined to be the false detection motion areas, and accordingly, the corresponding image processing can be carried out on the false detection areas, for example, if the motion object is a slightly-jittered leaf, the motion compensation processing can not be carried out on the slightly-jittered leaf in the highlight area, and therefore, the problem that the motion detection accuracy is improved due to the fact that the highlight leaf is detected as the motion object is subjected to motion compensation can be avoided, and the resultant image effect is poor can be caused.
The false detection suppression method according to the embodiment of the present invention is described below with reference to fig. 2. Fig. 2 is a flow chart of a false detection suppression method according to an embodiment of the present invention, as shown in fig. 2, the false detection suppression method includes the following steps 201 and 202:
step 201, the electronic device acquires M MVIs corresponding to the source image and the target image.
The source image is one frame of images in K continuous images acquired by the electronic equipment, the target image is any frame of image except the source image in the K continuous images, M and K are positive integers, and K is larger than 1.
In the embodiment of the invention, the source image may also be referred to as a reference image or a reference frame, and may be any image in K continuous images.
For example, the source image may be a first frame image of K consecutive images, a last frame image of the K consecutive images, or a frame image between the first frame image and the last frame image. The target image is any one frame image except the source image in the K frames of continuous images.
In the embodiment of the invention, the electronic device may perform motion detection and motion estimation on the source image and the target image first, and may specifically perform the following operations on the source image and the target image: image global alignment, gray value bidirectional mapping, multi-frame gray difference, self-adaptive morphological filtering, motion vector calculation and the like, so that M MVIs are obtained.
For example, in the process of motion vector calculation, a dense optical flow algorithm may be used to calculate the similarity degree of patch blocks in the source image and the target image through the sum of absolute value (sum of absolute differences, SAD) distance of pixel value differences of each pixel point, determine whether the motion area is the motion area, and then determine the offset value and the offset direction of each pixel point by minimizing the SAD distance, thereby obtaining MVI corresponding to the similar patch blocks.
In the embodiment of the invention, the MVI may include a motion direction corresponding to the pixel point and a motion amplitude of the pixel point. That is, each pixel point in the MVI correspondingly stores a set of motion vectors, including a lateral motion vector Δx and a longitudinal motion vector Δy for the pixel point.
Step 202, the electronic device determines whether the image area corresponding to the target MVI is a false detection area based on the MVOT and MVDD of the target MVI.
Wherein the target MVI is any one of the M MVIs.
It should be noted that the number of overflows of motion vectors and the distribution density of the motion vectors can represent key distribution characteristics of micro motion of an object, and can indicate motion characteristics such as the direction of motion, the amplitude of motion, the proportion in each direction and the like of small-amplitude shake. For example, key distribution characteristics of minute movements such as leaf type, quicksand type, water wave type, etc. can be characterized, and the movement characteristics such as the direction of movement, the amplitude of movement, the proportion in each direction, etc. of small amplitude shake can be indicated.
It should be noted that, in the related art, the mixed gaussian background modeling method may be used to perform false detection suppression processing on the highlight leaves, a large amount of static pixel point data is required to perform background modeling on the image, and multiple iterations are required, and the electronic device generally selects 3 to 5 frames of images to perform image synthesis in the process of collecting the image, so that the mixed gaussian background modeling method cannot meet the requirements of users on rapidity and instantaneity of capturing the image by the electronic device. In the embodiment of the invention, false detection inhibition processing of highlight leaves can be established on the basis of motion detection, and the global background is not required to be modeled, so that statistics and processing are only carried out on the motion vector distribution characteristics of the detected region of interest (namely MVI), thereby reducing the complexity of an algorithm and greatly improving the operation speed of electronic equipment.
According to the false detection suppression method provided by the embodiment of the invention, the electronic equipment can acquire M MVIs corresponding to the source image and the target image, wherein the source image is one frame of image in the K-frame continuous images, the target image is any frame of image except the source image in the K-frame image, and the electronic equipment determines whether the image area corresponding to the target MVI is the false detection area of the highlight leaf according to the overflow number of the motion vector and the distribution density of the motion vector of the target MVI. In other words, in the process of synthesizing the acquired multi-frame images in the scenes of high dynamic range imaging, multi-frame noise reduction, super-resolution imaging and the like, the electronic device can determine the motion characteristics and distribution density characteristics of the moving object according to the motion vector diagram corresponding to the target image close to the source image after the multi-frame images are subjected to motion estimation, so as to determine whether the moving object is a slightly jittered object, whether the moving object is a slightly jittered leaf, a slightly fluctuating water surface, slightly moving sand and the like, if the moving object is a slightly jittered leaf, a slightly fluctuating water surface, slightly moving sand and the like, the areas in the images can be determined to be the motion areas detected by mistake, and accordingly, corresponding image processing can be performed on the erroneously detected areas, for example, if the moving object obtained by motion estimation is a slightly jittered leaf, the slightly jittered leaf of the highlight area is not subjected to motion compensation processing, thus the problem that the effect of the synthesized image is poor due to the fact that the highlight leaf is detected by mistake as the moving object is subjected to motion compensation can be avoided, the accuracy of motion detection is improved, and the image processing is better effect is obtained.
Optionally, the method for suppressing false detection provided in the embodiment of the present invention may further include the following step 203 before the step 202:
and 203, the electronic equipment calculates MVOT and MVDD of the target MVI.
Further, the above step 202 may be specifically performed by the following steps 202a and 202 b:
step 202a, the electronic device compares the MVOT of the target MVI with the MVOT threshold value, and compares the MVDD of the target MVI with the MVDD threshold value.
Specifically, the electronic device may compare the magnitude of the MVOT and MVOT threshold of the target MVI, and compare the magnitude of the MVDD and MVDD threshold of the target MVI.
Step 202b, the electronic device determines whether the image area corresponding to the target MVI is a false detection area according to the comparison result of the MVOT of the target MVI and the MVOT threshold value and the comparison result of the MVDD of the target MVI and the MVDD threshold value.
It should be noted that the MVOT threshold value and the threshold value of MVDD may be selected according to empirical values.
Optionally, after determining the comparison result, the electronic device may determine which type of object in the image area corresponding to the target MVI is an object, for example, a leaf, a quicksand, or a water surface, and then determine whether the object is a false detection area.
The electronic device may determine whether the motion vector in the target MVI is characterized as the micro motion of the leaf shake according to the comparison result of the MVOT of the target MVI and the MVOT threshold value and the comparison result of the MVDD of the target MVI and the MVDD threshold value, and if the matching result is characterized as the micro motion of the leaf shake and the leaf of the micro motion is located in the highlight region, the electronic device may determine that the image region corresponding to the MVI is the false detection region of the highlight leaf.
In the embodiment of the invention, the highlight region may refer to a region in the image where the exposure exceeds a threshold. The highlight leaves may represent leaves that are located in a highlight region in the image.
It should be noted that, in the embodiment of the present invention, if the false detection is performed on the highlight leaf, the electronic device may determine whether the image area corresponding to the target MVI is the highlight area after determining M MVIs corresponding to the source image and the target image, and if it is determined that the image area corresponding to the target MVI is the highlight area, then step 202 is continuously performed. Of course, the electronic device may also determine whether the target MVI is a highlight region after step 202 a.
Based on the scheme, the electronic equipment can calculate the MVOT of the target MVI and the MVDD of the target MVI, then compare the MVOT of the target MVI with the MVOT threshold value, compare the MVDD of the target MVI with the MVDD threshold value, and finally determine whether the image area corresponding to the target MVI is a false detection area according to the comparison result of the MVOT of the target MVI and the MVDD threshold value. By combining the threshold value, the electronic equipment can accurately determine whether the image area corresponding to the target MVI is a false detection area or not, and the accuracy of false detection inhibition can be improved.
It can be appreciated that after motion estimation, since the size of the patch block corresponding to each motion object to be estimated is different, the corresponding MVI size is also different, and accordingly, the specific values of the MVOT threshold value and the MVDD threshold value are different for different MVI sizes. Therefore, after determining the target MVI, the values of the threshold values respectively corresponding to the MVOT and the MVDD need to be adjusted. Optionally, the method for suppressing false detection provided in the embodiment of the present invention may further include the following step 204 after step 201:
step 204, the electronic device adjusts at least one of the MVOT threshold value and the MVDD threshold value according to the size of the target MVI.
It should be noted that, in the embodiment of the present invention, the MVOT threshold value, the MVDD threshold value (MDVV threshold value, MDVSD threshold value) are related to the size of the MVI. As the MVI size changes, the range of values for the threshold may include regions of linear change and regions of non-linear change. Therefore, in the region where the MVI size corresponds to the nonlinear change of the threshold value, the corresponding threshold value can be adjusted according to the size of the target MVI.
It can be appreciated that if the size of the target MVI is within the linear variation range of the MVOT threshold value, the electronic device does not need to adjust the MVOT threshold value. The electronic device may select or calculate the MVOT threshold value corresponding to the size of the target MVI according to the linear correspondence between the size of the target MVI and the MVOT threshold value. And if the size of the target MVI corresponds to the nonlinear change area of the MVOT threshold, adjusting the MVOT threshold according to the size of the target MVI.
Similarly, if the size of the target MVI is within the linear variation range of the MVDD threshold value, the electronic device does not need to adjust the MVDD threshold value. The electronic device may select or calculate the MVOT threshold value corresponding to the size of the target MVI according to the linear correspondence between the size of the target MVI and the MVDD threshold value. And if the size of the target MVI corresponds to the MVDD threshold nonlinear change region, adjusting the MVDD threshold according to the size of the target MVI.
Based on the scheme, the electronic equipment can adjust the size of the corresponding MVOT threshold according to the size of the target MVI, and adjust the size of the MVDD threshold, so that the matching result is more accurate.
Optionally, in the embodiment of the present invention, in a case where the size of the target MVI is greater than the first preset size and less than the second preset size, the MVOT threshold value increases with an increase in the size of the target MVI. And under the condition that the size of the target MVI is smaller than or equal to a first preset size, the MVOT threshold value is a first threshold value. And under the condition that the size of the target MVI is larger than or equal to a second preset size, the MVOT threshold value is a second threshold value.
Optionally, in the embodiment of the present invention, in a case where the size of the target MVI is greater than the third preset size and less than the fourth preset size, the MVDD threshold value increases with an increase in the size of the target MVI. And when the size of the target MVI is smaller than or equal to a third preset size, the MVDD threshold value is a third threshold value. And when the size of the target MVI is greater than or equal to the fourth preset size, the MVDD threshold value is a fourth threshold value.
For example, fig. 3 is a schematic diagram of a correspondence between MVI sizes and threshold values, and as shown in fig. 3, for a correspondence between a threshold value of MVOT and a MVI size, a first preset size is size 1, a second preset size is size 3, the first threshold value is a minimum value of t_mvot, and the second threshold value is a maximum value of t_mvot. If the size of the MVI is less than or equal to size 1, the MVI threshold is adjusted to a T_MVOT minimum value, and if the size of the MVI is greater than size 3, the MVI threshold is adjusted to a T_MVOT maximum value. For the corresponding relation between the threshold value of the MVDD and the MVI size, the first preset size is size 2, the second preset size is size 4, the first threshold value is the minimum value of the T_MVDD, and the second threshold value is the maximum value of the T_MVDD. If the size of the MVI is less than or equal to size 2, the MVDD threshold is adjusted to a T_MVDD minimum value, and if the size of the MVI is greater than size 4, the MVDD threshold is adjusted to a T_MVDD maximum value.
Based on the scheme, the mapping relation between the size of the MVI and the MVOT threshold value and the mapping relation between the MVI and the MVDD threshold value can be stored in the electronic equipment, and when the method in the embodiment of the invention is executed, the threshold value corresponding to the size of each different MVI can be rapidly determined according to the mapping relation, so that whether the image area corresponding to the target MVI is a false detection area can be accurately determined according to the proper threshold value.
It will be appreciated that if the electronic device adjusts at least one of the threshold value of the MVDD and the threshold value of the MVOT, the electronic device needs to use the adjusted threshold value for comparison. Further, the step 202a may be performed by one of the steps 202a1 to 202a 3:
in step 202a1, under the condition of adjusting the MVOT threshold value, the electronic device compares the MVOT of the target MVI with the adjusted MVOT threshold value, and compares the MVDD of the target MVI with the MVDD threshold value.
In step 202a2, under the condition of adjusting the MVDD threshold, the electronic device compares the MVOT of the target MVI with the MVOT threshold, and compares the MVDD of the target MVI with the adjusted MVDD threshold.
In step 202a3, under the condition of adjusting the MVOT threshold value and the MVDD threshold value, the electronic device compares the MVOT of the target MVI with the adjusted MVOT threshold value, and compares the MVDD of the target MVI with the adjusted MVDD threshold value.
Based on the scheme, the electronic equipment can compare according to the adjusted threshold after the threshold is adjusted, so that the determined result is more accurate, and the accuracy of the electronic equipment on false detection inhibition can be improved.
Optionally, in the method for suppressing false detection provided in the embodiment of the present invention, in the step 203, calculating the MVOT of the target MVI may be performed by the following steps 203a and 203 b:
In step 203a, the electronic device calculates a motion vector offset (motion vector offset, MVO) of each pixel corresponding to the target MVI according to the first target preset formula.
The first target preset formula is any one of a first preset formula, a second preset formula and a third preset formula. The first preset formula is the following formula (1), the second preset formula is the following formula (2), and the third preset formula is the following formula (3).
MVO ij =|Δx ij |+|Δy ij I formula (2)
MVO ij =MAX(|Δx ij |,|Δy ij I) formula (3)
Wherein MVO ij MVO value, deltax, representing pixel point at jth row of ith column in MVI ij A lateral motion vector, deltay, representing the pixel at column i and row j ij Representing the longitudinal motion vector of the pixel at column i and row j.
It should be noted that, the above formulas (1) to (2) to (3) gradually decrease the accuracy and gradually increase the operation speed, and one formula may be selected from the above formulas (1), (2) and (3) to calculate MVO according to at least one of the accuracy requirement and the performance supported by the electronic device.
Step 203b, the electronic device determines the MVOT of the target MVI according to the MVO and the MVO threshold value of each pixel point corresponding to the target MVI.
Specifically, the electronic device may count the number of pixels in the target MVI for which MVO is less than the MVO threshold value after the target MVI is obtained.
Fig. 5 is a motion vector distribution characteristic diagram according to an embodiment of the present invention. As shown in fig. 5, the radius of the circle is MVO threshold, each dot represents a set of motion vectors, as shown in (a) in fig. 5, the dots are basically distributed inside the circle, the distribution densities in four directions (i.e., four quadrants) are similar, that is, the distribution of the motion vectors is relatively uniform, the amplitude of the motion vectors is relatively small, so that the distribution characteristics of small amplitude and irregular and unordered directions can be represented, for example, irregular jittering of leaves can be represented. As shown in fig. 5 (b), the dots are basically distributed in quadrant 1, i.e. the distribution density in a certain direction is concentrated, most of the dots are distributed outside the circle, the amplitude of the motion vector is large, i.e. the distribution characteristics of large amplitude and main direction of the motion direction can be represented.
Based on the scheme, the electronic device can select one formula from the formula (1), the formula (2) and the formula (3) to calculate the MVO in the MVI, and then determine the MVOT of the target MVI according to the MVO corresponding to each pixel point in the MVI and the MVO threshold value, so that the offset characteristic of the moving object can be determined, and whether the object in the image area corresponding to the target MVI is a false detected moving object can be accurately determined.
Alternatively, the motion vector distribution density may be: motion vector distribution variance (motion direction vector variance, MDVV), or motion vector distribution standard deviation (motion direction vector standard deviation, MDVSD).
It should be noted that, if the MDVV is selected to represent the motion vector distribution density, the calculation complexity is lower than that of the MDVSD, so that the calculation can be faster, and the motion vector distribution density can be approximately represented, that is, the precision is lower. If MDVSD is selected to represent the motion vector distribution density, the calculation complexity is higher relative to MDVV, the calculation speed is slower relative to MDVV, and the motion vector distribution density can be represented more accurately. The corresponding parameters characterizing the distribution density of motion vectors can be selected as desired.
Furthermore, in the false detection suppression method provided by the embodiment of the present invention, the calculating of the MVDD of the target MVI in the step 203 may be performed by the following step 203c or step 203 d:
step 203c, the electronic device calculates the MDVV of the target MVI according to a fourth preset formula.
The fourth preset formula is the following formula (4).
Wherein N represents N offset directions, M D Representing the number of pixels shifted in the direction D among N shift directions, M width Represents the width of MVI, M length The length of the MVI is indicated,
it should be noted that N directions may be divided, and then the number M of pixel points in each direction may be counted 1 To M N Normalization of the MDVV may be achieved by the number of directions, the size of the MVI (e.g., length of MVI times width of MVI), and the denominator of equation (4).
In the embodiment of the present invention, the number of offset pixels in each direction may be determined by MVI, and the specific value of the number N of directions may be selected according to the requirement of precision and the device performance, for example, 4 directions, 8 directions, 16 directions, and the like.
In an embodiment of the present invention, each of the N offset directions may correspond to a region, for example, the above-described directions may correspond to quadrants in a coordinate system.
Fig. 4 is a schematic diagram of a pixel offset direction according to an embodiment of the present invention, where the schematic diagram of the offset direction shown in (a) in fig. 4 may represent offset in four directions, the schematic diagram of the offset direction shown in (b) in fig. 4 may represent offset in eight directions, and in (a) in fig. 4, the number M of pixels offset into quadrant 1 in MVI may be counted 1 Number M of pixels shifted into quadrant 2 2 Number M of pixels shifted into quadrant 3 3 Number M of pixel points shifted into quadrant 4 4 . In FIG. 4 (b), the number M of pixels in the MVI shifted to quadrant 1 can be counted 1 Number M of pixels shifted into quadrant 2 2 Number M of pixels shifted into quadrant 3 3 Number M of pixel points shifted into quadrant 4 4 Offset to pixels in quadrant 5Number of points M 5 Number M of pixels shifted into quadrant 6 6 Number M of pixel points shifted into quadrant 7 7 Number M of pixels shifted into quadrant 8 8
It should be noted that, in fig. 4, the angular values of the corresponding quadrants in the coordinate system are equal, and of course, two quadrants with different angular values may also be present in the coordinate system, which is not limited in particular in the embodiment of the present invention.
Step 203d, the electronic device calculates the first MDVSD according to a fifth preset formula.
Wherein the fifth preset formula is the following formula (5):
for example, in the case where n=4, in combination with (a) in fig. 4, the formula (4) may be specifically the following formula (4-1), and the formula (5) may be specifically the following formula (5-1).
Wherein,,
for example, in the case where n=8, in combination with (b) in fig. 4, the formula (4) may be specifically the following formula (4-2), and the formula (5) may be specifically the following formula (5-2).
Wherein,,
based on the scheme, the electronic equipment can be based on the MDVV determined by the formula (4) or the MDVSD determined by the formula (5) as a parameter for representing the distribution density of the motion vectors, different calculation modes can be selected according to different requirements, different numbers of offset directions can be selected according to different calculation precision, and the mode for determining the distribution density of the motion vectors is more flexible.
Optionally, in the false detection suppression method provided by the embodiment of the present invention, in the case of n=4, the above formula (4) may be the following formula (4-3), and the above formula (5) may be the following formula (5-3).
Wherein M is up Representing the number of pixel shifts in a first direction, M down Indicating the offset amount M of the pixel point to the second direction left Representing the number, M, of pixel shifts to a third direction right Indicating the number of pixel shifts in the fourth direction,
in the embodiment of the invention, the offset direction can be divided by adopting the target coordinate system, the x axis and the y axis in the target coordinate system intersect, and the included angle between the x axis and the y axis can be a right angle or not. In the case where the angle between the x-axis and the y-axis is a rectangular, the target coordinate system may be a rectangular coordinate system. In the case where the x-axis of the target coordinate system is a coordinate axis in the horizontal direction, the y-axis in the target coordinate system may be a coordinate axis in the vertical direction or may be a coordinate axis in a direction other than the vertical direction; in the case where the y-axis is a vertical coordinate axis, the x-axis may be a horizontal coordinate axis or a non-horizontal coordinate axis. Of course, when the x-axis is a coordinate axis in a non-horizontal direction, the y-axis may be a coordinate axis in a non-vertical direction.
For example, if the x-axis is the coordinate axis in the horizontal direction in the target coordinate system, the y-axis is the coordinate axis in the vertical direction in the target coordinate system, and the x-axis and the y-axis are vertical, the MVI may be divided into an upper offset (i.e., the first direction is toward the upper side of the x-axis), a lower offset (i.e., the second direction is toward the lower side of the x-axis), a left offset (i.e., the third direction is toward the left side of the y-axis), a right offset (i.e., the fourth direction is toward the right side of the y-axis), and in combination with (a) in fig. 4, the middle pixel points of the 1 st and 2 nd quadrants belong to the upper offset, the 3 rd and 4 th quadrants belong to the lower offset, the 2 nd and 3 rd quadrants belong to the left offset, the 1 st and 4 th quadrants belong to the right offset, and M up Representing the number of upward shifts of the pixel point, M down Indicating the number of downward shifts of the pixel points, M left Representing the amount of pixel shift to the left, M right Indicating the amount by which the pixel point is shifted to the right.
Specifically, the above formula (4) may be the following formula (4-4), and the above formula (4) may be the following formula (5-4).
Wherein,,
based on this scheme, in the case of n=4, the electronic device may further determine the MDVSD determined according to the above formula (4-3) or formula (5-3) as a parameter characterizing the motion vector distribution density, so that the electronic device determines the motion vector distribution density to be more diverse.
Optionally, in the method for suppressing false detection provided in the embodiment of the present invention, the step 202b may be specifically performed by the following step 202b 1:
step 202b1, the electronic device compares the MVOT of the target MVI with the MVOT threshold value according to the sixth preset formula, and compares the MVDD of the target MVI with the MVDD threshold value.
Wherein the sixth preset formula is the following formula (6):
wherein t_mvot represents a MVOT threshold value, and t_mvdd represents a MVDD threshold value; in the case of Mis =0, the image block corresponding to the target MVI is the false detection area; in the case of Mis =1, the image block corresponding to the target MVI is a motion region.
For example, in the case of Mis =0, the image block corresponding to the target MVI is a highlight leaf false detection area; in the case of Mis =1, the image block corresponding to the target MVI is a motion region.
If the threshold value of MVOT is the adjusted threshold value, t_mvot represents the adjusted threshold value of MVOT, and if the threshold value of MVOT is the adjusted threshold value, t_mvot represents the adjusted threshold value of MVOT.
Fig. 6 is a schematic flow chart of a false detection suppression method according to an embodiment of the present invention. The electronic equipment inputs the image into the motion detection module to obtain a first processing result, the first processing result is input into the motion estimation module after processing, so that MVI is obtained, the MVI is input into the self-adaptive threshold constraint module, the MVOT threshold and the MVDD threshold are adjusted, the MVI is input into the motion vector calculation module to calculate MVOT and MDVV, the adjusted MVOT threshold and the adjusted MDVV threshold are input into the matching module to be compared, whether the motion area corresponding to the MVI is a highlight leaf false detection area is determined, the matching result is input into the motion compensation module, if the motion area corresponding to the MVI is determined to be a highlight leaf false detection area according to the comparison result, motion compensation is not needed, and if the motion area corresponding to the MVI is determined to be a real motion area according to the comparison result, the motion compensation is performed.
Based on the scheme, the electronic equipment can determine whether the motion area corresponding to the MVI is a highlight leaf false detection area or a real motion area according to the comparison result of the MVOT corresponding to the target MVI and the MVOT threshold value and the comparison result of the MVDD threshold value and the formula (6) so that the false detection is restrained more accurately.
Fig. 7 is a schematic diagram of a possible structure of an electronic device according to an embodiment of the present invention, as shown in fig. 7, an electronic device 700 includes: an acquisition module 701 and a determination module 702; the acquiring module 701 is configured to acquire M MVIs corresponding to a source image and a target image, where the source image is one frame of image in K continuous frames acquired by the electronic device, the target image is any frame of image except the source image in the K continuous frames, and the determining module 702 is configured to determine, based on MVOT and MVDD of the target MVI, whether an image area corresponding to the target MVI is a false detection area; wherein the target MVI is any one MVI among the M MVIs, M and K are positive integers, and K is larger than 1.
The embodiment of the invention provides electronic equipment, which can acquire M MVIs corresponding to a source image and a target image, wherein the source image is one frame of image in K continuous images, the target image is any frame of image except the source image in the K frame of image, and the electronic equipment determines whether an image area corresponding to the target MVI is a false detection area of highlight leaves according to the overflow number of motion vectors and the distribution density of the motion vectors of the target MVI. In other words, in the process of synthesizing the acquired multi-frame images in the scenes of high dynamic range imaging, multi-frame noise reduction, super-resolution imaging and the like, the electronic device can determine the motion characteristics and distribution density characteristics of the moving object according to the motion vector diagram corresponding to the target image close to the source image after the multi-frame images are subjected to motion estimation, so as to determine whether the moving object is a slightly jittered object, whether the moving object is a slightly jittered leaf, a slightly fluctuating water surface, slightly moving sand and the like, if the moving object is a slightly jittered leaf, a slightly fluctuating water surface, slightly moving sand and the like, the areas in the images can be determined to be the motion areas detected by mistake, and accordingly, corresponding image processing can be performed on the erroneously detected areas, for example, if the moving object obtained by motion estimation is a slightly jittered leaf, the slightly jittered leaf of the highlight area is not subjected to motion compensation processing, thus the problem that the effect of the synthesized image is poor due to the fact that the highlight leaf is detected by mistake as the moving object is subjected to motion compensation can be avoided, the accuracy of motion detection is improved, and the image processing is better effect is obtained.
Optionally, in conjunction with fig. 7, as shown in fig. 8, the electronic device 700 further includes: a calculation module 703; a calculating module 703, configured to calculate MVOT and MVDD of the target MVI; the determining module 702 is configured to compare the MVOT threshold value of the target MVI and compare the MVDD of the target MVI with the MVDD threshold value; and determining whether the image area corresponding to the target MVI is a false detection area or not according to the comparison result of the MVOT and the MVOT threshold value of the target MVI and the comparison result of the MVDD and the MVDD threshold value of the target MVI.
The embodiment of the invention provides electronic equipment, which can calculate the MVOT of a target MVI and the MVDD of the target MVI, then compare the MVOT of the target MVI with the MVOT threshold value, compare the MVDD of the target MVI with the MVDD threshold value, and finally determine whether an image area corresponding to the target MVI is a false detection area according to the comparison result of the MVOT of the target MVI with the MVDD threshold value and the comparison result of the MVDD of the target MVI with the MVDD threshold value. By combining the threshold value, the electronic equipment can accurately determine whether the image area corresponding to the target MVI is a false detection area or not, and the accuracy of false detection inhibition can be improved.
Optionally, in conjunction with fig. 8, as shown in fig. 9, the electronic device 700 further includes: an adjustment module 704; the adjusting module 704 is configured to adjust at least one of the MVOT threshold value and the MVDD threshold value according to the size of the target MVI after the obtaining module 701 obtains M MVIs corresponding to the source image and the target image.
The embodiment of the invention provides electronic equipment, which can adjust the size of a corresponding MVOT threshold value and the size of an MVDD threshold value according to the size of a target MVI, so that a matching result is more accurate.
Optionally, in the case that the size of the target MVI is greater than the first preset size and less than the second preset size, the MVOT threshold value increases with the increase in size of the target MVI; under the condition that the size of the target MVI is smaller than or equal to a first preset size, the MVOT threshold value is a first threshold value; when the size of the target MVI is greater than or equal to a second preset size, the MVOT threshold value is a second threshold value; in the case that the size of the target MVI is greater than the third preset size and less than the fourth preset size, the MVDD threshold value increases as the size of the target MVI increases; under the condition that the size of the target MVI is smaller than or equal to a third preset size, the MVDD threshold value is a third threshold value; and when the size of the target MVI is greater than or equal to the fourth preset size, the MVDD threshold value is a fourth threshold value.
The embodiment of the invention provides electronic equipment, wherein the electronic equipment can store the mapping relation between the size of MVI and the MVOT threshold value and the mapping relation between the MVI and the MVDD threshold value, and when the method in the embodiment of the invention is executed, the threshold values corresponding to the sizes of different MVIs can be rapidly determined according to the mapping relation, so that whether the image area corresponding to the target MVI is a false detection area can be accurately determined according to the proper threshold values.
Optionally, the computing module 703 is specifically configured to: calculating MVO of each pixel point corresponding to the target MVI according to a first target preset formula, wherein the first target preset formula is any one of the first preset formula, the second preset formula and the third preset formula; according to the MVO and the MVO threshold value of each pixel point corresponding to the target MVI, determining the MVOT of the target MVI; the first preset formula is:the second preset formula is: MVO (mechanical vapor recompression) ij =|Δx ij |+|Δy ij I (I); the third preset formula is: MVO (mechanical vapor recompression) ij =MAX(|Δx ij |,|Δy ij |) is provided; wherein MVO ij MVO value, deltax, representing pixel point at jth row of ith column in MVI ij A lateral motion vector, deltay, representing the pixel at column i and row j ij Representing the longitudinal motion vector of the pixel at column i and row j.
According to the electronic device provided by the embodiment of the invention, one formula can be selected from the first preset formula, the second preset formula and the third preset formula to calculate the MVO in the MVI, and then the MVOT of the target MVI is determined according to the MVO corresponding to each pixel point in the MVI and the MVO threshold value, so that the offset characteristic of the moving object can be determined, and whether the object in the image area corresponding to the target MVI is a false detected moving object can be accurately determined.
Alternatively, the MVDD is MDVV, or is MDVSD; the computing module 703 is specifically configured to: according to a fourth preset formula, calculating the MDVV of the target MVI, wherein the fourth preset formula is as follows: Or, calculating the MDVSD of the target MVI according to a fifth preset formula, wherein the fifth preset formula is as follows:Wherein N represents N offset directions, M D Representing the number of pixels shifted in the direction D, M, of the N shift directions width Represents the width of MVI, M length Indicates the length of MVI, ">
According to the electronic equipment provided by the embodiment of the invention, the MDVV determined based on the fourth preset formula or the MDVSD determined based on the fifth preset formula can be used as the parameter for representing the distribution density of the motion vector, different calculation modes can be selected according to different requirements, different numbers of offset directions can be selected according to different calculation accuracies, and the mode for determining the distribution density of the motion vector is more flexible.
Optionally, the determining module 702 is specifically configured to: according to a sixth preset formula, comparing the MVOT and the MVOT threshold of the target MVI, and comparing the MVDD and the MVDD threshold of the target MVI, wherein the sixth preset formula is as follows:wherein t_mvot represents a MVOT threshold value, and t_mvdd represents a MVDD threshold value; in the case of Mis =0, the image block corresponding to the target MVI is the false detection area; in the case of Mis =1, the image block corresponding to the target MVI is a motion region. />
Alternatively, in the case of n=4, Wherein M is up Representing the number of pixel shifts in a first direction, M down Indicating the offset amount M of the pixel point to the second direction left Representing the number, M, of pixel shifts to a third direction right Indicating the number of pixel shifts in the fourth direction,
according to the electronic device provided by the embodiment of the invention, the electronic device can determine whether the motion area corresponding to the MVI is the highlight leaf false detection area or the real motion area according to the comparison result of the MVOT corresponding to the target MVI and the MVOT threshold value, the comparison result of the MVDD and the MVDD threshold value and the sixth preset formula, so that the false detection is restrained more accurately.
The electronic device 700 provided in the embodiment of the present invention can implement each process implemented by the electronic device in the above embodiment of the method, and in order to avoid repetition, a description is omitted here.
Fig. 10 is a schematic hardware diagram of an electronic device according to an embodiment of the present invention, where the electronic device 100 includes, but is not limited to: radio frequency unit 101, network module 102, audio output unit 103, input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111. It will be appreciated by those skilled in the art that the electronic device structure shown in fig. 10 is not limiting of the electronic device and that the electronic device may include more or fewer components than shown, or may combine certain components, or a different arrangement of components. In an embodiment of the present invention, the electronic device includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted electronic device, a wearable device, a pedometer, and the like.
The processor 110 is configured to obtain M MVIs corresponding to a source image and a target image, where the source image is one frame of image in K continuous images acquired by the electronic device, and the target image is any frame of image except the source image in the K continuous images; based on the MVOT and the MVDD of the target MVI, determining whether an image area corresponding to the target MVI is a false detection area; wherein the target MVI is any one MVI among the M MVIs, M and K are positive integers, and K is larger than 1.
According to the electronic equipment provided by the embodiment of the invention, the electronic equipment can acquire M MVIs corresponding to the source image and the target image, wherein the source image is one frame of image in the K continuous images, the target image is any frame of image except the source image in the K frame of image, and the electronic equipment determines whether the image area corresponding to the target MVI is a false detection area of highlight leaves according to the number of overflow of the motion vectors and the distribution density of the motion vectors of the target MVI. In other words, in the process of synthesizing the acquired multi-frame images in the scenes of high dynamic range imaging, multi-frame noise reduction, super-resolution imaging and the like, the electronic device can determine the motion characteristics and distribution density characteristics of the moving object according to the motion vector diagram corresponding to the target image close to the source image after the multi-frame images are subjected to motion estimation, so as to determine whether the moving object is a slightly jittered object, whether the moving object is a slightly jittered leaf, a slightly fluctuating water surface, slightly moving sand and the like, if the moving object is a slightly jittered leaf, a slightly fluctuating water surface, slightly moving sand and the like, the areas in the images can be determined to be the motion areas detected by mistake, and accordingly, corresponding image processing can be performed on the erroneously detected areas, for example, if the moving object obtained by motion estimation is a slightly jittered leaf, the slightly jittered leaf of the highlight area is not subjected to motion compensation processing, thus the problem that the effect of the synthesized image is poor due to the fact that the highlight leaf is detected by mistake as the moving object is subjected to motion compensation can be avoided, the accuracy of motion detection is improved, and the image processing is better effect is obtained.
It should be understood that, in the embodiment of the present invention, the radio frequency unit 101 may be configured to receive and send information or signals during a call, specifically, receive downlink data from a base station, and then process the received downlink data with the processor 110; and, the uplink data is transmitted to the base station. Typically, the radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 may also communicate with networks and other devices through a wireless communication system.
The electronic device provides wireless broadband internet access to the user through the network module 102, such as helping the user to send and receive e-mail, browse web pages, access streaming media, and the like.
The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the network module 102 or stored in the memory 109 into an audio signal and output as sound. Also, the audio output unit 103 may also provide audio output (e.g., a call signal reception sound, a message reception sound, etc.) related to a specific function performed by the electronic device 100. The audio output unit 103 includes a speaker, a buzzer, a receiver, and the like.
The input unit 104 is used for receiving an audio or video signal. The input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, the graphics processor 1041 processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphics processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the network module 102. Microphone 1042 may receive sound and be capable of processing such sound into audio data. The processed audio data may be converted into a format output that can be transmitted to the mobile communication base station via the radio frequency unit 101 in the case of a telephone call mode.
The electronic device 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of ambient light, and the proximity sensor can turn off the display panel 1061 and/or the backlight when the electronic device 100 moves to the ear. As one of the motion sensors, the accelerometer sensor can detect the acceleration in all directions (generally three axes), and can detect the gravity and direction when stationary, and can be used for recognizing the gesture of the electronic equipment (such as horizontal and vertical screen switching, related games, magnetometer gesture calibration), vibration recognition related functions (such as pedometer and knocking), and the like; the sensor 105 may further include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., which are not described herein.
The display unit 106 is used to display information input by a user or information provided to the user. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an Organic Light-Emitting Diode (OLED), or the like.
The user input unit 107 is operable to receive input numeric or character information and to generate key signal inputs related to user settings and function control of the electronic device. Specifically, the user input unit 107 includes a touch panel 1071 and other input devices 1072. The touch panel 1071, also referred to as a touch screen, may collect touch operations thereon or thereabout by a user (e.g., operations of the user on the touch panel 1071 or thereabout using any suitable object or accessory such as a finger, stylus, etc.). The touch panel 1071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch azimuth of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts the touch information into touch point coordinates, and sends the touch point coordinates to the processor 110, and receives and executes commands sent by the processor 110. Further, the touch panel 1071 may be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. The user input unit 107 may include other input devices 1072 in addition to the touch panel 1071. In particular, other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein.
Further, the touch panel 1071 may be overlaid on the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or nearby, the touch operation is transmitted to the processor 110 to determine the type of touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of touch event. Although in fig. 10, the touch panel 1071 and the display panel 1061 are two independent components for implementing the input and output functions of the electronic device, in some embodiments, the touch panel 1071 may be integrated with the display panel 1061 to implement the input and output functions of the electronic device, which is not limited herein.
The interface unit 108 is an interface to which an external device is connected to the electronic apparatus 100. For example, the external devices may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the electronic apparatus 100 or may be used to transmit data between the electronic apparatus 100 and an external device.
Memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a storage program area that may store an operating system, application programs required for at least one function (such as a sound playing function, an image playing function, etc.), and a storage data area; the storage data area may store data (such as audio data, phonebook, etc.) created according to the use of the handset, etc. In addition, memory 109 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.
The processor 110 is a control center of the electronic device, connects various parts of the entire electronic device using various interfaces and lines, and performs various functions of the electronic device and processes data by running or executing software programs and/or modules stored in the memory 109, and calling data stored in the memory 109, thereby performing overall monitoring of the electronic device. Processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor that primarily handles operating systems, user interfaces, applications, etc., with a modem processor that primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.
The electronic device 100 may further include a power source 111 (e.g., a battery) for powering the various components, and the power source 111 may preferably be logically coupled to the processor 110 via a power management system, such as to provide for managing charging, discharging, and power consumption.
In addition, the electronic device 100 includes some functional modules, which are not shown, and will not be described herein.
Optionally, in conjunction with fig. 10, the embodiment of the present invention further provides an electronic device, which includes a processor 110, a memory 109, and a computer program stored in the memory 109 and capable of running on the processor 110, where the computer program when executed by the processor 110 implements each process of the above embodiment of the false detection suppression method, and the same technical effects can be achieved, and for avoiding repetition, a detailed description is omitted herein.
The embodiment of the invention also provides a computer readable storage medium, on which a computer program is stored, which when executed by a processor, implements the processes of the above embodiments of the false detection suppression method, and can achieve the same technical effects, so that repetition is avoided, and no further description is given here. Wherein the computer readable storage medium is selected from Read-Only Memory (ROM), random access Memory (Random Access Memory, RAM), magnetic disk or optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising several instructions for causing an electronic device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The embodiments of the present invention have been described above with reference to the accompanying drawings, but the present invention is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those having ordinary skill in the art without departing from the spirit of the present invention and the scope of the claims, which are to be protected by the present invention.

Claims (7)

1. A false detection suppression method applied to an electronic device, the method comprising:
acquiring M motion vector images MVI corresponding to a source image and a target image, wherein the source image is one frame of image in K continuous images acquired by the electronic equipment, and the target image is any frame of image except the source image in the K continuous images;
determining whether an image area corresponding to a target MVI is a false detection area or not based on the motion vector overflow number MVOT and the motion vector distribution density MVDD of the target MVI;
wherein the target MVI is any one MVI in the M MVIs, M and K are positive integers, and K is more than 1;
before determining whether the image area corresponding to the target MVI is the false detection area or not, the method further comprises:
Calculating MVOT and MVDD of the target MVI;
the determining whether the image area corresponding to the target MVI is a false detection area based on the motion vector overflow number MVOT and the motion vector distribution density MVDD of the target MVI comprises the following steps:
comparing the MVOT and MVOT threshold values of the target MVI, and comparing the MVDD and MVDD threshold values of the target MVI;
determining whether an image area corresponding to the target MVI is a false detection area or not according to a comparison result of the MVOT of the target MVI and the MVOT threshold value and a comparison result of the MVDD of the target MVI and the MVDD threshold value;
the calculating the MVOT of the target MVI includes:
calculating the motion vector offset MVO of each pixel point corresponding to the target MVI according to a first target preset formula, wherein the first target preset formula comprises any one of a first preset formula, a second preset formula and a third preset formula;
determining the MVOT of the target MVI according to the number of pixels, corresponding to the target MVI, of which the MVO is smaller than the MVO threshold value, of each pixel;
the first preset formula is:
the second preset formula is: MVO (mechanical vapor recompression) ij =|Δx ij |+|Δy ij |;
The third preset formula is: MVO (mechanical vapor recompression) ij =MAX(|Δx ij |,|Δy ij |);
Wherein MVO ij MVO value, deltax, representing pixel point at jth row of ith column in MVI ij A lateral motion vector, deltay, representing the pixel at column i and row j ij A longitudinal motion vector representing a pixel point at a j-th row of an i-th column;
MVDD is a motion vector azimuth variance MDVV or a motion vector azimuth standard deviation MDVSD;
the MVDD for calculating the target MVI includes:
calculating the MDVV of the target MVI according to a fourth preset formula, wherein the fourth preset formula is as follows:
or, calculating the MDVSD of the target MVI according to a fifth preset formula, wherein the fifth preset formula is as follows:
wherein N represents N offset directions, M D Representing the number of pixels shifted in the direction D among N shift directions, M width Represents the width of MVI, M length The length of the MVI is indicated,
2. the method according to claim 1, wherein after the M MVIs corresponding to the source image and the target image are acquired, the method further comprises:
and adjusting at least one of the MVOT threshold value and the MVDD threshold value according to the size of the target MVI.
3. The method of claim 2, wherein the step of determining the position of the substrate comprises,
in the case that the size of the target MVI is greater than a first preset size and less than a second preset size, the MVOT threshold value increases as the size of the target MVI increases; the MVOT threshold value is a first threshold value under the condition that the size of the target MVI is smaller than or equal to the first preset size; the MVOT threshold value is a second threshold value when the size of the target MVI is greater than or equal to the second preset size;
In the case that the size of the target MVI is greater than a third preset size and less than a fourth preset size, the MVDD threshold value increases as the size of the target MVI increases; the MVDD threshold value is a third threshold value under the condition that the size of the target MVI is smaller than or equal to the third preset size; and when the size of the target MVI is greater than or equal to the fourth preset size, the MVDD threshold value is a fourth threshold value.
4. The method of claim 1, wherein comparing the MVOT of the target MVI to the MVOT threshold value and comparing the MVDD of the target MVI to the MVDD threshold value comprises:
comparing the MVOT of the target MVI with the MVOT threshold value and comparing the MVDD of the target MVI with the MVDD threshold value according to a sixth preset formula, wherein the sixth preset formula is as follows:
wherein t_mvot represents the MVOT threshold value and t_mvdd represents the MVDD threshold value; in the case of Mis =0, the image block corresponding to the target MVI is a false detection area; in the case of Mis =1, the image block corresponding to the target MVI is a motion region.
5. The method according to claim 1, wherein, in the case of n=4,
wherein M is up Representing the number of pixel shifts in a first direction, M down Indicating the offset amount M of the pixel point to the second direction left Representing the number, M, of pixel shifts to a third direction right Indicating the number of pixel shifts in the fourth direction,
6. an electronic device, the electronic device comprising: the device comprises an acquisition module, a determination module and a calculation module;
the acquisition module acquires M motion vector images MVI corresponding to a source image and a target image, wherein the source image is one frame of image in K continuous images acquired by the electronic equipment, and the target image is any frame of image except the source image in the K continuous images;
the determining module is used for determining whether the image area corresponding to the target MVI is a false detection area or not based on the motion vector overflow number MVOT and the motion vector distribution density MVDD of the target MVI;
wherein the target MVI is any one MVI in the M MVIs, M and K are positive integers, and K is more than 1;
the calculating module is used for calculating the MVOT and the MVDD of the target MVI;
the determining module is specifically configured to compare the MVOT of the target MVI with a MVOT threshold value, and compare the MVDD of the target MVI with a MVDD threshold value; determining whether an image area corresponding to the target MVI is a false detection area or not according to a comparison result of the MVOT of the target MVI and the MVOT threshold value and a comparison result of the MVDD of the target MVI and the MVDD threshold value;
The computing module is specifically configured to compute an MVO of each pixel point corresponding to a target MVI according to a first target preset formula, where the first target preset formula is any one of the first preset formula, the second preset formula, and the third preset formula; determining the MVOT of the target MVI according to the number of pixels, corresponding to the target MVI, of which the MVO is smaller than the MVO threshold value, of each pixel;
the first preset formula is:
the second preset formula is: MVO (mechanical vapor recompression) ij =|Δx ij |+|Δy ij |;
The third preset formula is: MVO (mechanical vapor recompression) ij =MAX(|Δx ij |,|Δy ij |);
Wherein MVO ij MVO value, deltax, representing pixel point at jth row of ith column in MVI ij A lateral motion vector, deltay, representing the pixel at column i and row j ij A longitudinal motion vector representing a pixel point at a j-th row of an i-th column;
MVDD is MDVV or MDVSD;
the calculating module is specifically configured to calculate the MDVV of the target MVI according to a fourth preset formula, where the fourth preset formula is:or, calculating the MDVSD of the target MVI according to a fifth preset formula, wherein the fifth preset formula is as follows:Wherein N represents N offsetsDirection, M D Representing the number of pixels shifted in the direction D, M, of the N shift directions width Represents the width of MVI, M length The length of the MVI is indicated,
7. An electronic device comprising a processor, a memory and a computer program stored on the memory and executable on the processor, which when executed by the processor, implements the steps of the false detection suppression method according to any one of claims 1 to 5.
CN202010075685.1A 2020-01-22 2020-01-22 False detection suppression method and electronic equipment Active CN111292354B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010075685.1A CN111292354B (en) 2020-01-22 2020-01-22 False detection suppression method and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010075685.1A CN111292354B (en) 2020-01-22 2020-01-22 False detection suppression method and electronic equipment

Publications (2)

Publication Number Publication Date
CN111292354A CN111292354A (en) 2020-06-16
CN111292354B true CN111292354B (en) 2023-07-28

Family

ID=71029220

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010075685.1A Active CN111292354B (en) 2020-01-22 2020-01-22 False detection suppression method and electronic equipment

Country Status (1)

Country Link
CN (1) CN111292354B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI788251B (en) * 2022-04-01 2022-12-21 偉詮電子股份有限公司 Super-resolution image reconstruction method and super-resolution image reconstruction system

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11113003A (en) * 1997-08-07 1999-04-23 Matsushita Electric Ind Co Ltd Motion vector detector and motion vector detection method
CN101102504A (en) * 2007-07-24 2008-01-09 中兴通讯股份有限公司 A mixing motion detection method combining with video encoder

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH01219509A (en) * 1988-02-26 1989-09-01 Matsushita Electric Ind Co Ltd Motion vector detecting device
JPH05236455A (en) * 1992-02-25 1993-09-10 Nec Corp Motion vector detector for moving image
JP3779494B2 (en) * 1998-06-03 2006-05-31 松下電器産業株式会社 Motion detection device and recording medium
WO2008023466A1 (en) * 2006-08-24 2008-02-28 Mitsubishi Electric Corporation Moving vector detecting bdevice
JP2009147807A (en) * 2007-12-17 2009-07-02 Fujifilm Corp Image processing apparatus
CN101527046B (en) * 2009-04-28 2012-09-05 青岛海信数字多媒体技术国家重点实验室有限公司 Motion detection method, device and system
JP2012034225A (en) * 2010-07-30 2012-02-16 Canon Inc Motion vector detection device, motion vector detection method and computer program
JP2012073971A (en) * 2010-09-30 2012-04-12 Fujifilm Corp Moving image object detection device, method and program
JP5848665B2 (en) * 2012-05-15 2016-01-27 日本電信電話株式会社 Moving object motion vector detection apparatus, moving object motion vector detection method, and program
JP6074198B2 (en) * 2012-09-12 2017-02-01 キヤノン株式会社 Image processing apparatus and image processing method
JP6297822B2 (en) * 2013-11-19 2018-03-20 ルネサスエレクトロニクス株式会社 Detection device, detection system, and detection method
CN103679749B (en) * 2013-11-22 2018-04-10 北京奇虎科技有限公司 A kind of image processing method and device based on motion target tracking
JP6671994B2 (en) * 2016-02-02 2020-03-25 キヤノン株式会社 Imaging device and control method therefor, program, storage medium
CN107437257A (en) * 2017-08-08 2017-12-05 重庆信络威科技有限公司 Moving object segmentation and dividing method under a kind of mobile background
CN108596109B (en) * 2018-04-26 2021-04-13 浪潮集团有限公司 Target detection method and device based on neural network and motion vector

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11113003A (en) * 1997-08-07 1999-04-23 Matsushita Electric Ind Co Ltd Motion vector detector and motion vector detection method
CN101102504A (en) * 2007-07-24 2008-01-09 中兴通讯股份有限公司 A mixing motion detection method combining with video encoder

Also Published As

Publication number Publication date
CN111292354A (en) 2020-06-16

Similar Documents

Publication Publication Date Title
CN108513070B (en) Image processing method, mobile terminal and computer readable storage medium
CN111223143B (en) Key point detection method and device and computer readable storage medium
CN110784651B (en) Anti-shake method and electronic equipment
CN110896451B (en) Preview picture display method, electronic device and computer readable storage medium
CN111145192B (en) Image processing method and electronic equipment
CN110262737A (en) A kind of processing method and terminal of video data
CN111145087B (en) Image processing method and electronic equipment
CN111031234B (en) Image processing method and electronic equipment
CN107730460B (en) Image processing method and mobile terminal
CN110766610A (en) Super-resolution image reconstruction method and electronic equipment
CN111031178A (en) Video stream clipping method and electronic equipment
CN111601032A (en) Shooting method and device and electronic equipment
CN111028161B (en) Image correction method and electronic equipment
CN111145151B (en) Motion area determining method and electronic equipment
CN111008929B (en) Image correction method and electronic equipment
CN110769154B (en) Shooting method and electronic equipment
CN109104573B (en) Method for determining focusing point and terminal equipment
CN108932505B (en) Image processing method and electronic equipment
CN111292354B (en) False detection suppression method and electronic equipment
CN110913133B (en) Shooting method and electronic equipment
CN110769162B (en) Electronic equipment and focusing method
CN111031265B (en) FSR (frequency selective response) determining method and electronic equipment
CN111147754B (en) Image processing method and electronic device
CN111026263B (en) Audio playing method and electronic equipment
CN110443752B (en) Image processing method and mobile terminal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant